Add Custom Voice Control to any Project using this Module without Internet

so this module can help you to do a lot of task with your voice commands offline without any internet connectivity let me show you a couple of demos meow I am here turn on Blue Light okay blue light up turn off blue light okay blue light off open the door okay door open close the door okay door close play music play music next music okay next music which is the best YouTube channel undoubtedly turkey SS is the best YouTube channel up CH so this is the AI thinkers vc02 kit which is based on the vc02 module now this is the same model which we have used in one of our previous videos but that board was from Seed Studio and it was lacking with two major thing one it was not having enough GPI pins exposed and secondly it was not having built-in programming circuit in it while this board from AI thinker got everything that we need and this video covers everything that you need to know starting from what comes in a pre-built firmware how to create a custom firmware that has our customized voice commands in it how to trigger a particular GPI pin based upon a particular voice commands and later in the end of the video I'll show you how to flash that firmware into this vc02 kit and Trust Me by end of the video you will definitely fall in love with this board so now let's get started with this video so this is how you'll receive the kit in which you'll get the main board along with the external speaker and microphone which you can easily connect at the dedicated slots now let me tell you this complete kit is available for sale on our website so you can buy it from there and get it delivered at your doorstep and start making some amazing projects using this amazing kit now this modu comes with a pre-built Factory firmware in it which has limited number of voice commands and you can see all those voice commands on the screen right now so now let's first test out it's built-in Factory firware hey pudding yes I'm here turn on the light okay turn on the light warm light turn on Okay warm light turn on turn off the light okay turn off the light start to Fan okay start to Fan warm light turn off okay warm light turn off see you see you later so that was the buil-in factory firmware and now here we can customize all the voice commands and get store up to 150 voice commands in this vc02 module so now let me take you to the computer and show you the complete process of making a custom firmware so now I'll be showing you all the steps for building the firmware and also to flash the firmware now here make sure that you follow each and every step very carefully it will be better if you like follow the steps along with me by pausing the video after every interval so now let's get started with this so first you need to go to voice. think.com website and here don't just translate it with the Google translate option rather click on the English button on the website itself which will not only translate this website into English but it will also open up couple of options which are only available in the English option after doing that you can click on register for free and here fill up all the necessary details now once you fill up the details you will get a verification code on your email ID which you to provide here and later you'll be able to make the account in my case I already made the account so I'll quickly log to my account okay so after logging in you need to click on create product and here we have several different product categories like the lamp switch socket and inside each category we have also subcategories available so here for the demo purpose I'll click on lamps and I'll select ceiling lamp now here I'll select the scene as offline as we want to control everything offline and the module we are using is vc02 later we to give the product and name so I will name it as demo light and select the language as English So currently this vc02 model only supports two language Chinese and English so after doing all this thing click on the save button and now we are into the configuration page so here we have several different configuration to make starting from the front end signal processing now here we'll keep everything as it is like by default and mov ahead we have the pin configuration option so here we have all the pins for the vc02 module and some of the pin are just gpios while some of the pin have several other functionalities as well like the U pin pwm pin and so on so for our project purpose we need to select the GPI pins only because we want to turn on and off the gpios in case if you want to attach an external microcontroller and send the voice command data to that controller well you need to select uart here now in case of U you won't be able to send the exact voice command rather you'll be sending the hex data involved in that command later I'll show you how to send the hex command as well so currently I have chosen every pin as the GPI pin only later we have a wake up word customization option so here in this module we can not only give the custom voice commands but we can also choose a custom wakeup command as well now wake up command is nothing but a command given to the module which after recognizing it later it can accept the voice command until unless it doesn't get the wake up command it won't be accepting the other commands so here we need to follow a couple of rules to choose a wake up command which are mentioned here and the first and formost most rule is it only supports Chinese 3 to six character and four character is the best option so here one thing we cannot choose a English wakeup command we can only choose a Chinese wakeup command well I tried giving the English wakeup command as well just like Jarvis and Alexa and Google but it was not able to recognize all the time but when I gave the Chinese wakeup command it was recognizing completely fine and all the time as well so by default here it is written as hello xiaomi now xiaomi is a Chinese command but here we can change the word and here I'll provide the wakeup command as niow now niow in Chinese means hello and here in vc2 module we cannot just provide one single wake up command rather we can provide multiple wake up command as well so to add another wakeup command you just need to click on add one and here you can type another wake up command so here I will type as hello pudding and similarly you can add multiple wakeup commands but make sure it should be a Chinese word after that we need to set the wake up sensitivity will be set to highest possible now here we have option called as reply for Wake Up Now this means that once the wake up command is recognized by the module what do you want to hear from the module well here we have three replies by default like I am here please go ahead what can I do for you and here also we can add multiple reply statements as well for example I will write as yes I am listening okay now the module will play any of the reply randomly so that was the reply from for Wake Up Now comes the option for customize offline command words and response words so here we need to provide the voice commands based on which we'll be doing some actions so let's understand how we can add it so first of all we need to provide the behavior like for what purpose we are putting that command so behavior is kind of a variable and here you can type anything that you want it is just for your reference and nothing else but the only condition is you you can't put a space in between the words okay so let's just uh put the Behavior as red light on so I'm making a project to turn on and off the red light or red LED connected to the vc02 module so here I WR as red light on behavior and then here we can provide the command word now here you can provide multiple commands for just one action for example here it is written as please light up the lamp and then after this line we can provide another command like please light up so these two are both different commands but are here written for only one single action which is to turn on the red light so I can you modify this command so let's just delete all this thing and type as turn on red light then to provide different command just put line and type red light on then provide line to add another command turn on red LED red LED on so I have put four voice commands for one single action and then here going to prove the reply word like after listening to this voice command what do you want to hear from the vc02 module so here by default is written as Lightning is turned on for you so I'll remove it and I'll type as red light is turned on for you that's it so Behavior command word and reply word I think it is clear for you and similarly we can add another commands to let's say turn off the red lights how you can do that well for that you just need to click on add one and here I will type the behavior as red light off without spaces and now we need to provide the uh voice commands for it so the command will be turn off red light line red light off turn off red LED red LED off and the reply should be red light is turned off for you perfect so I just given two commands turning on and turning off the light this is just for the demo purpose and similarly you can add many more voice commands as well now the question is how we can turn on and off the LED like how to integrate the GPI pin for this voice command well for that you can go to this control detail option and here you can provide all the control details or all the integration with the gpios okay so here we have three different behaviors because we already provided three Behavior one is for the wakeup and other two are for turning on and off the red light and the respective voice commands are also mentioned here now here we can add the control option to provide what actions we want to take once that command is recognized by the module for example for the red light on what I'll do is I'll click on ADD control and here I'll select the control type as now here to select the particular gpin on which we want to send the signal for example here I select the GPI of b0 now here we to set the action whether you want to send a pulse then we to provide the pulse period and how many times we should repeat the pulse or else you can select the setting and here you can turn on and off or turn high or low that particular GPR pin for red light on I will be turning the uh GPR pin high and click on the okay button so that's how we have assigned one task that once this command is recognized you just need to give the signal High to gpio b0 and it's that simple to add the actions based upon voice commands so let's do it for the red light off so I'll click on ADD control control type will be b0 because I want to turn off that same GPI bin action will be setting and parameter will be low click on the okay button so that's how we have added this GPI option and as I said in the beginning that on the uart you can send the uh you know hex values as well so how we can do that well let me show you that quickly so what I'll do is I'll first add a u RX to this uh pin number two and as you can see by default pin number one and two becomes RX and TX and once it becomes RX and TX what you can do is you can click on ADD control button and here you can select TX that like the thing which you want to transmit and here in the action you can click on the send button and here you can type out that Hax value which you want to send when the particular command is being recognized okay this just for the reference purpose I'm telling you I will not be using this in this demo maybe in some other future videos so I'll cancel this and I'll make it a gpio pin once again so yeah once any of this command is recognized we are turning on the b0 gpio and when any of this command is recognized we are turning off the GPO b0 simple right let's move ahead and let's see what else we have then here we to set the recogniz and sensitivity as high as possible now here we have very interesting setting which is wake up free command words and here we can add up to 10 words so what is this so what happens is as I said in the beginning that uh it will be only recognizing this command once the device is wake up by this wake up command until and unless the device is not wak up we cannot use this command but in this vc02 module we have an option to add up to 10 voice commands that can be recognized without waking up the device interesting right let me show you how to do that so first of all here are all the commands that we have provided till now and here we need to choose like which of the command should be listened by the device without waking it up so here what I'll do I'll just add two commands for the demo red light on and the red light off after selecting the command just click on this arrow button and as you can see these commands are provided here now here you can click on selected options and both the options are selected so let's move ahead and now we have a speaker configuration option in which we can choose multiple voices from this uh platform now the only down part is here we can't listen to each of the voice right now rather we can select the voice and once the firmware is uploaded at that time we'll be able to know like how the voice actually is okay so here for the demo purpose I'll be choosing the first voice and Below we have the parameters about the voice like we can increase or decrease the volume we can increase or decrease the speed of of the speech and we can change the brightness as well now I'm not sure what this brightness actually is in case if you know you can let me know in the comments but I'm not really sure about the brightness so later on we have other configuration option in which we have a boot broadcast option so here I'll select has boot broadcast and here we can provide a statement which will be spoken by the device as soon as the device boots up for example here I'll type as Welcome to our studio so what it will do is as soon as we power up the device it will say the statement Welcome to our studio which is a nice little gesture a greeting gesture to end user like you can install it in your home and when the switch is turned on it will say Welcome to our home and stuff like that so it's a very good thing to add okay so later we have option called as quit for timeout and reply for quit so let me explain what are this option so what happens is once you wake up the device and later if you don't give any voice command it will go into the sleep mode after timeout period and that timeout period we need to provide here so by default after 10 second the device will go back to sleep mode and once we need to wake up we again need to give the wake up command so that time you can change it here like from 5 to 60 second you can choose and later here we need to provide a reply statement like what the device will say when it is going back into the sleep mode by default it is written as please call me if necessary you can add multiple statement like goodbye or else see you next time okay similarly you can add multiple statements then we have another option called as quit so what happens is once you wake up the device and once you give the command to turn on and off the light and now you want to make that model go back to the sleep mode and for that we need to give the quit command so by default the quit command is quit and here we can add multiple commands just like goodbye then we can add as go to sleep so all this command will make this model go back to the sleep mode and here again we can provide the reply for the quit like as soon as any of this command is recognized what you want to hear from the device so again I will add one more statement called as okay goodbye and one more see you next typ perfect so those were all the configurations that you to do to make your own custom firmware with your custom voice commands so now we are good to go to click on make new version here I'll click on okay let's just leave this description as it is and here in this option you just need to click on build SDK as you can see data submitted successfully please click to download later now this firmware building time can be anywhere between 10 minutes to 30 minutes so we can't do anything rather than just waiting for the first firmware to be successfully built so after almost 25 minutes the firmware file is ready and here we can click on the download firmware button and here just click on the keep button and it will start downloading the firware file so now here I shifted to the Windows system and it's just because for flashing the firware to the vc02 module you will need a Windows system only okay so after downloading the firware file you need also to download one flash tool which you can find on this documentation page whose link I'll be providing in the description and here you just need to click on uard burning tool and just download it so after downloading both the files just go to the download folder and just extract both the files here okay so I have successfully extracted both of them and here in the output folder we have the firware file which is here which is appor releasor update. bin so what I'll do now is I'll go to the downloads folder and into this hummingbird folder I'll open this un1 update tool click on yes and here is the Flasher tool you can say so now make sure that the vc02 moduel is connected with the computer while us USB cable and you have the Cs 340 driver installed in it in case if you have the driver successfully installed you able to see the com Port here after that what you need to do is you need to just click on this uh button and here just go to your downloads folder into the output folder into output once again and just select this firmware file and click on open after doing that just click on this button and here on the board you need to press the reset button to start flashing the firmware so as you can see the firmware started flashing onto our module Welcome to our studio okay so it was successfully flashed and we are able to hear Welcome to our studio from this vc02 model that was the broadcast statement that I have provided which means the firw is successfully flashed and it is working as well and now let us experience this in action so here I connected the red LED at the pin B 0 and the Ground Terminal and now let's us try out our firmware so first I'll try to wake up the device neow what can I do for you okay so it was successfully recognized device waked up let's just try to give the command red light on red light is turned off for you wow let's try to turn it off turn off red light red light is turned off for you let's just try to quit please call me if necessary okay so the quit command was also recognized by the device now let's try out those two commands which we have provided which can be recognized without the wake up command just like red light on red light is turned on for you red light off red light is turned off for you wow so this commands are recognized without even waking up the device and right now we cannot access the other voice commands for example if I say turn on red light as you can see it was not recognized but if I say red light on red light has turned off for you amazing red light off red light has turned off for you and to say the other commands we need to wake up the device let's try to wake it up with the other wake up command hello pudding yes I am listening turn on red light red light is turned on for you so after waking up it recognize that command turn off red light red light is turned off for you goodbye see you next time okay so all our custom voice commands are perfectly working and now let us test out what range we are getting okay so now we are testing the range so I'm very close to the device and let's try to test out here neow please go ahead head turn on red light red light is turned up for you let's go a little back turn off red light red light is turned off for you quit see you next time ni yes I am listening turn on red light red light is turned on for you quit please call me if necessary n how I am here turn off red light red light is turned off for you good wait see you next time nio I am here turn on red light red light is turned up for you great okay goodbye niow niow please go ahead turn off red light red light is turned off for you quit see you next time hello ping yes I am listening turn on red light red light is turned on for you quit please call me if necessary hello pudding please go ahead turn off red light red light is turned off for you quit okay goodbye niow please go ahead turn on red light turn on red light red light light is turned down for you great please call me if necessary niow please go ahead turn off red light red light is turned off for you quit quit see you next time hello budding niow please go ahead turn on red light red light is turned on for you quit quit goodbye okay [Music] goodbye n how what can I do for you turn off red light red light is turned off for you quit goodbye see you next time hello pudding I am here turn on red light red light is turned on for you great [Music] goodbye quit so that was the range test and with this range we can easily control the home appliances by sitting in any corner of the room where the device is installed so that was the vc02 K from AI thinker and now I hope you got to know about how amazing this board is and how much variety of projects you can make using it it's like you can add the voice control to any of your existing projects as well quite easily well genuinely love this product and I'm 100% sure you also love it too then just show it to me by clicking like button to this video and let me and YouTube algorithm know that this video was fantastic and worth watching and also share your thoughts in the comment about what will you be making with the help of this board if you're talk about myself then I'm planning to make a complete home automation project using this board so I'll soon be making its video so if you don't want to miss that video make sure to subscribe to the channel right now and finally you can get this board from te sms.com and not only that we do have a lot of electronic components and projects on our website so whenever you want to make any purchase in electronic components well do prefer tms.com and that's how you can indirectly support us for making such free content for you on YouTube and yeah that being said now I'm just ending this video here and now just wait for my next video Until Then explore learn share with me te SMS [Music]

Channel: techiesms

Views: 16,237

Keywords: techiesms, electronics, electronics projects, vc-02 kit, vc02 module, offline voice recognition, offline voice control, vc02 firmware, Aithinker, offline voice recognition module, aithinker vc-02

Id: dAqX4CmozfM

Length: 24min 4sec (1444 seconds)

Published: Sat May 18 2024