Train your own speech commands model in 10 minutes, and run it on ESP32 with MicroPython

bright dark bright welcome to tinker doodle diy in this video i'm going to show you how to train your speech commands model using your own words and use the model on the esp32 device this whole training can be done purely in browser with zero installation once we have the model we're going to put the speech model onto a esp32 power device this m5 stick c which has a built-in microphone and we're going to use the m56c to control this micro servo then to control a light switch turn turn on or turn off a light switch okay let's get started first let's go to the page the web page that trains the speech commands model go to this url tinker2.cc which i shared my speech commands training app on this page so we have a few steps to change the model the first one is um let's choose up to five speed commands to be recognized in this example let's say we want to control the light switch using tools dark meaning turn off the light or bright means turn on the light and for each label we're going to add 20 samples first for for the first training round now let's add the audio example will i use microphone dark dark yes good dark dark dark dark okay now let's apply the labels here let's say they're dark it's all dark now let's do the same for the bright label bright right bright bright bright okay let's put the labels on and then let's add some other labels some negative labels for words that are these are bright nor dark let's say we have we use 1 to 10. one two three nine ten okay let's deposit as other okay we can try our first training now great so we get 100 accuracy on the training data now let's see how well it does on new samples dark yeah it's correctly predicted it's dark bright good dark bright three that's great another bright dark bright dark pretty good looks like it's doing very good let's have another round of model training and go down great okay now let's download the model and let's upload the model to your tinkerdoodle home folder click this link to open the notebook page close the warnings now it's time to connect the m56c choose a usb port and let's connect the micro servo on the m56 as well you just connect directly without using a breadboard just make sure you connect down the gnd side of the connectors okay let's go back to the notebook page click connect to connect to the m560 first one we need to flash the m56c with the custom built firmware this stock m56 firmware does not support the speed commands model let's run this cell it's doing flashing it's going to take about a minute great it's done next since we've already trained the speech command model and already uploaded the model to our home folder so let's just upload the model file to m56c great now let's move to the demo program the demo program basically connect the m56c to a micro server and use the speed command to control the position of the servo um let's make sure we're connecting we're setting the right pin which is g26 as we're just showing and for here you want to replace the labels with your home for demo we use bright and dark so we use two commands to control the servo at different positions okay now let's use the mcu menu to write the current code to mcu it's sending code to mcu down great well now let's ignore the last code sale and it's ready to do some real testing first don't press the left button for 6 seconds to turn the m5 stick c off and then press it again to turn it on ready dark bright dark bright three five dark okay it's working great now that's all for our demo thanks for watching

Channel: Tinkerdoodle DIY

Views: 13,257

Keywords:

Id: 5ggfJfckU5g

Length: 9min 49sec (589 seconds)

Published: Fri Apr 16 2021