Build your own Alexa with the ESP32 and TensorFlow Lite
Video Statistics and Information
Channel: atomic14
Views: 39,323
Rating: undefined out of 5
Keywords: Alexa, diy alexa, esp32, tensorflow, tensorflow lite, tensorflow lite esp32, esp32 alexa, wake word detection, wit.ai, wit.ai tutorial, amazon alexa, smart home, amazon echo, home automation, iot projects, machine learning, neural network, speech recognition, esp32 projects, esp32 projects 2020, smart device, esp32 tutorial, voice apps
Id: re-dSV_a0tM
Channel Id: undefined
Length: 24min 1sec (1441 seconds)
Published: Sun Oct 04 2020
Please note that this website is currently a work in progress! Lots of interesting data and statistics to come.
I've been playing around with TensorFlow Lite and it works pretty well - end-to-end wake word detection takes about 100ms in total including pre-processing the audio to get the Spectrogram.
There's room for quite. a bit of optimisation as I'm currently using floating-point FFT and could switch to a fixed point version.
It's fairly robust - it only really get confused by words that are very close to the wake word ("Marvin") - so words like "Marvel" definitely cause false positives.
GitHub repo contains the training notebooks and the firmware: https://github.com/atomic14/diy-alexa
Wow super awesome!
Can we make the voice snootier?
This is great. Iβve been wanting some of the benefits of home assistants for a while, without the always-on bigcorp data logging. Whatβs your take on the wit.ai developer experience? Do you have any sense of their privacy or identifiability policies?
Pretty interesting! How is it compatible to Jarvis personal assistant and other selfhosted personal assistant softwares? I thought of an centrilzed jarvis server and multiple esps for audio input output connected via network. Would this work for this? Maybe it would be a great idea to design it especially kompatible for multiple personal assistance solutions (self hosted and so on). Would be a great step to high performance and high privacy personal assistant/ home assistant.
I'm amazed there is enough power on the 32 for that