This is a demo of a voice assistant made in Home Assistant with an Esp32 satellite with visual responses played on a tablet on which I installed fully kiosk browser and browser mod.
Here’s a small demo - for English turn on subtitles:
For more information you can visit my github page
- ESP32 dev board
- INMP441 Microphone
- WS2812 Led
- copper conductor spiral for touch
- printed ha logo case
- android tablet
- Google Cloud STT
- Edge TTS
- Fully kiosk browser
- Browser mod
- Extended OpenAi integration
- Vindoz AI talking photo platform
What he does:
- When the wake word is detected, the MUTE switch on the Esp32 satellite turns on. This is a REAL MUTE SWITCH made by connecting the L/R pin on the microphone to a digital pin on the Esp32 through which the microphone records only when there is voltage on this pin, and in the code, the microphone is set to the left channel.
- When the wake word is detected, a video and audio response is streamed through the browser mode media player on the tablet’s display. You can make several answers that can be played randomly.
- After this answer is finished playing, the mute switch goes back to off and the listening starts.
- When the streaming of the tts response starts, it is played through the fully kiosk media player on the tablet.
- At the same time, a no_sound_speech video is sent, i.e. simulation of speech but without sound, through the browser mode media player on the tablet display.
- Several voice assistants can be set, each with individual responses and pipelines that can be exchanged through voice commands.