Jarvis Assistant

Voice Assistant Contest
1

Hello!

I am working on making my house run with Jarvis as the Voice Assistant. So I thought it would be cool to combine a ESP32 voice setup with a 3D printed Iron Man Helmet.

Video demo

For the hardware I used

ESP32 NodeMCU CP2102
MAX98357A Dac AMP
INMP441 Microphone
And 3W 8Ohm speaker

For the helmet I printed this in PLA, sanded and painted it. This whole process took about 4 weeks with few hours a day to complete start to finish.

For the eyes I used some flexible LED eyes for cosplays. Those have some standard positive / negative wiring so that could be easily added to the ESP32 board.

I did also use a custom wake word “Jarvis” instead of “Hey Jarvis”. I am not getting false positives at all so that’s nice.

With the addition of micro wake word on the new ESP32 S3 board (still on the way) I hope I can add a wake sound as well. That’s the only thing that is missing in my opinion.

I’m also thinking about making some Arc Reactors and putting some Raspberry Pi Zero 2 W with Mic HAT. And making them into Voice Satellites for the other rooms.

I hope you guys will like this and if you have any question or tips, please leave the down in the comments. Maybe I have inspired people to do the same projects. It took a lot of work but it’s all worth it in the end!

Thanks,

Bas

2

Great looking build! My Daughter would love this (she’s 29 lol)
Your hard work has certainly paid off , nice clean looking and they eyes look great. Good Luck!

1 Like
3

do you have the source to get the sounds, I have a nack of making ai voices say words correctly. (as you know some are said completly wrong. Check out what I have done previously.)

1 Like
4

Oh nice! Do you happened to have some cool activation sound to play like “Jarvis”?

I just downloaded some sound I found online for now.

5

These are very awesome, well done!
How do you use them within your home and automations?

Any chance you’d be able to do one for Cortana (as in, the Jen Taylor version from the games and TV show)? :slight_smile:

6

I have just added the new ESP32 S3 board. And I must say it does run faster. And it does recognize the wake word a lot better and from further distances. So overall worth the upgrade! :slight_smile:

7

The results of the contest are out!
They may be of interest to you :wink:
Have a look!

8

Sorry its been a while since I have been home, the files have to be on the system, then play them to a speaker,

service: media_player.play_media
data:
  media_content_id: >-
    http://homeassistant ip/local/media/audio/jarvis/the-evening-is-upon-us-sir-i-am-closing-your-blinds.mp3
  media_content_type: audio/mp3
target:
  entity_id: media_player.living_room_speaker

for alexa its a bit more complicated and they have to be behind a https address to play.

I only got as far as 4 jarvis responses though and even then I was not happy with the sound.

9

is there a github project of this that I can checkout?

10

hi, do u have STL file for this? tq

11

Yes I do, there you go

12

How does this setup work on the assist side?

I (very) recently got into trying to setup my own assistant after designing an ESP32-S3 based WLED board with my Dad which now includes a microphone, and realising I could repurpose one using ESPHome to be an assist satellite.

I’ve got all the pieces of the puzzle setup using the micro wake word “Hey Jarvis” (which I’d also love to reduce to just Jarvis) but this setup is USELESS. It’s somehow even worse at recognising what I’m asking than Siri on my HomePods has become.

I suspect the issue is mainly Whisper transcribing what I’m saying poorly, and if it correctly worked out what I said, then the built in HA assist would do what I wanted. But not sure what else to run to improve this…

13

Hi all,
Are there instructions regarding the hardware setup in addition to software installation?

14

I used Home Assistant Cloud for the STT and TTS aspect for this setup.
I mainly used this video to get the wiring done correctly with the LED’s (just + and -).

15

I followed the instruction video above. Check it out, it gives great explanation :slight_smile:

16

Great, thank you