[Voice] Multiple Voice Assistants (>1 Wake-word and Pipeline)

It would be awesome if we could have multiple voice assistants in operation simultaneously. So if I say “ok nabu” I get a nabu casa pipeline for controlling the house and if I say “OK Jarvis” I get a ChatGPT pipeline. Others have described how it would be useful to have different languages for bilingual households
This actually briefly almost worked by mistake Wyoming ignores second assistant's wake word. · Issue #101942 · home-assistant/core · GitHub (at least the open wake word side did).

Provided the hardware is capable of running multiple wake-word models it would seem trivial to implement. Just mandate that each active pipeline have a different wake-word and once a wake-word is detected forward the speech to the appropriate pipeline/wyoming endpoint.

Related:

With 2 pieces of hardware you can so it now.

I am aware, as you can select the pipeline for each piece of hardware, but why not >1 on one piece of hardware?

2 Likes

This would be extremely helpful.
I’d like to have this possibility to use different wake words for different languages.

1 Like

Yeah we need this.

As far as my testing, we can only use 1 language per voice satellite.

Some are reporting success using the Wyoming satellite function on Linux devices e.g raspberry pi zeros

I’d love to see this. I actually have bought multiple of those Atom Echo devices and plugged them into USB outlets in most of my rooms, and they work decently enough as generic house control.

Recognizing different wake words on the same hardware, would allow a different pipeline to be associated with it, and to be route to something like my Ollama instance for general LLM interaction.

adding my comment.

I think this is useful for safety and not only for “fun”: I have three mini-me running around my apartments and the oldest is already capable to ask google to start music, light etc.

I do have also electric shutters in my house and I think this should be used only by adult (It’s not fun to be locked outside). Having multiple wakeworks can be a good solution.

For example: “Hey Jarvis, lower the shutters” for me and my wife. But this should not be available for my daughters wakeword (Hey Casita - for example using Encanto disney movie).

I think this a great use case - but not for multiple wakewords … because it won’t take your kids long to work out that they can also give Jarvis commands.
Instead this seems ideal for Voice Assist to recognise the speaker.

Sounds as if this feature is planned. Mentioned in the latest update at 11:48 and again here:

I’d like to suggest that support for multiple wakewords could be used for more than just running multiple pipelines.

Commercial voice assistant smart speakers like Google Home or Alexa can cancel/stop alarms, or stop playing music, when the user says “Stop”. Home Assistant’s voice assistant should also have this capability.

What if we were to support multiple wakewords, and use “Stop” as a secondary wakeword that could stop timers, and perhaps send commands to HA to stop playback on media devices?

1 Like