Adding more Assist-ants

Hi all!
I would like to have multiple assistants, with different device exposure. The reason is simple: I want to control what devices are exposed to cloud providers (potentially zero), while being able to have conversations about non-home stuff, and still have full exposure to local assistants. I’ve already up-voted the two WTH items I just found about this.

Now, in HA I’ve noticed there seems to be the possibility to have more than one assistant. In Settings → Voice Assistants, there are two tabs: Assistants and Expose. On the Assistants tab, there seems to be an “openness” to other assistants in addition to Assist. Why is it called Assistants in plural? Plus, in Expose, there’s a column Assistants, where I can only see the famous blue icon. HA seems to be ready to add more assistants, but I can’t find the way to add them.

Does anyone know if this is possible and how to do it?

Thanks!

PS: I fear this is only for the Home Assistant Cloud? that’s not what I am looking for.

Click “Add Assistant” and you can put together any combination of…

  • Conversation Agent
  • Speech to Text
  • Text to speech

You’re only using Home Assistant Cloud if you select it in the “Speech to Text” box.

The Expose tab exposes entities to Assist. Assist will use whatever methods you have set up in the Assistants tab.

Yes. Not only possible HIGHLY ENCOURAGED.

Read Friday’s Party were just now getting into multi modal assistants and why you’d want to do it.

Thanks for the quick responses!
I did already add assistants inside Assist, but I can’t seem to have more than one Assist. In the expose tab I can only expose devices to one single Assist, even if I have more than one assistants inside Assist. That’s why I figured I could expose different entities to different assistants, but I can’t.
Hope I’m making sense…

You expose one to the end point at any given time. Then you assign an assistant to a wake word.

That voice endpoint starts with that assistant but it can absolutely Call any other assist (this is exactly how heavy tool calls like MCP Works.)

So let’s say I have Nabu. Friday and Jarvis. I’ve assigned Friday to the kitchen and Jarvis to the living room both with thier own wake word.

Now I can wake word each in thier own room and it will stay that way I can give them each a script tk facilitate ‘asking’ and have Friday ask Jarvis a question and respond. I can also run a script that tells them to swap VPEs and now Jarvis is in the kitchen and Friday is in the living room. I can open a new conversation on any vpe with any configured assistant…

Hey Fri ask Jarvis to join me in the bedroom…

Friday fires the open conversation script - for Jarvis in the bedroom. He steps up and says Hi boss, Friday said you needed me?

Options are nearly endless.

Oookay this is actually pretty amazing!
Thanks, I understand now; it starts with a wake word, then call one of the assistants. Eventually get assistants talk to each other (that’s for the next level).
My only missing features are:

  • Multiple wake-words per device (so I can choose which one to wake up, depending on what I need) and
  • Ability to restrict devices/entities to different assistants.

The second one is a bit confusing, because in the Expose tab one would assume you could expose to different assistants… but you can only select Assist, not each assistant individually.

Thanks!

Read Friday’s Party then ask your questions.

On your second point, it was my understanding that this was for exposing devices to either Assist, Google Assistant, or Alexa, not the individual voice pipelines that Home Assistant calls assistants.

Ok understood! That’s what I imagined, thanks to all!
BTW I just went through Friday’s Party, that’s a complete new level, who knows, maybe one day :slight_smile:

1 Like