Voice Flow - A Custom Integration to Allow Multiple Conversation Agents in One Assistant Pipeline

Hey everyone!

I’m excited to share a Home Assistant integration I’ve developed: Voice Flow.

logo

The idea behind this integration came from my desire to enjoy the speed and reliability of direct commands to Home Assistant Assist for smart home tasks while also being able to route general queries to another LLM (like a local or cloud-based AI). This avoids the frustration and slowdown of an external LLM interpreting (or misinterpreting) smart home commands and then forwarding them to Assist.

You can assign conversation agents to two predefined keywords to be spoken or typed before your query (and after your wake word if you’re using one). No keyword? Any query without a keyword defaults to Assist.

Keywords:

  • Question: Assign this to another agent (like a local or cloud-based LLM) to handle general queries.
  • Command: You can assign this to another agent or keep it as Assist to ensure specific commands always go to Home Assistant.

For example:
“Hey Jarvis Question who wrote the book The Hobbit?”
or
“Hey Jarvis Command turn off the bathroom lights”

This is my first time creating an integration, and I’m thrilled to contribute something back to a community I’ve loved being part of! My logos and icons were approved by HomeAssistant last night and I’m planning to submit to HACS today, but if you’re interested, you can check it out now on GitHub and give it a try.

I run a consulting business as my day job, so development is a hobby and passion project for me. If you like what I’ve built and want to support the project, you can always buy me a coffee or send a donation. Not expected, but always appreciated: My LinkTree

I’m also looking to implement custom commands for intelligent command routing in upcoming updates and would love your input and suggestions to make this even better.

Let me know what you think, and feel free to reach out if you give it a try. Thank you!
Voice Flow on Github

2 Likes