Conversation agent with plugins, web search ex

Recently added a home assistant platform to this

which lets you set it as the conversation agent, which gives you access to plugins

currently updated a few plugins to work with home assistant, and these all work with voice pe really well
kinda opens the doors for anything you can think of

current plugins that work with home assistant/voice-pe:

web_search: Performs web search to help answer user questions

overseerr_trending: Fetches Trending or Upcoming movies/TV shows from Overseerr. Example: what movies are trending, what TV shows are upcoming

overseerr_request: Adds a movie or TV show to Overseerr by title, creating a new request for it. Example: add the movie F1, request the TV show One Piece.

comfyui_audio_ace: Composes full-length songs using AceStep. Generates lyrics, tags, and MP3s

comfyui audio ace plugin will auto play back the generated song on the voice pe which is pretty cool

example of the web search plugin working, yes the phone number is correct hehe

did add a home assistant plugin as well so that you can still control devices, pretty basic right now but it does control lights in rooms pretty well

The Home Assistant control plugin for tater has been updated and works really well now.

So if you decide to use Tater Assistant as your conversation agent you can still fully control all of your devices in your home.

in-fact if feels faster then the Intent Handling in home assistant, maybe because tater uses very simple function calling and its faster for smaller LLM’s

example of it working in the webui. (note the voice PE wont have the waiting message only the final response)

side note - now that i’ve had some more time to play with Tater Assistant as the Convo Agent, the conversation flow is much better then using other llm integrations, you dont get, “I am a AI assistant that controls devices in the house” when asking things like “Hey ‘AI’ hows it going” he response like Tater, or whatever you decide to name it, its your AI after all

I wont flood this thread with more updates, just wanted to throw this last one in.