I can’t seem to get VA using the ChatGPT convo agent to change the app on my Roku. I’ve exposed the entities to Assist, but it tells me it is unable to do what I request.
I’m new to using VA, so excuse my ignorance, but is this even something that is possible?
Thanks!
Just exposing a entity isn’t enough. You need to tell it what to do with them
How do you control the roku. How would the Voice agent control it? Etc (tools matter, can it control it depends on how IT is presented to the voice assistant, if it has built in intents for whatever thing it is and you’ve added information to the tool and or prompt telling it exactly what you want it to do with the tools and entities… (the long version of that is called Grandma’s Box and it’s in my Friday’s Party post…)
So expose, describe, tool?
Then which model did you pick. You’re probably good with most Oai models but some are better than others…
Hey @NathanCu ,
Thanks for the reply. Your Friday’s Party thread looks FASCINATING and I will spend time studying it as I’ve been looking for a resource to help give me some context about even what is possible.
For my particular dabble, the Roku integration has an entity which is called Application that allows you to select from a list of your installed Roku apps to automatically have the Roku load that app.
I can get it to work by doing what I did back on my old Homeseer setup: create an automation (or script) that changes the value of application to one of the other apps on the Roku and then expose it to Google Home with a key phrase (“Hey, Google. Switch Roku to YouTube”).
I’ve been experimenting with the Voice PE and an Atom Echo using the Extended OpenAI integration (gpt-4o-mini) to see if I can do this variable type of voice actions without having to plan for each one in advance. I think reading that thread will help me know what actions are possible and, frankly, how to think about this area and how to implement it.
Such a different paradigm than I’m used to….
It is but sounds like you have a script that allows you to do what you want we could build off of?