Friday's Party: Creating a Private, Agentic AI using Voice Assistant tools

Configuration Voice Assistant
, , , ,
122

Where do I add all this Context you’re always yammering on about, Nathan?

Here: Is it possible to define aliases for ToDo items? - #5 by NathanCu

But all of the entties support this. Note every word you put in here eats toks for context. be descriptive but be aware of the result. This will directly impact the context size and either be concise or use a model with a gigantic context window and be ready to burn toks.

123

Workflow Ala HA voice…

This is now technically possible in 2025.7.x. Someone please write a good example?

124

In today’s episode of

wierd stuff we haven’t confirmed but sure seems to be the case from the data…

Essentially what this means, HA’s default context does include name, alias, and entity_id but does NOT include device_id.

Given context crafting rules that means

until I create context for her to understand device ID IT DOES NOT EXIST in the Assist context space…

…therefore targeting by device ID without building your own resolution process for an LLM won’t work in most cases.

125

I believe it’s deliberately not possible to control via device_ID through Assist. In fact, it seems that they don’t want us doing it that way at all, but haven’t yet removed the ability to do so.

126

it’s a very lively summer and we had quite an adventure with an oven throwing fireballs and then thank g-d for carbon monoxide detectors and homepod sound detection. i will be catching up soon, i’ve just been in a funnel. <4

1 Like
127

Sounds like events you didn’t want. Hope all is ok.

128

Notes on Searching with OpenAI

If you turn on web search in your llm provider, make sure you tell it how to behave…

(I found a bug in the files crud handler had to fix before posting. Probably tomorrow. This will do till then.)