Problems/question with windows and doors and temperature

Configuration Voice Assistant
1

Hi there,

I’m really having problems/question with Assist Questions, Entity types, …and hope, someone can lead me into right directions.

I have several window sensors (sensor entitys = open, closed, tilted) and door sensors (binary, on/of=open/closed). Whatever I ask, e.g. which windows are closed or how many doors are open, the result is 0 or none. How to bring Assist into the possibility with windows and doors like above to give information same as for lights, covers, …?

Secondly I have a sensor (not a climate entity) in each room which has the temperature in the room, but is is ignored/not taken into account if I ask for the actual temperature of the room. How to reach that information?

2

HA comes with fixed sentences/questions it can respond to. They are fairly static in action and responses available.

You may add your own set of sentences/intents. This will extend and expand the actions/responses available to you.

Adding Ollama (local) will provide an ability for HA to respond dynamically.
This is ultimately what you are seeking. I belive adding support for openAI (remote) is possible and will be easier if you dont have the needed hardware to run AI models.

3

Thanks you for the input. I have tested before with that, but don’t get most of it.

e.g. Second point. There are sentences to get the temperature of an room/area (e.g. kitchen), but Assist tells me that “no thermostat is enabled in the kitchen”. But there is a sensor with the temperature assigned to the kitchen. What can I do with this sensor or whatever else, that this is taken into account, if I ask for the temperature in the kitchen?

Or first point. Even if there is no sentence for state of e.g. a binary window sensor. Why is Assist not telling that and instead always says “0” if I ask for “how many windows are open” and “how many windows are closed”?

Just another thing. How can I influence some of it. E.g. If I ask for “how many lights are on” it counts every light entity, including groups. So if I have one light on, which is in room and nested in area and floow group, it will answer 4, which can be explained, but not really what I want to know.

4

These sentences are static. look at the sentences for temperature in github. You cannot vary from these much at all.

I have thermostat in master bedroom.
I ask “What is the master bedroom temperature” RESPONSE: Sorry couldnt understand that
This was verified in debug page of voice assistant in HA

I try again
The second time it heard “What is the temperature in Mr. Bedroom”

I try again
I ask "What is the temperature in the Master Bedroom: RESPONSE: 71 degrees.

MY POINT:
the sentences spoken are fairly specific. Make sure you are saying the correct thing.
It doesnt always hear correctly. Verify it even understands what your saying correctly.
background noise can cause problems. I have automation to mute TV in room when assistant in the room changes to: “listening” and unmute when changes from: “listening”

enabling openAI or some other AI improves this and expands the sentences as it adds inference of your actual intentions and corrects mistakes. This is not perfect either.

This is still a huge work in progress
To be fair, I used alexas for past 7yrs and it was only slightly better and you still have to “learn” the correct questions to ask and then customize sentences for the things it cant figure out. Over time I believe they may expand available sentences and ultimatly I think local AI may be cheaper to implement which will solve a lot of problems.

For you:
-Verify the sentences you are using are correct
-verify they are recognized consistently in voice debug HA >> settings >> voice assistant >> 3 dots next to your “assist” agent >> debug
-maybe look at adding ai agent after getting good understanding of function without it