What device info is sent to voice-assistants and why is it ... dumb?

tldr: See the quote at the bottom.

I have a bedroom with a closet in it. The closet light is “smart” called “[mankyd’s] closet light”. The light is labeled as being in the “[mankyd’s] room” area.

I have Google’s Gemini hooked up to my voice assistant.

When I ask “Turn on the light in [mankyd’s] room”, it tells me there are no lights in the room. When I ask what devices are in the room, it will tell me that there is “[mankyd’s] closet light”, among a few others. When I then repeat my request, it works.

What information does the voice assistant know about by default? How do I make it more intelligent by default?

A typical conversation will look like this:

Me: Turn on the lights in [mankyd’s] room.
Google: I can’t find a light in [mankyd’s] room.
Me: Are there any lights in [mankyd’s] room?
Google: No
Me: What devices are in [mankyd’s] room?
Google:: [mankyd’s] room has a minisplit, an air filter, a closet light and a temperature sensor.
Me: Is the closet light a light?
Google: Yes
Me: Are there any lights in [mankyd’s] room?
Google: Yes. There’s a closet light.
Me: Turn on the lights in [mankyd’s] room.
Google: OK. I’ve turned on [mankyd’s] Closet Light.