LLM Vision: Let Home Assistant see!

hi i have a problem i was configurated all but it gave me a error i use tailscale and self sign ssl certifcate please help me thanks you

Summary

^
File “/usr/src/homeassistant/homeassistant/helpers/script.py”, line 624, in _async_run_long_action
return await long_task
^^^^^^^^^^^^^^^
File “/usr/src/homeassistant/homeassistant/core.py”, line 2799, in async_call
response_data = await coro
^^^^^^^^^^
File “/usr/src/homeassistant/homeassistant/core.py”, line 2842, in _execute_service
return await target(service_call)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/config/custom_components/llmvision/init.py”, line 604, in image_analyzer
request = await processor.add_images(image_entities=call.image_entities,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
…<4 lines>…
)
^
File “/config/custom_components/llmvision/media_handlers.py”, line 328, in add_images
base_url = get_url(self.hass)
File “/usr/src/homeassistant/homeassistant/helpers/network.py”, line 211, in get_url
raise NoURLAvailableError
homeassistant.helpers.network.NoURLAvailableError
2025-07-16 09:19:51.255 ERROR (MainThread) [homeassistant.helpers.script.websocket_api_script] websocket_api script: Error executing script. Error for call_service at pos 1:
2025-07-16 09:19:51.255 ERROR (MainThread) [homeassistant.components.websocket_api.http.connection] [140134862178880] Error handling message: Unknown error (home_assistant_error) hacirehim from 192.168.1.125 (Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/138.0.0.0 Safari/537.36)
Traceback (most recent call last):
File “/usr/src/homeassistant/homeassistant/components/websocket_api/decorators.py”, line 28, in _handle_async_response
await func(hass, connection, msg)
File “/usr/src/homeassistant/homeassistant/components/websocket_api/commands.py”, line 878, in handle_execute_script
script_result = await script_obj.async_run(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
msg.get(“variables”), context=context
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)

Yea GPT also suggested the counter idea when I was trying to figure this out. May have to do that to see what’s going on. I have 3 cameras setup with the automation blueprint. One is a doorbell cam that triggers probably 1-5 times a day. The other is a garage cam which triggers probably about the same, and the other is the bedroom cam I mentioned, which I have set to run 8pm-6am. This one maybe triggers 10x a day. They are all set to person detected, not motion. Looking at my LLMV timeline cal, I see about 20-30 events a day. Even if the event description and title generation count as an event, it’s still way under the 200.

Previously I had 1.5 configured and never had an issue. Automation fired whenever a person was detected. When I noticed the automation stopped working, I found out 1.5 had been deprecated, but 2.0 was supported and even had 150 more RPD than 1.5. So at 50 RPD with 1.5, no issue. With 200 RPD in 2.0, literally nothing changed or added, I hit 200. And what’s also confusing is that it hasn’t reset today. So no events yesterday or today, and I’m still showing at 200 max for today.

There are issues at the moment with this add-on (or whatever it is). Please check out Gemini endless retry loop · Issue #398 · valentinfrlch/ha-llmvision · GitHub

See if you are having the same issues.

HTH

4 Likes

Thank you!

So, it’s a LLMVision infinite retry loop that’s maxing quotas in minutes? Is that what I’m understanding?

1 Like

I believe so.

please help me

check your url’s are set

homeassistant:
  external_url: "https://yourdomain.duckdns.org"
  internal_url: "http://192.168.1.100:8123"

thanks you for reply i don’t use any dns service i use self signed ssl cert and tailscale

Has anyone experienced OpenAI providing lots of false responses? I am asking if there is a blue recycling bin or green garbage can (2 separate scripts) on the left side of my driveway and OpenAI says yes most of the time, even though there is nothing there but grass.

That’s rough, and that issue is over a week old. Too worried to get this running for the moment, IDK if google counts repeated API calls that return 429 towards billing or not, but i’d rather not find out.

Been reading through all the Git issues trying to get this figured out with Gemini to no avail. The option to remove title in the blueprint was removed a while back I guess, and I couldn’t get it to work with generate_title: false in the automation. Tried downgrading the blueprint and integration to 1.42, that didn’t work. For whatever reason, ever since I had to upgrade to Gemini 2.0, It’s running like 10+ requests per event, getting to 200 max very quickly. I don’t know how, with 1.5’s 50 RPD, and anywhere from 20-150 event firings in a day, I never went over once. When I went back to LLMV 1.5, I saw there was a fix for the endless retry loop, but it’s not working for me no matter what I do. If anyone has gotten this figured out, would love to hear how!

1 Like

How exactly does the “Live Preview” work? I have it set up with iOS, but I just see a screenshot each time I get a notification.

1 Like

After the 1.5 update my Gemini/Google provider settings return “invalid API key” despite using the identical setup for quite some time before. The API key in question is used in other tools right now, so I know it’s valid.
I am contemplating downgrading, but curious if anyone had a similar experience?
Came back a day later and it is working again. Patience was the key?

I get good responses if I give it a camera entity to pull the image from.

But if I instead have it analyze an image file the response makes no sense.
It says something like “here are the bounding box detections” and that’s it. Nothing intelligent

Has anyone else been having really varied response times from Gemini lately? They were nearly instant a few weeks back now I’m seeing delays, sometimes of minutes 5-15+ until I get a response back. Tried a bunch of models to see if any makes a difference, really not seeing a difference. I assume it’s API load related but odd that it started soon after recent HA and LLMV updates.

You can’t control the speed ot the internet.

Yea same here. Gemini just went from working perfectly to barely at all. Been looking into trying other models.

There’s a note about certain Gemini versions (free tier!?) above burning through toks on endless return loop. If you’re on that it may be tie issue.

I am on free teir, but I’m staying within rate limits. Actaully maxing the rate limits return a 4xx error, this isn’t the case. This is a processing speed issue, unless Google secretly added response delays to free teirs. But other then the rate limit changes I haven’t seen anything about response time delays. At least I’m not the only one seeing this. Been trying to wrap my head around the potential pricing if I moved to OpenAi, at least until I solution a local set-up.

1 Like