Camera, Frigate: Intelligent AI-powered notifications

Sorry this is the correct url:
https://github.com/valentinfrlch/ha-llmvision/blob/56ab80cef76b0f214757c3e6c0123423555d8113/blueprints/event_summary.yaml

I had accidentally deleted the dash.

That imported fine.I did a quick test only. I selected ‘camera’ again instead of frigate. The snapshot works a lot better. It first sends a notification, with a picture that motion is detected. Then after a few seconds it updates the picture to a few seconds later (much quicker then live preview) with the AI description. So that’s much better.

Nice blueprint, works fine for me.
I have a question about the tap navigate. Is it possible to show a big snapshot instead of going to a lovelace dashboard? I’m using the frigate mode.

Thx

1 Like

Wow, I’ve got like 20 notifications last night. That’s a bit too much. No person was detected, but it triggered on motion I guess.

The blueprint has an important parameter to only notify (and analyze) important events.

For iOS you can press and hold a notification to expand it which will display a snapshot. Not sure about android but I’m sure there is a similar gesture to expand a notification.

Ok thx wasn’t aware of this function. Works fine i m using ios.

1 Like

The blueprint has been update along with v1.3.1 of LLM Vision and now supports multiple devices! A few bugs mentioned here should also be fixed. Thanks for the feedback!

Make sure to re-import the blueprint to get the updates! If you get an error message after updating, select the devices to send notifications to again and save your automation.

Also got frigate working. Turned out I hadn’t configured mqtt for it. But it also gives a notification that my car is on the driveway. Need to test some further. It seems much quicker though.

Also while testing it does not send a picture when I’m on mobile internet. How to get around that?

Make sure image to be sent is accessible from internet?

Since the last time I responded I have Frigate up and running and I was actually getting notifications. To many actually and getting them from cameras all over and not just the once I selected. I came here and seen that there was and updated blueprint and have updated to the latest. Now I have an error with my phone which I did not have on previous version and I have not changed anything with my phone name. See below.

AI Event Summary (LLM Vision v1.3.1) uses an unknown actionError ⸱ Reported by Automation

The automation “AI Event Summary (LLM Vision v1.3.1)” (automation.ai_event_summary_llm_vision_v1_3_1) has an unknown action: notify.mobile_app_tjss23phone.

This error prevents the automation from running correctly. Maybe this action is no longer available, or perhaps a typo caused it.

To fix this error, edit the automation and remove this action.

How do I do that?

This likely happens because there is some character in your phone’s name that is not handled correctly. Could you share the correct name of the service? You can find it in developer tools > Actions.

In the meantime you can re-import the blueprint using this link to roll back to v1.3:

https://github.com/valentinfrlch/ha-llmvision/blob/80dcdac7e371e51e92a376c5f19d041cd6f282bd/blueprints/event_summary.yaml

Here ya go … mobile_app_tjs_s23_phone. I use this same device for many other automations and notifications without issue. It seems to me that your code is stripping the underscore between the the ss’s (lol) and between the 23 and phone. I will redo this blueprint with the one you provided.

Had the same issue (Device Name: Andrés iPhone). The blueprint was struggling with the letter é. I changed the device name to andres iPhone and now it works perfectly! @valentinfrlch thanks so much for your easy to use blueprint - I love it

1 Like

Thanks for the feedback!
Obviously you shouldn’t need to change your phone’s name for this to work! I will look for an alternative solution and update the blueprint accordingly.

2 Likes

2024-11-11 23:11:27.148 ERROR (MainThread) [homeassistant.components.automation.ai_event_summary_office] Error rendering variables: UndefinedError: 'dict object' has no attribute 'payload_json'

The automation won`t pass certain conditions …

Hello,

I have the integration running with a Unifi camera in conjunction with Google AI Pro.

Is it possible to change the answers to German?

When I change something in the automation, I get the following error message even though I don’t have Frigate/MQTT enabled:

Logger: homeassistant.components.automation.ai_event_summary_llm_vision_v1_3_1
Source: components/automation/init.py:830
Integration: automation (documentation, problems)
First Occurred: 11:43:22 (1 occurrence)
Last logged: 11:43:22

Got error ‘Cannot subscribe to topic ‘frigate/events’, make sure MQTT is set up correctly’ when setting up triggers for AI Event Summary (LLM Vision v1.3.1)

thanks

In my case, the Friendly Name of my mobile is “GB-iPhone”. The Entity-Name ist gb_iphone. But the Blueprint creates the Entity-Name “gbiphone”.