Camera, Frigate: Intelligent AI-powered notifications

Are you on Android or iOS? It is possible that notifications need to be updated differently on android. I have only tested this using iOS.

Yeah Iā€™m on android

I may have found the issue. Home Assistant docs mention unexpected behaviour when using the same tags across different groups on Android (Introduction | Home Assistant Companion Docs). Iā€™ll try to fix this in the next update.

There are no images in that folder. Except some older ones. Do I need to use frigate, since I configured it to use the camera? Somehow frigate gives me no results. No motion or people detected.

v1.3 seems to have a few issues. If youā€™d like to test the blueprint beta, import this url https://github.com/valentinfrlch/ha-llmvision/blob/data-analyzer/blueprints/event_summary.yaml and overwrite the existing blueprint (your configuration will remain). If you encounter any issues please report them!

v1.3.1 also adds multi-device notifications.

Canā€™t import the blueprint.

Sorry this is the correct url:
https://github.com/valentinfrlch/ha-llmvision/blob/56ab80cef76b0f214757c3e6c0123423555d8113/blueprints/event_summary.yaml

I had accidentally deleted the dash.

That imported fine.I did a quick test only. I selected ā€˜cameraā€™ again instead of frigate. The snapshot works a lot better. It first sends a notification, with a picture that motion is detected. Then after a few seconds it updates the picture to a few seconds later (much quicker then live preview) with the AI description. So thatā€™s much better.

Nice blueprint, works fine for me.
I have a question about the tap navigate. Is it possible to show a big snapshot instead of going to a lovelace dashboard? Iā€™m using the frigate mode.

Thx

1 Like

Wow, Iā€™ve got like 20 notifications last night. Thatā€™s a bit too much. No person was detected, but it triggered on motion I guess.

The blueprint has an important parameter to only notify (and analyze) important events.

For iOS you can press and hold a notification to expand it which will display a snapshot. Not sure about android but Iā€™m sure there is a similar gesture to expand a notification.

Ok thx wasnā€™t aware of this function. Works fine i m using ios.

1 Like

The blueprint has been update along with v1.3.1 of LLM Vision and now supports multiple devices! A few bugs mentioned here should also be fixed. Thanks for the feedback!

Make sure to re-import the blueprint to get the updates! If you get an error message after updating, select the devices to send notifications to again and save your automation.

Also got frigate working. Turned out I hadnā€™t configured mqtt for it. But it also gives a notification that my car is on the driveway. Need to test some further. It seems much quicker though.

Also while testing it does not send a picture when Iā€™m on mobile internet. How to get around that?

Make sure image to be sent is accessible from internet?

Since the last time I responded I have Frigate up and running and I was actually getting notifications. To many actually and getting them from cameras all over and not just the once I selected. I came here and seen that there was and updated blueprint and have updated to the latest. Now I have an error with my phone which I did not have on previous version and I have not changed anything with my phone name. See below.

AI Event Summary (LLM Vision v1.3.1) uses an unknown actionError āø± Reported by Automation

The automation ā€œAI Event Summary (LLM Vision v1.3.1)ā€ (automation.ai_event_summary_llm_vision_v1_3_1) has an unknown action: notify.mobile_app_tjss23phone.

This error prevents the automation from running correctly. Maybe this action is no longer available, or perhaps a typo caused it.

To fix this error, edit the automation and remove this action.

How do I do that?

This likely happens because there is some character in your phoneā€™s name that is not handled correctly. Could you share the correct name of the service? You can find it in developer tools > Actions.

In the meantime you can re-import the blueprint using this link to roll back to v1.3:

https://github.com/valentinfrlch/ha-llmvision/blob/80dcdac7e371e51e92a376c5f19d041cd6f282bd/blueprints/event_summary.yaml