Can you reimport the blueprint? I’ve just made some changes (not to that specifically but I just tested every combination of setups and can’t it to produce this error).
You can reimport the blueprint in the blueprint section.
i will try that, i already had the version with motion sensor options.
//edit//
sorry, did not do anything.
is there a good way to see if the frigate communication is working? i think something is wrong there. i used the internal ip (http://192.168.1.1:5000/ )
/edit2/
i stopped because the kids came home. but i am getting messages on my phone that a car or person is detected, no snapshot or clip, and no extra info of the AI.
Hmm ok yeah that sounds like something is wrong with the frigate_url. Do you use the Frigate addon for Home Assistant? Obviously I don’t know about your network configuration but 192.168.1.1 sounds like the IP your router would be on by default.
the url is correct if i put it in my browser , its not .1 , but randomized it for the forum 
the HA log is now filled with these :
- Error while executing automation automation.ai_event_summary_llm_vision_v1_2_1_2: Failed to fetch frigate clip 1729690264.278839-j417sb
I see. The error means the clip cant be fetched (because the url cant be reached). I just noticed you had a “/” at the end. Try deleting that so that frigate_url ends with the port number. I’ll add some logic to the blueprint that if there’s a “/” at the end it is removed.
Exposing the port didn’t help, but I just realized that error is giving me my duckdns address, when I set the frigate_url to the IP address, so it seems as though it’s not using the frigate URL in the blueprint?
the/ at the end of the url did not make any difference, still the same errors.
however, i got one notification that was with a sort of GIF like snapshot, no AI text, just a moving snapshot.
- AI Event Summary (LLM Vision v1.2.1): Analyze event: choice 1: Error executing script. Error for call_service at pos 1: Failed to fetch frigate clip 1729693637.965129-qp6wh7
- AI Event Summary (LLM Vision v1.2.1): Error executing script. Error for choose at pos 4: Failed to fetch frigate clip 1729693637.965129-qp6wh7
The url in the blueprint is only required to show the preview in the notification. This is required because when you’re not connected to your home network, the local IP of your frigate server will not work.
I think I forgot to put this into the docs, but the frigate integration needs to be installed in home assistant for this to work. To analyze the event, llmvision will fetch the clip through this integration.
@Nightraider this is likely the reason why the preview works but the summary doesn’t.
Installed this, but on my phone i get a notification with no picture or anything, and it just says “Car Seen” and then what camera registered it. In the logbook, if i click on the even and go to “Trace Timeline” it says: “Failed to fetch frigate clip 1729868179.613682-mnpe91”
I also got:“error 500: response status code was unacceptable” but can’t seem to remember from where and i can’t reproduce it. When i click on the notification on phone, it opens HA, but on default dashboard.
I have Frigate running on a separate server, but with the frigate proxy addon running in HA.
Camera mode: Frigate
Frigate URL: http://192.168.1.101:5000
Blueprint version 1.2.1
Thanks for the detailed error report.
I am unfamiliar with the proxy addon. For this blueprint (and the integration) to work, you need the frigate integration as it creates the /frigate endpoint in the home assistant api.
Sorry for the confusion I forgot to put this (crucial) step in the docs.
Otherwise, your configuration of the blueprint looks correct to me. Let me know if this helped!
Hi again,
I don’t know what happened, but it seems to be working with the proxy… sometimes. If a person is detected, i get a notification with a AI prompt and i can see a thumbnail. If a cat is detected, it just says “Cat detected” and no thumbnail, or, well… a thumbnail picture with some error text on it. Same with a car. Could it have something to do with the configuration of frigate?
Even though it doesn’t work 100% for me yet, i already love it. Is it possible to somehow get a overview of the notifications? Like a historic overview to see how the AI responded to the motion, for instance last thursday, when something special happened? Maybe that is a question or feature request for frigate or HA itself.
In the automation blueprint, there is the option to choose a “Trigger State” and the documentation says “(Camera) State camera needs to be in to trigger”, but when i go to ‘Developer tools’ > ‘States’ and find the states of the camera that is imported from the frigate instance, i see a lot of sensors, and i’m not sure what sensor to look for, to confirm that it is the correct state. I mean, it could be 0, 1, motion, detection, recording, true or something else.
Here are pictures of some of the options i think it could be. How do i know which one the automation blueprint is monitoring?
So when the thumbnail is an error message, what does it say? Failing to load the preview could be due to a few reasons. Do you have a local IP address for frigate_url? Maybe your phone wasn’t connected to your home wifi which would explain the error message.
I am already working on an overview. I’d love to push the summary to frigate directly but they don’t seem to have a place in the UI to display such a summary.
The overview I’m working on right now will be a calendar entity which will eventually also enable asking Home Assistant Assist things like “When have you last seen someone at the front door?” etc. Might be a while until it’s ready though.
- The
trigger_staterefers to the state of your camera entities. In your casecamera.entrance_2has a state ofrecording. (If you’re using frigate this state is likely alwaysrecording- at least for me it is). - If you’d like the automation to trigger based on a
binary_sensoryou can select them asmotion_sensors(this is new, you might need to reimport the blueprint to see this option).
Important to note: trigger_state and motion_sensors only apply when you use the Camera mode of the blueprint. Otherwise frigate’s mqtt messages are used as triggers.
Hope this helps!
So I figured out the issue with the clip, it was the wrong port. It should have been :5000 vs the default 8791. However, as someone noted below I only get Person Seen in the description. How can I make it provide a larger description. Also, it is showing me every frigate camera, vs the entity I told it to monitor
Can you check the traces? They can be very helpful for debugging automations. You can check them by clicking the three dots > Traces. Click each step to see what went wrong.
For Frigate mode the camera entities do not apply. I get why this is confusing and I’ll change this with the next update. Originally what is now two modes were two different blueprints, which is why these camera entities only apply to camera mode.
So it’s not possible to only get alerted for one specific camera when in frigate mode?
Will be available in the next update in a few days
1 Like
So you’re saying that the thumbnails will only be viewable locally if the frigate url is local?
I was previously using the blueprint below which doesn’t have the same limitation. I’m trying to look into the differences into how the two reference thumbnail pictures.
HA_blueprints/Frigate_Camera_Notifications at main · SgtBatten/HA_blueprints · GitHub
1 Like
I found a better way to fetch the previews which doesn’t require the frigate_url. It instead will rely on the Frigate Integration. This will make configuration of this blueprint much easier. It will be in the next update.
Thanks for looking into it though!
1 Like
anyone tried this blueprint with reolink doorbell camera?
i imported this and followed the step of setting it up
my camera does not change status to recording.
it always remain in idle status.
the entity - motion, person, visitor gets triggered though.
how to use the automation in this situation?
using another automation, i do get a snapshot when motion is detected though.
not sure how to feed it to gemini using this automation
