Camera Notification V0.7 with Actionable Buttons Android IOS - Frigate LLM Vision AI

Blueprints Exchange
, , , ,
142

On android anyway the review gif will play on an end event, so the notification has the gif playing without pressing anything, although you can also configure to view externally with buttons yes.

143

Hi, issues like this are usually external to the automation itā€™s more likely the device or application in sleep mode or something like this.
. I believe I already have ttl: 0 and priority: high, unless there is another specific parameter for iOS I should be setting.

144

Ok thanks, doesnā€™t seem to have that behaviour on my iOS device as I only get the live camera feed by default, including on an end event.

Iā€™m happy for now with my configurationā€¦ took control and display a cropped snapshot, which does the job until I can get video to work in the iOS notification.

I may add a button in the original snapshot notification that updates the notification or opens a new notification with live video on demand. Only issue is that the frigate camera feed seems to load slowly (10 seconds+ of black screen, then possibly more loading time on a static image) in notifications at the moment, so need to solve that or use another feed.

145

Okay interesting, do you reckon IOS can play a M3U8 file directly in the notification, if you llok at the yaml it is using the review gif as the end event attachment and it does this on android as expected but obviously IOS is different, its using the entity_id as the attachment then.

              - action: notify.{{ repeat.item }}
                data:
                  title: '{{response.title if gen_title2 else title_clip}}'
                  message: '{{response.response_text}}'
                  data:
                    video: '{{gif}}'
                    image: '{{gif}}'
                    entity_id: '{{input_camera}}'
                    url: !input click_action2
                    clickAction: !input click_action2
                    group: '{{camera}}-frigate-notification'
                    tag: '{{id}}'
                    interruption-level: active
                    ttl: 0
                    priority: high

i do not know much about ios but you could try removing the entity_id line and test

146

Hi. Iā€™ve installed this blueprint and everything works besides clips. Iā€™ve set up 3rd button at start and end to play clips but whenever i click it it opens up browser and play button is crossed- like it is not foundā€¦ that is on iphone. I can go to HA > Media > Frigate > Clips and i can play clips from thereā€¦ Any thoughts? Also is it possible to play live cam directly in HA instead of openning browser? Same for snapshots.

One to add - it is not not found - i think it is actually there but will not start playing for some reason. I tried same link that gets opened up on desktop and it worksā€¦

147

Oh yesā€¦ see thatā€™s part of what I did when taking control, just set it to snapshot rather than gif as I gifs grainy/less useful.

So can confirm deleting entity_id: camera.ABC is required for ios notifications to embed another media type than the live camera feed.

148

Maybe taking control of the blueprint and in the yaml replacing ā€œclip.mp4ā€ with ā€œmaster.m3u8ā€ in the following will help:

video: /api/frigate/notifications/{{id}}/{{camera}}/clip.mp4

That will likely link to play in browser though. I havenā€™t been able to get it to play inside the notification in ios, or to play in HA

150

yup that helps :wink:
Thanks

151

Okay thatā€™s good to know for any future update, so once removed it uses the image or video parameter. Thanks

152

Hi, I have been working on some IOS specfic updates and added a few extra options for attachments and a response output, if i get a few IOS users to test if would be great before i release the latest update, i can add a github link if you can confirm please. thanks

153

Thanksā€¦ happy to test out.
I noticed another limitation of the existing blueprint re iOS tooā€¦
If the {{ video }} links to clip.mp4 then the video wonā€™t play on iOS,
but if it references master.m3u8 then the end event isnā€™t analysed (ffmpeg error).

So will need to reference separate variables for clip.mp4 and master.m3u8

154

On my application of your blueprint I also hardcoded actions to trigger a separate notification with live video (triggers an additional automation), to open the video clip in the HA companion app, and a direct notification click (url rather than clickaction for iOS) to open a dashboard on the companion app.

                      - action: notify.{{ repeat.item }}
                          data:
                            title: "{{response.title if gen_title2 else title_clip}}"
                            message: "{{response.response_text}}"
                            data:
                              image: "{{image}}"
                              url: /dashboard-dash/1
                              group: "{{camera}}-frigate-notification"
                              tag: "{{id}}"
                              interruption-level: active
                              ttl: 0
                              priority: high
                              actions:
                                - action: show_live_entry_cam
                                  title: View Live
                                - action: URI
                                  title: View Clip
                                  uri: "{{video_ios}}"
155

hi that would be great if you can give it a try. See the link

156

Hi, Any luck with the updated blueprint?

157

Hi All, Along with talalal, is there any IOS users can support or test the 0.7 dev version for us please. Any feedback post here or PM or git Thanks again.

158

All android users welcome also to contribute especially if any ill effects on the core automation etc exist from the update

1 Like
159

Hi @Whag and thanks for sharing this awesome blueprint

Is there a way to send the notification to telegram instead of the HA app?

Another question is why when I click on the notification it opens the HA app but it does not show the full notification text and I donā€™t find a way to read it fully.
Normally, I donā€™t use HA app for notification.

Thanks

160

I donā€™t like having a bunch of per-camera automations so I created a multi-camera blueprint with include/exclude zones, LLM Vision and lots of other improvements. Under very active development.

161

Hi,

I am running it since a while (5days) and it seems to work on iOS. Anything special that you would want me test?

162

Hi, Is it the devLatest version? If so its the image and clip viewing in particular i was wanting confirmation, are the gif live previews showing within the notification? When opening a clip does it play as expected?