Camera, Frigate: Intelligent AI-powered notifications

Blueprints Exchange
, , , ,
145

Hi,

I have a problem with AI-notification. In developer tools it works (AI description) but when my cameras recognise objects I have small notify with “person”, “dog”, “car” etc. I have Frigate (and notification from other blueprint works good). I have Google Generative AI intalled and added API (the same for Google Provider). And it is my notification on IOS (iPhone):

2B06D090-871E-4057-847D-468264D0EC61
2B06D090-871E-4057-847D-468264D0EC611290×1771 94.4 KB

Traces: Traces - Pastebin.com
And my YAML for blueprint:
“alias: AI Event Summary (LLM Vision v1.3.5)
description: “”
use_blueprint:
path: valentinfrlch/event_summary.yaml
input:
mode: Frigate
notify_device:
- baee6028aad0ca03df8ad0dcf7a1ca1b
camera_entities:
- camera.garaz
- camera.kanciapa
- camera.kuchnia
- camera.ogrod
preview_mode: Live Preview
provider: 01JH86KC6YATGA5KPC6G2G7CVY
object_type:
cooldown: 1
message: >-
Describe what you see in this image from my security camera. Focus only on
dynamic objects like cars, people and animals. Rules for the response: 1.
Response must be in Polish 2. Keep it short (max 200 characters) to fit in
a mobile notification 3. Ignore all static objects like buildings, gates,
letterboxes etc. 4. If you see a person: mention their main
characteristics 5. If you see a car: mention its type and color 6. If
you see an animal: mention its species and behavior 7. Add a funny
comment or emoji occasionally 8. If you see multiple objects, focus on the
most important one - this will be most probablu surrounded by a bounding
box from the camer 8. Use present tense
max_tokens: 90
temperature: 0.5
detail: high
model: gemini1.5-flash”

146

Try changing your model to model: gemini-1.5-flash-8b

1 Like
147

Great :slight_smile: it works and description is in my language. As title I have „Person seen” - can I translate this?

And can I:

  1. set this that after click on the notification I can see shot clip?
  2. notification on my Telegram with snapshot (I set without snapshot and it works but which url out for last snapshot which was analysed?)
148

I have no idea! There was a mention about telegram earlier in the post I think, have a read through and I’m 60% sure the solutions are 100% there.

149

Upon further investigation, I noticed that the description also appears to be truncated in the calendar entries, so perhaps the issue is not with the iOS notification…