Send Frigate Snapshots/Thumbnails to Google Gemini Pro

Configuration
1

I’m relatively new here - hoping someone can help me out.

I’m using Frigate for security cameras. After seeing the demonstration on the 2024.2 release note blog post, I was intrigued by the use of Google Gemini Pro to describe the contents of images to create custom notification text.

I am running into trouble in pointing the Gemini service to the snapshot files. Since Frigate saves the timestamp into the filename, I don’t see a way to use the latest snapshot. I’m also not even familiar with how to reference files in the Media browser from the HA installations address.

In other words, I’m looking for something similar to http://192.168.1.20:8123/media/frigate/snapshots/entryway/latest.jpg .

My installation is Docker based - both HA and Frigate are running in Docker containers on a Debian host. The Frigate integration is working fine and I can see the Snapshot files in the media browser - I just don’t know how to reference them.

I hope this makes sense and would appreciate any pointers.

2

You don’t need HA to get frigate snapshots, you can get them directly fro frigate.
Take look on docs:
https://docs.frigate.video/integrations/api/

In your case, the url will be something like:
http://192.168.1.20:5000/api/entryway/snapshot.jpg

Best regards.

3

Thanks for your help! I’m not sure why I didn’t think of that.

With a bit of persistence I was finally able to get it to work. Now, if I can figure out response variables I’ll be set.

1 Like