Frigate LLM Notification v0.7 [iOS-aware] - Intelligent Security Camera Automation
An advanced Home Assistant automation blueprint that combines Frigate NVR, LLM Vision AI, and interactive mobile notifications to create intelligent, context-aware security alerts with actionable buttons. Now with native iOS support.
Key Features
iOS & Android Support
- Native iOS Streaming: Uses HLS (
.m3u8) for iOS devices and MP4 for Android. - Device Specific Attachments: Automatically serves the correct media format based on the target device.
- Dedicated iOS Device Selector: Easily categorize your notify devices.
Interactive Notifications
3 Customizable Buttons per notification type (New Event + End Event)
Smart Silence Feature with custom timer input (5-120 minutes)
Direct Call Integration with configurable phone numbers
Quick Actions: View Live, View Snapshot, View Clip (iOS/Android aware)
Custom Actions: Execute any Home Assistant automation
Advanced AI Analysis
- Dual Analysis: Initial snapshot + comprehensive video clip analysis
- Multiple LLM Support: Gemini 2.0/2.5, Claude 3.5/3.7, GPT-4o, Llama 4
- Person-Verified Detection: Handles Frigate’s enhanced person detection
- Memory Integration: Uses LLM Vision timeline and memory features
- Custom Prompts: Tailored AI analysis for your specific needs
Smart Filtering System
- Zone Vacancy Detection: Only alert when specific people are away
- Person Presence Validation: Check if family members are home/away
- Custom Conditions: Add complex logic conditions
- Sub-label Support: Advanced filtering with Frigate sub-labels
Features
- Optional Downloader: Choose between direct URLs or local file storage
- Parallel Processing: Handle multiple camera events simultaneously
- Enhanced Error Handling: Robust retry logic and safe template processing
- Cooldown Management: Prevent notification spam with configurable delays
Prerequisites
Required Components
-
# Frigate 0.13+ with MQTT setup # Camera zones configured # Object detection enabled -
# Provider configured (OpenAI, Anthropic, Google, etc.) # API keys properly set # Memory/Timeline optional but recommended -
# Android/iOS app installed # Notification permissions enabled # Actionable notifications supported -
Downloader Integration (Optional)
# Built-in HA integration # Directory permissions configured # Storage space available
Installation & Migration
New Installation (v0.7)
1. Import Blueprint
# Method 1: Direct URL Import
https://raw.githubusercontent.com/willhaggan/HA_Frigate_VLLM_Notification/main/Latest.yaml
# Method 2: HA UI
Settings → Automations & Scenes → Blueprints → Import Blueprint
2. Basic Configuration
# Minimal setup for testing
Camera: camera.front_door
Objects: ["person"]
LLM Provider: your_llm_vision_provider
Notification Devices: [your_mobile_device]
iOS Devices: [your_iphone] # Select iOS devices here for HLS support
Button 1: "View Live" (VIEW_LIVE)
Button 2: "Silence" (SILENCE)
3. Test Your Setup
- Create automation with minimal settings above
- Trigger person detection at your camera
- Verify notification appears with working buttons
- Test silence functionality with custom timer
Configuration Examples
Example 1: Basic Front Door Monitoring (Mixed Devices)
# Simple person detection with interactive buttons
Frigate Camera: camera.front_door
Required Objects: ["person"]
Zones: ["front_porch"]
Severity: ["alert", "detection"]
# Device Configuration
Notify Devices: ["mobile_app_iphone", "mobile_app_android"]
iOS Devices: ["mobile_app_iphone"] # Important for correct video format
# Interactive Buttons (New Event)
Button 1: "View Live" → VIEW_LIVE
Button 2: "Silence" → SILENCE
Button 3: "Call Security" → CALL
# AI Analysis
Snapshot Prompt: "Describe who is at the front door and what they appear to be doing"
Clip Prompt: "Analyze the person's behavior. Are they delivering something, visiting, or suspicious?"
Interactive Button Features
Available Button Actions
| Action | Description | Use Case |
|---|---|---|
VIEW_LIVE |
Open live camera feed | Quick security check |
VIEW_SNAPSHOT |
View event snapshot | See what triggered alert |
VIEW_CLIP |
View full video clip | Review complete event (iOS/Android aware) |
SILENCE |
Pause notifications | Temporary quiet period |
CALL |
Dial phone number | Contact security/family |
Smart Silence Feature
# User interaction examples:
Tap "Silence" → 5 minutes (default)
Type "30" + Send → 30 minutes
Type "120" + Send → 2 hours
Advanced Template Variables
Use these in custom messages and AI prompts:
Event Information
{{input_objects}} # Objects required: ["person", "car"]
{{objects}} # Objects detected: ["person"]
{{camera_name}} # Camera name: "Front Door"
{{zone_names}} # Zones required: ["front_porch"]
{{video}} # MP4 Clip URL (Android)
{{video_ios}} # HLS Clip URL (iOS)
{{detections[0]}} # Event ID: "1642095978.456789-abc123"
Performance Tips
AI Model Selection
# Fast models (real-time alerts):
- gpt-4o-mini
- gemini-2.0-flash-lite
- claude-3-5-haiku-latest
# Quality models (detailed analysis):
- gpt-4o
- claude-3-7-sonnet-latest
- gemini-2.0-flash
- gemini-2.5-pro
- Llama-4-Maverick
Token Optimization
# Snapshot Analysis: 50-100 tokens (quick description)
# Clip Analysis: 100-200 tokens (detailed analysis)
# Balance: Speed vs Detail based on your needs
Contributing
We welcome contributions! Here’s how to help:
Bug Reports
- Use GitHub Issues with detailed error logs
- Include Home Assistant and integration versions
- Provide configuration examples that reproduce the issue
Version: v0.7
Author: whag
Last Updated: December 2025
Compatibility: Home Assistant 2024.1+, Frigate 0.13+
Quick Links
- Blueprint File - Ready to import
- GitHub Issues - Bug reports and feature requests
- Home Assistant Community - General discussion
- Frigate Documentation - Camera setup guide
- LLM Vision Setup - AI provider configuration
