Local realtime person detection for RTSP cameras

Gotcha, thanks!

Sponsored on Github!

Really appreciate all the effort you put into this and your support on the forums. Iā€™ve used Frigate for months now on multiple iterations of my HASS systems and havenā€™t had any issues personally.

Keep up the great work, itā€™s awesome to see this evolve.

Congrats on an amazing 8.0 release - Frigate continues to be my favorite HA project and it keeps getting better. My local police department thanks you too - weā€™ve caught some bad dudes using Frigate.

Whatā€™s the best way to deal with peopleā€™s shadows causing false triggers? I have masked an area of the sidewalk so Frigate wonā€™t trigger on people there, but in the early morning hours just after sunrise, their shadows are long enough that they come inside the area that is not masked causing an alert. Iā€™m including a couple pictures. One showing the shadows that triggered Frigate, and then mask I have applied. Is it a threshold thing I need to tweak? Its hard to test and solve for since it only happens after sunrise for a small bit of time when the sun is low. Those shadows registered as a 75% confidence rate which seems high for shadows.

It probably wasnā€™t the shadows. The bottom center of the bounding box is what Frigate uses to calculate if a detection is in/out of a zone/masked area. You could turn on snapshots with the bounding box in your config, or watch the debug stream to see what triggers it.

Hmmā€¦ If its not the shadows, then Iā€™d get triggers all day long from people walking/running on the sidewalk. But I only get those triggers in the morning. I never get them after approx 9am. That corresponds to long shadows.

Iā€™ll look into turning on snapshots with bounding boxes.

Edit: I turned on snapshots with bounding boxes and I see them being written to the /media/frigate/clips directory. When it happens again tomorrow morning Iā€™ll see what the bounding boxes show.

They arent integrated like clips yet.

1 Like

Hiā€¦
Seems that Iā€™ve missed some settings hereā€¦
As soon frigate detect motion, object detection starts, but it never ends. As you can see there is no motion at all but this keep going. Have to stop Frigate att restart itā€¦
frigate
Itā€™s doing this for a couple of my cams and putting pressure on my poor CPU :slight_smile:

Iā€™ve have set this as global args:

detect:
  max_disappeared: 8
motion:
  threshold: 20
  contour_area: 100
  delta_alpha: 0.2
  frame_alpha: 0.2
  frame_height: 280

This is expected behavior in the current version. It is tracking detected objects.

Ok, understoodā€¦ But this also triggers a new event causing multiple notifications where there is no motion.

Best way to avoid that?

Do you have a specific use case for tracking cars?

Not sure if I understand your questionā€¦

Iā€™m using your motion detection to trigger for new objects in my zone.

There are many many ways to adjust things, but I donā€™t know what your goal is. Iā€™m guessing that you want to be notified when a car pulls into your driveway. Are the ā€œoldā€ cars in the image you posted almost always parked in those locations?

after looking for a solution regarding motion detection and object recognition I found this today.
I LOVE IT!!!
@blakeblackshear you made an unbelievable great job.
My HA Instance is running on an ODRID N2+. As well the performance is great.
Will try to implement a google coral usb stick as next.

Thatā€™s precisely what I want. The ā€œoldā€ cars have been parked all day, and when motion triggers the object detection it continuously tracks the ā€œoldā€ cars causing load on the CPU, even when there is NO motion detectedā€¦

Frigate will continue watching detected objects regardless of whether or not there is motion. Frigate is not as simple as ā€œif motion, run detection on imageā€.

The only way around that for now is to use an object mask for car in your filters to prevent cars from being detected further up your driveway.

1 Like

Thanks for the infoā€¦ I may found a way around ā€œmy issueā€ with multiple notifications.
As today im using MQTT for events. I could use my camera motion sensor to trigger a notification istead. But stillā€¦ it puts some load on my CPUā€¦ Imho it would be better to search for objects when motion is detectedā€¦

Anyhowā€¦
Your Frigate is one the most impressive addons Iā€™ve seen for HA ā€¦
Keep up the wonderful jobā€¦ Big thanksā€¦

I have the same issue. I want to have a trigger sent when a car drives along the road in front of my camera, but I have cars normally parked in the masked area I setup. So once the car drives through, it still locks onto the cars that are parked and never gives up.

I need to look into object masks then if that is the only solution for now.

The other way to do it is by setting up zones and only notifying when the object is in a specific zone. It will still track objects in other areas but not notify.