Local realtime person detection for RTSP cameras

Share your Projects!
3700

Seems in your config snippet above you have:
width: 1280
height: 720

My Wyze cams (V2) are
width: 1920
height: 1080

Are you sure you have the correct settings?

3701

Loving the new UI in 0.8.2. Also not sure if a new feature or not (as I just started using it this week), but discovered the dark mode option on the upper right :smiley: I had thought it was a setting in the configuration so suspect Iw as looking in the wrong placeā€¦

3702

Downloaded the new release. Getting some ā€œblinkingā€ when I hover over certain items in the UI. Like in the Road Mask and Zone Creator, the Add/Remove buttons appear/disappear when I move the mouse over them.

Also when I hover over the ā€œToggle Detect/Clips/Snapshotā€ in the main UI, the camera images blink when moving the mouse of those items. Using Chrome btw.

3703

Dark mode was always available, but it was set to ā€œautoā€, so it depended on your system setting

@biggen1684 Iā€™m not able to reproduce this. Can you please file an issue on GitHub with as much information as possible (browser, system, etc) as well as a screen recording or something?

1 Like
3704

Dark mode was always available, but it was set to ā€œautoā€, so it depended on your system setting

Got it! that explains why on my work Mac in dark mode it showed up with dark mode, and on my regular desktop running Ubuntu, while in Dark mode Iā€™d see light mode as doesnā€™t really carry across to Chrome for the mode type. Thanks!

3705

New release dont show up hereā€¦ How to force an upodate? Remove and reinstall?

3706

The addon has not been published yet; only the Docker images are available.

3707

Ahhhā€¦ okā€¦ Will wait thenā€¦

3708

Love now that snapshots can be configured for zones only now! That is a great feature! I was able to reduce masking quite a bit but I do still get multiple snapshot ā€œeventsā€ from the same car/person driving/walking through the zone occasionally. Not often but sometimes a slow walker seems to create more than one ā€œeventā€. I guess I need to up the max_disappeared value further a bit for my setup to tweak it just a bit.

Great job though!

3709

@blakeblackshear might be worth adding a small note on the HA integration installation instructions that the MQTT server HA is connected to must be the same as the one Frigate is connected to for the sensors to work. Iā€™ve been wondering why mine were showing as unavailable then I remembered I connected Frigate to a local MQTT db running on the same instance instead of my main one which my HA is connected to.

3710

funny :sunglasses:
how should it work if itā€™s not the HA MQTT server :thinking:

1 Like
3711

There are plenty of integrations which donā€™t use mqtt to update entities?

3712

Hello

I install Home assistant in RP4 can I use this component for face recognition in RP4 ?

3713

soounds interesting I have a OPENALPR docker container running but not sure how to use it and ho to integrate it properly int o home assistant . any ideas heere?

3714

I have a similar issue with the camera at the front of my house. It kept picking up the parked cars in the street as a car was parking on our drive. I set a motion mask to cover the street which has fixed that and defined two zones on the drive and path. I also keep getting false positives of our car as a new object regularly. Iā€™m not sure whatā€™s triggering it, as the frequency seems to be way over the default max_disappeared of 25. Iā€™m going to try increasing it in any case but any other suggestions would be much welcomed.

This is the frequency Iā€™m looking at:

front car 72.66% drive 22/02/2021 09:16:42 09:16:52
front car 82.03% drive 22/02/2021 09:16:41 09:16:52
front car 70.70% drive 22/02/2021 09:09:12 09:09:23
front car 84.38% drive 22/02/2021 09:09:11 09:09:23
front car 84.38% drive 22/02/2021 09:08:46 09:08:54
front car 79.49% drive 22/02/2021 09:08:30 09:08:46
front car 84.38% drive 22/02/2021 09:08:22 09:08:43
front car 84.38% drive 22/02/2021 08:44:46 08:44:59
front car 75.39% drive 22/02/2021 08:28:12 08:28:19
front car 76.95% drive 22/02/2021 08:06:27 08:06:39
front car 82.42% drive 22/02/2021 07:53:12 07:53:21
front car 84.38% drive 22/02/2021 07:20:18 07:20:31
front car 84.38% drive 22/02/2021 07:09:56 07:10:04
front car 81.25% drive 22/02/2021 07:09:42 07:09:51
front car 80.66% drive 22/02/2021 07:09:10 07:09:17
front car 83.20% drive 22/02/2021 07:04:55 07:05:03
front car 84.38% drive 22/02/2021 07:03:31 07:03:40
front car 84.38% drive 22/02/2021 06:56:40 06:56:56
front car 72.66% drive 22/02/2021 06:53:21 06:53:32
front car 74.61% drive 22/02/2021 06:51:10 06:51:20
front car 76.95% drive 22/02/2021 06:45:38 06:45:45
front car 79.30% drive 22/02/2021 06:44:22 06:44:33
front car 79.69% drive 22/02/2021 06:42:29 06:42:38
front car 72.66% drive 22/02/2021 06:40:51 06:40:57
front car 79.30% drive 22/02/2021 06:31:11 06:31:19
front car 74.02% drive 22/02/2021 06:23:28 06:23:35
front car 82.42% drive 22/02/2021 06:20:28 06:20:36
front car 71.09% drive 22/02/2021 06:17:36 06:17:44
front car 74.61% drive 22/02/2021 06:01:29 06:01:34
front car 72.66% drive 22/02/2021 05:34:48 05:35:01
front car 75.39% drive 22/02/2021 05:29:30 05:29:38
front car 76.17% drive 22/02/2021 05:27:02 05:27:14
front car 71.48% drive 22/02/2021 05:25:28 05:25:34
front car 75.78% drive 22/02/2021 05:21:19 05:21:25
front car 75.39% drive 22/02/2021 05:17:39 05:17:47
front car 74.22% drive 22/02/2021 05:14:27 05:14:36
front car 75.39% drive 22/02/2021 05:12:52 05:12:59
front car 81.25% drive 22/02/2021 05:01:13 05:01:21
front car 78.91% drive 22/02/2021 04:58:03 04:58:08
front car 70.51% drive 22/02/2021 04:49:52 04:50:02
front car 78.91% drive 22/02/2021 04:48:15 04:48:21
front car 78.13% drive 22/02/2021 04:39:21 04:39:31
front car 78.91% drive 22/02/2021 04:32:08 04:32:15

I noticed some corruption on the stream, could that be the cause? I probably need to look at fixing the corruption but itā€™s odd as the camera is hard wired and Iā€™m using a low res stream for the detection.

3715

You need to setup an object mask as well which prevents any object you define from being detected from within the object mask. Motion masks only prevent Frigate from triggering on motion from within the motion mask. However, once motion has been triggered elsewhere (e.g. outside the motion mask), objects everywhere in the scene (including the motion mask) are now fair game. If you also have identical motion/object masks, that tells frigate to not only ignore any motion in the motion mask, but also ignore objects in the object mask as well.

So in your example, you need a car object mask covering that grey car (or the whole space) if itā€™s always parked in that spot and you donā€™t want it to ever be detected. That will tell Frigate to ignore any object of car that is within the mask. It will only ignore car and still trigger for any other object (Frigate defaults to person if you donā€™t specifically tell it to look for certain objects).

Here is a snippet of my config excluding zones.

motion:
  mask:
    - 2688,0,2688,196,0,318,0,0
    - 0,1520,2519,1520,1970,715,0,713

And this:

objects:
  filters:
    car:
      mask:
        - 2688,0,2688,196,0,318,0,0
        - 0,1520,2519,1520,1970,715,0,713
    person:
      mask:
        - 2688,0,2688,196,0,318,0,0
        - 0,1520,2519,1520,1970,715,0,713

You can see how I use identical motion/object masks because I donā€™t want frigate to act on motion in any of those masked area AND I donā€™ want it to detect any car/person objects in those masks areas either.

4 Likes
3716

I canā€™t help with HA integration with OpenALPR as I donā€™t use HA with it. I exclusively use HA just for Frigate notifications and thatā€™s it.

Head over to ipcamtalk.com if you are interested in LPR setup and advice. We are pretty active over there. There is a dedicated subforum just for it.

3717

Ah ok thanks for the tip! Iā€™ve checked and Iā€™m not getting any object detection in the motion mask area though? Thatā€™s the blacked out area at the top.

I do want to detect the grey car and any car on the drive as Iā€™d like to know if the car moves. The problem is the car isnā€™t moving and it keeps detecting it as a new object every 2 - 8 minutes.

Iā€™ll try the object mask and see if that improves things.

3718

As I understand it, motion kicks off Frigate ā€œdetection processesā€ and then any object you have set in your config will get tracked even if its not moving. So even if that car in your driveway isnā€™t moving, Frigate will detect it when Frigate sees movement elsewhere in the frame. Maybe those bushes are blowing on the left or someone walks on the sidewalk on the right. Whatever Frigate is keying in on motion, that motion event is making Frigate start its detection and you must have car set as one of your tracked objects so Frigate is tracking that even though it isnā€™t moving.

The only way to prevent that is to use an object mask set for car and that will ignore that grey car.

1 Like
3719

This is likely happening for various reasons - birds moving over the cars, sun/lighting changes, etc. Anything that causes Frigate to see motion in that area will cause objects to be redetected (even if theyā€™ve been determined as ā€œstationaryā€ previously and had detection automatically turned off after a set period - on 0.8.2 and later). You may be able to adjust your motion: settings to be less sensitive ( see https://blakeblackshear.github.io/frigate/configuration/advanced) to prevent this, but there is no foolproof way to see if only the car moves.

1 Like