Local realtime person detection for RTSP cameras

Share your Projects!
3416

Try without the ?format=android. I think with IOS you don’t need it.

3418

Yes, the beta is the older version. Master is the current release and its version is 0.8.1.

Looks like he has also started work on 0.8.2 as well.

3419

opened an issue https://github.com/blakeblackshear/frigate/issues/703

3420

Need help.
I run Frigate on an ODROID N2+ with a Coral USB device.
My config with only 1 camera runs perfect. If I try to add a second camera I get these ffmpeg errors.
The first camera is an “old” Annke C800 and runs H264
The second camera is a New Annke C800 which runs with H265 only.

this is my error message:

terasse_annke: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
frigate.video INFO : terasse_annke: ffmpeg process is not running. exiting capture thread…
ffmpeg.terasse_annke.detect ERROR : [flv @ 0xaaaaee09bda0] Video codec hevc not compatible with flv
ffmpeg.terasse_annke.detect ERROR : Could not write header for output file #1 (incorrect codec parameters ?): Function not implemented

an this is my config:

detectors:
  coral:
    type: edgetpu
    device: usb
mqtt:
  host: 192.168.1.193
  port: 1883
  topic_prefix: frigate
  client_id: frigate
  user: mqtt_user
  password: mqtt
  stats_interval: 60
ffmpeg: {}
cameras:
  garten_annke:
    ffmpeg:
      inputs:
        - path: 'rtsp://admin:[email protected]:554/Streaming/Channels/101'
          roles:
            - detect
            - rtmp
            - record
            - clips
    width: 2560
    height: 1440
    fps: 8
  terasse_annke:
    ffmpeg:
      inputs:
        - path: >-
            rtsp://admin:[email protected]:554/Streaming/Channels/101
          roles:
            - detect
            - rtmp
            - record
            - clips
    width: 1920
    height: 1080
    fps: 8
clips:
  max_seconds: 300
  tmpfs_cache_size: 256m
  retain:
    default: 10
    objects:
      person: 15
objects:
  track:
    - person
    - cat
    - dog
    - bird
3421

The flv message is related to rtmp. You cannot use rtmp with h265, so you will need to disable that role for the second camera.

1 Like
3422

great thanks!

3423

this was to easy :wink:

3424

If I want to track everything. How do I apply this in config file? Feels kinda overkill to write down all of the 80 detectable objects.

3425

I too am curious about the value of a second coral. My 8 cam setup currently functions just fine on an old i5 box, but I have an open mini pcie slot and $25 to burn on a second coral if it will actually help drop CPU usage (which I think is the only thing that would really add value for me right now).

3426

Unless you have a lot of activity you are tracking, a 2nd Coral is unlikely to be of any benefit for CPU usage. Motion detection is done via the CPU, then the Coral does object detection on any images that Frigate has marked as having motion.

To lower your CPU usage, you could try using a substream with a lower resolution on your camera for the detect role. You could also use motion masks to prevent Frigate from using CPU cycles to analyze motion in areas where there’s unlikely to be an object you’re searching for (a person in the sky or a treetop, for instance). Using hardware acceleration arguments for ffmpeg also will drastically reduce your CPU usage. The docs give lots of helpful tips for optimizing performance.

Correct me if I’m wrong, @blakeblackshear!

2 Likes
3427

Awesome. OK then I think I’m good, as I’ve already accounted for everything you mentioned. As of now, it runs so well with very little overhead; all this talk of two corals just got me curious.

Thanks for the detailed response!

1 Like
3428

Other than preserving CPU, how to preserve bandwith?

I tried to remove “rtmp” role from cam and turn off detection from HA: I would expect that the stream will stop, but it doesnt.

My intention is to activate streaming, detection and clip only when alarm is active.

3429

Do you have a detect role still in place? Frigate has to decode the bitstream in order to detect.

3430

Apologies in advance, I’m sure I’m missing something obvious - I have installed the integration in HACS but it does not show up in the HA configuration UI. I confirmed in my HA log that the custom component was found and loaded.

Any pointers to help me debug?

Thanks

3431

After you’ve installed it, go to the HA configuration and click the “+ Add Integration” button in the bottom right. Search for “Frigate” and then follow the prompts in the form.

3432

Thanks for the quick reply. I’ve done that but it does not show up in the search.

3433

Did you restart HA after installing the integration in HACS?

3434

How do you turn on ffmpeg logging?
I tried

logger:
  default: info
  logs:
    frigate.mqtt: error
    ffmpeg.garden: info

but that does seem to work

3435

Yes, several times. Also rebooted just to be sure. No joy.

EDIT: Found the prob - app discovery was not enabled in HACS. Thanks for your help.

3436

I’m gone crazy for hours: clear browser cache.