Local realtime person detection for RTSP cameras

Share your Projects!
5796

Uncomment the very first line.

5797

Perfect! You really are covering everything in this project, highly appreciated, please share a donation link, I have to send something over, this project has made my life sooo much easier.

Just out of interest, are these planned/being-worked-on?

  1. Timeline to be able to nicely scroll through virtually a whole day’s worth of recording or more like in Milestone’s XProtect?

  2. HLS support for the Frigate card, for live video+audio monitoring of cameras? Maybe a new role, something like ‘live’, where those of us who have dedicated server-class nvidia GPUs can assign hardware ffmpeg to the input/output for streams?

For I, those are the only two things that would completely force me to wave goodbye to XProtect for good.

5798

I use github sponsors: Sponsor @blakeblackshear on GitHub Sponsors · GitHub

  1. There is a basic version of this under recordings in the existing UI, but there are plans for a better UI in the future.
  2. Yes, but I don’t expect the need for a GPU to use HLS. It should be a copy operation for cameras that are H264/AAC already. I am hoping to use LL-HLS.
1 Like
5799

Regarding 2:

Indeed, if one is fine with the stream efficiency from the camera for local live viewing. I just favour the more fine-tuning aspect for better bandwidth/quality customisation of the feeds for remote viewing (ie smartphone), something which as you know cameras don’t really excel in whereas ffmpeg with nvenc can achieve pretty impressive bandwidth/quality ratios with low latencies of around 20 to 40 frames, source permitting of course.

From a use-case/functional point of view. I like the jsmpeg integration for Frigate love-lace card. So I literally have a dashboard with all my primary cameras. At this point I want to view a particular camera in live mode with audio, so dream of clicking on a button on that relevant camera, and then that opens the HLS stream in fullscreen with audio, that would be perfect.

Although there is RTMP already there, it just doesn’t buffer ‘nicely’ across 4G and the spinner is quite annoying.

HLS definitely does a better job (looking at Shinobi javascript code, can see how it was done there and works quite well, unfortunately XProtect on the other hand is closed-source so have no idea about their code but wireshark does prove HLS is in play there via websockets in their mobile app with dynamic bandwidth logic, ie quality of stream goes up and down depending on bandwidth.

5800

Thanks for advise , containers is running however lots of error regarding FFMEG

`

[2021-11-11 15:15:45] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:15:45] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:15:46] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:15:46] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:15:55] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:15:55] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:15:55] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:15:55] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:15:55] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:15:55] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:15:55] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:15:55] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:15:55] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:15:55] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:15:56] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:15:56] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:05] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:05] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:05] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:05] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:05] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:05] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:05] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:05] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:05] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:05] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:06] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:06] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:15] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:15] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:15] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:15] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:15] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:15] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:15] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:15] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:15] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:15] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:16] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:16] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:25] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:25] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:25] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:25] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:25] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:25] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:25] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:25] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:25] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:25] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:26] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:26] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:35] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:35] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:35] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:35] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:35] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:35] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:35] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:35] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:35] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:35] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:36] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:36] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:45] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:45] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:45] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:45] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:45] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:45] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:45] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:45] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:45] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:45] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:46] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:46] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:55] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:16:55] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:55] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:55] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:16:55] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:16:55] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:16:55] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:16:55] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:16:55] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:55] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:16:56] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:16:56] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:05] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:05] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:05] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:05] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:05] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:05] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:05] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:05] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:05] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:05] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:06] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:06] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:15] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:15] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:15] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:15] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:15] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:15] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:15] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:15] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:15] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:15] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:16] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:16] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:25] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:25] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:25] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:25] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:25] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:25] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:25] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:25] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:25] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:25] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:26] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:26] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:35] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:35] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:35] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:35] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:35] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:35] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:35] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:35] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:35] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:35] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:36] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:36] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:45] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:45] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:45] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:45] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:45] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:45] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:45] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:45] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:45] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:45] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:46] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:46] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:55] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:17:55] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:55] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:55] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:17:55] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:17:55] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:17:55] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:17:55] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:17:55] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:55] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:17:56] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:17:56] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:05] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:18:05] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:05] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:05] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:18:05] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:18:05] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:05] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:05] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:18:05] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:05] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:06] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:06] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:15] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:18:15] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:15] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:15] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:18:15] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:18:15] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:15] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:15] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:18:15] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:15] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:16] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:16] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:25] watchdog.front ERROR : FFMPEG process crashed unexpectedly for front.

[2021-11-11 15:18:25] watchdog.front ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:25] watchdog.front ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:25] ffmpeg.front.detect ERROR : rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1: Input/output error

[2021-11-11 15:18:25] watchdog.garage_driveway ERROR : FFMPEG process crashed unexpectedly for garage_driveway.

[2021-11-11 15:18:25] watchdog.garage_driveway ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

[2021-11-11 15:18:25] watchdog.garage_driveway ERROR : You may have invalid args defined for this camera.

[2021-11-11 15:18:25] ffmpeg.garage_driveway.detect ERROR : rtmp://192.168.0.51/bcs/channel0_main.bcs?channel=0&user=admin&password=Garage1: Input/output error

[2021-11-11 15:18:25] frigate.video INFO : garage_driveway: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:25] frigate.video INFO : garage_driveway: ffmpeg process is not running. exiting capture thread…
[2021-11-11 15:18:26] frigate.video INFO : front: ffmpeg sent a broken frame. memoryview assignment: lvalue and rvalue have different structures
[2021-11-11 15:18:26] frigate.video INFO : front: ffmpeg process is not running. exiting capture thread…

Installed some args  but still have the same issue. Look on line but unable to find ad a solution. 
My  Config .yml now

detectors:
coral:
type: edgetpu
device:pci: 0

cpu1:

type: cpu

num_threads: 3

cpu2:

type: cpu

num_threads: 3

mqtt:
host: 192.168.0.81
user: mikey
password: mqtt6283

database:
path: /media/frigate/frigate.db

cameras:
front:
ffmpeg:
inputs:

- path: rtmp://192.168.0.48/bcs/channel0_main.bcs?channel=0&user=admin&password=Front1

   - path: rtsp://admin:[email protected]:554//h264Preview_01_main

- path: rtsp://viewer:{FRIGATE_RTSP_PASSWORD}@192.168.0.48:554/cam/realmonitor?channel=1&subtype=2

      roles:
        - detect
        - record
      hwaccel_args:
        -hwaccel vaapi
        -hwaccel_device /dev/dri/renderD128
        -hwaccel_output_format yuv420p
      input_args: 
        -avoid_negative_ts make_zero 
        -fflags +genpts+discardcorrupt 
        -rtsp_transport tcp 
        -stimeout 5000000 
        -use_wallclock_as_timestamps 1
      output_args:
        record: 
          -f segment 
          -segment_format mp4 
          -segment_time 10 
          -reset_timestamps 1 
          -strftime 1
          -codec:v h264_vaapi
          -global_quality 50
          -b:v 2M
          -maxrate 2M
detect:
    width: 640
    height: 480
    fps:  7```
5801

Github is the proper place for getting support.

5802

Hey @blakeblackshear, would you mind letting me know what I need to add to my config to include audio, been reading the docs and issues on github, but still not able to figure out what needs to be added to my config.

ffprobe output

  Metadata:
    title           : Media Server V4.40.015
    comment         : Media Server Session Description : standard
  Duration: N/A, start: 2.375000, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuv420p(progressive), 384x512, 8 fps, 8 tbr, 90k tbn, 16 tbc
    Stream #0:1: Audio: aac, 32000 Hz, mono, fltp

Frigate Config

mqtt:
  host: 192.168.200.211
  port: 1883
  topic_prefix: frigate
  client_id: frigate
  user: hassos
  password: password
  stats_interval: 30

detectors:
  coral:
    type: edgetpu
    device: usb

birdseye:
  width: 1536
  height: 2048
  quality: 1
  mode: continuous

cameras:
### DoorBell Camera
  frontdoor:
    ffmpeg:
      hwaccel_args:
        - -c:v
        - h264_v4l2m2m
      inputs:
        - path: rtsp://admin:[email protected]/streaming/channels/102
          roles:
            - detect
        - path: rtsp://admin:[email protected]/streaming/channels/101
          roles:
            - record
            - rtmp

    detect:
      width: 320
      height: 320
      fps: 5
      max_disappeared: 25

    record:
      enabled: true
      events:
        post_capture: 10
        retain:
          default: 5

    objects:
      track:
        - car
        - person
        - cat
        - dog

    motion:
      mask:
        - 37,193,320,192,320,0,44,0
        - 0,194,49,180,68,0,0,0
        - 180,312,184,290,0,295,0,310

    best_image_timeout: 30

    zones:
      Door:
        coordinates: 55,298,186,320,185,238,56,225,0,263
      Porch:
        coordinates: 176,320,320,320,320,210,183,237
      Steps:
        coordinates: 189,235,274,223,264,183,191,188

    rtmp:
      enabled: true

    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
        objects:
          person: 45

### South Side Camera 06
  south_side:
    ffmpeg:
      hwaccel_args:
        - -c:v
        - h264_v4l2m2m
      inputs:
        - path: rtsp://admin:[email protected]/streaming/channels/102
          roles:
            - detect
        - path: rtsp://admin:[email protected]/streaming/channels/101
          roles:
            - record
            - rtmp
    detect:
      width: 320
      height: 320
      fps: 5
      max_disappeared: 25

    record:
      enabled: true
      retain_days: 0
      events:
        post_capture: 10
        retain:
          default: 5

    objects:
      track:
        - person
        - cat
        - dog

    motion:
      mask:
        - 189,66,186,0,320,0,320,68
        - 0,299,0,320,94,320,96,298

    best_image_timeout: 30

    rtmp:
      enabled: true

    snapshots:
      enabled: true
      timestamp: true
      bounding_box: true
      retain:
        default: 30
        objects:
          person: 60
5803

Did you figure this out? Thoughts @blakeblackshear

5804

Since your camera is already sending audio in aac, you just need to remove the parameter that discards the audio.

Add this at the global level or at the camera level:

ffmpeg:
  output_args:
    record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy

The -an from the default command was removed.

5805

This generally happens when something is missing in the reverse proxy that forwards to Frigate. It is probably one of these lines that needs to be added to your nginx config inside the location block for frigate alongside the proxy_pass: frigate-hass-addons/proxy_params.conf at 833c2a2d2a9eb81d4b327167b6f1f239f18eccae · blakeblackshear/frigate-hass-addons · GitHub

5806

Thanks, so I added the following, and moved the hwaccel_args to global, is the following correct?

ffmpeg:
  global_args: -hide_banner -loglevel warning
  hwaccel_args:
    - -c:v
    - h264_v4l2m2m

cameras:
### DoorBell Camera
  frontdoor:
    ffmpeg:
      output_args:
        record: -f segment -segment_time 10 -segment_format mp4 -reset_timestamps 1 -strftime 1 -c copy
      inputs:
        - path: rtsp://admin:[email protected]:9092/streaming/channels/1602
          roles:
            - detect
        - path: rtsp://admin:[email protected]:9092/streaming/channels/1601
          roles:
            - record
            - rtmp

Also, since adding the TPU and the second camera the cpu use seems to be higher, is there additional config I need to add to reduce the cpu usage?

5807

Greetings,
please help somebody (dont have much time)
I have HAOS a second user with non-admin rights and when user open Frigate(addon) this shows:

SUPERVISOR
Unable to fetch add-on info to start Ingress

5808

I’m having another shot at frigate - always had issues setting it up.
Same old issues with the config.yml

mqtt:
  host: 192.168.1.163
  user: user
  password: pass
cameras:
  frontyard:
    ffmpeg:
      inputs:
        - path: rtsp://user:[email protected]:554/Channel/01
          roles:
            - detect
            - rtmp
    detect:
      width: 1280
      height: 720

container will not start due to this error:

Error parsing config: extra keys not allowed @ data['cameras']['frontyard']['detect']['width']

I thought my syntax was the most up to date, looked at all the examples and followed them.

Can anyone suggest a different format/syntax please?

Thanks

5809

This means you are using an old version of frigate with a new config. Check the image you are using to make sure its 0.9.4.

1 Like
5810

Thanks. That was it! Thought I was using the latest pull command

5812

Trying to figure out a way to send a snapshot from nodered.
I see the mqtt payload is

frigate/<camera_name>/<object_name>/snapshot

But how to encode that and end a jpg though telegram on nodered I’m stuck.
Do I need to extract it from the original folder path where it is stored?

Thanks

5813

Hi! Can someone help me here? I am using a Pi 4 with Hassio. I cannot understand if I should be using 1, 2 or more CPU detectors. Can someone explain to me what is a CPU detector and what might be the best config? I am running 4 cameras with low resolution 2 detector (CPU idles in 30% and inference speed for the cpus vary from 150 when no movent to 600 with a lot of motion) and I am missing some events. This can be because of the hight inference speed (that I would love some detailing of what it is)

Thanks a lot!

5814

4 cpu detector but you will still miss detections and have poor function. CPU is not recommended

https://docs.frigate.video/configuration/detectors/#cpu-detectors-not-recommended

look at logs. detector probably cannot keep up and this will not improve much with more CPU.
I use single TPU and with 10 cameras i have inference speed of 7 with heavy movement and no loss. blake has said before that frigate was intended for use with TPU

1 Like
5815

Yeah, I am reducing my config for 2 cameras, 4 was way too much. Regarding the TPU, I would love to get my hands on one, but I am from Brazil and prices for that hardware are out of this world (and they are OOS everywhere).
Another question, what about hwaccel? When I tried it seems to increase CPU usage but couldn’t find it bringing more accuracy on the events. It makes a difference using a Pi 4 with CPU and no TPU?

5816

it is balance.

CPU can handle xx images per second. Adjust frame rates and needed detections to stay within this limit. Nothing you do will make much difference I believe but finding good balance and you will be OK

what is current frame rate? lowering the frame rate will reduce the detections and reduce the number of image processing request to CPU. Image processing is biggest hog of resource on CPU. even using TPU, CPU manage the detection but detection only is not big problem for CPU. Image Processing on CPU is slow so causes backlog and eventually missed detection. I imagine this was improved when clips merge with recording but not sure.

try lower framerate and find minimum framerate that allow the detection of object in needed time (catch moving vehichle passing quickly or impatient person at doorbell before they leave). this will be more useful to you. Yes, hwacel help but not significant gain

I think at one point I was able to look in logs and see how long it take to process image. At t