Local realtime person detection for RTSP cameras

[denver]

Does anyone know why the clips are showing in media/browser like this:

The clips do play perfectly ok.

Thanks again

[Eeeeeediot]

@lawrence-jeff

Interesting I have a 410 as well and use the RTMP stream for both without issues, tons of clips…I have the same parameters in ffmpeg and running at the same resolution/fps. I am on all wired… do you have wireless in the mix? Is your camera firmware up to date?

@srk23

If it helps, after some trial and error this is the setup that I got working with my Reolink RLC-410-5MP cameras. Initially with the older non-beta build, the RTSP streams were working fine, but when I switched to the 0.8 beta they had a lot of smearing. I switched to RTMP which improved things, but then when I tried to record clips off the RTMP stream the camera crashed of froze resulting in an FFMPEG crash.

Solution: Use the RTMP stream for detection, and the RTSP stream for clips:

I have the 410 also and it seems a bit more stable now thanks. I see you have fps: 5 in your config - have you set your camera to 5 fps and if so how have you manged this - i only have 4, 7, 15. When i set it to 4 or 7 I noticed that my clips were stuttering and jumping - I think it was today with both values not being equal and skipped frames. I have since made both values 7 and the clips are good but at the expense of more CPU

[srk23]

Stream is set to 7fps on the camera. Replay of clips does stutter a bit - I will change it to 7 and see if it helps - thanks!

[lawrence-jeff]

I have 7 in the config for mine. No issues I have noticed

[lawrence-jeff]

@denver

Does anyone know why the clips are showing in media/browser like this:

The clips do play perfectly ok.

Thanks again

I think media browser shows the snapshot not part of the clip, that is why it has bounding boxes even through they aren’t on any frame of the clip. I would focus on your snapshot parameters

[denver]

Thank you, will do.

[denver]

Solved: Height and width in config > cameras didn’t match rtsp settings .

[rhatguy (Travis)]

When you say latest have you upgraded your Reolink cameras to the html based firmware? I’ve upgraded one in December and my rtmp stream and web gui haven’t worked since. I’ve been emailing back and forth with support since then. I wanted to switch frigate over to rtmp on the newest firmware but since the first upgrade went so poorly I haven’t upgraded any more yet to see if they have the same issue.

[srk23]

I have the latest firmware for my cameras from the reolink site. I can access them from both the reolink desktop software, and directly through the integrated webserver with no issues.

[srk23]

So matching the stream and clip fps didn’t do much for the playback smoothness, but it does seem to have reduced my CPU usage from 60% to 6%!!

[lawrence-jeff]

What playback issues are you having… is it high resolution clips? i have my clips generated off the detect stream (640x480x7) and they play ok.

[WhistleMaster (Wm)]

I’ve noticed that when using camera.snapshot on a camera created by the Frigate custom component, the snapshot size height is 277 due to this line.

Is there another way to get the full size when using camera.snapshot ? Thanks !

[srk23]

High-res clips. Almost certainly network or problems with lack of hardware decoding in my HA vm rather than a recording problem. Not really a major issue.

[danbutter]

If you are using the beta and custom component you can use the snapshot config section to change it.

    snapshots:
      # Optional: Enable writing jpg snapshot to /media/frigate/clips (default: shown below)
      enabled: False
      # Optional: print a timestamp on the snapshots (default: shown below)
      timestamp: False
      # Optional: draw bounding box on the snapshots (default: shown below)
      bounding_box: False
      # Optional: crop the snapshot (default: shown below)
      crop: False
      # Optional: height to resize the snapshot to (default: original size)
      height: 175

Just change the height. I did this to get a snapshot at the same res of my cameras output so I could see the whole picture rather than just the object detected in that frame.

[WhistleMaster (Wm)]

Thanks for your answer. I have already configured it to have a full size height, but this does not affect the camera.snapshot service as you can see on Frigate custom component github, line 51, where the height of 277 is hard coded.

You can try yourself, calling the camera.snapshot service on HA, you’ll get a 277 height picture.

[Eeeeeediot]

Does anyone have a doorbell automation that they wouldn’t mind sharing? I have a camera with frigate right above my front door and would like a snapshot from frigate sent to me when the button is pressed.

The action part of this automation is form the docs but it doesn’t seem to work

  - alias: 'Doorbell Snapshot'
    trigger:
    - platform: state
      entity_id: binary_sensor.doorbell_button
      to: 'on'
    condition:
      - condition: state
        entity_id: group.family
        state: 'home'
    action:
    - service: notify.mobile_app_stephen_s20
      data_template:
        title: 'Someone is at the door'
        message: "{{now().strftime('%H:%M')}}".
        data:
          image: 'https://xxxxxxxxxxxxxxx.ui.nabu.casa/api/frigate/notifications/{{trigger.payload_json["after"]["id"]}}.jpg?format=android'
          tag: '{{trigger.payload_json["after"]["id"]}}'

[WhistleMaster (Wm)]

It depends if your device is an android or an iPhone. Your automation is for android, maybe that’s why it doesn’t work.

[denver]

This is mine:

alias: Door bell
description: ''
trigger:
- platform: state
  entity_id: switch.door_push_button
  from: 'off'
  to: 'on'
condition: []
action:
- service: notify.trevor_angela_ios_group
  data:
    message: Someone's at the door!
- service: browser_mod.more_info
  data:
    entity_id: camera.doorcam_sd
    deviceID:
    - tablet_kitchen
    - tablet_office
    large: true
- delay: 00:00:45
- service: browser_mod.close_popup
  data: {}
mode: single

It doesn’t give a snapshot but a live video feed in a popup window that closes after 45 seconds on both tablets and just a popup message on our iPhones

[danbutter]

We must be doing two different things that sound similar. Check my post from about two weeks ago to see what I’m doing. I definitely get full frame images sent through to telegram.

Local realtime person detection for RTSP cameras

This is the automation I use. Should be pretty easy to edit to work for you with pushover. Just keep in mind that this is using the .80 beta3 and the home assistant integration. Otherwise these cameras don’t exist to pull snapshots from. If one knows where these snapshots are stored by mqtt it would be even simpler. This is just my workaround. alias: Frigate Person Frontyard description: '' trigger: - platform: state entity_id: sensor.frigate_frontyard_person to: '1' condition: []…

[cybertza]

Hi, Would you be able to show some of your configs, I have an near identical setup, having some issues getting the media browser part working

Do you just plainly mount the unraid folder onto the /media/ folder?