Frigate person detection

Pedro1x · March 25, 2025, 4:11am

Hi,
I have frigate setup with my cameras, but on home assistant, I have 2 main issues:
1- Motion is always detected (it seems to be triggered by small light changes) , is there a way to specify sensitivity?
2- Person detection is showing as unknown all the time.
This is how it’s configured on frigate for that camera:

cam7:
    ffmpeg:
      inputs:
        - path: 
            https://camera-ip-address

          roles:
            - detect

      
    detect:
      width: 640
      height: 360
      
    objects:
      track:
        - person
       

    snapshots:
      enabled: true
      retain:
        default: 10

This is how it shows in home assistant:

Tamsy · March 26, 2025, 12:29am

Much to little information given to pinpoint why object detection doesn’t work.

On what hardware are you running Frigate?
Post the whole conf, not just a snippet you think is relevant.
Where are the referring Frigate logs?

A good point to start with Frigate Object Detection you will find HERE.

Look-up about Tuning Motion Detection.

Pedro1x · March 26, 2025, 2:50am

Here is the config file

# /config/config.yml

mqtt:
  host: MyIP
  port: 1883
  topic_prefix: frigate
  user: MyUser
  password: Mypassword
  stats_interval: 300


birdseye:
  enabled: true
  mode: continuous

detectors:
  coral1:
    type: edgetpu
    device: pci:0
   
  coral2:
    type: edgetpu
    device: pci:1
    
  coralusb:
    type: edgetpu
    device: usb

cameras:
  

  cam7:
    ffmpeg:
      inputs:
        - path: 
            https://camera-ip-address

          roles:
            - detect

      
    detect:
      width: 640
      height: 360
      
    objects:
      track:
        - person
       

    snapshots:
      enabled: true
      retain:
        default: 10


  
record:
  enabled: false

snapshots:
  enabled: false



go2rtc:
  # Even if you have no streams, at least define this section as empty
  streams: {}

# For NGINX, disable TLS or set some defaults
tls:
  enabled: false
version: 0.15-1

Pedro1x · March 26, 2025, 2:55am

It’s running on a zima board.

Tamsy · March 26, 2025, 2:57am

You have 3 Coral TPUs, 2 x PCI-types, 1 x USB-type?

Pedro1x · March 26, 2025, 4:05am

That could be the issue?

Tamsy · March 26, 2025, 4:06am

Which Coral TPU do you really (physically) have connected?

Restart Frigate and copy its startup-logfile in here.

Pedro1x · March 26, 2025, 4:18am

The 3 of them are connected.

Pedro1x · March 26, 2025, 4:22am

2025-03-26 00:19:34.428171593 [2025-03-26 00:19:34] peewee_migrate.logs INFO : Starting migrations
2025-03-26 00:19:34.444800315 [2025-03-26 00:19:34] peewee_migrate.logs INFO : There is nothing to migrate
2025-03-26 00:19:34.544915820 [2025-03-26 00:19:34] frigate.app INFO : Recording process started: 397
2025-03-26 00:19:34.562822984 [2025-03-26 00:19:34] frigate.app INFO : Review process started: 406
2025-03-26 00:19:34.570622393 [2025-03-26 00:19:34] frigate.app INFO : go2rtc process pid: 98
2025-03-26 00:19:34.625453810 [2025-03-26 00:19:34] detector.coral1 INFO : Starting detection process: 413
2025-03-26 00:19:34.641946528 [2025-03-26 00:19:34] frigate.detectors.plugins.edgetpu_tfl INFO : Attempting to load TPU as pci:0
2025-03-26 00:19:34.642346191 [2025-03-26 00:19:34] frigate.detectors.plugins.edgetpu_tfl INFO : TPU found
2025-03-26 00:19:34.642459165 [2025-03-26 00:19:34] detector.coral2 INFO : Starting detection process: 419
2025-03-26 00:19:34.658621751 [2025-03-26 00:19:34] frigate.detectors.plugins.edgetpu_tfl INFO : Attempting to load TPU as pci:1
2025-03-26 00:19:34.658633047 [2025-03-26 00:19:34] detector.coralusb INFO : Starting detection process: 432
2025-03-26 00:19:34.666236738 [2025-03-26 00:19:34] frigate.detectors.plugins.edgetpu_tfl INFO : TPU found
2025-03-26 00:19:34.699320065 [2025-03-26 00:19:34] frigate.app INFO : Output process started: 466
2025-03-26 00:19:35.178435428 [2025-03-26 00:19:35] frigate.app INFO : Camera processor started for cam7: 545
2025-03-26 00:19:36.013487539 [2025-03-26 00:19:36] frigate.api.fastapi_app INFO : Starting FastAPI app
2025-03-26 00:19:36.836972264 [2025-03-26 00:19:36] frigate.api.fastapi_app INFO : FastAPI started
2025-03-26 00:19:37.313328609 [2025-03-26 00:19:34] frigate.detectors.plugins.edgetpu_tfl INFO : Attempting to load TPU as usb
2025-03-26 00:19:37.321750050 [2025-03-26 00:19:37] frigate.detectors.plugins.edgetpu_tfl INFO : TPU found
2025-03-26 00:19:41.200380546 [2025-03-26 00:19:41] frigate.video ERROR : cam7: Unable to read frames from ffmpeg process.
2025-03-26 00:19:41.201601767 [2025-03-26 00:19:41] frigate.video ERROR : cam7: ffmpeg process is not running. exiting capture thread…
2025-03-26 00:19:55.749649907 [2025-03-26 00:19:55] watchdog.cam7 ERROR : Ffmpeg process crashed unexpectedly for cam7.
2025-03-26 00:19:55.749712542 [2025-03-26 00:19:55] watchdog.cam7 ERROR : The following ffmpeg logs include the last 100 lines prior to exit.

Tamsy · March 26, 2025, 5:04am

Something is wrong with calling ffmpeg for cam7 on your system.

Port? Protocol?

Look HERE how to setup your cam(s) correctly.

Pedro1x · March 26, 2025, 5:09am

rtsp://userf:password@IP_Address:554/stream0

I am able to see the camera feed on Frigate.

Why did you ask me about the TPU? My original issue is the sensor on home assistant, does the TPU affect that? I could remove them.

Tamsy · March 26, 2025, 5:19am

I was wondering about 3 Coral TPU-units just for 1 cam

Then: Are those 3 TPUs getting detected and initialized correctly? The log-snipped shows they are

But the snippet also shows that the ffmpeg-stream for cam7 is broken. Hence before going back to the Frigate person detection issue fix your ffmpeg stream because that stream is getting fed into the TPU(s) for getting further analyzed (for object detection).

Pedro1x · March 26, 2025, 5:23am

ffmpeg seems to be crashing. but can’t figure out why.
I am not using go2rtc. Maybe I should give it a try.

Tamsy · March 26, 2025, 5:27am

go2rtc is integrated into the HA core since Home Assistant 2024.11. Further readings about the latter HERE.

Pedro1x · March 26, 2025, 5:28am

My frigate is not installed on home assistant. It has its own server.

Tamsy · March 26, 2025, 5:37am

Thank you for letting us know.

As an example from the docs:

go2rtc:
  streams:
    reolink_cam: http://192.168.0.139/flv?port=1935&app=bcs&stream=channel0_main.bcs&user=admin&password=password

…and then refeed the stream into ffmpeg like i.e.:

cameras:
  reolink_cam:
    ffmpeg:
      inputs:
        - path: http://192.168.0.139/flv?port=1935&app=bcs&stream=channel0_ext.bcs&user=admin&password=password
          input_args: preset-http-reolink
          roles:
            - detect
        - path: rtsp://127.0.0.1:8554/reolink_cam
          input_args: preset-rtsp-generic
          roles:
            - record

dharvey24 · March 26, 2025, 6:35am

What version of Frigate do you have installed? The most recent version has much more user friendly interface. Much of the settings can be edited without the need to edit the config. Its more institutive.