Local realtime person detection for RTSP cameras

Do you have any errors in the log. Can you see the video feed in the WebUI?

Yes, webUI is fine, with list of events (person) and snapshots. Live stream is good as well.
Log:

* Starting nginx nginx
   ...done.
frigate.app                    INFO    : Creating directory: /tmp/cache
frigate.app                    INFO    : Creating tmpfs of size 256m
Starting migrations
peewee_migrate                 INFO    : Starting migrations
There is nothing to migrate
peewee_migrate                 INFO    : There is nothing to migrate
frigate.app                    INFO    : Camera processor started for hik1: 41
frigate.app                    INFO    : Camera processor started for hik2: 43
frigate.app                    INFO    : Camera processor started for aicam: 45
frigate.app                    INFO    : Capture process started for hik1: 46
frigate.app                    INFO    : Capture process started for hik2: 47
frigate.app                    INFO    : Capture process started for aicam: 49
frigate.mqtt                   INFO    : MQTT connected
detector.coral                 INFO    : Starting detection process: 38
frigate.edgetpu                INFO    : Attempting to load TPU as usb:0
frigate.edgetpu                INFO    : TPU found
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x56171c5cb140] moov atom not found
/media/frigate/recordings/hik2-20210123142335.mp4: Invalid data found when processing input
frigate.record                 INFO    : bad file: hik2-20210123142335.mp4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x55c20db89140] moov atom not found
/media/frigate/recordings/aicam-20210123142337.mp4: Invalid data found when processing input
frigate.record                 INFO    : bad file: aicam-20210123142337.mp4
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x557278b2a140] moov atom not found
/media/frigate/recordings/hik1-20210123142335.mp4: Invalid data found when processing input
frigate.record                 INFO    : bad file: hik1-20210123142335.mp4

Invalid data appears only once after restart.

That all seems normal. When looking at the video feed in the webui with motion boxes, regions, and bounding boxes enabled, what do you see when a person walks in the feed? You wont see anything come across that mqtt topic unless something is detected. Also, what stats do you see on the debug page in the UI? Are your camera_fps values what you would expect?

FPS seems to be OK.

Strange. Did this happen with RC3? Maybe I broke something in RC4.

Oh, I’m so sorry, just discovered that initial_state of my automation was false.
Frigate works as it supposed to be. I have another error now in HA:

Last logged: 15:01:23
Error sending photo: Image_process_failed. Args: (), kwargs: {'chat_id': 312164519, 'photo': <_io.BytesIO object at 0x7f8674f11cc0>, 'caption': 'A person was detected on hik1 camera', 'disable_notification': False, 'reply_markup': None, 'timeout': None, 'parse_mode': 'Markdown'}
Error sending photo: Image_process_failed. Args: (), kwargs: {'chat_id': 312164519, 'photo': <_io.BytesIO object at 0x7f8677eef2c0>, 'caption': 'A person was detected on hik1 camera', 'disable_notification': False, 'reply_markup': None, 'timeout': None, 'parse_mode': 'Markdown'}
Error sending photo: Image_process_failed. Args: (), kwargs: {'chat_id': 312164519, 'photo': <_io.BytesIO object at 0x7f867d048d60>, 'caption': 'A person was detected on hik1 camera', 'disable_notification': False, 'reply_markup': None, 'timeout': None, 'parse_mode': 'Markdown'}
Error sending photo: Image_process_failed. Args: (), kwargs: {'chat_id': 312164519, 'photo': <_io.BytesIO object at 0x7f867f3e6630>, 'caption': 'A person was detected on hik1 camera', 'disable_notification': False, 'reply_markup': None, 'timeout': None, 'parse_mode': 'Markdown'}
      - service: notify.telegram
          data_template:
            message: 'A {{trigger.payload_json["after"]["label"]}} was detected.'
            data:
              photo:
                - url: 'http://192.168.2.4:5000/events/{{trigger.payload_json["after"]["id"]}}/snapshot.jpg'
                  caption : 'A {{trigger.payload_json["after"]["label"]}} was detected on {{ trigger.payload_json["after"]["camera"] }} camera'


Or should URL address to be with public IP?

This needs to be http://192.168.2.4:5000/api/events/{{trigger.payload_json["after"]["id"]}}/snapshot.jpg

1 Like

Probably not related to the Frigate directly, but on screenshot in documentation we can see nice thumbnails with detected objects. My Media Player Browser shows only common icons.
image

You need to use the integration to get the thumbnails and other features: https://github.com/blakeblackshear/frigate-hass-integration

I’m using the integration with 0.8.0 RC4 and if I go to media browser - frigate - clips I have zero items even though I have put snapshots in my config. I have the switch entity for snapshot turned on in the integration, but nothing shows up. Even tossed in the mqtt snapshot to try and get them to show up.

Could we get another directory for just snapshots instead of having them under clips? It would be more intuitive.

relevant part of config:

cameras:
  frigate_frontyard:
    ffmpeg:
      inputs:
        - path: >-
            rtsp://aaa:[email protected]:554/cam/realmonitor?channel=1&subtype=2
          roles:
            - detect
    height: 720
    width: 1280
    fps: 5
    snapshots:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: false
      height: 720
      retain:
        default: 5
        objects:
          person: 5
    mqtt:
      enabled: true
      timestamp: false
      bounding_box: true
      crop: false
      height: 720

Can anyone see what I’m missing?

Thanks

I will need to add the snapshots separately to the media browser. Currently that only supports the clips.

Thanks again. I thought before, that in case of hassio addon separate integration is not needed.
I have time in AM/PM format in Media Browser. Is there any option to display time in 24h format on the clips/recording folders?

Maybe someone had the similar issue…
Clips not playing in HA browser.
Tried on versions:
frigate: 0.8.0-beta2-amd64, 0.8.0-rc[2-4]-amd64
Home Assistant: “2020.12.2” and “2021.1.[1-5]” versions.

In debug console I see 404:


but file 100% exists (I can download and play it). Also in Frigate UI everything work.

Can you open an issue and include the requested info?

In installation section of documentation I can see:

 docker run --rm \
--name frigate \

Option --rm automatically remove the container when it exits (stop/restart). Is it intended?

Opened and added more info, Clips not playing in HA browser · Issue #21 · blakeblackshear/frigate-hass-integration · GitHub
Thanks.

Upgraded from 1.2 to 1.7 and it broke a few things. Got everything sorted out, except the integration. Entities were unavailable, so I removed it and re-added. It will not connect and shows error “Unable to connect to frigate”. Tried using http://ccab4aaf_frigate-beta:5000, http://ccab4aaf-frigate-beta:5000, http://ccab4aaf-frigate:5000, hardcoding the URL, etc with no luck. Frigate is running and everything seems to be fine with no errors in the logs. Tried rebooting multiple times. It worked before, no issues. Any ideas?

http://ccab4aaf-frigate-beta:5000/ should be the correct address for the integration when using the addon. Can you access the new WebUI on port 5000? What about the side panel? Also check the homeassistant and supervisor logs.

Not saying this is the issue, but a few people now have had similar issues when the mqtt broker doesn’t have a user and password configured in the frigate addon config.
Could be something to look into.

1 Like

Could someone please help me with the following error message? It seems Frigate is crashing. I red that Bus error could be related to the shm size. However, some post says this should be solved in release 0.7.

I am running Frigate 0.7.3 as a plugin version 1.3 on a supervised HASSIO installation on top of Ubuntu.

Any help is much appreciated.

PS! Thanks for a great plugin @blakeblackshear!

Edit: I have not (been able to) change shm in the docker container as I am uncertain how to do it appropriately.

 * Debug mode: off,
Fatal Python error: Fatal Python error: Bus error,,
r,
Thread 0x00007f64e5ab1700 (most recent call first):,
  File "/Thread 0xus00007f64e5ab1700r (most recent call first):,
/  File li"b//puysthro/nl3i.8b//tphryetahdionng3.p.y8"/t, line h302r in ewaaditi,
n  File g"./upsyr"/l, line ib302/p in ywtahoint3,
.  File 8/"m/uulstri/plriobc/epsystinhgo/qnu3e.ue8s/.pmyu", line lt227i in p_freoedc,
es  File "s/iunsgr//qluiebu/epsyt.phoyn"3, line .8227/ in t_hrfeeaedidn,
g.  File p"y/"us, line 870r in /rluinb,
/  File py"t/huosrn3/.l8ib//thpyrethaodni3n.g8./ptyh"r, line e870a in driunn,
g.  File p"y/"u, line s932r in /_bloiobt/stpraypt_hinonner3,
.  File "8//utshr/rleaidbi/pnyg.tphyon", line 3.9328 in /t_hbroeaodtisngt.prya"p, line _890 in i_nbnoeorts,
t  File r"ap/,
u,
sCurrent thread 0xr00007f64e32b0700/ (most recent call first):,
  File li"/bo/ppt/yftrihgoant3e/.f8ri/gtather/evaiddieno.gp.yp"y", line , line 139 in 890c in ap_tbuoreo_tfrsamtersa,
p  File ,
",
/Current thread 0xop00007f64e32b0700t (most recent call first):,
/  File fr"ig/aotpe/tf/rifgratieg/vaitdeeo./pfyr", line i235g in rautne,
/  File "v/iusdre/o.lipby/", line py139t in hcona3p.t8/utrhree_adfinrga.mpye"s, line 932,
 in   File _b"oo/tosptrta/p_firnniegr,
a  File t"/eu/srf/rliibg/payttheo/n3v.i8/dtehor.epayd"i, line 235n in gr.upny",
, line   File 890" in /_buosorts/tlraipb,
/Thread 0xp00007f64dc112700y (most recent call first):,
t  File h"o/onpt3/.f8r/itghatree/afdriignagte./vpiyd"eo, line .932p in y_"b, line 208o in ortustnr,
a  File "p/_uisnrn/elir,
b/  File p"yt/houns3r.8//ltihbr/eapdyitngh.opny"3, line .9328 in _/btohotrsetaradpi_inngne.rp,
y  File ""/u, line s890r/ in l_ibb/opyotthosnt3r.a8p/,
t,
hThread 0xr00007f64dc112700 (most recent call first):,
ea  File d"i/ngop.tpy/"f, line r890 in i_bgoaottset/rafpr,
iThread 0xg00007f65159c1740 (most recent call first):,
a  File t"e//usvri/dliebo/.pyptyh"on, line 3.2088/ in trhurena,
di  File n"g./puy"s, line r1027/ in l_iwba/ipt_ytfhoron_3ts.t8/atthe_reloacdikn,
g  File ."p/yu"sr, line /932l in i_bb/opoytstthroanp3._8i/tnhnreeardi,
n  File g."p/y"u, line s1011r in /jloiibn/,
p  File y"t/ohpotn/3f.r8ig/atther/feraidgaitne/gv.ipdeyo"., line py890" in , line _242b in ocoapttsutrre_acpam,
e,
rThread 0xa00007f65159c1740,
 (most recent call first):,
  File   File "/"u/sur/slrib//lpiytbh/onpy3.th8o/nm3u.l8t/iptrhorceesasidngi/npgro.cpesys".p, line y"1027, line  in 108_ in rwuan,
i  File t"_/fuosrr/_ltisbt/apytteho_nl3o.8c/km,
ul  File ti"p/ruocserss/ilnigb//ppryotcheosns3..py8"/, line 315t in h_broeoatdstirnagp.,
p  File y""/u, line s1011r in /ljibo/ipnyt,
h  File on"3/.o8/pmtul/tfirpriogcaestsein/gf/rpiopgeatn_ef/ovrikd.epoy."p, line 75y in "_l, line a242u in ncch,
a  File p"t/uusrre/l_icb/apmyethroan,
3  File .8"//muusltri/lpirbo/cpeystshionng/3.p8o/pmeulnt_ifporrko.cepsys"i, line n19g in /p_r_oicneits_s_.,
p  File y"/", line us108r in /rluinb,
/  File p"y/tuhsonr3/.l8i/mbu/lptiyptrohcoesns3in.g8/c/omntuelxtti.ppyr"o, line c277e in ss_Pinogp/enpr,
  File o"c/eusssr./plyi"b, line /315p in y_tbhooon3t.st8r/mapu,
l  File t"i/uprsorc/eslsiibng//pcoyntthexotn.p3y."8, line /224 in m_uPlotipeprno,
c  File e"s/susirn/gl/ibp/oppytehno_n3f.o8r/mku.lptiypr"o, line ce75s in si_nlga/puronccehs,
s.  File p"y"/, line u121 in ssrta/rlti,
b/  File p"ydtehteocnt3._o8b/jmeuclttsi.ppry"o, line c274e in smasiin,
n  File g"/dpeotepcetn_o_bfjoecrtks..ppyy", line "441, line  in <19m in o_du_lie>n,
it__,
  File "/usr/lib/python3.8/multiprocessing/context.py", line 277 in _Popen,
  File "/usr/lib/python3.8/multiprocessing/context.py", line 224 in _Popen,
  File "/usr/lib/python3.8/multiprocessing/process.py", line 121 in start,
  File "detect_objects.py", line 274 in main,
  File "detect_objects.py", line 441 in <module>,
Fatal Python error: Bus error,
Thread 0x00007f64e5ab1700 (most recent call first):,
  File "/usr/lib/python3.8/threading.py", line 302 in wait,
  File "/usr/lib/python3.8/multiprocessing/queues.py", line 227 in _feed,
  File "/usr/lib/python3.8/threading.py", line 870 in run,
  File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner,
  File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap,
Current thread 0x00007f64e32b0700 (most recent call first):,
  File "/opt/frigate/frigate/video.py", line 139 in capture_frames,
  File "/opt/frigate/frigate/video.py", line 235 in run,
  File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner,
  File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap,
Thread 0x00007f64dc112700 (most recent call first):,
  File "/opt/frigate/frigate/video.py", line 208 in run,
  File "/usr/lib/python3.8/threading.py", line 932 in _bootstrap_inner,
  File "/usr/lib/python3.8/threading.py", line 890 in _bootstrap,
Thread 0x00007f65159c1740 (most recent call first):,
  File "/usr/lib/python3.8/threading.py", line 1027 in _wait_for_tstate_lock,
  File "/usr/lib/python3.8/threading.py", line 1011 in join,
  File "/opt/frigate/frigate/video.py", line 242 in capture_camera,
  File "/usr/lib/python3.8/multiprocessing/process.py", line 108 in run,
  File "/usr/lib/python3.8/multiprocessing/process.py", line 315 in _bootstrap,
  File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 75 in _launch,
  File "/usr/lib/python3.8/multiprocessing/popen_fork.py", line 19 in __init__,
  File "/usr/lib/python3.8/multiprocessing/context.py", line 277 in _Popen,
  File "/usr/lib/python3.8/multiprocessing/context.py", line 224 in _Popen,
  File "/usr/lib/python3.8/multiprocessing/process.py", line 121 in start,
  File "detect_objects.py", line 274 in main,
  File "detect_objects.py", line 441 in <module>,