Facial recognition & room presence using Double Take & Frigate

Seeing this older comment now, but want to second my interest in object recognition. One of my use cases is having it recognize my car while driving up the driveway. I know I can do license plate recognition, but I think object recognition could handle it just fine. Also, I think it would be cool to recognize other peoples cars.

Example: A friend visits, and when the friend’s car is recognized, Frigate stops recording and detecting on indoor cameras. That way the recording can be stopped before recognizing the person, but more importantly the recording and detection can start again once the friend’s recognized vehicle leaves, since the outdoor cameras will no longer detect the car.

Im running double take fine so far testing all sorts of resolutions at the minute to reduce false negatives etc. I have some nice simple automations in node red where a known person detection changes tho whole equation... however sometimes I get a pause in double take for some reason ... Im looking at frigate and I can see movment detection working but then double take doesnt present any snapshots for lets say 30 seconds ... im wondering if it is the mqtt server …

Also im writing the images on a synology nas with hdds .. Im wondering if it would speed up adding some SSDs to the host of proxmox and record directly there ? I mean its by no means slow however I feel like there is sometimes a little bit of lag in showing pressence from one camera to the other …

First of all, thank you so much for creating the addons for Home Assistant. I am learning, but slowly, and the addons make things much simpler. I now have Frigate, MQTT, Deepstack, and Double Take running with no errors. After reading and rereading the docs, I still have a couple questions/problems:

  1. If I try to try to upload photos into Double Take to use for training, nothing happens. I get the prompt to select the files, but after selecting them and clicking OK, nothing happens.

  2. My uderstanding is that I should have a sensor created in home assistant for each user that I have defined (trained). However I only get 3 sensors, 1 for each of my 2 cameras, and one that is called sensor.double_take_unknown. Should I get a sensor for each person?

Thanks in advance for any help.

Hey @tbrausch, thank you for checking out Double Take.

I’ve attached a GIF of what should happen for #1. Can you look at the logs and see if there are any errors that occur right after the upload?

The people sensors for #2 only get created when there is a positive match for that person. I may tweak this in a future release, but if there have been no matches for the person you created, then the sensor won’t be created yet. In your case it seems like all the results have been for the “unknown” person. If you jump over to our Discord server, I can help you fine tune your config to give you more matches.

2021-11-27 13.37.01

1 Like

Happy to announce with the help of others we have a Home Assistant CompreFace Add-on which includes persistent storage.

5 Likes

first of all i want to say thank you it’s an amazing tool,
i have a problem with the new version it’s keep crashing ever since i upgraded

Basically, after I select the image and click OK, the dialog box disappears and it acts like I cancelled the operation. There are no errors reported in the log. My home assistant is running on a separate linux installation, but my main system is windows based. This is where I have been trying to upload an image from. I tried the same thing from the linux server that home assistant is running on and the upload worked OK. Should this work from a browser in windows? I will get with you soon for help on my config - I tried the new Compreface add-on and am having some difficulty getting it running.

Edit: My bad - I was running the instance of home assistant on windows via https, as soon as I changed it to http the file upload worked fine. Sorry for the trouble.

Hello,

I’m pretty new to all the AI stuff. I’m currently running Blue Iris and have already purchased a Jetson Nano for DeepStack and compreface (once supported). DeepStack for BlueIris mainly, or will that become obsolete with Double Take? Now the question is how do I integrate Double Take with BlueIris? What exactly do I have to consider to be able to use the room detection or to detect if a stranger is in the house or to open the door when you are standing in front of the door? (Would probably be quite insecure since no depth scan, any image would probably work then?)

Sorry, this question is rather general. I don’t know yet exactly how to implement it at all.

It depends on what you are running BlueIris for…as in how you are using it and what features you are relying on in BlueIris.
I run BlueIris (BI) to do 24/7 recording and I make use of some of its features that aren’t available elsewhere. I use frigate for object detection and since Jako just got a single container addon for compreface I’ll be looking into Double Take soon for facial recognition.

I’ve tried deepstack and BI and while it works I had a heck of a time with all the extra stuff I needed to run and the false positives with deepstack were just too many to be useable. I wouldn’t recommend it.
I’ve been running frigate for about a year now and I think I have had 4 hits that were recognized as a person or car that weren’t. Pretty amazing stuff there.

i have a problem with the compare face add on and since i upgraded to 1.7 double take add on keep crushing,
and for the life of me i cant figure out why

@Ben_Asraf Can you send me the logs of the CompreFace addon? Does the UI load up? Or does it not start at all?

1 Like

I’m using BlueIris for Recording when I’m away.
Have you directly connected your cameras to frigate or over BlueIris?
Have you used the GPU or the CPU Version of DeepStack?

About the facial recognition, what are you using it for? Intruder Alerts? I can’t imagine an
automation for now that could be useful, presence detection yes but face?

Well if you are comfortable with the way frigate works you could use that for recording. I prefer being able to use BI like a more traditional NVR and don’t use frigate to record any video…just do object recognition.
I connected my cameras to frigate (2nd stream) as well as BI (main stream)…not one through the other.
I tried out both versions of deepstack, but not for over a year now.
I not using double take at all yet, but I plan to play with it. I think it could be useful to tell who is where at certain times.
If you don’t think facial recognition is worth much to you then I would suggest you go check out frigate and see if that works for your needs a bit better. It is more object detection and it is quite good at it.
HTH

the ui starts i’m able to enter and than it always alert me this “Error during synchronization between servers: Connection refused (Connection refused) executing GET http://localhost:3000/status” when im trying to enter the app to get a key,

but the main problem really is that double take keeps crushing since i update to latest version

Hey @Ben_Asraf, have you verified your system has AVX2? I’ve updated the add-on to check for that before starting, but it’s a requirement for CompreFace.

I installed Double-Take latest beta 1.7.0 but I get gateway error. 1.6.0 works properly. I openene an issue on github . Maybe you can have a look @Jako ? :slight_smile:

[BUG] Gateway Error in version 1.7.0 · Issue #173 · jakowenko/double-take (github.com)

thats my problem too

I will take a look at it tonight and report back! For now it should work if you use port 3000 directly and don’t go through ingress.

i doesnt because the add on keeps stopping at least for me

I had to change the port to another as 3000 is already in use but Still same issue. But another strange issue after trying to run the container. The Zwavejs addon and integration stops working. I will investigate this. It happened after my last Backup .(