Esp32-cam always idle?

ESPHome
6

General update
I’ve managed to get more frequent updates so changes show up within a second delay - nothing that would ever be considered movie level, but at least I see changes very close to when they happen, and the resolution is high enough for my purpose.

However, HA still calls it ‘idle’. For now, I’m removing that status since it’s ‘false’ allowing the media->video view to work just fine, the dashboards will show the ‘live’ video with 1-2 frames a second (tops).

I didn’t expect high end camera quality - so the low framerate isn’t a big issue. But I would definitely still like to ‘fix’ the idle status.

Here are the image settings I use (successfully):

  # Image settings
  aec2: True
  aec_mode: AUTO
  name: "My Camera"
  resolution: 800X600
  max_framerate: 6 fps
  idle_framerate: 0.1 fps
  jpeg_quality: 10
  wb_mode: home
  agc_gain_ceiling: 8x
  vertical_flip: False
  horizontal_mirror: False

Note, the max_framerate is funny - it’s nowhere close to 6, but since it is an upper bound only it would only prevent the device trying to push more through the wireless signal.

7

Thank for all your testing work. I am also using the camera since some weeks and facing exact the same issue. So i was also wondering what causes the issues about the Idle status.

8

I was suggesting taking it out of your config because I thought it was probably the cause of your problem. If idle_framerate is 0.2 and if the state is showing as idle, the camera will display one frame every 5 seconds, which would show the sort of display you were describing.

Of course why the camera integration is showing as idle all the time is another matter.

9

I’ll leave this with just a simple comment as I don’t think this is relevant to the topic. Your argument/complaint was that it wasn’t commented out. Hopefully we can agree that it doesn’t matter how you change the value. I appreciate the suggestion - really - but if your point was that the camera was slow because it was idle, it doesn’t really answer the question that the camera is idle in the first place. And removing the value from the configuration file just makes it LESS than 0.2 which also means it doesn’t solve the problem you say it does.

I would like to know if the idle frames has to be high for ESPHOME to detect motion. I don’t see that documented anywhere - and if that’s the case making it higher, not lower, would be the solution. I don’t know.

For now I’ll go through the code-base instead to find an answer. If I do find one, I’ll post it.

10

If the camera says it is in idle mode all the time, perhaps it is showing the idle_framerate (which would describe what you are seeing). That is why I suggested removing idle_framerate. Can I suggest then that you try the same as max_framerate, just to see if you see any difference. I don’t have idle_framerate set at all and I do not see what you see.

I don’t see anything about motion detection in the docs.

11

I’ll add this thread for something that uses an espcam to do motion detection. MQTT Motion Detection using ESP32 Camera (no PIR) - but does not provide a camera entity in HA.

Also motion detection is, I believe, possible with esphome esp32camera when combined with motion or motioneye.

12

Removing or commenting out idle_framerate won’t make any difference for the simple reason that it’s an optional parameter that will default to 0.1, per the docs:

ESP32 Camera Component — ESPHome

I am seeing the same behavior as described by @egoalter , with the thumbnail being labeled as “Idle”, but I think that’s actually normal. If I add the camera to a dashboard, and tap the thumbnail, I get a pop-out view that updates (somewhat) more frequently.

Frame rate in both cases is terrible, but there is a clear difference between the two.

13

Yes true, I was getting a little hung up on that.

Mine always has the state “idle” too, but does give moving images at greater than 0.1 FPS.

The default FPS is only 10, which will be a bit jerky.

14

I ended up giving up on the ESP32-CAM for this. Just could not get a decent frame rate. Repurposed an old Pi3 with a webcam as an MJPEG streamer and getting much better results. Overkill, but since I had the hardware available…

15

I tried a few different routes before I settled for the option of running ESPhome on the ESP32-cam with the web server camera component publishing the camera to a Motioneye server I have for other purposes. This will give me a live feed of the ESP32-cam in HA as well as access to all the usability found in ESPhome. Before that I tried the Arduino ESP32 example “Camera Web server” code instead. That in turn allowed me to use my Motioneye server to connect to the ESP32-cam and get a feed to HA, but I lost all the OTA access and such.

Fredrik

2 Likes
16

What kind of framerate did you get when using motioneye between?

17

I have tried esphome, GitHub - s60sc/ESP32-CAM_MJPEG2SD: ESP32 Camera motion capture application to record JPEGs to SD card as AVI files and stream to browser as MJPEG. If a microphone is installed then a WAV file is also created. Files can be uploaded via FTP or downloaded to browser. and GitHub - rzeldent/esp32cam-rtsp: Simple RTSP (streaming image) server for the ESP32CAM. Easy configuration and monitoring through the web interface.
Using the rtsp since the only thing I need is a video stream, and I get a good framerate. I can also use this directly in home assistant and I think I could do OTA (just saw that the arduino IDE finds the device on the network).

18

If I disable the HA API connection, I.E. disable the esp device in HA, I gett a framerate through motioneye around 5fps. The instant I enable the API the rate drops to 0.5fps.

/Fredrik

19

I’ve the same experience with the low frame rate.

I’ve added the [ESP32 Camera Web Server Component — ESPHome] to the ESP32_CAM and when I view the stream the logs on the ESPHome shows up a better framerate (for the stream via the webserver), but is is not reflected to the HA entity.

I’ve added a card on the dashboard with a webpage with the URL to that cam and have now a live stream on the HA dashboard.

1 Like
20

I had the same issue. Without being an expert, I am reasonably certain the ESPHome implementation ESP32 Camera Component results in Home Assistant sending a request to the camera which then sends a image back, and the communication overhead is too much to provide reasonable framerates. At least running HA on an Raspberry Pi 3 B, might be different on newer models.
The log of the ESP32-CAM (in HA under ESPHome, works kind of like the Serial Monitor in Arduino) looks something like this:

[17:51:40][D][esp32_camera:196]: Got Image: len=73025
[17:51:41][D][esp32_camera:196]: Got Image: len=72865
[17:51:41][D][esp32_camera:196]: Got Image: len=72846
[17:51:41][D][esp32_camera:196]: Got Image: len=73011

The solution is to add the ESP32 Camera Web Server Component to the yaml file:

esp32_camera:
  external_clock:
    pin: GPIO0
    frequency: 20MHz
  i2c_pins:
    sda: GPIO26
    scl: GPIO27
  data_pins: [GPIO5, GPIO18, GPIO19, GPIO21, GPIO36, GPIO39, GPIO34, GPIO35]
  vsync_pin: GPIO25
  href_pin: GPIO23
  pixel_clock_pin: GPIO22
  power_down_pin: GPIO32

esp32_camera_web_server:
  - port: 8080
    mode: stream
  - port: 8081
    mode: snapshot

(if we try to use only esp32_camera_web_server, it will complain that it requires esp32_camera)

You can then add a Picture Card to your HA dashboard and put in the stream’s adress as image path, for example http://192.168.2.109:8080 for the stream.
The log of the ESP32-CAM in your ESPHome will look like this:

[17:51:41][D][esp32_camera_web_server:198]: MJPG: 73025B 236ms (4.2fps)
[17:51:41][D][esp32_camera:196]: Got Image: len=73134
[17:51:42][D][esp32_camera_web_server:198]: MJPG: 73134B 240ms (4.2fps)
[17:51:42][D][esp32_camera:196]: Got Image: len=72908

However, I found that using the HA’s MJPEG IP Camera Integration is a better choice to avoid a 24/7 continuous stream.
After setting it up it will show up in HA in Settings - Devices & Services as “MJPEG IP Camera” and if you open the “device” page you will see “Add to Dashboard” below the sensor (just click around a bit, you will get used to it). HA will propose a card for you and you can just confirm it.

After that you should have the still image on your dashboard and if you click on it it will open the stream, as can be verified looking at the logs of the ESP32-Cam. Pretty much the behavior you are probably aiming for.

What I haven’t found out yet is if the framerates we can specify in esp32_camera impact the streaming and still image framerates. Doesn’t look like it.

1 Like
21

After that you should have the still image on your dashboard and if you click on it it will open the stream, as can be verified looking at the logs of the ESP32-Cam. Pretty much the behavior you are probably aiming for.

Thanks - I think in 2+ years that’s the furthest anyone has come for a solution. I almost think marking this a solution would work, if it didn’t require full open access to camera end points, non encrypted etc. But I’ll chase that down and if I find something I’ll update and mark yours as a solution.

My first issue is that I need to manually enter the IP of the device that I typically don’t care about (it gets added to an isolated iot network VLAN behind egress limiting firewalls - don’t care what IP in that segment it has). If I can find a way to secure it, I’ll add that stream to Zoneminder although it’s framerate is a bit too low it should work and become of the rest of the fixed cameras. As you can see, that basically means I don’t need ESPHome for this unit implementing the web-server part raw would give me more control too and maybe give me higher framerates. I just like Esphome for easy limited device integration - just doesn’t seem cameras is going to be one of those. One out of a few hundreds isn’t bad …

I think the esp32_camera module is still in error. From your description it wrongly uses “image push” and not an stream push. Or to your point, both should be used. With your work-around I need two dashboard entries - one that will show the area with indication of the area features like motion detected, lights and other controls for that area, and now another for the video. In the standard HA dashboard object, the video stream is an option too; I admit it’s something I can live with - so since I’ve given up on getting esp32_camera corrected I prefer to this to just remain as a “warning” to others. The real solution would be another module I guess or a PR to the existing one.

Thanks again - I may change my mind and mark your post as a solution. I was just impressed at seeing 7fps from the insecure camera - I definitely do not see this as security camera ready but it’s 14x better than 0.5fps. Great progress.

22

These 5$ cameras are really just a novelty and im not sure why people set their expectations so high and making them a 24/7 streaming camera. Their video and picture quality is fair at best and only in the best lighting conditions. You used to be able to stream (poor)video with these camera’s several years ago but they had an overheating self-destruct problem.

If anything I do think they have value for doing something like snapshots or short recordings as part of a security system or checking on your pets etc, but 24/7 streaming feed,… you should probably just get a real camera.

23

I agree these are low-end cameras, but that’s actually the point. I can with a bit of “smarts” use it to do exactly what the more expensive models (that I run too - hence zoneminder) can do. It’s partly an experiment on my side, but also allowing me to do motion detection with a simple camera to take a picture or two, without needing to invest $50-$150 in a camera that tends to try to break out of my network because “cloud”.

In other words - while I agree lense size and as you mentioned some electrical challenges aside, this is one of the few ways I know will have NO chance of opening a backdoor into the network.

For inside video ranges, I don’t have a quality issue. I wouldn’t want to use it to detect license-plates though - so I absolutely agree that there are large limits with these cameras modules.

24

I 100% agree about the cloud issues and the backdoor shenanigans with brand name camers. I wasnt trying to imply they are worthless, just that IMO it seems some peoples expectations with these cameras are way too high. They’re cool, fun to play with and i have some myself buy they have have limitations for sure.

25

Just a followup - using zoneminder and dropping esphome’s esp32-cam module I’m geting 10-20fps and can do motion detection. While using HA’s MJPEG IP Camera that v5v5 suggested, no more 0.1fps and full back log.

I cannot see frame jumps anymore - it’s smooth. So as long as I can keep the module cool enough this should work.

And yes, the small camera module isn’t high quality but at relative close range like an inside room, the resolution is good enough to see people and other “things” that create motion. Now would be to try to do a bit of AI to recognize things - that’s not for this thread; I just wanted to let those who want to use the esp32-cam at more than <1fps that this is a solution that works for me.

I used the Micro-FTSP library to setup a very simple RTSP server on the esp32 (https://github.com/geeksville/Micro-RTSP/blob/84e16162c2c25d482ea12def2b69438e636853eb/README.md) which I can easily add a bit of security to (again basic security).