Not enough system resources / too many files open with 33.3 upgrade

[maddox (Jon Maddox)]

This used to happen to me after restarting HA too many times after a reboot. I would have to reboot to fix it.

Now, since 0.40, it happens after HA is running for a while. It’s completely broken my setup. It appears macOS just has an insanely low limit for this. We just need to increase the allowed number of files to be open.

You can see the list here:

$ ulimit -a
-t: cpu time (seconds) unlimited
-f: file size (blocks) unlimited
-d: data seg size (kbytes) unlimited
-s: stack size (kbytes) 8192
-c: core file size (blocks) 0
-v: address space (kbytes) unlimited
-l: locked-in-memory size (kbytes) unlimited
-u: processes 709
-n: file descriptors 256

after running:

ulimit -Sn 10000

it shows

-t: cpu time (seconds) unlimited
-f: file size (blocks) unlimited
-d: data seg size (kbytes) unlimited
-s: stack size (kbytes) 8192
-c: core file size (blocks) 0
-v: address space (kbytes) unlimited
-l: locked-in-memory size (kbytes) unlimited
-u: processes 709
-n: file descriptors 10000

But it doesn’t stick on a reboot. It goes back to 256.

Does anyone know the best practice for getting this to stick?

[diplix (felix schwenzel)]

@maddox

Does anyone know the best practice for getting this to stick?

How to persistently control maximum system resource consumption on Mac?

https://blog.dekstroza.io/ulimit-shenanigans-on-osx-el-capitan/

[maddox (Jon Maddox)]

I found this particular solution to be the cleanest and least invasive on your system.

[mihalski (Michal Dobrzynski)]

Has anyone found a solution to this?

I’m finding HA has become totally unusable in the last few weeks due to this problem.

[gpbenton (Graham)]

This post found that Web OS TV was leaking files, so if you have that it might be worth turning off

Components that can break whole setup

Had problems configuring HA for some time. All of a sudden either postgres or mysql (tried both) would stop logging and break up with no warnings in the log. Sometimes an error like connection timed out was reported. My HA couldn’t run for more than 3 days in a row without restarting. Freezes or breaking out of other components (nmap, ping and others were failing with one error or another). Than all of a sudden i have seen a post on github HA issues about Web OS Tv opening too many connections…

[Eric_Bauer]

Had it, commented it out, still having issues.

[gpbenton (Graham)]

How about these two

Too many open files with Unifi device tracker and new LIFX lights components

I’ve been fighting a major recent problem I’ve been having with HA that results in “too many open files” errors on a MASSIVE scale… Still working to figure it out, but this seems relevant… pi@homepi:~ $ sudo lsof | wc -l 21795 pi@homepi:~ $ sudo lsof |grep homeassistant |wc -l 15445 pi@homepi:~ $ sudo lsof |grep homeassistant |grep -i lifx |wc -l 4998 pi@homepi:~ $ sudo lsof |grep homeassistant |grep -i ubnt |wc -l 8942 pi@homepi:~ $ sudo lsof |grep homeassistant |grep -vi ubnt | grep -vi lifx …

[Martinvdm (Martin)]

Exactly the same behavior today. Restart HA and Homebridge and everything fine. Perhaps it is something with the latest homebridge version?