High CPU usage since December, how can I check what is causing it?

[Boerny]

Hi,

Since December, my CPU usage has increased by a factor of 6. After a reboot, it briefly drops to normal levels, but then increases and stays high.

It’s been a long time since I made any major changes to HA or added anything new, certainly longer than December.

Is there any way to check what is causing the CPU usage?

This is the CPU usage from August to today. It went up from 5% to 30% in mid-December.

[tom_l]

Due to the high CPU use it is probably not this, but if you use the CPU Speed integration it may be worth checking.

PSA: CPU Speed Integration Issue

I have been chasing an intermittent CPU temperature issue for months. Today I finally found the cause: [Screenshot 2024-01-26 at 15-10-39 History – Home Assistant] The issue has little affect on CPU or memory resources, only temperature, but it does cause stability issues if left long enough without restarting. And now knowing which integration is at fault I found this previous exact issue with a comment from the devs: https://github.com/home-assistant/core/issues/71388#issuecomment-11459901…

Otherwise, start disabling integrations one by one (third party integrations first) until you find which has an effect.

Also try reloading automations to make sure it is not a rogue loop.

[Boerny]

Unfortunately that’s not it.
Is there no way to check the CPU usage and see what’s causing it? I’d like to avoid disabling one integration at a time.

[tom_l]

Yes there are a couple of ways but they are not easy to interpret.

Profiler Scan (this will work better after 2024.2 is released with Python 3.12 support as it will show the thread info). But is still worth trying now:

Profiler

Also Py-Spy.

Instructions to install Py-spy on HAOS

originally landed at How to install Py spy on a HA OS instance, please instruct - #44 by Mariusthvdb but this might be valuable to post as a standalone community guide. thanks to the relentless support by @bdraco, I can post the solution to original request for instructions to install py-spy on HAOS (you need to run it on the host): 2 ways to install and run the required files: 1 The easiest way to run docker commands required for the py-spy is to install the ssh & web terminal add-on and dis…

Run the scan and ask for help interpreting the results in this topic if you need it:

How to install Py spy on a HA OS instance, please instruct

Mem: 3657596K used, 225460K free, 10448K shrd, 289212K buff, 1609196K cached CPU: 35% usr 21% sys 0% nic 35% idle 0% io 0% irq 7% sirq Load average: 4.47 4.44 4.60 5/1134 2261 PID PPID USER STAT VSZ %VSZ CPU %CPU COMMAND 64 61 root S 903m 24% 0 2% python3 -m homeassistant --config /config 127 64 root S 699m 18% 1 0% /config/rtsp2webrtc_v5_aarch64 {"server":{"http_port":"127.0.0.1:8083","ice_servers":["stun:stun.l.google.com:19302"]},"strea…

[Boerny]

The profiler looks very interesting. As we are only a few days away from 2023.02, I’ll just wait for the update. After all, it has been running like this for over a month now.

I’ll come back here and let you know if it helped when the update is released.

Thanks for the quick answers!

[Boerny]

I have found out what is causing the CPU load. After doing a backup, it jumps from 5% to 30% CPU load and stays there until I restart HomeAssistant.

I run HA as a VM in Proxmox and do daily backups. I’ve tried snapshot and stop mode but it happens both ways.

Is there anything I can do about this? Is it possible to create a rule in HA to reboot at a set time?

[tom_l]

@Boerny

Is it possible to create a rule in HA to reboot at a set time?

Rather than doing that report the issue so it gets fixed.

Issues · home-assistant/core

[cyberax17]

Hi Boerny,
I would be curious how you finally solved this issue. Same phenomenon on my side. Many nightly backups go well but every now and then there is one where the CPU load stays at around 30% in my case. Usually it’s around 1%. Only a restart of the entire system does help, than the CPU load is back to 1% again. I do daily backups during the night. After a week or so the CPU load stays high, even if the backup job is finished. I trigger the backup with an automation rule.
Cheers