Multiple "is taking over 10 seconds" warnings after upgrading to 2022.6.7

[gfn256]

I’m running hassio on RPI4 8GB USB SSD - running smoothly!
BUT since upgrading to 2022.6.7, on every (scheduled) host reboot I’m getting multiple “is taking over 10 seconds” warnings - never had this before.

I attach sample log:

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_boolean is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_button is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of counter is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_number is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_datetime is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of zone is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_select is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of timer is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.setup] Setup of input_text is taking over 10 seconds.

2022-06-29 07:42:14 WARNING (MainThread) [homeassistant.components.update] Setup of update platform hassio is taking over 10 seconds.

2022-06-29 07:42:15 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform systemmonitor is taking over 10 seconds.

2022-06-29 07:42:15 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform command_line is taking over 10 seconds.

Any help would be welcome!

[Neil_Brownlee]

@gfn256

2022-06-29 07:42:15 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform command_line is taking over 10 seconds.

Welcome to my world. In my case if you look in the HA docker you may see it has fired up another instance with a higher PID. This then causes all sorts of timeouts.

Kill it (kill -9 PID) - only one should be running. Started for me with 2022.6.x

[gfn256]

My Installation Type: Home Assistant OS don’t have any docker containers

[Neil_Brownlee]

So is mine.

SSH in and use :

docker exec -it homeassistant /bin/bash

Then type :

top

If you have more than one homeassistant running - that’s your issue.

[gfn256]

Never used SSH access with my RPI HA

[Neil_Brownlee]

Hi,

There is an official add-on. Worth installing to check if your issue is the same as mine (and then uninstall if it’s not).

You can use it as a terminal within Home Assistant itself.

[w35l3y]

[gfn256]

I’m fully aware of the Terminal & SSH addon, (I use SSH extensively on other non-HA devices), but what makes me think that I don’t suffer from you scenario, is that my Processor use idles almost constantly at 2-3%. Yes at boot-up it can get up to 60% (maximum, and limited to ONE such reading!).
I think if I had more than one HA instance, things would look different.

[Neil_Brownlee]

Hi,

It adds another 1-2% cpu usage. Anyway - it was just a suggestion as it’s what causes those problems on mine.

[gfn256]

Don’t misunderstand me, I enjoy your input, and many thanks for that. I also wish I could help you. See this open issue on Github (https://github.com/home-assistant/core/issues/73863).

[CaptTom (Tom)]

@Neil_Brownlee

SSH in and use :

docker exec -it homeassistant /bin/bash

Then type :

top

If you have more than one homeassistant running - that’s your issue.

Thank you, that command was helpful. I’ve never used docker and so far I’ve managed to avoid digging into it, but this will be a great starting point for learning.

Meanwhile, I also get a lot of “is taking over 10 seconds” warnings. My top command output looks very similar to what @w35l3y posted. If I’m reading this correctly, there’s only one process which launched python to run homeassistant. I’m on core 2022.6.7 and OS 8.2.

At this point it’s not a show-stopper for me, but it does seem that HA is very chatty with the logs. Given the limited writes an SD card can tolerate, this seems counter-productive. If you were to run HA for a long period without restarting, the growing log files might also become an issue.

[petro]

I wouldn’t worry as the limiting factor is typically loading yaml configurations and related to your hardware. In the next version, the yaml loading has been optimized by @bdraco, so it should be faster. He can correct me if I’m missing the mark. But that’s the take away I’ve gathered from his recent PRs.

[bdraco (J. Nick Koston)]

If the problem is because the system is cpu or I/o bound there is a good chance it will be much better in 2022.7. If connecting to the device/service is slow it won’t help

[gfn256]

How come I NEVER had this before 2022.6.7, as others have also noted?

[bdraco (J. Nick Koston)]

If you could get a py-spy during startup we might be able to get an idea why, but since there weren’t any core changes between 2022.6.6 and 2022.6.7 (Comparing 2022.6.6...2022.6.7 · home-assistant/core · GitHub) its not obvious why.

How to install Py spy on a HA OS instance, please instruct

thanks to the relentless support by @bdraco, I can post the solution to original request for instructions to install py-spy on HAOS (you need to run it on the host): 2 ways to install and run the required files: 1 The easiest way to run docker commands required for the py-spy is to install the ssh & web terminal addon and disable protection mode then you can ( get into the host and) access the docker cli and follow the rest of the steps described below. Important: this is the ssh addon in the…

[Mariusthvdb (Marius)]

fwiw, running the latest dev, and all of the improvements Nick did, I still see several of those too.

And I did already upgrade the hardware to a mini pc, with a now super fast restart time of 1 minute…52 sec even. wow, never seen before

but, its way less than before and intermittent. `for testing purposes just did another restart, an now only see:

Logger: homeassistant.setup
Source: /usr/local/lib/python3.10/asyncio/events.py:80 
First occurred: 16:52:28 (1 occurrences) 
Last logged: 16:52:28

Setup of rest is taking over 10 seconds.

to illustrate, the one before did:

2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of input_select is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of input_datetime is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of rest is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of input_boolean is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of input_number is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of zone is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.setup] Setup of python_script is taking over 10 seconds.
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.config_entries] Config entry 'Philips Hue 1' for hue integration not ready yet: Error connecting to the Hue bridge at 192.168.1.212; Retrying in background
2022-06-29 16:20:48 WARNING (MainThread) [homeassistant.components.binary_sensor] Setup of binary_sensor platform mqtt is taking over 10 seconds.

[ster1um]

I have same problem in latest stable version 2022.8.

2022-08-10 11:37:48.419 WARNING (MainThread) [homeassistant.setup] Setup of input_number is taking over 10 seconds.
2022-08-10 11:37:48.436 WARNING (MainThread) [homeassistant.setup] Setup of input_select is taking over 10 seconds.
2022-08-10 11:37:48.440 WARNING (MainThread) [homeassistant.setup] Setup of input_text is taking over 10 seconds.
2022-08-10 11:37:48.444 WARNING (MainThread) [homeassistant.setup] Setup of input_button is taking over 10 seconds.

[mekanics]

Home Assistant 2022.9.7
Supervisor 2022.09.1
Operating System 9.0
Frontend 20220907.2 - latest

Raspberry Pi 4 4GB + SSD + Conbee2

2022-09-28 05:13:53.437 WARNING (MainThread) [homeassistant.setup] Setup of automation is taking over 10 seconds.
2022-09-28 05:13:53.444 WARNING (MainThread) [homeassistant.components.binary_sensor] Setup of binary_sensor platform deconz is taking over 10 seconds.
2022-09-28 05:13:53.445 WARNING (MainThread) [homeassistant.components.light] Setup of light platform deconz is taking over 10 seconds.
2022-09-28 05:13:53.447 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform deconz is taking over 10 seconds.
2022-09-28 05:13:53.448 WARNING (MainThread) [homeassistant.components.sensor] Setup of sensor platform forecast_solar is taking over 10 seconds.
2022-09-28 05:13:53.450 WARNING (MainThread) [homeassistant.components.weather] Setup of weather platform met is taking over 10 seconds.
2022-09-28 05:13:53.452 WARNING (MainThread) [homeassistant.components.climate] Setup of climate platform deconz is taking over 10 seconds.
2022-09-28 05:13:53.453 WARNING (MainThread) [homeassistant.components.switch] Setup of switch platform deconz is taking over 10 seconds.

Varies a bit each time, but at least some timeouts with every boot.

[odwide]

Same here with my snmp sensors. Outside of HA SNMP polling takes less than a sec.

Logger: homeassistant.helpers.entity
Source: helpers/entity.py:538
First occurred: 22:07:27 (3 occurrences)
Last logged: 22:09:27

Update of sensor.iot_vlan_interface_down_throughput is taking over 10 seconds
Update of sensor.home_vlan_interface_down_throughput is taking over 10 seconds

[VincentClement1 (Vincent Clement)]

The “Update of … is taking over 10 seconds” occurrences have increases between 2023.4 and 2023.5. In my case it’s three specific entities with fan.levoit_air_cleaner being the worst

Logger: homeassistant.helpers.entity
Source: helpers/entity.py:749
First occurred: 11:26:21 am (3 occurrences)
Last logged: 0:18:31 pm

• Update of binary_sensor.bedroom_occupancy is taking over 10 seconds
• Update of fan.levoit_air_cleaner is taking over 10 second