Error processing webhook on 0.107

sd_dracula · March 19, 2020, 8:14am

I keep getting this error in my log after the 107.0 update and I think it is making HA eventually hang:

2020-03-19 08:11:31 ERROR (MainThread) [homeassistant.components.webhook] Error processing webhook 165c8a7090d99477c90e715b95060fd925a5fdb4eb839277bc0
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/webhook/__init__.py", line 77, in async_handle_webhook
    response = await webhook["handler"](hass, webhook_id, request)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 186, in handle_webhook
    return await WEBHOOK_COMMANDS[webhook_type](hass, config_entry, webhook_payload)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 131, in validate_and_run
    return await func(hass, config_entry, data)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 439, in webhook_update_sensor_states
    await hass.data[DOMAIN][DATA_STORE].async_save(safe)
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 136, in async_save
    await self._async_handle_write_data()
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 197, in _async_handle_write_data
    self._write_data, self.path, data
concurrent.futures._base.CancelledError
2020-03-19 08:11:31 INFO (MainThread) [homeassistant.components.websocket_api.http.connection.2894501104] Connection closed by client

Any idea what it is about?

BrentV · March 30, 2020, 7:56pm

Same issue here. "Error processing webhook … " and HA webUI hangs every few days.
Currently running HA 0.107.3

Nearly stock config, only added 2 foscam camera’s (platform: foscam)

2020-03-30 19:33:12 ERROR (MainThread) [homeassistant.components.webhook] Error processing webhook 20265b5b2257a267c2eace8e1f51ae0417ebf9b02d2c105c18acbe456209e85c
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/webhook/__init__.py", line 77, in async_handle_webhook
    response = await webhook["handler"](hass, webhook_id, request)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 186, in handle_webhook
    return await WEBHOOK_COMMANDS[webhook_type](hass, config_entry, webhook_payload)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 131, in validate_and_run
    return await func(hass, config_entry, data)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 439, in webhook_update_sensor_states
    await hass.data[DOMAIN][DATA_STORE].async_save(safe)
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 136, in async_save
    await self._async_handle_write_data()
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 197, in _async_handle_write_data
    self._write_data, self.path, data
concurrent.futures._base.CancelledError
2020-03-30 19:34:01 ERROR (MainThread) [homeassistant.core] Error doing job: Task exception was never retrieved
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 109, in async_init
    result = await self._async_handle_step(flow, flow.init_step, data)
  File "/usr/src/homeassistant/homeassistant/data_entry_flow.py", line 172, in _async_handle_step
    result: Dict = await getattr(flow, method)(user_input)
  File "/usr/src/homeassistant/homeassistant/helpers/config_entry_oauth2_flow.py", line 270, in async_step_discovery
    return await self.async_step_pick_implementation()
  File "/usr/src/homeassistant/homeassistant/helpers/config_entry_oauth2_flow.py", line 202, in async_step_pick_implementation
    implementations = await async_get_implementations(self.hass, self.DOMAIN)
  File "/usr/src/homeassistant/homeassistant/helpers/config_entry_oauth2_flow.py", line 315, in async_get_implementations
    implementation = await get_impl(hass, domain)
  File "/usr/src/homeassistant/homeassistant/components/cloud/account_link.py", line 29, in async_provide_implementation
    services = await _get_services(hass)
  File "/usr/src/homeassistant/homeassistant/components/cloud/account_link.py", line 76, in _get_services
    services = await account_link.async_fetch_available_services(hass.data[DOMAIN])
  File "/usr/local/lib/python3.7/site-packages/hass_nabucasa/account_link.py", line 120, in async_fetch_available_services
    resp = await cloud.client.websession.post(f"{cloud.account_link_url}/services")
  File "/usr/local/lib/python3.7/site-packages/aiohttp/client.py", line 582, in _request
    break
  File "/usr/local/lib/python3.7/site-packages/aiohttp/helpers.py", line 586, in __exit__
    raise asyncio.TimeoutError from None
concurrent.futures._base.TimeoutError
2020-03-30 19:35:22 ERROR (MainThread) [homeassistant.components.webhook] Error processing webhook 20265b5b2257a267c2eace8e1f51ae0417ebf9b02d2c105c18acbe456209e85c
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/webhook/__init__.py", line 77, in async_handle_webhook
    response = await webhook["handler"](hass, webhook_id, request)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 186, in handle_webhook
    return await WEBHOOK_COMMANDS[webhook_type](hass, config_entry, webhook_payload)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 131, in validate_and_run
    return await func(hass, config_entry, data)
  File "/usr/src/homeassistant/homeassistant/components/mobile_app/webhook.py", line 439, in webhook_update_sensor_states
    await hass.data[DOMAIN][DATA_STORE].async_save(safe)
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 136, in async_save
    await self._async_handle_write_data()
  File "/usr/src/homeassistant/homeassistant/helpers/storage.py", line 197, in _async_handle_write_data
    self._write_data, self.path, data
concurrent.futures._base.CancelledError

micque · March 30, 2020, 9:31pm

In both cases the system is trying to write something. Are you low on memory or storage space?

BrentV · March 30, 2020, 9:59pm

After a powercycle HA started working again. But as this happend a few times now, I think it will freeze agian.

I ran the df -h command to look into the system storage

 $ df -h
Filesystem                Size      Used Available Use% Mounted on
overlay                  13.9G      2.6G     10.6G  20% /
tmpfs                    64.0M         0     64.0M   0% /dev
tmpfs                   462.0M         0    462.0M   0% /sys/fs/cgroup
shm                      64.0M     12.0K     64.0M   0% /dev/shm
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /addons
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /data
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /config
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /ssl
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /backup
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /share
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /run/audio
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /etc/asound.conf
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /etc/resolv.conf
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /etc/hostname
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /etc/hosts
/dev/mmcblk0p8           13.9G      2.6G     10.6G  20% /etc/pulse/client.conf
tmpfs                   462.0M         0    462.0M   0% /proc/asound
tmpfs                    64.0M         0     64.0M   0% /proc/keys
tmpfs                    64.0M         0     64.0M   0% /proc/latency_stats
tmpfs                    64.0M         0     64.0M   0% /proc/timer_list
tmpfs                    64.0M         0     64.0M   0% /proc/sched_debug
tmpfs                   462.0M         0    462.0M   0% /sys/firmware

So still 10GB free from my 16GB card. Maybe it’s a bad card?

slusar_o2 · April 2, 2020, 6:06am

Got the same errors, after which HA freezes. I use ssd drive, so i guess its not card problem.

dokime7 · April 16, 2020, 10:32am

Same error HA freeze also sometime after…
Maybe related to https://github.com/home-assistant/core/issues/29946