Home assistant database locked again

Yeah… my errors in the log are down to nothing as well… so my interpretation was correct then. One of the issues I often have with docs is they will have some random setting and then give no example of how to use it or if there is an example, they don’t use the setting. A classic is when they telly you there are a few different ways to configure something and then give the 3 configurations and they are all ‘different’ which makes it hard to follow… anyway I’m sure I sucked at explaining that… Glad you got it working.

I did agonise over the host but in the end just followed verbatim the example (except username/password). Your approach could just as easily have been right.

Since installing MariaDB I have noticed a very worrying trend:

The only other addon I installed was Mosquito mqtt broker v3. Could be that too I suppose.

I had been on 0.77.2 and recently added a few history_stats sensors. I did not see this problem. Then yesterday I updated to 0.81.6 and boom!, my log was loaded with these errors! I’ve since disabled discovery (which I have no use for) and slowed down the history_stats sensors (by specifying larger scan_intervals.) Now I still see these errors, but not nearly as often. Maybe finally time to bite the bullet and switch to something other than SQLite.

BTW, now that I’m on 0.81.6 all the timer out of sync errors are gone that I used to see a lot. But of course, they’ve just morphed to events, which I still see. Interestingly, now that the events show how much the timer tick was delayed, I’m amazed that the times are so big. Before turning off discovery it was not uncommon to see delayed ticks of up to 10 seconds! Now I’m seeing fewer and they’re more around 2 seconds. Still, for something that is supposed to happen every second, to be delayed by 2 seconds is nuts! FWIW, I’m on a pi 3B. And here are the events from the last 10 minutes:

pi@raspberrypi:/home/homeassistant/.homeassistant $ grep timer_out_of_sync home-assistant.log
2018-11-08 09:46:04 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event timer_out_of_sync[L]: seconds=2.3558670060010627>
2018-11-08 09:46:18 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event timer_out_of_sync[L]: seconds=1.135453613998834>
2018-11-08 09:50:41 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event timer_out_of_sync[L]: seconds=2.214339808000659>
2018-11-08 09:54:04 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event timer_out_of_sync[L]: seconds=2.320807561998663>
2018-11-08 09:56:04 DEBUG (MainThread) [homeassistant.core] Bus:Handling <Event timer_out_of_sync[L]: seconds=2.096397927001817>

just so I may try that too, why exactly are your settings now? In the addon and for the db_url please…

FYI, I went ahead and changed to MariaDB. I don’t use hassio so I had to manually install it and create the database, which took a bit of reading/Googling. After restarting things do seem better. It’s only been a short time, but already I don’t see database errors anymore. Also, I’ve only seen one timer_out_of_sync event each time I restart (which so far only seems to happen during startup), and they’ve been just over 2 seconds. I just enabled the memory_use_percent and processor_use sensors, so I can update you on what I see after a while.

@pnbruckner My memory use has levelled off at between 50% and 55% (pi3B with 1GB).

@Mariusthvdb, settings below:

configuration.yaml:

 recorder:
  db_url: !secret mariadb_url
  purge_interval: 1
  purge_keep_days: 7

secrets.yaml:

mariadb_url: mysql://hass:my_redacted_password@core-mariadb/homeassistant

Mariadb config:

{
  "databases": [
    "homeassistant"
  ],
  "logins": [
    {
      "username": "hass",
      "host": "homeassistant",
      "password": "my_redacted_password"
    }
  ],
  "rights": [
    {
      "username": "hass",
      "host": "homeassistant",
      "database": "homeassistant",
      "grant": "ALL PRIVILEGES ON"
    }
  ]
}

thanks, i have same settings except use % for host. Thought that to be necessary when using more than 1 instance accessing the db. (I have 2 HA setups)

do you logbook and history tabs work alright? Mine grind the Ha instance to hold due to memory depletion…

They load but take longer than I’d like (10-20s). Loading them takes my memory use from ~ 55% to ~ 65%.

I do make extensive use of the exclude option in both history and logbook though.

A yes, tried that too.
but I think I learned that doesn’t make any difference on the back end , only doesn’t show it in the frontend, while backend DB records anything. not sure though.

I use includes in recorder and history to try to calm it down, but it doesn’t really help at all.

Where do you get that nonsense from?

1 Like

FWIW, here’s my memory and CPU usage over the last week:

Memory usage is, of course, the top line, and starts around 36% and ends around 42%. Haven’t paid close enough attention to know what was happening during the temporarily increased usage periods.

1 Like

is that a click on more-info in Ha? or is this some other tool. My more-info screens never go past a day…?

It’s from the History page.

ah, well, that’s beyond reach in my 2 instances, and has been so for as long as I can remember…

After installation of MariaDB database may I delete home-assistant_v2.db file in /config ?

Yes you can.

Can you share a link about how to change database from the default to mariadb on a raspberry pi3?

Ok but i need to register myself in the mariadb site or do i need only that config?

If you are using Hassio just install the addon.