2024.9: Sections go BIG

with the update to from 2024.8.3 to 2024.9.1 I have negative values:

what is wrong?

My HA is fine too. I even ran the beta versions and none of them caused issue for me. That said, I donā€™t use the few Integrations you mentioned. Are they the only affected onesā€¦?

A lot of them are the usual ā€œI will report issues with custom integrations in the HA Core thread because I donā€™t know what Iā€™m doingā€ type posts.

ā€œall of themā€ or ā€œussualā€? You are contradicting in single sentence.

guys please avoid playing down. it doesnā€™t help anyone.
Recent HA versions contain serious stability issues, regardless someone uses custom integration or not (most of us do anyway).

Distinguish a root cause is often out of a reach for many users.

1 Like

No, I said:

which is VERY different to how you misquoted me.

I do too however I do try to do my part in helping the HA dev team by taking part in the Beta each month.

6 Likes

Thatā€™s a wrap. Letā€™s move on. !!

After the Update to 2024.9.1 the Database upgrade Process are crashed now the second time!

image

Error Logs today:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
MySQLdb.OperationalError: (1206, 'The total number of locks exceeds the lock table size')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/recorder/core.py", line 981, in _migrate_schema
    new_schema_status = migrator(
                        ^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 334, in migrate_schema_live
    schema_status = _migrate_schema(
                    ^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 300, in _migrate_schema
    _apply_update(instance, hass, engine, session_maker, new_version, start_version)
  File "/usr/src/homeassistant/homeassistant/components/recorder/util.py", line 703, in wrapper
    job(instance, *args, **kwargs)
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 883, in _apply_update
    migrator_cls(instance, hass, engine, session_maker, old_version).apply_update()
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 929, in apply_update
    self._apply_update()
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 1761, in _apply_update
    _restore_foreign_key_constraints(
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 721, in _restore_foreign_key_constraints
    _add_constraint(session_maker, add_constraint, table, column)
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 753, in _add_constraint
    connection.execute(add_constraint)
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1418, in execute
    return meth(
           ^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/sql/ddl.py", line 180, in _execute_on_connection
    return connection._execute_ddl(
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1529, in _execute_ddl
    ret = self._execute_context(
          ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context
    return self._exec_single_context(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context
    self._handle_dbapi_exception(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2353, in _handle_dbapi_exception
    raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
sqlalchemy.exc.OperationalError: (MySQLdb.OperationalError) (1206, 'The total number of locks exceeds the lock table size')
[SQL: ALTER TABLE states ADD FOREIGN KEY(attributes_id) REFERENCES state_attributes (attributes_id)]
(Background on this error at: https://sqlalche.me/e/20/e3q8)

Logger: homeassistant.helpers.recorder
Quelle: helpers/recorder.py:101
Erstmals aufgetreten: 02:47:50 (10 Vorkommnisse)
Zuletzt protokolliert: 13:25:42

Error executing query
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
MySQLdb.OperationalError: (1206, 'The total number of locks exceeds the lock table size')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/recorder.py", line 101, in session_scope
    yield session
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 753, in _add_constraint
    connection.execute(add_constraint)
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1418, in execute
    return meth(
           ^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/sql/ddl.py", line 180, in _execute_on_connection
    return connection._execute_ddl(
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1529, in _execute_ddl
    ret = self._execute_context(
          ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context
    return self._exec_single_context(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context
    self._handle_dbapi_exception(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2353, in _handle_dbapi_exception
    raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
sqlalchemy.exc.OperationalError: (MySQLdb.OperationalError) (1206, 'The total number of locks exceeds the lock table size')
[SQL: ALTER TABLE states ADD FOREIGN KEY(attributes_id) REFERENCES state_attributes (attributes_id)]
(Background on this error at: https://sqlalche.me/e/20/e3q8)
Logger: homeassistant.components.recorder.migration
Quelle: components/recorder/migration.py:753
Integration: Recorder (Dokumentation, Probleme)
Erstmals aufgetreten: 02:47:50 (10 Vorkommnisse)
Zuletzt protokolliert: 13:25:42

Could not update foreign options in states table
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
MySQLdb.OperationalError: (1206, 'The total number of locks exceeds the lock table size')

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/components/recorder/migration.py", line 753, in _add_constraint
    connection.execute(add_constraint)
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1418, in execute
    return meth(
           ^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/sql/ddl.py", line 180, in _execute_on_connection
    return connection._execute_ddl(
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1529, in _execute_ddl
    ret = self._execute_context(
          ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1846, in _execute_context
    return self._exec_single_context(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1986, in _exec_single_context
    self._handle_dbapi_exception(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 2353, in _handle_dbapi_exception
    raise sqlalchemy_exception.with_traceback(exc_info[2]) from e
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/base.py", line 1967, in _exec_single_context
    self.dialect.do_execute(
  File "/usr/local/lib/python3.12/site-packages/sqlalchemy/engine/default.py", line 924, in do_execute
    cursor.execute(statement, parameters)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 179, in execute
    res = self._query(mogrified_query)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/cursors.py", line 330, in _query
    db.query(q)
  File "/usr/local/lib/python3.12/site-packages/MySQLdb/connections.py", line 261, in query
    _mysql.connection.query(self, query)
sqlalchemy.exc.OperationalError: (MySQLdb.OperationalError) (1206, 'The total number of locks exceeds the lock table size')
[SQL: ALTER TABLE states ADD FOREIGN KEY(attributes_id) REFERENCES state_attributes (attributes_id)]
(Background on this error at: https://sqlalche.me/e/20/e3q8)

The energy uses the total home consumption to calculate the grey part. If the grid import/export, solar, etc. sensors do not count all sources, or list them wrongly, the sum of individual power monitors might be higher then what HA thought it used. It may also be because you have emulated individual sources that are incorrect.

My guess is you have solar panels but did not list them? So grid import minus grid export is almost 0 at 7:00, and HA does not know solar delivers energy to the individual devices? Or the grid totals come in less than once an hour, so one moment it looks like you didnā€™t consume a thing, while the next hour all the energy for the last two hours is counted for that one hour?

You can try the adjustments Iā€™ve made on MariaDB instance, which response similar like MySQL in post 2024.9: Sections go BIG - #183 by luftdieb (see also mysql - The total number of locks exceeds the lock table size - Stack Overflow)

You have to adjust tmpdir path to your local conditions.

I hope your MySQL server have more than 4GB RAM, just to avoid other problems with those settings.
After modification, you have to restart MySQL Server.

If you restart HA, migration is started newly after a small delay of ~60 seconds.

Finally got around to watch the release party, I tried to copy what was demonstrated with the vertical tiles (in a grid?) and what was almost jokingly announced as the new/super new badges replacing the legacy badges?

I must have missed the essentials there (went by without many details) so I hope this is what was shown:

New 'badges' in a grid?
square: true
type: grid
cards:
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
  - type: tile
    entity: sensor.home_assistant_core_cpu_percent
    vertical: true
    name: Cpu
layout_options:
  grid_columns: full
columns: 8

but somehow I dont think this is what was meant to be:

ofc, nevermind the actual entities, Iā€™m merely trying to experiment with the layout of things here. Couldnt get this to show in the actual badges area, so itā€™s now the first card in the sections.

the main issue I have with this in my config is that it takes up a lot of (unused) space for those tiles and that is exaggerated by the diminished icon size., and those tiles dont resize to fit.

If the vertical option as for tiles gets added to badges, Iā€™d be super happy.

1 Like

didnt see this mentioned before, but we have a new clear button on the event listener (Gebeurtenissen wissen) ! thanks for that, a really useful addition to the toolbox, when one restarts listening to the same event_type, but needs a clear screen.

having said thatā€¦
I am experiencing some issues with a homekit integrated Ikea smart button event entity, which is supposed to have either long_press, double_press or single_press as state

Only see this single press (eenmalig ingedrukt) in the frontend:

And, only my automation triggering on the single_press is executed, the other to event_types dont trigger at all. They all are triggering the single_press, which I can see happening because of the notification it sends.

Did something change in the way HomeKit deals with these devices/events? Anyone see something alike?

edit
I can add a new automation via the ui and use the device_trigger for any of the 3 event_types, so the device itself still emits these events ( for a second I feared Ikea would have changed their devices). According to the docs we can not see any event happening.

And yet we could do this:

    trigger:
      platform: state
      entity_id:
        - event.sneltoets_bureau_marijn
    condition:
      - >
        {{trigger.to_state.attributes.event_type == 'long_press'}}

or:

    trigger:
      platform: state
      entity_id: event.sneltoets_bureau_marijn
#       platform: device
#       device_id: 1c24d1239eb2
#       domain: homekit_controller
#       type: button1
#       subtype: single_press
    condition:
      condition: state
      entity_id: event.sneltoets_bureau_marijn
      attribute: event_type
      state: single_press

now how to get to the correct event entities again in 2024.9 , and trigger on their state_change
logged the issue in event entity state only single_press on Ikea Smart button Ā· Issue #125736 Ā· home-assistant/core Ā· GitHub

I use the MariaDB Home Assistent Addon. My Server has 50gb free Diskspace and 10gb Ram.

After 9h of migration the process always stop. My database are 15GB

Have you tried to apply my settings for MariaDB Iā€™ve mentioned in 2024.9: Sections go BIG - #183 by luftdieb ?

Hello,

Somebody have trouble with nabu casa cloud tts ? It s ok with all of my google nest audio but one doen t want to speak. I heard the bell but it doesn t speak.

Works fine hereā€¦

Hive hot water control still not working in 2024.9.2. Do we have any idea if it will be fixed in .3ā€¦ Still seeing far more issues with 2024.9 than we usually see in releases. Wonder if quality control is going downhill.

What are your references?

If you wanna know: NO

My references are my eyes and my ability to count - I looked at the number of reported issues for 2024.8 and 2024.9 and there certainly seems to be more issues reported. Other things such as responsiveness are worsening too. Iā€™ve cut down the work HA is doing and it seems slower now.

Possibly something to do with the quality of issue reporting too.

Take this one for instance. 2024.9.x Hive Integration Cannot Turn On Hot Water Ā· Issue #125481 Ā· home-assistant/core Ā· GitHub. no logs, no yaml for the apparently failing automation. No spark that the addition of _2 in an entity name indicates some problem.

But at the same time I agree, no response at all from the code owners.

Itā€™s not an automation. Itā€™s just turning on the hot water in the thermostat entity using . There is no log generated. I could, I suppose have posted the exact error message. But it is as simple as turning on the Hive thermostat hot water. I have no entities with _2 in the name. As you said - no code owner response. I have looked at possible solutions and so far have seen that I can use my home bridge server to link to hive and then the home kit home assistant integration to link to that. Itā€™ll be a workaround.

I will try again if a .3 release comes out. But hey, this is the joys of OSSā€¦

PS: If youā€™ve ever worked in customer support ā€œquality of issue reportingā€ will put peoples backs up - constructive criticism is far better.