Yes, for example. But 2023.11 also had a database upgrade. Which isn’t mentioned in the releasenotes. That’s why I’m asking.
tom_l
December 5, 2023, 12:54pm
342
It wasn’t mentioned because it did not have one.
Why did my logs say “Database is about to upgrade from schema version: 41 to: 42” after upgrading from 2023.10 to 2023.11 then?
tom_l
December 5, 2023, 10:26pm
344
Maybe because your stats migration failed previously and this is now caught and fixed:
home-assistant:dev
← home-assistant:migrate_stats
opened 06:30PM - 10 Oct 23 UTC
## Proposed change
<!--
Describe the big picture of your changes here to com… municate to the
maintainers why we should accept this pull request. If it fixes a bug
or resolves a feature request, be sure to link to that issue in the
additional information section.
-->
The stats timestamp migration had some somewhat rare failure cases that were not accounted for:
- If a user has duplicate rows that were manually inserted or inserted by external stats before we had the unique index they could fail to migrate. We now fallback to a one by one migration when this happens.
- If the user downgraded HA from 2023.3.x to an older version without restoring the database and they upgrade again with the same database they will have un-migrated statistics columns since we only migrate them once.
Because this involves migrating data, this should go through beta. While it means the users in the linked issue will have to wait a month for a solution, we need to make sure it doesn't have any side effects.
## Type of change
<!--
What type of change does your PR introduce to Home Assistant?
NOTE: Please, check only 1! box!
If your PR requires multiple boxes to be checked, you'll most likely need to
split it into multiple PRs. This makes things easier and faster to code review.
-->
- [ ] Dependency upgrade
- [x] Bugfix (non-breaking change which fixes an issue)
- [ ] New integration (thank you!)
- [ ] New feature (which adds functionality to an existing integration)
- [ ] Deprecation (breaking change to happen in the future)
- [ ] Breaking change (fix/feature causing existing functionality to break)
- [ ] Code quality improvements to existing code or addition of tests
## Additional information
<!--
Details are important, and help maintainers processing your PR.
Please be sure to fill out additional details, if applicable.
-->
- This PR fixes or closes issue: fixes #101466
- This PR is related to issue:
- Link to documentation pull request:
## Checklist
<!--
Put an `x` in the boxes that apply. You can also fill these out after
creating the PR. If you're unsure about any of them, don't hesitate to ask.
We're here to help! This is simply a reminder of what we are going to look
for before merging your code.
-->
- [x] The code change is tested and works locally.
- [ ] Local tests pass. **Your PR cannot be merged unless tests pass**
- [ ] There is no commented out code in this PR.
- [ ] I have followed the [development checklist][dev-checklist]
- [ ] I have followed the [perfect PR recommendations][perfect-pr]
- [ ] The code has been formatted using Black (`black --fast homeassistant tests`)
- [x] Tests have been added to verify that the new code works.
If user exposed functionality or configuration variables are added/changed:
- [ ] Documentation added/updated for [www.home-assistant.io][docs-repository]
If the code communicates with devices, web services, or third-party tools:
- [ ] The [manifest file][manifest-docs] has all fields filled out correctly.
Updated and included derived files by running: `python3 -m script.hassfest`.
- [ ] New or updated dependencies have been added to `requirements_all.txt`.
Updated by running `python3 -m script.gen_requirements_all`.
- [ ] For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
- [ ] Untested files have been added to `.coveragerc`.
<!--
This project is very active and we have a high turnover of pull requests.
Unfortunately, the number of incoming pull requests is higher than what our
reviewers can review and merge so there is a long backlog of pull requests
waiting for review. You can help here!
By reviewing another pull request, you will help raise the code quality of
that pull request and the final review will be faster. This way the general
pace of pull request reviews will go up and your wait time will go down.
When picking a pull request to review, try to choose one that hasn't yet
been reviewed.
Thanks for helping out!
-->
To help with the load of incoming pull requests:
- [ ] I have reviewed two other [open pull requests][prs] in this repository.
[prs]: https://github.com/home-assistant/core/pulls?q=is%3Aopen+is%3Apr+-author%3A%40me+-draft%3Atrue+-label%3Awaiting-for-upstream+sort%3Acreated-desc+review%3Anone+-status%3Afailure
<!--
Thank you for contributing <3
Below, some useful links you could explore:
-->
[dev-checklist]: https://developers.home-assistant.io/docs/development_checklist/
[manifest-docs]: https://developers.home-assistant.io/docs/creating_integration_manifest/
[quality-scale]: https://developers.home-assistant.io/docs/integration_quality_scale_index/
[docs-repository]: https://github.com/home-assistant/home-assistant.io
[perfect-pr]: https://developers.home-assistant.io/docs/review-process/#creating-the-perfect-pr
This is the only other db change I could find:
home-assistant:dev
← home-assistant:increase_sqlite_max_binds
opened 11:26AM - 05 Oct 23 UTC
## Proposed change
<!--
Describe the big picture of your changes here to com… municate to the
maintainers why we should accept this pull request. If it fixes a bug
or resolves a feature request, be sure to link to that issue in the
additional information section.
-->
For sqlite 3.32+ we can increase the max bind vars to purge / migrate more data in one call. For postgresql and mysql we can always use a larger max bind vars.
This is also a small improvement to startup time as well do a few less queries to find the attributes and states meta ids to record initial states
replaces and closes #96955
related issue #101100
## Type of change
<!--
What type of change does your PR introduce to Home Assistant?
NOTE: Please, check only 1! box!
If your PR requires multiple boxes to be checked, you'll most likely need to
split it into multiple PRs. This makes things easier and faster to code review.
-->
- [ ] Dependency upgrade
- [ ] Bugfix (non-breaking change which fixes an issue)
- [ ] New integration (thank you!)
- [ ] New feature (which adds functionality to an existing integration)
- [ ] Deprecation (breaking change to happen in the future)
- [ ] Breaking change (fix/feature causing existing functionality to break)
- [x] Code quality improvements to existing code or addition of tests
## Additional information
<!--
Details are important, and help maintainers processing your PR.
Please be sure to fill out additional details, if applicable.
-->
- This PR fixes or closes issue: fixes #
- This PR is related to issue:
- Link to documentation pull request:
## Checklist
<!--
Put an `x` in the boxes that apply. You can also fill these out after
creating the PR. If you're unsure about any of them, don't hesitate to ask.
We're here to help! This is simply a reminder of what we are going to look
for before merging your code.
-->
- [x] The code change is tested and works locally.
- [ ] Local tests pass. **Your PR cannot be merged unless tests pass**
- [ ] There is no commented out code in this PR.
- [ ] I have followed the [development checklist][dev-checklist]
- [ ] I have followed the [perfect PR recommendations][perfect-pr]
- [ ] The code has been formatted using Black (`black --fast homeassistant tests`)
- [x] Tests have been added to verify that the new code works.
If user exposed functionality or configuration variables are added/changed:
- [ ] Documentation added/updated for [www.home-assistant.io][docs-repository]
If the code communicates with devices, web services, or third-party tools:
- [ ] The [manifest file][manifest-docs] has all fields filled out correctly.
Updated and included derived files by running: `python3 -m script.hassfest`.
- [ ] New or updated dependencies have been added to `requirements_all.txt`.
Updated by running `python3 -m script.gen_requirements_all`.
- [ ] For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
- [ ] Untested files have been added to `.coveragerc`.
<!--
This project is very active and we have a high turnover of pull requests.
Unfortunately, the number of incoming pull requests is higher than what our
reviewers can review and merge so there is a long backlog of pull requests
waiting for review. You can help here!
By reviewing another pull request, you will help raise the code quality of
that pull request and the final review will be faster. This way the general
pace of pull request reviews will go up and your wait time will go down.
When picking a pull request to review, try to choose one that hasn't yet
been reviewed.
Thanks for helping out!
-->
To help with the load of incoming pull requests:
- [ ] I have reviewed two other [open pull requests][prs] in this repository.
[prs]: https://github.com/home-assistant/core/pulls?q=is%3Aopen+is%3Apr+-author%3A%40me+-draft%3Atrue+-label%3Awaiting-for-upstream+sort%3Acreated-desc+review%3Anone+-status%3Afailure
<!--
Thank you for contributing <3
Below, some useful links you could explore:
-->
[dev-checklist]: https://developers.home-assistant.io/docs/development_checklist/
[manifest-docs]: https://developers.home-assistant.io/docs/creating_integration_manifest/
[quality-scale]: https://developers.home-assistant.io/docs/integration_quality_scale_index/
[docs-repository]: https://github.com/home-assistant/home-assistant.io
[perfect-pr]: https://developers.home-assistant.io/docs/review-process/#creating-the-perfect-pr
1 Like
Updated to HA release 2023.11.3 this afternoon. Now it says I cannot use the weather information provided by the Ecobee integration as a platform for the weather:
item in configuration.yaml. I’d guess this is somewhere in the ‘breaking changes’ area of a release notes page?
This post is mostly intended as FYI for other Ecobee users… I simply disabled the weather:
item altogether. Can’t currently use the NWS integration because it’s not updating the sensor values, even though the Python component is parsing the JSON from NWS successfully.
nickrout
(Nick Rout)
December 6, 2023, 10:05am
346
Yep, the 41 to 42 was committed on October 23
home-assistant:dev
← home-assistant:migrate_stats
opened 06:30PM - 10 Oct 23 UTC
## Proposed change
<!--
Describe the big picture of your changes here to com… municate to the
maintainers why we should accept this pull request. If it fixes a bug
or resolves a feature request, be sure to link to that issue in the
additional information section.
-->
The stats timestamp migration had some somewhat rare failure cases that were not accounted for:
- If a user has duplicate rows that were manually inserted or inserted by external stats before we had the unique index they could fail to migrate. We now fallback to a one by one migration when this happens.
- If the user downgraded HA from 2023.3.x to an older version without restoring the database and they upgrade again with the same database they will have un-migrated statistics columns since we only migrate them once.
Because this involves migrating data, this should go through beta. While it means the users in the linked issue will have to wait a month for a solution, we need to make sure it doesn't have any side effects.
## Type of change
<!--
What type of change does your PR introduce to Home Assistant?
NOTE: Please, check only 1! box!
If your PR requires multiple boxes to be checked, you'll most likely need to
split it into multiple PRs. This makes things easier and faster to code review.
-->
- [ ] Dependency upgrade
- [x] Bugfix (non-breaking change which fixes an issue)
- [ ] New integration (thank you!)
- [ ] New feature (which adds functionality to an existing integration)
- [ ] Deprecation (breaking change to happen in the future)
- [ ] Breaking change (fix/feature causing existing functionality to break)
- [ ] Code quality improvements to existing code or addition of tests
## Additional information
<!--
Details are important, and help maintainers processing your PR.
Please be sure to fill out additional details, if applicable.
-->
- This PR fixes or closes issue: fixes #101466
- This PR is related to issue:
- Link to documentation pull request:
## Checklist
<!--
Put an `x` in the boxes that apply. You can also fill these out after
creating the PR. If you're unsure about any of them, don't hesitate to ask.
We're here to help! This is simply a reminder of what we are going to look
for before merging your code.
-->
- [x] The code change is tested and works locally.
- [ ] Local tests pass. **Your PR cannot be merged unless tests pass**
- [ ] There is no commented out code in this PR.
- [ ] I have followed the [development checklist][dev-checklist]
- [ ] I have followed the [perfect PR recommendations][perfect-pr]
- [ ] The code has been formatted using Black (`black --fast homeassistant tests`)
- [x] Tests have been added to verify that the new code works.
If user exposed functionality or configuration variables are added/changed:
- [ ] Documentation added/updated for [www.home-assistant.io][docs-repository]
If the code communicates with devices, web services, or third-party tools:
- [ ] The [manifest file][manifest-docs] has all fields filled out correctly.
Updated and included derived files by running: `python3 -m script.hassfest`.
- [ ] New or updated dependencies have been added to `requirements_all.txt`.
Updated by running `python3 -m script.gen_requirements_all`.
- [ ] For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
- [ ] Untested files have been added to `.coveragerc`.
<!--
This project is very active and we have a high turnover of pull requests.
Unfortunately, the number of incoming pull requests is higher than what our
reviewers can review and merge so there is a long backlog of pull requests
waiting for review. You can help here!
By reviewing another pull request, you will help raise the code quality of
that pull request and the final review will be faster. This way the general
pace of pull request reviews will go up and your wait time will go down.
When picking a pull request to review, try to choose one that hasn't yet
been reviewed.
Thanks for helping out!
-->
To help with the load of incoming pull requests:
- [ ] I have reviewed two other [open pull requests][prs] in this repository.
[prs]: https://github.com/home-assistant/core/pulls?q=is%3Aopen+is%3Apr+-author%3A%40me+-draft%3Atrue+-label%3Awaiting-for-upstream+sort%3Acreated-desc+review%3Anone+-status%3Afailure
<!--
Thank you for contributing <3
Below, some useful links you could explore:
-->
[dev-checklist]: https://developers.home-assistant.io/docs/development_checklist/
[manifest-docs]: https://developers.home-assistant.io/docs/creating_integration_manifest/
[quality-scale]: https://developers.home-assistant.io/docs/integration_quality_scale_index/
[docs-repository]: https://github.com/home-assistant/home-assistant.io
[perfect-pr]: https://developers.home-assistant.io/docs/review-process/#creating-the-perfect-pr
this must be something related to your config, my ecobee weather is still coming through without issue on 2023.11.3
edit: for clarity, I am using the ecobee integration, not the homekit integration.
I also have weather pulling from the Meteorologisk institutt (Met.no) integration so that I can also have an hourly forecast available in homeassistant, since the ecobee weather does not
It happened to me in the past that I tried to rollback just the HA container to a previous version, but then HA didn’t startup because the database schema version was newer than it expected. Because I didn’t rollback the database addon (I prefered to keep the data that was generated in the meantime).
So that’s why a little sentence in the releasenotes like 'this release has an upgrade to the database schema" would be real nice. So that people know they need to make sure to backup their database.
tom_l
December 6, 2023, 10:05pm
349
Yes I understand why you want a warning in the notes and I agree it should be included when there is a schema update .
However as I said, this release did not actually include an update . It only included a fix in case you missed previous updates.
So most people who the update worked for in a previous release would not see an update this time.
Something went wrong with your install when it tried to update your install in a previous release or possibly because of this:
Home Assistant now realises you are on the wrong DB version and updated it for you . This did not happen for everyone.
1 Like
VdR
January 5, 2024, 3:12pm
351
Had the same problem. That’s how I ended up here.
image969
(James Scialdone)
May 3, 2024, 6:19pm
352
Hey this worked great for my media player. Only thing missing is when I click the handle its a diff color…
Is there a md-slider-ON-CLICK-handle-color: orange
I can tell you for certain that my device ID’s changed. I did a comparison of an older core.device_registry to the one after the update. A big number of these changed…
The automations now have errors due to the ID’s changing.
petro
(Petro)
July 7, 2024, 8:36pm
354
Please show the comparison then
Here is an example…
Old: (2024.6.4)
{“area_id”:null,“config_entries”:[“c2cc4f4ef1e0bd78d35dd6921630d1c4”],“configuration_url”:null,“connections”: ,“disabled_by”:null,“entry_type”:null,“hw_version”:null,“id”:“5ab4f196bb5cacaf1d03f64991ae80d4”,“identifiers”:[[“mobile_app”,“f0db0ce87b8ca83d”]],“labels”: ,“manufacturer”:“samsung”,“model”:“SM-G991W”,“name_by_user”:null,“name”:“SM-G991W”,“serial_number”:null,“sw_version”:“34”,“via_device_id”:null},
New: (2024.7.1)
{“area_id”:null,“config_entries”:[“c2cc4f4ef1e0bd78d35dd6921630d1c4”],“configuration_url”:null,“connections”: ,“disabled_by”:null,“entry_type”:null,“hw_version”:null,“id”:“15626cf34118514d603501c0b20f25ed”,“identifiers”:[[“mobile_app”,“f0db0ce87b8ca83d”]],“labels”: ,“manufacturer”:“samsung”,“model”:“SM-G991W”,“name_by_user”:null,“name”:“SM-G991W”,“primary_config_entry”:“c2cc4f4ef1e0bd78d35dd6921630d1c4”,“serial_number”:null,“sw_version”:“34”,“via_device_id”:null},
petro
(Petro)
July 11, 2024, 2:15am
356
That would be a bug, I suggest you create an issue against the mobile app integration for Android.
Do you have other examples of “big” number of them changing?
The biggest number of devices that changed were my Zigbee devices (ZHA). I had to redo all of my automations that had anything to do with ZHA. Unfortunately, I deleted the backups after sending you the example. This is the second time for me that this has happened in 2023.11 and 2024.7. I know others have reported this as well in the past.
petro
(Petro)
July 11, 2024, 8:11pm
358
The point is, this should not happen. if/when it does happen, an issue should be written up against the offending integration. Your device IDs will not change. If they do, you encountered an issue.
I noticed that after removing all TODO integrations (tested few locally), the sidebar icon redirecting to /todo
still exits, showing nothing (empty page):
I expected that when the last todo.*
entity has been removed, that item is also removed. Now the only (ugly as it needs to be done on every client) way to hide them (temporarily) is to use Manage sidebar/menu items (hide/add/move) .
There’s also no config option at /config/lovelace/dashboards
like for other dashboards (“show in sidebar” config option). Nothing
Has that been fixed in a later HA release maybe?
Didn’t try yet
Good old Windows style right… haha