2025.1: Backing Up into 2025!

Yes but apparently we’re too stupid to manage our own backups and prevent them filling up the disk. As the new system has no way of cleaning up after these add-on update / core update backups.

20 Likes

Logs might be a good start :wink:
especially on the templates if you already suspect anything there
could also be another entity from some integration which you use in those templates

I’m betting on a slow integration using the old blocking calls. There will be warnings or errors in your logs about this.

Thanks for your suggestion. I looked at the logs and found this:

2025-01-07 13:10:19.836 WARNING (MainThread) [homeassistant.bootstrap] Setup timed out for bootstrap waiting on {<Task pending name=‘Task-566’ coro=<MySkodaDataUpdateCoordinator._mqtt_connect() running at /config/custom_components/myskoda/coordinator.py:180> wait_for= cb=[set.remove()]>} - moving forward

I deactivated the integration and now HA restarts are as quickly as before. Thanks!

3 Likes

OK, so I was debating chiming in here or not, as this thread is already cray-cray. But I have a rule about not letting brave people stand alone or feel unappreciated, so I needed to voice my support for all the work that @tom_l and @ShadowFist have done in this thread and for their other contributions such as during beta rounds; your efforts may not be celebrated but they sure as heck are appreciated by a great many people, so thank you. :pray:

After that intro, let’s cut to the chase…

I may not be a backup expert, or a code expert, and my HA install is rudimentary at best. But what I am expert at is Agile methodologies, Product Ownership and leading development teams. And I can tell you that description is NOT best practice, and it is 100% NOT what MVP is about.

The principle of MVP is “what is the least/cheapest amount of work we can do to run an experiment that we can learn something from”. Examples of cheap things include interviews with ‘friendlies’ or subject matter experts, surveys and questionnaires, low-fidelity mockups. Slightly more expensive options are conceptual or functional prototypes, usability tests, competitor analysis. But the MOST expensive option? Code! It needs to be architected, designed, written, reviewed, unit tested, regression tested, with branches, merges, backouts and pull requests. Even after all that it needs have release notes and instructions written and support docs updated. But that’s just the beginning because - if you use code to release an MVP to test a hypothesis with a foundation concept that’s wrong - you then need to spend lots more time dealing with a 600-post thread and a community backlash.

NC could have just asked the questions from your post in a dedicated survey thread to get the same answers without all this drama and wasted time, so that was a major mis-step that I hope the team has learned from.

From what I’ve read in this thread the other major error seems to be that there was even a beta test where the same feedback was given. I’m puzzled as to why NC would go to the trouble of having a beta group if it wasn’t going to listen to the feedback? Those beta testers are end-users, so their opinions should be like gold. And if NC disagrees with those kind beta-testing end-users then that’s the perfect time and reason to then run surveys and other low-cost tests with a wider sample size and audience to see which approach is right.

I hope this is the last time this sort of thing happens, as the user-base here is exceptional and their voices should be valued and listened to, and their time and expertise should be respected and leveraged like the brilliant tools that they are.

tl;dr: “MVP” is for testing hypotheses with a subset of users in a safe and non-destructive way. It should never be used for directional shifts in a live product’s foundation concepts that will impact 100% of the user-base.

49 Likes

You found a workaround for the ics Problem?

It’s so often misinterpreted by devs in general to justify pushing POC to production… I can see it in many companies (incl. one I work for).
Don’t ask me why. You as Agile specialist probably knows its genesis.

However, I’m pretty confident, that what happened here, is not an accident. IMO it’s planned to be forced because of some non-communicated interest. I cannot believe it’s because of a lack of education or imagination. It also applies to Madelena’s questions. I feel so abused by them…

17 Likes

in addition to the backup system of version 2024.12 (how can we force local encryption in the new release, we are able to personally manage our backups!!) I make a monthly clone of my ssd attached to the rpi 4 via the windows balena program. it works like a charm

I don’t think they need your work as an apologist.

They haven’t even acknowledged the biggest gaps.

I think you are pretty close here… As I pointed out previously, even more concerning than forced encryption is the abandonment of encryption keys of your own choosing. From now on you have to trust the operating system that the encryption key stays on your local installation, otherwise the door to decrypting cloud-data will be wide open…

6 Likes

I wouldn’t be surprised by a 2025.1.2

Here’s a nice backup situation summary I saw on Discord:

We have custom encryption, that:

  • is enforced
  • has no decryption tool
  • has security issues (nonrandom IV)
  • has file format issues (gets random broken due to padding, known for 2 years)
  • is turned off, when it is the most critical (before update)
48 Likes

I love this, and echo your comments and support for the likes of tom_l and ShadowFist.

I’ve been following this since the beta, and have read every comment in this thread and the other related ones on the forum, PRs etc. Until a few moments ago, this just felt like another situation like the badges update - a big change that wasn’t well received, created a lot of noise, then things eventually settled down and we moved on.

But this feels different. I cannot remember seeing so many liked comments, replies and support, and it seems the mood is shifting from confusion/annoyance/anger to defeat. I know in the grand scheme of things that the sum of all of these likes and replies would still represent a minority in the total HA userbase, but surely it has to be indicative?

We’ve seen two formal responses from the HA team. Neither of which really said “we hear you, we might have got this wrong, let’s see what we can do”. Instead, we got a “why do you need this?” even though the feedback in the beta provided all of this, and a “you can unencrypt the encrypted backups in the application that might unavailable for the very reason that you’re trying to access your encrypted backup”.

I get that they might be reluctant to create a precedent and demonstrate that given enough noise, the community can force a change, but I have never seen this community so alienated.

Even if the HA team was to announce today that backups before updates and unencrypted-by-default local backups would return in the next release, I fear the damage has already been done - we’ve seen amazing mods and contributors start to question their future in the project and the HA team is going to have to work very hard to put this right.

We know HA is used by high profile individuals in the media. How long until LTT or The Verge runs a piece on this? That in itself could undo the amazing work that the HA team has done in recent years to promote this project.

I now find myself at the bargaining stage: HA team - please listen to your community. Enforced encryption for cloud backups are a must, but please let us chose whether or not encrypt when backing up to our trusted local sites. Also, please bring back the option to backup before installing updates.

42 Likes

My gut feeling is the same. But this would be self-inflicted if they (and yes I’m back in they and we) react and wait until there is a blind alley in the way you are mentioning.

3 Likes

Am I missing something here?
In 2025.1 does Settings → System → Backups encrypt the local backup file?

Thank you NC the HA team & community for your past, current & future work. It is quite amazing.

I too would like the choice to Not-encrypt or to encrypt At Will please.

I would also like the “pre-update backup” toggle to return please.

It would be very useful to enable multiple scheduled backups with or without encryption for each scheduled event for when and wherever is chosen. Local, LAN, Cloud, Carrier pigeon, Swappable removable drives etc…

How often: 1 - 2 weeks, activity dependant.
What for: Management or files & to cut paste; thus far :wink:
Restoration: Non so far; but only been using HA for around 18 months or so.

On another note: HACS disappeared completely from my RPI3 Core install, I re-installed it. The only other casualty is local zigbee eWelink TH01 disappearing, I had the hammer of fixing in mind when re-configure didn’t work, but removing & adding worked.

TTFN.

3 Likes

How about this?

Complete encrypted backups - necessary because I do not want any credentials stored unencrypted anywhere,
and a second backup type that has a lot of data stripped out - logs, history and credentials that might be useful when I need to repair a script or broken config.

For a while I was considering signing up for NC to support the team. The way this has been handled has made me reconsider this.

I’d venture a guess that this system is designed to encourage people to use the great features provided by NC which is understandable and reasonable, however the implementation has caused people to go the other direction. More importantly than the implementation has been the communication or lack thereof.

There has been clear communication on the community’s side. It is unreasonable to ask for something clear on your end Nabu Casa? I get the burden of leadership. Mistakes happen, they are growing pains, leaders recognize them, own them, and move forward together.

The community is what makes Home Assistant. I suggest that without it, it would not be the awesome platform that it is today. Can you imagine HA without the community? I can’t.

It’s tempting to think it’s ok to make decisions like these behind closed doors and stand firm when they’re rejected, however it’s alienating and divisive. This is not dividing to the community. The community’s unity is fairly clear. This is perpetuating a rift between Nabu Casa and the community.

(If you’re interested in one person’s opinion of a path forward, start with sharing the reasons why this isn’t a straight forward pivot, and discuss what it would take to meet the major requests (unencrypted local backups, and restoring the update toggles)).

Perhaps you don’t care. I hope that you decide to show us otherwise.

17 Likes

OMG, our last resort is gone !
Even after this complete debacle, they still did it ?

Silence from the team on all these backup complaints. I simply don’t get why and there are still no unencrypted option for backup when reading 2025.1.1 notes.

8 Likes