2024.6: Dipping our toes in the world of AI using LLMs šŸ¤–

Blog
110

Again, another amazing release from the HA team.

I have to say A BIG THANK YOU!! to @karwosts for developing collapsible sections in blueprints. I get asked about this all the time, and seeing it go from a feature request to being developed and now implementedā€¦ nice. As always, I have tested it, and it works flawlessly. I will be rolling this out in many of my blueprints. It makes them so clean and very easy to use now. On behalf of everyone using blueprints and all the blueprint developers, THANK YOU!!

Watching the YouTube releaseā€¦ JLo, you are a weapon.

Blacky :smiley:

2 Likes
111

Wow, what an amazing release! Thanks so much to everyone whoā€™s been working on this - you are all epic. :smiley:

112

How complicated is it to add the autocorrect to home assistant

113

Could something like a Coral TPU enable a RPi to run a local model?

114

Since upgrading to 2024.6 I am experiencing many issues/outages.
I am new to Home Assistant but not networking or home automation.

So far, Govee, Shelly, Sonos, Nanoleaf are all failing, plus not sure if related but the Symfonisk Remote Blueprint is configuring but unable to see any of the buttons presses visible in Home Assistant Device page and the Automation is not showing either.

Not sure if these are related yet.

Need to figure out how to roll back to 2024.5.

Looks like I just run ha core update --version 2024.5.6 ?

115

the ha core update --version 2024.5.6 command will revert you but not solve the issuesā€¦

have a look here How to help us help you - or How to ask a good question, post your logs, share what config and setup you have and who knows maybe the issues(s) you have can be solvedā€¦youā€™ll never know if you donā€™t ask :grin:

1 Like
116

Did you miss this bit?

Local LLMs have been supported via the Ollama integration since Home Assistant 2024.4. Ollama and the major open source LLM models are not tuned for tool calling, so this has to be built from scratch and was not done in time for this release. Weā€™re collaborating with NVIDIA to get this working ā€“ [they showed a prototype last week.] (https://youtu.be/aq7QS9AtwE8?si=yZilHo4uDUCAQiqN)

2 Likes
117

That appears to have been added after publication and after my comment, as this snapshot from the Wayback Machine shows. You can compare the timestamp of my comment with that of the Wayback snapshot: the passage wasnā€™t there when I commented.

3 Likes
118

Well, I guess they sort-of responded to your comment, then.

2 Likes
119

If you want to use Gemini in Europe, there is no free plan available. But, if you activate first Gemini free credit in a project in Google Cloud console, you will get three months of free Gemini in the Gemini studio. Then activate Gemini API through the studio console, and here you are, 3 months of Gemini credit.

First try are quite awesome, despite some issues with special characters in room names, like CheminƩe in French.

But so cool to ask Assist : What is the warmest room ? Open covers in the kitchen half way ā€¦

So so cool. Sure I would prefer to have it running a local LLM but it a first approach to replace Siri in day to day use.

1 Like
120

Good morning all. Itā€™s a Saturday here and my weekday routines have all fired! Seems something is up with workday_sensor

1 Like
121

Two days after 2024.6 and thereā€™s already an update?

This pace of software releases is too fast. Iā€™d prefer stability to new features.

How about even months thereā€™s UI updates and odd months thereā€™s integrations updates?

2 Likes
122

Yep, Iā€™ve just discovered the same thing. My workday sensor is ā€˜onā€™ despite being Saturday.

1 Like
123

This workaround automation seems to handle it for me.

alias: Workday sensor fix
trigger:
  - platform: time
    at: "00:00:00"
action:
  - service: homeassistant.reload_config_entry
    target:
      entity_id:
        - binary_sensor.workday_sensor
        - binary_sensor.workday_tomorrow
        - binary_sensor.workday_yesterday
1 Like
124

I think weā€™ll have to agree to disagree. I think that modern generative LLMs do not understand the words they output. They work based on word distributions following the trained statistical path through their network. But I will acknowledge that for simple queries they seem able to predict the intent of the query and produce valuable results. It seems to me that Home Assistantā€™s voice is a good candidate for simple AI use.
In fact the company Hailo recently partnered with Raspberry Pi to produce a 70$ AI kit with a neural network M.2 card for computer vision acceleration. And Hailo has announced a forthcoming processor able to process LLMs. This might be another local solution to language processing in Home Assistant.
If you havenā€™t read it yet, this blog post about HA and the furture of AI interfaces is very interesting (and reassuring to me).

1 Like
125

Having a non-YAML background control is great! Now, I wish there was a card transparency control. And if there was a ā€œfrosted glassā€ effect ā€” that would be even better.

3 Likes
126

No one is forcing you to update. There are plenty of people who only update annually. You apparently donā€™t know the difference from open source and production software. If you want stable production-quality IOT that rarely updates, then buy a Bosch or Seimens system. But donā€™t ask them for DIY help or adding hardware from other manufacturers. But, you will never be bothered with monthly updates.

In my home I have over 110 WiFi clients. Many are things I built using ESP modules. I like the flexibility that Home Assistant allows. If all you want to do is turn some lights on and off and never be bothered with an update, then buy one of those very expensive closed systems.

5 Likes
127

FYI, understand that ā€Yā€ releases in ā€YEAR.X.Yā€ only add cherry-picked bug-fixes, not new features, as it is only the ā€Xā€ releases that adds new features.

Example: 2024.6.1 and so on only adds cheery-picked bug-fixes to the 2024.6.0 release.

Regardless, stating that there are too many releases is a stupid thing to complain about to a free and open-source project.

Be glad that there are releases at all and simply choose not to update each release, (I know many that only update once a month, usually at the end of the month).

128

Yes, that was the problem. Bus error. I did not want to put dev versions on my main controller so I was stuck to 2024.5.5.

i noticed it being detected and discussed before my post.
Now it is available in 2024.6.1 and my system works again.

thanks for the great work!

129

You can got to Settings ā†’ Voice Assistants ā†’ Exposed Entities ā†’ Expose Entities ā€¦

image

image

Then you have a list of checkboxes

image
image497Ɨ716 16.4 KB