This assistant cannot control your home (since 2024.8.x)

silkyclouds · August 13, 2024, 7:00am

Hi all,

Since I’ve updated to HA 2024.8.0 (and now, 2024.8.1) I can’t use my voice assistant anymore when using a web browser. The message “This assistant cannot control your home” appears when selecting the assistant shortcut.

Assistants are not listed in the assistants list anymore when you click on the upper part of the assistant popup :

This while I do have two assistants configured :

and properly configured :

fun fact, the assistant DO work when I’m using the HA mobile companion app :

This is happening whatever browser I am using + on my LAN and on my cloudflared tunnel… Anyone here has an idea on how to fix this ? (rolling back to 2024.7 works, but I’d like to fix this under 2024.8.x)

Radioffka · August 14, 2024, 12:08am

Hi, I’m experiencing the same issue. Thank you for the perfect description. I hope someone can advise on how to fix it. However, I’m afraid it might be due to an incompatible library that was implemented in the latest HA update. We’ll probably need to wait for a new patch of Extended Open AI.

silkyclouds · August 14, 2024, 12:34pm

I did not check my extended openAI integration settings, and indeed :

Still, it is weird it works with absolutely no issue on mobile clients (ios here) and when using an atom echo device as input.

Radioffka · August 14, 2024, 10:09pm

yes, it seems we have exactly the same problem:) I can confirm that mobile app (android, iOS) run smoothly as well. I installed normal version of OpenAI conversation and there is no issue. Of course, now is a problem with restricted settings for instructions and behavior.

kuligs2 · August 15, 2024, 6:29pm

Bruds… i can confirm its borked… the assist works on the phone but does not work in browser :(… i just updated today and it still broken

kuligs2 · August 15, 2024, 6:37pm

EDIT:

It works in brave browser but doesnt in firefox on the PC… bruws…

taiman · August 16, 2024, 10:16am

I’ve got the same problem

Roarrk · August 16, 2024, 3:47pm

Took the liberty to post this as a github issue:

github.com/home-assistant/frontend

Unable to use Assistant through browser

opened 04:34PM - 16 Aug 24 UTC

Roarrk

### Checklist - [X] I have updated to the latest available Home Assistant versi…on. - [X] I have cleared the cache of my browser. - [X] I have tried a different browser to see if it is related to my browser. - [x] I have tried reproducing the issue in [safe mode](https://www.home-assistant.io/blog/2023/11/01/release-202311/#restarting-into-safe-mode) to rule out problems with unsupported custom resources. ### Describe the issue you are experiencing Since updating to HA 2024.8.x I can’t use voice assistants anymore when using a web browser. The message “This assistant cannot control your home” appears when selecting the assistant shortcut, while not being able to select any of the available assistants configured. This is both for Safari and Firefox. iOS works fine, and so does debugging the assistant through developer tools. I have tried with official and unofficial assistant integrations, including deleting and re-adding them (Google AI, Anthropic AI etc). They worked before 8.x upgrade. ### Describe the behavior you expected I should be able to comunicate with the assistant through the "Assist" window in a browser, as I was previously. ### Steps to reproduce the issue 1. Open "Assist" in a web browser 2. Watch it fail ### What version of Home Assistant Core has the issue? 2024.8.1 ### What was the last working version of Home Assistant Core? _No response_ ### In which browser are you experiencing the issue with? Safari Version 18.0 (20619.1.26.11.3) and FireFox 130.0b5 (64-bit) ### Which operating system are you using to run this browser? macOS Seqouia ### State of relevant entities _No response_ ### Problem-relevant frontend configuration _No response_ ### Javascript errors shown in your browser console/inspector _No response_ ### Additional information https://community.home-assistant.io/t/this-assistant-cannot-control-your-home-since-2024-8-x/759320/8 Thread with others having the same issue

tiagoferreira · August 16, 2024, 8:16pm

I have the same problem. So i supose that everyone using OpenAI have the same issue

taiman · August 22, 2024, 12:06pm

any updates on this?

silkyclouds · August 23, 2024, 9:19am

funny to see that not much people are complaining. Is such a small amount of users using openAI assistants ?

IoSonoAndreaZ · August 26, 2024, 6:09am

same issue here and still present in 2024.8.3
I don’t use ollama but gemini and chatgpt.

Chris_Holt · August 26, 2024, 8:52am

i just noticed this last week, cos i only really use it on my phone unless im making changes to home assistant then i use the browser to test things… its weird that it works fine through the mobile app but something has changed and prevents it working in the browser

HAuser_1 · August 28, 2024, 7:41am

have the same issue

Wolfgeek · August 30, 2024, 7:44pm

Bump - same here.

wangine · August 30, 2024, 11:56pm

Strange thing is first time i install HA on debian , and i was thinking i configure something wrong. Still my HA dont work in brave either
Is my first comm’ here

huotarih · August 31, 2024, 6:01pm

Hey, just wanted to come and put my first comment in here as I just got local Llama3.1 model running.

I had to go to the settings of the model and enable assist.

It doesn’t work with all my requests, but seemed to work atleast controlling the office lights.

Deathbot64 · September 1, 2024, 9:32pm

Having this issue with the Fallback Conversation Agent

Nitroedge · September 2, 2024, 5:15pm

Yup me too, broken on Chrome and my PC local… I get “This assistant cannot control your home.”

EDIT: Further testing, same error on Brave, Firefox, Arc browsers… Works fine on Android phone using HA Companion App.

Nitroedge · September 2, 2024, 9:34pm

But can you send it commands through Assist in the browser?
I’m using the Extended OpenAI Integration… I cannot use Assist in any PC browser as I get the error message of this thread… only my mobile with HA companion app works.