🚀 Introducing AI Agent HA - Create Automations & Dashboards with Just Plain English with AI agent

Tired of complex Home Assistant setup? Just tell AI what you want in plain English!

:sparkles: Create Dashboards by Chatting:

  • :speech_balloon: “Make a security dashboard with all my cameras”
  • :speech_balloon: “Build a living room control panel”
  • :speech_balloon: “Create an energy monitoring dashboard”

:zap: Build Automations with Words:

  • :speech_balloon: “Turn on porch light when someone arrives”
  • :speech_balloon: “Dim lights when TV turns on”
  • :speech_balloon: “Alert me if doors are left open”

No coding. No YAML. Just conversation.

The AI finds your devices, organizes everything, and creates it all for you - in seconds!

Works with: OpenAI GPT-4, Claude, Gemini & more

:link: Try it now: GitHub - sbenodiz/ai_agent_ha: A Home Assistant custom component that provides an AI-powered agent capable of generating automations based on natural language queries. The agent connects to all entities in your Home Assistant instance and uses OpenAI's or Llama API to translate user requests into valid Home operations including creating automations for you! (also available in HACS, search for " AI Agent HA"

Transform your smart home with the power of conversation! :rocket:

#HomeAssistant #SmartHome ai #NoCode

Let me know what do you think, it’s alpha version

1 Like

This sound very interesting will try later today thanks

1 Like

I honestly don’t trust AI agents that much… often ChatGPT or Gemini make way too many mistakes and don’t compile automations correctly.

Most of my queries just show “Unknown response type: get_entities_by_domain”
Any ideas to fix?

sure, the agent will not do any operation without your approval. The agent first show you what they plan to do in terms of automation/dashboard and only if you approve it it will deploy it

can you share the logs? best will be to open issue in Github, it’s the first time I am seeing that message

it think its a good idea to add a blue my HA Button.

sorry, what do you means by that?

i try frist to see if can turn on off a light , it does but get this error

try with how many light are on


like there: GitHub - zollak/homeassistant-syslog-receiver: A Home Assistant integration that receives and filters syslog messages (UDP/TCP/TLS), fires events for automations, and can expose optional sensor entities.

Sure. added! thanks for the tip

Good morning! great tool thanks!! I’m using with GEMIMI 2.0 flash but when try to switch to 2.5-pro model have no successs any tip?

TBH I didn’t test Gemini API. can you please share you logs and open issue in github?

which AI should i get API keys from? is it i must subscribe from the AI services?

This seems a great idea, but I can’t find any way off getting out of it via the Companion App.

Had to disable the integration via browser then restart.

I missed some flexibility, I use the dirt cheap GLM Coding Plan with GLM-4.6 for 6 dollars a month, anyway long story short, you can find and install it here, it works as described but only if you have a GLM Coding Plan :wink:

Release GLM Agent HA v1.00.6— Full Fix & Polished Integration with GLM Coding Plan API · johnneerdael/glm_agent_ha

Add GitHub - johnneerdael/glm_agent_ha: A Home Assistant custom component that provides an AI-powered agent capable of generating automations based on natural language queries. The agent connects to all entities in your Home Assistant instance and uses OpenAI's or Llama API to translate user requests into valid Home operations including creating automations for you! as a custom repo under hacs if you want it :wink:

I tried the local model option but it does not seem to want to work with Ollama ?

This plugin is dangerous (which, like, I totally could have guessed). I asked it to make a dashboard for me and it completely rewrote my config.yaml erasing everything. Excellent example of the unexpected side effects of an AI Agent. Recovered from backup. Terrible idea.

Against my better judgement I may continue to experiment with it; I came here looking for a way to give an AI the contents of my home to better make dashboards, maybe I’ll figure out a good way to do that with this.

1 Like

Yes and quite honestly it’s not been stressed enough. If you’re new to LLMs and see openclaw it’s shiny… Yes great capabilities…

But we need to be CRYSTAL CLEAR - ANY llm with direct access to your config directory is dangerous. This… This is just like if I had decided to jump on my Harley barefoot with shorts, no helmet and decided to run high speed in through a busy construction zone laying down a gravel base…

Yeah I can probably do it but there’s also an extremely high chance 'll fall get crunched burned on the pipes or wipe the heck out with zero safety gear.

Many. Many Many people do not seem to realize this is possible with ANY LLM given direct write access to your HA install.

You’re risking the entire setup. Yeah it’s that bad.

Just be glad it didn’t export your secrets file… (hint yes it ab-so-freaking-lutely can)

THIS ^^^ is the exact reason why I do not currently endorse ANY llm that has direct access to write to your config directory. If you know what you’re doing great… do put on the damn helmet. Also glad you’re back up.