Multi-provider LLM integration with service calls, YAML editing and dashboard generation
Hi everyone ![]()
I’d like to share AI Assistant for Home Assistant, a Home Assistant add-on that provides a chat interface connected to multiple LLM providers and allows structured interaction with your HA instance.
The goal is not just “chatting with AI”, but enabling controlled, validated operations inside Home Assistant using natural language.
What it does
Multi-provider LLM support
You can configure and switch between multiple providers:
- Anthropic (Claude models)
- OpenAI (GPT models)
- Google (Gemini)
- NVIDIA (NIM)
- GitHub (GitHub Models)
40+ models supported depending on provider availability.
Switching model/provider only requires changing settings in the add-on configuration.
Native chat interface (Ingress)
- Integrated in the HA sidebar via native Ingress
- Conversation history persists across restarts
- Streaming responses (when supported by the provider)
- Visual indicators when tools/service calls are being executed
- Multilingual support (EN / IT / ES / FR)
Service calls & entity interaction
You can use natural language to:
- Call Home Assistant services
- Change entity states
- Query entity status
- Retrieve statistics and history
The assistant generates structured actions that are executed through HA APIs.
Automation & YAML generation
The assistant can:
- Generate automation YAML
- Modify existing automations
- Show diffs before applying changes
- Read and suggest edits to configuration files
Changes are not blindly applied — the workflow allows preview and validation.
Lovelace dashboard generation
You can request dashboard creation via natural language.
The assistant:
- Detects relevant entities
- Generates appropriate card structures
- Builds Lovelace views automatically
It validates entity existence before use to avoid empty or broken dashboards.
Image / Vision support
If the selected model supports vision, you can upload images or screenshots and include them in the conversation context.
Architecture approach
- Prompt routing depending on request type (service call, YAML edit, dashboard generation, etc.)
- Structured tool usage instead of free-form responses
- Validation steps before applying configuration changes
- Provider-agnostic design
This is not an autonomous agent — it executes user-requested actions within defined boundaries.
Installation
- Add repository:
https://github.com/Bobsilvio/ha-claude - Install AI Assistant for Home Assistant
- Configure at least one API key
- Open from the sidebar
Repository:
https://github.com/Bobsilvio/ha-claude
Issues / Support:
Why I built this
I wanted a way to interact with Home Assistant that goes beyond voice commands — something that can generate YAML, assist with configuration changes, and build dashboards while still keeping the user in control.
Feedback, edge cases and suggestions are very welcome.





