Run Lumo Proton's Private AI Inside Home Assistant

I love Proton's Lumo. It is a fantastic privacy-first AI assistant, but it is still locked behind the web interface. For people like me who want to integrate AI into their automations without compromising privacy or sending data to third-party clouds, there isn't a real solution, apart from running local LLMs on devices like the RPi5 or, if lucky, on a more powerful machine.

The community project lumo-tamer by ZeroTricks solved this by creating a local proxy that exposes Lumo's capabilities via an OpenAI-compatible API. And Home Assistant definitely understand the OpenAI API.

While lumo-tamer is powerful, setting it up in a Home Assistant environment can require some manual configuration and Docker knowledge. To make this easily accessible, I developed ha_app-lumo-tamer.

This is a dedicated Home Assistant app that packages lumo-tamer for almost seamless integration. Generating the initial token is still a bit cumbersome, but maybe some of you can help improve that workflow!

Key Features of the Add-on

  • Native Integration: Runs directly within Home Assistant as a standard add-on. No external Docker containers or complex networking required.
  • OpenAI Compatibility: Exposes a local endpoint using the Extended OpenAI Conversation integration that works seamlessly with Home Assistant's existing conversation tools.
  • Privacy First: All communication stays within your local network. Your prompts never leave your infrastructure, and authentication tokens are encrypted.
  • Easy Setup: Includes a guided configuration process and documentation for copying necessary vault files.
  • Built with Lumo: I actually wrote the code for this add-on using OpenCode connected to Lumo via the upstream project (I then contributed a guide on how to use lumo-tamer with OpenCode, proving the tool's utility for development workflows.

My First Agent: a calendar and agenda manager

I am now using it daily to keep my schedule organized:

  1. When I receive an email that requires an action, I forward it to myself into a dedicated IMAP folder.
  2. Home Assistant detects the new email.
  3. It sends the text to the ha_app-lumo-tamer endpoint.
  4. Lumo semantically analyzes the text, identifies it as a meeting or a task, and extracts the date/time.
  5. Home Assistant automatically creates the event in my Nextcloud calendar or adds the item to my to-do list.

This is just one example. I also added a voice assistant integration and I'm currently working on a morning "todo summary" greeting routine.

Get Started

You can find the add-on, installation instructions, and the token renewal automation blueprint here: ha_app-lumo-tamer on Codeberg

Huge thanks to ZeroTricks for creating the upstream lumo-tamer project that made this possible. If you have ideas for improving the token generation flow or other automations, feel free to open an issue or join the discussion!