Hi all,
I've turned my Home Assistant Voice PE into a natural, low-latency voice assistant
running on OpenAI's Realtime API (gpt-realtime-2). The device streams audio to a
small HA add-on that runs the speech-to-speech session and controls your home through
the official MCP Server integration — lights, scenes, climate — and it has web
search built in (weather, news, quick facts). It's a real back-and-forth conversation
rather than the classic pipeline.
It comes in two parts :
- Add-on: GitHub - xandervanerven/ha-openai-realtime · GitHub
- Firmware: GitHub - xandervanerven/home-assistant-voice-pe: Home Assistant Voice PE — OpenAI Realtime 2 fork · GitHub
A full step-by-step install guide (INSTALL.md) is linked right from the firmware repo's
README, and each repo points to the other.
Setup is mostly one-click once the add-on and a small ESPHome stub are in place. Heads-up:
it's an experimental hobby project and runs on OpenAI's paid API, so you'll need an
OpenAI key with billing enabled.
Would love for people to try it and share feedback!