HouSign - Control Home Assistant with hand gestures — no extra hardware, just your webcam

Share your Projects!
1

HouSign — Gesture Control for Home Assistant

Download - HouSign-Setup.exe

Control your smart home with hand gestures. No buttons, no voice, no phone — just a wave.

HouSign watches your camera in the background, detects hand gestures using MediaPipe, and fires actions in Home Assistant the moment it recognizes what you’re doing.

:tv: See it in action

:clapper: Watch the demo

image
image1907×981 78.7 KB

What it does

  • Runs quietly in the system tray — starts with Windows, stays out of your way
  • Uses your webcam to track hand gestures in real time
  • Sends commands to Home Assistant via WebSocket (lights, media players, scenes, scripts — anything)
  • Supports an activation gesture (like a wake word, but for your hands) so it only listens when you want it to
  • Plays sound feedback so you know when it picked up your gesture
  • Comes with a clean settings UI to configure everything without touching JSON

Getting started

Option 1 — Windows installer (recommended)

Download HouSign-Setup.exe from Releases, run it, enter your Home Assistant URL and token, done.

The installer handles everything — shortcuts, autostart option, default config.

image
image1196×867 79.1 KB

Option 2 — Run from source

git clone https://github.com/SmolinskiP/HouSign
cd HouSign
python -m venv venv
venv\Scripts\python.exe -m pip install -r requirements.txt
python ha_gestures/app.py

Requires Python 3.11.

Configuration

On first run, open Settings from the tray menu and fill in:

  • Home Assistant URL — e.g. http://homeassistant.local:8123/
  • Long-Lived Access Token — create one in HA under Profile → Security → Long-Lived Access Tokens

image
image1875×409 18.2 KB

Activation gesture

By default, HouSign uses an activation mode — it won’t fire commands until you make a specific pose (like an open palm held for ~600ms). This prevents accidental triggers while you’re just moving around. You can disable it and go always-listening if you prefer.

image
image840×935 29.6 KB

How gesture bindings work

image
image1723×514 71.6 KB

Each binding connects a gesture to a Home Assistant action:

Field Example
Gesture open_palm
Mode one_hand
Action type service
Domain light
Service turn_off
Entity light.living_room

image
image1856×532 11.7 KB

Execution modes:

  • instant — fires once, immediately ends the session
  • hold & repeat — keeps firing while you hold the gesture (great for dimming)

System tray

The tray icon shows the current runtime state and lets you open settings, start a preview, reload config, or quit.

image
image233×196 3.53 KB

Requirements

  • Windows 10/11 (64-bit)
  • Webcam
  • Home Assistant instance reachable on your local network

Built with

1 Like