Does anyone know if there is something like this, or does someone with experience want to help me build it?
I envision a small ESP32 with Cam, battery powered, that could clip on to a ball-cap or otherwise attach to anyone’s head. Not sure if it could do reliable AI on device, or needs a client program that would run on a PC and do all the communicating with Home Assistant.
After training/setup, you would be able to point at a light, and then adjust its brightnestt with your hand, flat moving up or down. You would be able to point at your thermostat and then adjust the temp with your hand, turning a knob left or right. You would be able to turn on a fan by pointing at it and then spinning your finger in a circle.
I’ve recently seen such things done with WLED and a Meta VR Controller… it’s can’t be too hard to get full HA control with a camera and your finger these days. Does anyone know if this exists, or would anyone like to help build it?