Sound recognition sensor for HomeAssistant and Meshtastic

Thank you for letting me share this acoustic sensor node project I’ve been working on the last 1-2 years and now campaigning as open source project on crowdsupply. I’ve shared a little bit about the history on Reddit and you can look up some specs on the campaign page.

Here I would like to show you some real pictures and functions:

Basically, it’s an acoustic sensor, it classifies sounds. You can choose which sounds you want to alert to your Home Assistant Broker or have broadcasted to your private Meshtastic channel. E.g. vehicle sound at your gate, wild animal in your camp ground, neighbors cat in your backyard, stressed chickens, etc.

It uses Google’s Yamnet model for classification, packed on an ESP32 microcontroller. There is the possibility to teach some new sounds and scenes (sounds over a period time: eg water tap, dishes and pots, drawers, microwave = kitchen activity). You can have a node far away from your home network, it’ll send the message to a node via Lora to a node that’s on the network. On a network the nodes use WiFi to communicate, offline or hybrid the broadcast goes via Meshtastic within your private node fleet, HomeAssistant via MQTT.

Please checkout the crowdsupply page for more info and let me know what you think!!

1 Like