Talking to nabu (HA Voice PE) directly with ESPHome client.js lib

I’ve got a project here where I want to interact directly with my HA Voice PE (Nabu) puck without going through HomeAssistant. I’m using ESPHome’s python libraries and can connect to the device and configure it to send me audio streams after a wake word is detected.

But I can’t figure out how to get it to stop the stream when the user is done speaking. There are API events for enabling/disabling VAD (voice detection) but none of these seem to work. And I haven’t been able to find any references in the HA python code that I have running successfully here and can control the puck with voice streams.

Any pointers?