I was able to setup an app to send audio over the websockets to Home-Assistant. Using Porcupine to detect a wake word and send the audio to a voice assistant pipeline.
Currently I am testing with a raspberry pi, USB microphone and the OpenAI conversation integration. You can setup the prompt for OpenAI to get information on people in your household and have a voice pipeline speak something clever.