This may be obvious, but make sure the mic is not muted. I have used whisper and HA Cloud for STT both successfully. I’m not sure about Azure STT. You may want to install whisper and piper and test to see if it is a problem with Azure.
Also try turning up the gain on rtpmic.
The microphone is not muted and i have tried all the gain settings in rtpmic (the level is correctly moving over 3/4th).
This is what i’ve in the services
Maybe there’s something wrong with the ip of rtpmic? How can i check if HA is receiving the stream?
Tried with whisper, no luck. Same as Azure/Microsoft
Perhaps. Or some sort of firewall block. I don’t know how to test mic in HA. I THINK you can probably use VLC on another computer and see if you can connecto to RTPMic and that it is streaming the audio. If that works then you can eliminate RTPMic issue I guess.
I’ve set this up as described in the original post. I’m having a problem though where the second time I trigger assist with the wake word, it triggers, but doesn’t seem to be able to hear me. I have “always start a new copy” checked in the Tasker task.
I’ve checked the logs in Whisper, and it looks like it’s just getting silence.
If I tap to close the assist popup and then use the wake word again, it seems to work well most of the time. Something about the assist popup already being open when I use the wake word causes it to break.
@janstadt, I see you are using an automation to close the popup. Is this why? Did you find any other ways around this?
Sounds like an android audio handling issue, what version of Android are you using?
Android 13 on a Pixel 4.
I think I’m abandoning this idea for now. Might come back in 6 months or so and see what the landscape is like for HA native voice assist.
I was using StreamAssist successfully for a couple days but it seems to be broken and I have no idea why
Using the debug option in the browser I’m able to confirm that there’s nothing wrong with the pipeline. It detects the wakeword and processes everything just fine. I also tested the RTP stream in VLC (you have to use rtp://0.0.0.0:{port number in RTPMic} to get it to work!) and it’s working perfectly, but it just doesn’t respond anymore. Running an up to date HASS OS install. I wonder if one of the more recent updates caused some issues with the integration?
Has anyone seen an Android Tab with speakers (decent speakers)? Im trying to find something to replace ALexa as its almost dead.
Thanks guys
I assume you don’t want to use a thinksmart view? That’s the cheapest option by any measure, they’re $27 on woot right now.
I have an Ulefone Armor Pad 2 which wasn’t too pricey and the speakers on it are pretty kickass (for a tablet)
Thanks mate
But I mean good speakers lol I have found POS tablets on Ali that look pretty good. But I want something with integrated speakers. Essential something that’s an Echo Show 10, but with Android so I can use it with the Android wake word.
Did some investigations…
So we have to use the companion app for this to work and android 11.
Ok, what about turning the screen on/off though? Or increase/decrease brightness? Is that possible?
These can work with wallpanel and fully kiosk, but then we are not using the companion app and we cant use the voice assistant…
So i figured the above out, you can set a timeout and wake the device using home assistant itself, that’s epic. Is there a way to use a chime from home assistant when it’s ready to listen to commands? The hotword plugin has a ding sound, but it plays immediately and not before home assistant is ready to listen to commands.
Thank you for your guide!
I now configured Tasker, but the voice assistant dialog stays opened and until I close it manually, there is no voice input at all.
Is there any possibility to close the voice assistant windows automatically after one command?
I don’t want to use a wait for X seconds. Is there any event to grab or can I make an automation inside of Home-Assistant?
Not that I’ve found, but if you find a way please share it, I currently just use a timer.
Hi! I’m trying to recreate the OP method, but I’m having trouble. After wakeword detection, tasker opens up assist, but how then do do you get spoken text into the ‘enter your request here’ field? I cant seem to do it without button pressing the mic icon on the keyboard, and I’ve tried using autotools to press it for me, but apparently soft keyboards don’t like that? I’m complicating things by using futo for STT, but it does function as expected after hitting the mic button.
Any thoughts?
Thanks for this. I got it working with Tasker. However, I have a problem with Home Assistant freezing after giving it one command. The whole app freezes and Android asks me to close the app. I turned off the plugin and tried just clicking the assist button in HA App. Still freezes.
Anyone else see this behaviour? I am wondering if it is the cheap tablet this is running on or a app problem. Or a config problem?
I’ve been trying to use Automate on my Pixel 8 to use the hotword detection and start the HA companion app, but it won’t work.
Here are my logs from starting the flow
12-21 16:33:22.580 I 1@1: Flow beginning
12-21 16:33:22.582 I 1@2: Hotword detected
12-21 16:33:22.687 F 1@2: java.lang.IllegalStateException: Hotword keyphrase unsupported
12-21 16:33:22.693 I 1@2: Stopped by failure
12-21 16:33:24.584 I 2@1: Flow beginning
12-21 16:33:24.585 I 2@2: Hotword detected
It starts automatically when I just create the flow giving the error that the Hotword keyphrase is unsupported and stops automatically. However, I can start it up again and then it instantly says “Hotword detected” without me having said “OK, Google” or anything like that.
I set up my flow similarly to how @nervousapps did.
It requested me all sorts of permissions when I first created the flow, like replacing Google Assistant as my default assistant with Automate and some other permissions. The only one which I couldn’t find was “Ignore app hiberation”, but the app also says if you can’t find this, just click “Forget”, which I eventually did. I did notice that there were no microphone permissions, so I tried adding them manually, but alas, it still doesn’t work for me.
Anyone knows how to fix this?