Year of the Voice - Chapter 2: Let's talk

Great updates.

Is the Grandstream GS-HT802 (2 lines) also supported on the new VoIP integration? Would both lines be connected direct to home assistant or could one be free for regular VoIP?

Why can’t the large model be used for whisper? Unfortunately, for languages other than English, smaller models are very inaccurate and make it unusable.

I have a brunch of wall mounted old tablets running the companion app. Those all have microphones! Is there a chance we can get the companion app to do some of this listening?

8 Likes

There is a Rhasspy Android App (obviously without active development)

This works great with rhasspy, so i guess sooner or later something like this will be native in home assistant companion.
Would love it! Also as media Player.
But i’m also fine with the MPD App
ESPHome als MediaPlayer / Assist Satellites. That’s great as well!

3 Likes

So, I can call Home Assistant on a phone…can it ring the receiver for notifications?

3 Likes

I think I missed something from the video. Could someone give me an explanation considering that I could have done just the stupidest mistake ever?
I installed Piper and Whisper. They both triggered the integration “configure” button and clicking on it went fine as expected. I went on enabling both for the default assistant and the “try voice” command form the bottom of the TTS box let me get the nice playback of what I wrote in the box.
I still cannot make the assistant answer me with a TTS response along with the text one I obviously got until now when I asked “turn on the living room main light”. Even if the light does indeed get on.
What didn’t I understand? What is the setting that enables the voice response that the video shows in the 13:00 demo?

Why is this when I want to install piper? Is above only available next month?
You are running Home Assistant 2023.4.6, to update to this version of the add-on you need at least version 2023.5.0.dev20230418 of Home Assistant

I flashed an M5 and its in HA:

But I get a red light and following logging:

Using 'COM12' as serial port.
Showing logs:
[21:13:30][D][binary_sensor:036]: 'Button': Sending state ON
[21:13:30][D][voice_assistant:065]: Requesting start...
[21:13:30][W][voice_assistant:067]: Could not request start.
[21:13:30][D][light:035]: 'M5Stack Atom Echo a63938' Setting:
[21:13:30][D][light:046]:   State: ON
[21:13:30][D][light:058]:   Red: 100%, Green: 0%, Blue: 0%
[21:13:30][D][binary_sensor:036]: 'Button': Sending state OFF
[21:13:30][D][voice_assistant:073]: Signaling stop...
[21:13:31][D][light:035]: 'M5Stack Atom Echo a63938' Setting:
[21:13:31][D][light:046]:   State: OFF
[21:13:31][D][api:102]: Accepted 192.168.1.142
[21:13:31][D][api.connection:961]: Home Assistant 2023.4.6 (192.168.1.142): Connected successfully
[21:13:45][D][binary_sensor:036]: 'Button': Sending state ON
[21:13:45][D][voice_assistant:065]: Requesting start...
[21:13:45][W][voice_assistant:067]: Could not request start.
[21:13:45][D][light:035]: 'M5Stack Atom Echo a63938' Setting:
[21:13:45][D][light:046]:   State: ON
[21:13:45][D][light:058]:   Red: 100%, Green: 0%, Blue: 0%
[21:13:45][D][binary_sensor:036]: 'Button': Sending state OFF
[21:13:45][D][voice_assistant:073]: Signaling stop...
[21:13:46][D][light:035]: 'M5Stack Atom Echo a63938' Setting:
[21:13:46][D][light:046]:   State: OFF

Is it not working because of the above?

Please can you also answer above?

Indeed, with Android you can set the app for (voice) assistance (idk for Apple). If we could set this to the HA companion app then it would require no additional hardware :raised_hands:

In case you are in NL: still a few left at TinyTronics at the moment! Be quick! :slight_smile:

1 Like

Thx, managed to buy 2 at another shop

Thanks for showing me this, i just installed. It does work pretty well though sometimes it fails to handle intent, and i have to hit the microphone even to get wakeword to still work. But damn if its not the easiest sattellite ive setup yet!

You joke, but I could seriously see someone doing this, even right now with the M5, it would really just need a battery to power it and the thing is super low energy already, it wouldn’t be that uninmaginable, and would personally love something like this no matter how much fun I get made of lol!

1 Like

Sorry if I missed it, but where can I find the ESPHome sources of the M5Stack Echo " $13 voice remote for Home Assistant" project?

I have a MAX98357A amp and a INMP441 from a similar project I did for Rhasspy.

I’m not really sure if you can do both input and output I2S audio so easily :wink:

I think it is here GitHub - esphome/media-players: This repo hosts known, tested devices that can server as media players to Home Assistant. (but why are we having to guess).

3 Likes

Really interested to see if there will be support for SIP-based “paging” equipment like speakers and microphones.

The phone trick mentioned here is cool, but that Grandstream device speaks SIP, and it definitely would be easier to set up, more extensible, and a million times more awesome if Home Assistant could speak SIP as well

1 Like

Can the docs be updated to include that the audio pipeline needs a HTTPS connection (even with the companion app)? Spent most of the morning messaging around with my setup & the companion app, including even trying some android sip clients to see if they’d work with the new VOIP setup, and was expecting the issue to be that the companion app needed an update not the http(local)/https(remote) HAProxy setup I have.

Suspect a fair amount will fall into this http config issue and wonder why audio doesn’t work for them.

1 Like

Piper started OK with this but Whisper is failing to start with the following. Anyone also had this issue or have a solution?

INFO:__main__:Downloading FasterWhisperModel.MEDIUM to /data stderr
09:54:29 Traceback (most recent call last): stderr
09:54:29 File "/usr/lib/python3.9/runpy.py", line 197, in _run_module_as_main stderr
09:54:29 return _run_code(code, main_globals, None, stderr
09:54:29 File "/usr/lib/python3.9/runpy.py", line 87, in _run_code stderr
09:54:29 exec(code, run_globals) stderr
09:54:29 File "/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/__main__.py", line 132, in <module> stderr
09:54:29 asyncio.run(main()) stderr
09:54:29 File "/usr/lib/python3.9/asyncio/runners.py", line 44, in run stderr
09:54:29 return loop.run_until_complete(main) stderr
09:54:29 File "/usr/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete stderr
09:54:29 return future.result() stderr
09:54:29 File "/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/__main__.py", line 75, in main stderr
09:54:29 model_dir = download_model(model, args.download_dir) stderr
09:54:29 File "/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/download.py", line 41, in download_model stderr
09:54:29 with urlopen(model_url) as response: stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 214, in urlopen stderr
09:54:29 return opener.open(url, data, timeout) stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 523, in open stderr
09:54:29 response = meth(req, response) stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 632, in http_response stderr
09:54:29 response = self.parent.error( stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 561, in error stderr
09:54:29 return self._call_chain(*args) stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 494, in _call_chain stderr
09:54:29 result = func(*args) stderr
09:54:29 File "/usr/lib/python3.9/urllib/request.py", line 641, in http_error_default stderr
09:54:29 raise HTTPError(req.full_url, code, msg, hdrs, fp) stderr
09:54:29 urllib.error.HTTPError: HTTP Error 404: Not Found

Is there a Piper and Whisper setup for us docker users?

For future me.

No internet in the container so it can’t download the required model also not all combinations of models are available.

Yes look up the thread. That is what I am trying to setup

1 Like