Voice assistant not working

jatgm1 · July 29, 2024, 7:01pm

So I configured faster-whisper, open wake word, and piper using the assistant microphone and a USB microphone to try to make it work. It says that it’s assisting me when I say Alexa, but piper always says unknown. Whisper and open wake word just have the date and time or something. I tried doing it in silence when clicking the mic mute thing to make sure it only heard what I want. What is this year of voice thing? I thought it would function. Like at least to some extent.

Edit
So I restarted everything and it worked once. Lke it issued a single command, to turn on goodnight. Then proceeded to fail to respond to any other commands. It seems to respond to the first command and nothing else.

jatgm1 · July 29, 2024, 7:06pm

Here’s assist microphones log

Traceback (most recent call last):
File “/usr/local/lib/python3.11/dist-packages/wyoming/server.py”, line 37, in run
event = await async_read_event(self.reader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/wyoming/event.py”, line 79, in async_read_event
json_line = await reader.readline()
^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 545, in readline
line = await self.readuntil(sep)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 637, in readuntil
await self._wait_for_data(‘readuntil’)
File “/usr/lib/python3.11/asyncio/streams.py”, line 522, in _wait_for_data
await self._waiter
File “/usr/lib/python3.11/asyncio/selector_events.py”, line 995, in _read_ready__data_received
data = self._sock.recv(self.max_size)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ConnectionResetError: [Errno 104] Connection reset by peer
INFO:root:Connected to server
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
WARNING:root:Did not receive ping response within timeout
INFO:root:Disconnected from server
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.11/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(104, ‘Connection reset by peer’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.11/dist-packages/wyoming/server.py”, line 37, in run
event = await async_read_event(self.reader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/wyoming/event.py”, line 79, in async_read_event
json_line = await reader.readline()
^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 545, in readline
line = await self.readuntil(sep)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 637, in readuntil
await self._wait_for_data(‘readuntil’)
File “/usr/lib/python3.11/asyncio/streams.py”, line 522, in _wait_for_data
await self._waiter
File “/usr/lib/python3.11/asyncio/selector_events.py”, line 995, in _read_ready__data_received
data = self._sock.recv(self.max_size)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ConnectionResetError: [Errno 104] Connection reset by peer
INFO:root:Connected to server
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
INFO:root:Streaming audio
Playing raw data ‘stdin’ : Signed 16 bit Little Endian, Rate 16000 Hz, Mono
WARNING:root:Did not receive ping response within timeout
INFO:root:Disconnected from server
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.11/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(104, ‘Connection reset by peer’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.11/dist-packages/wyoming/server.py”, line 37, in run
event = await async_read_event(self.reader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/local/lib/python3.11/dist-packages/wyoming/event.py”, line 79, in async_read_event
json_line = await reader.readline()
^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 545, in readline
line = await self.readuntil(sep)
^^^^^^^^^^^^^^^^^^^^^^^^^
File “/usr/lib/python3.11/asyncio/streams.py”, line 637, in readuntil
await self._wait_for_data(‘readuntil’)
File “/usr/lib/python3.11/asyncio/streams.py”, line 522, in _wait_for_data
await self._waiter
File “/usr/lib/python3.11/asyncio/selector_events.py”, line 995, in _read_ready__data_received
data = self._sock.recv(self.max_size)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
ConnectionResetError: [Errno 104] Connection reset by peer
INFO:root:Connected to server
INFO:root:Streaming audio

Open wake word has no logs

Piper has no logs

File “/usr/lib/python3.9/asyncio/streams.py”, line 190, in _drain_helper
raise ConnectionResetError(‘Connection lost’)
ConnectionResetError: Connection lost
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: .
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: I’m not going to let you go for a second I don’t know if you’re going to run or not If you’re going to run or not, I will be there We all have a bunch of things like which you write on the slide So you don’t know what to do I don’t know
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.9/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(‘Connection lost’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 41, in run
if not (await self.handle_event(event)):
File “/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/handler.py”, line 95, in handle_event
await self.write_event(self.wyoming_info_event)
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 29, in write_event
await async_write_event(event, self.writer)
File “/usr/local/lib/python3.9/dist-packages/wyoming/event.py”, line 131, in async_write_event
await writer.drain()
File “/usr/lib/python3.9/asyncio/streams.py”, line 387, in drain
await self._protocol._drain_helper()
File “/usr/lib/python3.9/asyncio/streams.py”, line 190, in _drain_helper
raise ConnectionResetError(‘Connection lost’)
ConnectionResetError: Connection lost
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: I’m a little bit more tired than what I was trying to tell you, it’s not that it’s a place that you’ve been with me. But I can’t say, it’s not that I’m a little bit more tired than what I was trying to tell you.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: I don’t have a solution. Okay. I got a lot of things to do with everything. I don’t like these cells. I’ll tell them to wait for the radio to get you. Just make a little bit of a push to go. I’ll tell them to do it.
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.9/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(‘Connection lost’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 41, in run
if not (await self.handle_event(event)):
File “/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/handler.py”, line 95, in handle_event
await self.write_event(self.wyoming_info_event)
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 29, in write_event
await async_write_event(event, self.writer)
File “/usr/local/lib/python3.9/dist-packages/wyoming/event.py”, line 131, in async_write_event
await writer.drain()
File “/usr/lib/python3.9/asyncio/streams.py”, line 387, in drain
await self._protocol._drain_helper()
File “/usr/lib/python3.9/asyncio/streams.py”, line 190, in _drain_helper
raise ConnectionResetError(‘Connection lost’)
ConnectionResetError: Connection lost
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: The other one is a good night.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: I’ll let you know. I’ll let you know. Relax up. Third. I’ll let you know.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: It’s a little bit of a difference between a square, a square, a square, a square, a square, a square, a square and a square. The difference is that you can’t decide what you’re going to do to decide. The difference between a square and a square, a square, a square, a square, a square.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: .
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: . . . . .
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: . . . .
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: . . . . . . . .
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.9/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(‘Connection lost’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 41, in run
if not (await self.handle_event(event)):
File “/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/handler.py”, line 95, in handle_event
await self.write_event(self.wyoming_info_event)
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 29, in write_event
await async_write_event(event, self.writer)
File “/usr/local/lib/python3.9/dist-packages/wyoming/event.py”, line 131, in async_write_event
await writer.drain()
File “/usr/lib/python3.9/asyncio/streams.py”, line 387, in drain
await self._protocol._drain_helper()
File “/usr/lib/python3.9/asyncio/streams.py”, line 190, in _drain_helper
raise ConnectionResetError(‘Connection lost’)
ConnectionResetError: Connection lost
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: chart.
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name=‘wyoming event handler’ coro=<AsyncEventHandler.run() done, defined at /usr/local/lib/python3.9/dist-packages/wyoming/server.py:31> exception=ConnectionResetError(‘Connection lost’)>
Traceback (most recent call last):
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 41, in run
if not (await self.handle_event(event)):
File “/usr/local/lib/python3.9/dist-packages/wyoming_faster_whisper/handler.py”, line 95, in handle_event
await self.write_event(self.wyoming_info_event)
File “/usr/local/lib/python3.9/dist-packages/wyoming/server.py”, line 29, in write_event
await async_write_event(event, self.writer)
File “/usr/local/lib/python3.9/dist-packages/wyoming/event.py”, line 131, in async_write_event
await writer.drain()
File “/usr/lib/python3.9/asyncio/streams.py”, line 387, in drain
await self._protocol._drain_helper()
File “/usr/lib/python3.9/asyncio/streams.py”, line 190, in _drain_helper
raise ConnectionResetError(‘Connection lost’)
ConnectionResetError: Connection lost
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: on the power.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: on Good Night.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: Turn on the good night.
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: turn on good night
INFO:faster_whisper:Processing audio with duration 00:15.000
INFO:wyoming_faster_whisper.handler: Turn on good night

Whisper literally has the words needed to function and perform the task at the end. It didn’t work. The lights never turned off. What is going on?

Rofo · July 31, 2024, 11:40am

If you type it into assist, rather than speak it, does that work ?
And what reply is assist sending, if any ?

jatgm1 · August 2, 2024, 12:20pm

It works fine when using the feature on my overview or even using the microphone on my phone. Perfectly fine. It’s the audio part of it with the USB microphone. Also I don’t bother with a speaker for it I don’t care what it says I just need it to perform actions. Do a thing.

jatgm1 · August 2, 2024, 9:31pm

So it looks like Piper isn’t working?

It’s giving me an error.

jatgm1 · August 4, 2024, 10:42pm

So I changed the external URL and that fixed the issue with piper. It’s still not working though.

jatgm1 · August 8, 2024, 10:55pm

Whenever I say the trigger word the speakers make a beeping noise to acknowledge it, then a little while later they make another beeping noise. And it does not execute any commands. So to be clear the voice commands for the home assistant do not work. I can see in logs the words for the commands of which I am trying to use. So something in the Wyoming protocol logs the words that I’m saying but somehow they don’t get executed. The exact same words were perfectly fine when typing it out on my phone using the assistant.