Getting Whisper working on Raspberry Pi via docker

Installation
1

I have HA Container installed on a Pi 4 running Raspbian 64bit, and I want to experiment with the voice features.

I’ve got Piper up and running, using the rhasspy/wyoming-piper image, but I can’t find an image to install Whisper. I read that rhasspy/wyoming-whisper was the way to go, but when I try to pull that image onto the Pi I get the following:

no matching manifest for linux/arm/v8 in the manifest list entries

Does anyone know of a different image I should be using, or if I’m doing something wrong with docker?

EDIT: Yes, I’ve read that running Whisper on a Pi will be slow. I’m looking to test it out, not use it properly. I’ll probably have to look into getting some beefier hardware to run local STT in the future.

2

Try forcing the platform on your docker run or docker compose file.

--platform linux/arm64
3

Thanks, I put that into a compose file and it did pull the image.

But it exited with code 159 - I could have sworn I installed raspbian 64bit, and when I checked with uname -m earlier it gave me aarch64 - but I just read that’s the kernel not the OS. So I think I was wrong and that the OS is actually 32bit. :man_facepalming:

4

May I ask how you solved this?

Because of the TP-Link USB driver not running 64 bit, I was forced to switch to the 32 bit kernel (armv7l) by removing arm_64bit=1 in the config.txt.

5

I couldn’t get it working. I had to run Whisper on a different server afterwards. I think I’ll probably reinstall the OS on my Pi to be 64bit - but that’s a thing for a day off. Even so, I expect I’ll still keep Whisper running on a more powerful device.

6

There’s somewhere here my post about running Frigate 64bit in docker. My Rasp4 kernel is 64bit, but os 32bit but still I managed to run it 64bit. And it’s been running ever since.