Whisper seems to confuse languages

Configuration Voice Assistant
1

I am trying to set up voice assistant with an M5stack Atom Echo and the Home Assistant piper/whisper/wakeword addons.

I have configured everything locally with Danish as the language. I have two big issues with Whisper:

  1. The speech-to-text is very bad even though I run HA in a virtual machine and have chosen the medium-int8 model (the tiny was also bad, this seems to not be better)

  2. When I say “Tænd lyset” (Danish for turn on the light), Whisper gets the first word as the number 10 - “Tænd” is very close to “Ten” but very far from the Danish “Ti” which is 10 i Danish. It seems Whisper hears the first word in English and the rest in Danish (with lots of errors).

The error rate could be caused by microphone quality issues but with the number 10 I suspect something else is wrong… - and others seem to have good experiences with this setup, also in non-English languages?

Any ideas?

/Jaybe