Computer for whisper and face detection

Hardware
1

So I use assist in first tries with ha cloud, works ok. So I would like to use whisper locally and also Piper to have all data locally. Also to have more options about the config.

I also use frigate with double take for object and face detection with a coral usb stick.

I would now like to buy or build a cheap pc that can handle face detection, whisper and piper and does need as low power as possible to run it all day.

Is it possible to run all this services from 1 machine and having only 1 gpu? Can they share it?

How do you handle it? Do you run a machine for everything or just use cloud and coral?

2

I bought NUC 9 months ago and run everything on it. Coral USB is a must.

3

May as well look into this same time…
Ollama - Home Assistant.

Think gaming PC to run all this… Forget saving power.

4

Whisper does run with coral? As far as I know the models are to large for coral usb stick. Only good for object detection or not?

I also have a nuc with coral for object detection but it is not fast enough for speech to text. Also face detection is not working good.

5

What should that machine use? 400 Watt per hour? A bit to much for me. And ollama does face detection and support whisper/piper?

6

Hi, what hardware you ended up picking? I’m in the same boat now - Frigate with 2 Corals (dealing with 14 cameras, flawlessly) and looking to host Whisper base now for the new HA Assist satellites. I’m on Intel n5105 and upgrading to the recommended n100 doesn’t look like a big upgrade to me. Isn’t there anything better now (more horse power for the same or similar power consumption)?

Also, is out there a dedicated hardware (like Coral) for running LLMs?