Hi, I’ve got HomeAssistant installed on a powerful PC using the x64 image. I would like to make the voice recognition and answers more accurate and extensive, so I would like to integrate a LLM (Like ollama for instance) I have seen all kinds of tutorials on how to connect an LLM running on some …

[image] FredsterNL: Is it totally impossible to run without GPU and be usable UNEQUIVOCALY YES. <<< Like Commander Scott, I cannot change the laws of physics, captain… Yes. (Physics in this case is TONS of tensor math - like a game engine…) MUST have a GPU capable of maintaining 8k context …

Yes it is. Now it can depend on your setup but if you are using docker container or such monstrosity just put it in container and run it. But ollama does use a lot of gpu and cpu so count on that. That also depends on model you are using but generally it does use a lot. As It can crash your server…

If the machine has the beef… Then you can make it run Proxmox and punch your GPU through to a VM running ollama (the ‘separate’ server) and HA on a separate VM calling the ollama instance. Just because it says separate machine it doesn’t mean separate iron because virtualized environment. Whats th…

I’ve got ollama installed on a Linux Mint installation, running two GPU’s (5070TI and 3060TI, although only the 5070 gets used) with a AMD Ryzen 9 9900x That machine however, as you can imagine, is quite hungry in the kWh department and is switched off when not in use… I know GPU would be the be…

Hmmm ya, I was afraid of that… Guess I could write an automation that boots the Dual GPU machine / Shuts it down when the LLM isn’t being queried… Thanks for your help, appreciated!

If you set the machine up correctly it will idle down - The NUC driving my 770 only uses 35w on idle and spins up to as much as I think 300…

Typo in the first post: 3060 not a 3090 :laughing: but it’s memory is nice to offload tasks to, whilst the 5070 is busy What is Friday ?

That… [image] Friday's Party: Creating a Private, Agentic AI using Voice Assistant tools Voice Assistant Well, Ok I’ve been cajoled into it entirely long enough. Here I’m going to document some random thoughts I’ve collected about building an Agentic AI - ‘Friday’ in Hom…

Hi Nathan, Interesting, I’ll be sure to follow that! Thanks again!

Running LLM on HomeAssistant?

Configuration Voice Assistant

NathanCu (Nathan Curtis) February 2, 2026, 3:27pm 9

That…

Im on the long ramp to publicly deployable right now. Goal is llm framework 100% INSIDE ha native without addons. Provides the glue to solve the grandma’s cardboard box problem. (see posts apologies for typos)