Home Assistant Operating System already has official installation builds for a few of other ARM-based single-board computers (most notably Raspberry Pi and Hardkernel Odroid hardware models), but wondering if we can get an official Home Asssistant OS build for Nvidia Jetson family of single-board computers and compute modules?
Believe I can guess that reasoning we do not have this already is that all Nvidia Jetson series of products have historically simply been too costly in combinatin that the demand for generative AI acceleration has been low, but guessing that will chang now with the first official Home Assistant voice hardware about to be launched later today there will surely be a growing interest using a AI conversation agent via an LLM (Large-Language Model) locally via the Ollama integration (instead of via cloud services) and then it would be convinient to run everything nativly on the same computer that runs Home Assistant OS.
And maybe more interestingly, NVIDIA just launched their NVIDIA Jetson Orin Nano Super Developer Kit for only $249(US) which include a Jetson Orin Nano compute module and a carrier board for it:
At the announcent NVIDIA’s CEO where marketing this kit as ”The World’s Most Affordable Generative AI Computer”:
That specific development kit is based on the 8GB variant model of new NVIDIA Jetson Orin Nano module series which could potentially be good choice for use in a such suggested mid-range model with buitl-in AI acceleration capabilities to run a smaller LLM model locally.
NVIDIA also makes a 4GB variant, two 8GB variants (with different memory bandwidth), and a 16GB variant in that same NVIDIA Jetson Orin Nano series, but the other modules looks to not yet be available or there is at least no price for the other variants that I could find, however I believe a compute module like that 16GB model could potentially be good enough run a larger LLM model locally.
The same same NVIDIA Jetson Orin Nano module is by the way also used in the reComputer J3011 (Edge AI Computer with NVIDIA Jetson Orin Nano 8GB) sold for $599(US) by Seeed Studio: