Has anyone made use of the AI accelerator, Nividia Jetson Orin Nano, as the local LLM platform for Home Assistant? I understand the most recen version of this product is less than half the price of its predecessor ($249 vs $599). Looking forward to your comments. ai
1 Like
Got one on order for this use case, let’s see how it performs (out of stock here till end of Jan 25)
Chris - thanks for your reply! I look forward to hearing about your experiences when it arrives. Have fun!
From what I have researched, one of the more important requirements is RAM, where 8GB is bare minimum for some LLM models, so may want to consider a 16GB version.
I ordered one for this purpose as well, it just cleared US customs, so we’ll see…
What retailer did you order from?