Anyone seen this? Seems like a match made in heaven for hass on-device voice assistant usage. (But granted, you still need a STT model.)
Project: GitHub - cactus-compute/needle: 14MB foundation model for tiny devices; phones, wearables, smart home, and robots. · GitHub
Demo: Needle 2 - The 14 MB Agentic LLM for Tiny Devices | Cactus