About making inexpensive models smarter by providing tools and context. (local models, gpt-5-mini, gpt-4.1-mini, gpt-4o-mini ...)

[NathanCu (Nathan Curtis)]

I get my data through the tools I wrote…

Read the Fridays party project. Specifically the part about the indexer. The project IS the index. And why it took me nearly a year to write it… Because this problem.

Friday's Party: Creating a Private, Agentic AI using Voice Assistant tools

Read the thread - this is an ongoing project. First there is HA itself…- its not optimized for context, that’s where the index came from. this is step 1. Second it’s not optimized for secure access. This is step 2 (SP1 will bring most of it and the plumbing is there now) - and will be done before I EVER look at tuning a model. (If you want to knock yourself out) Third - HA sucks at providing a way for users to add written context. The cabinets solve that. (Yes, they can be in a DB in the fut…

The way the GetLiveContext tool and how HA populates system state in the system prompt is insane and I want to burn it with fire.