Local memory for my HA chat bot

There’s a hard limit.

This kind of storage is limited… Because


homeassistant.exceptions.TemplateError: Template output exceeded maximum size of 262144 characters

THAT is the max you can output from the template (prompt) at all. So your functional prompt PLUS any grounding on the prompt must be less.

Any single memory in fact must be less to read it. Or you’re walking the JSON stores in the memory.

If you use a trigger text sensor instead total of any one single storage item (attribute in an entirely) could theoretically store 16384k but it would be fragile.

And no not for books. This is for short quick ad hoc memories. Like the first ‘memory’ list chatgpt had. It was no more than a list of 100 things…

Books need other solutions RAG in fact. But there’s no easy way to do that yet. So, letting most people have the LLM remember favorite color or birthday is cool.

Note on the memory feature in Friday’s Party -