Yup - this is CRITICAL to understanding context load.
I’m pretty sure [state_data] in the context, currently hard limited to 200000 tokens by Open AI in their largest models (ask me how I know - read Friday’s Party. Context is our current issue)
Yes my install is artificially bloated for a reason - but it points out I have no tools to understand what’s going on inside the state data.
expand(exposed_entites)
How big is it, how close am I to redline?
length(expand(exposed_entites))
(Yeah, it really is that simple then /4 for a rough token estimate.)
Or then you could then also take the entire length of the prompt do the calc,
add approximately 10000 tokens for a tools estimate.
Then you have an overall context load estimate. (But we NEED exposed_entities, especially with 2025.4 coming giving us start conversation and continued conversation what you can do with these will quickly gain speed, stay ahead of it with the tools…