Respectfully I’d suggest considering a different approach… offer that filtering the entities on its own does not offer any value. Summarization yields much better results.
Yes, trimming ents. shrinks the context set but smaller context isn’t the answer. In fact richer denser context is… Because the the llm itself can tell me what it needs. Yes we need better context management tools but not used probably isn’t the measure I’m considering… I do like the logging angle though.
Here’s. My random thoughts
And what happens when you go for rich not small.
