DEFINITION
Context window utilization
Effective use of available context window in LLM-based agents
Definition
The principle that how efficiently an LLM uses its available context window matters more than the absolute size of the context window. Tightly scoped working context at each step of an agent workflow outperforms giving the model unrestricted access to all available context.
Examples in the Wild
- Example 1:Showing only 5 relevant tools instead of dozens
- Example 2:Providing clear instructions for current phase only
- Example 3:Limiting context to current state scope
- Example 4:Reducing token usage while improving reliability