Context Capacity refers to the amount of information (instructions, conversation history, tool results) that a language model can hold in its context window at one time. As an agent operates, this window fills up.
Why it matters: Efficient management of the context window is crucial for effective agent design. If the context window is exceeded, the model may lose important information, leading to errors or a failure to complete its task.
Connections:
Sources: