James Booth
Back to Per-call context demand and the routing veto

Method for finding 1 of 2

The median call sent 30,596 tokens. A 200K context window holds 99.29% of calls.

2,245 calls on one deployment over 30 days, measured by input tokens per call.

Basis: 2,245 calls

Back to Per-call context demand and the routing veto

Method for finding 2 of 2

The routing loop promoted no model in 273 evaluations. In 114 of them, the incumbent's advertised context window or output limit had become an entry requirement.

2,245 calls on one deployment over 30 days, measured by input tokens per call.

Basis: 273 routing evaluations