Skip to main content

​
What you saw

​
Why it happened

Manifest caps in-flight requests per agent at 10 by default. Streaming completions hold a slot until the stream ends, so an agent that fires off parallel streams can hit this fast.

​
How to fix it

  1. Let in-flight requests finish, then retry. Most SDKs handle this automatically with backoff on 429.
  2. Reduce parallelism on the client side. Most agents only need one or two concurrent calls.
  3. On a self-hosted install, raise CONCURRENCY_MAX in proxy-rate-limiter.ts.