Docs

Rate Limits

Updated 2026-07-21

Why rate limiting is applied

Rate limiting protects the platform and upstream providers from traffic spikes that could affect stability.

Best practices

  1. Control client concurrency
  2. Implement exponential backoff for 429 responses
  3. Split batch jobs into separate queues
  4. Monitor usage and error rates

Specific thresholds may vary by account tier, model, or group. Refer to your console configuration and actual response headers.