✨Shipping a smoother developer experience
Some updates on our Gateway that will help you work faster and efficiently!
✅ You can now use shorthand for guardrails in your API calls, making the creation of raw guardrails faster and simpler.
✅ Gateway now fills in the model field in /chat/completions responses, even if your provider doesn’t, keeping everything consistent with OpenAI’s API signature.
✅ Introduced a new retry setting use_retry_after_header
. When set to true, if the provider returns the retry-after
or retry-after-ms headers
, the Gateway will use these headers to determine retry wait times, rather than applying the default exponential backoff for 429 responses