Portkey now has a Terraform provider for managing workspaces, users, and organization resources through the Portkey Admin API. This enables you to manage:

• Workspaces: Create and update workspaces for teams and projects
• Members: Assign users to workspaces with defined roles
• Access: Send user invites with organization and workspace access
• Users: Query and manage existing users in your organization

This makes it easier to provision and manage Portkey resources as part of your existing infrastructure workflows.

Portkey is named a Cool Vendor in the 2025 Gartner® Cool Vendors™ in LLM Observability Report! True to our recognition, we are making our observability even better!

• Tool calls are now auto-detected and displayed separately in logs — making it easy to trace each call in agent workflows.

• Web search results now appear in a cleaner, structured format for faster review and debugging.

Take a look!

Add Prefix: Automatically add a configurable prefix to user inputs before sending them to the model. This is useful for enforcing context, tone, or compliance instructions across all model interactions.

Allowed Request Types: Control which request types (endpoints) are processed by your Gateway. You can set up either an allowlist or blocklist to manage the types of LLM requests permitted

You can now configure Javelin AI Security guardrails directly in the Portkey AI Gateway and check every model interaction for:

• Trust & Safety – Detect and filter harmful or unsafe content

• Prompt Injection Detection – Identify attempts to manipulate model behavior

• Language Detection – Verify and filter language in user or model responses

See how you can add Javelin to your model interactions here: https://portkey.ai/docs/integrations/guardrails/javelin

We’ve rolled out several upgrades across major providers to make your LLM integrations faster, more flexible, and production-ready:

OpenAI & Azure OpenAI: Added support for streaming audio transcription requests.

Vertex AI: Added custom model support for batch inference.

Support for input_audio parameter to enable richer context in requests

Support for anthropic-beta header

AWS Bedrock: Added global profile support for Bedrock models.

Added name field mapping for /messages endpoint document objects.

Streamlined token counting endpoint to use invoke mode for better compatibility.

Added pass-through parameters for Bedrock batch create endpoints.

Azure:

Improved Azure Entra caching for better performance.

Added pricing support for image editing models across OpenAI, Azure OpenAI, and Azure Foundry providers.

You can now set rate limits for both tokens and requests under an API key.

Request-based limits: Control the number of requests per minute, hour, or day.

Token-based limits: Control the number of tokens consumed per minute, hour, or day.

This gives you more precise control over usage, budgets, and traffic patterns across teams and applications.

Claude Haiku 4.5 is Anthropic’s fastest, most efficient model yet, delivering near-frontier performance at a fraction of the cost. It’s ideal for real-time agents, chatbots, and reasoning-heavy workloads where speed matters.

With Portkey, you can bring Haiku 4.5 into production with:

✅ Unified access via Bedrock, Vertex AI, and Anthropic providers

✅ Guardrails for safe, compliant usage

✅ Full observability across logs, latency, and spend

✅ Budget and rate-limit controls for teams and apps

You can now extend OpenAI’s AgentKit to work across different LLM providers — all through Portkey

• End-to-end observability

• Guardrails for every interaction

• Cost tracking across executions

• Reliability features like fallbacks and retries

• Bring production-grade visibility and control to your agents.

Read more about this here -> https://portkey.ai/docs/integrations/libraries/openai-agent-builder

Llama 3.1 and 3.2 models on Vertex AI Managed API will be deactivated on January 15, 2026.

What to do:

• Migrate to Llama 3.3 or Llama 4 (recommended)
• Update model names in your integration
• Test before the cutoff date

Anthropic’s latest Claude Sonnet 4.5 is now available through the Portkey AI Gateway.

With Portkey, you can bring Claude Sonnet 4.5 into production with:

✅ Unified access via the AI Gateway

✅ Full observability: logs, latency, and spend

✅ Budget and rate-limit controls across teams and apps