Announcements

Stay informed about Portkey's newest releases, features, and improvements

  1. ✨ Portkey x Jan AI integration is live!

    Announcement

    Jan is a simple open-source app that works as ChatGPT alternative. With Portkey, you get access to 1600+ models, plus built-in observability and governance—right from the start.

    Try it out today: Link to docs 

     

    MongoDB+Portkey

    Like

  2. 🚀 Portkey x Anything LLM Integration

    Announcement

    Anything LLM (36k+ ⭐) is one of the most loved open-source apps—chat with any LLM, use RAG, and build AI Agents, all in one place.

     

    With Portkey, it’s now simpler, more secure, and scalable.

    One integration, 1600+ models – From OpenAI and Claude to your own Ollama deployments.

    🔒 Granular security & access control – Set budget & rate limits, mask keys, track usage, and enforce RBAC.

    👥 Enterprise-grade AI operations – Manage teams, workspaces, metadata logging, and audit logs with ease.

     

    MongoDB+Portkey

              Link to Docs 

     

    Like

  3. Portkey x Qdrant Integration is Live! 🎉

    Announcement

    You can now use Qdrant vector database with Portkey. With this integration, you get:

    • Unified API - Call Qdrant alongside your LLMs with Portkey's unified API

    • Virtual Keys - Manage your API keys effortlessly

     

    Streamline your AI workflows today!

     Link to docs 

    MongoDB+Portkey

     

    Like

  4. Zed x Portkey Integration

    Announcement

    🚀 Portkey now integrates with Zed natively!

    Zed is a next-gen code editor with built-in AI features. Portkey's integration with Zed gets you:

    • Access 1600+ LLMs

    • Real-time observability & logging

    • Enterprise governance

    • PII detection & redaction

     

     Link to docs 

    Like

  5. 🚀 New Cookbook: Tracking LLM Costs Per User with Portkey

    Announcement

    LLM costs can escalate quickly. Currently, there is no way to track granular insights on the cost of your AI app. With Portkey’s metadata-based tracking, you get:

     

    ✅ Per-user, team, or feature-level cost insights

    ✅ Dashboards for real-time tracking

    ✅ Portkey API to fetch and analyze spend programmatically

     

     Link to cookbook 

     

    Like

  6. 🚨 Model Deprecation Alert: Azure GPT35 Turbo Model: 0313 & 0613 Series

    Announcement

    Azure is sunsetting all GPT-35 Turbo model versions 0313 and 0613 on 13th February 2025. This means a migration is required! The default model will be set to version 0125 after the retirement.

    image

    Quick action items:

    ✅ Audit your Azzure API calls

    ✅ Plan migration to Gpt-4 series

    ✅ Finish all tests before February

     

     

     

     

     

    Like

  7. o3-mini on Portkey available now! OpenAI & Azure OpenAI

    Announcement
    ray-so-export (3)

    OpenAI's latest & greatest o3-mini model is now available on Portkey on both OpenAI & Azure OpenAI!

    ✅ Backward compatible with system role. (On Portkey you can continue using system role and we convert it to developer for the reasoning models)

    ✅ Backward compatible with max_tokens param. (we convert it to max_completion_tokens at the Gateway level)

    ✅ Route to both OpenAI & Azure OpenAI

    ✅ Log your requests and get metrics on cost, latency, and more

    ✅ Enforce model behavior with real-time guardrails

     

     Try it out now! → 

    Like

  8. Portkey 🤝 Firework AI - Get Access to DeepSeek R1

    Announcement

    🚀 Want to use Deepseek R1 in the US? Now you can!

    We've teamed up with Fireworks AI in our latest cookbook to make R1 accessible via Portkey’s unified API.

    Get the best of both worlds: Deepseek’s cutting-edge model, deployed on Fireworks, with Portkey’s enterprise-grade features:

     

    📊 Full cost & performance insights

    ⚡ Smart routing between R1 & GPT models

    ✅ Built-in reliability & safety guardrails

     

     Link to the cookbook 

     

    post (1)

      

    Like

  9. 🔍 Audit Logs: Full Visibility Across Your Org

    New Feature
    CleanShot 2025-01-28 at 17.32.39 2@2x

    We've launched comprehensive audit logging with org-wide visibility.

    Monitor every action across your infrastructure

    • See prompt template modifications that affect production
    • Track API key creation and access patterns
    • Configuration changes across guardrails
    • Log export requests and authorization changes
    • Create, update, delete, publish actions for all Portkey objects (prompts, configs, virtual keys etc.)

    Key Benefits

    • Complete Audit Trail: Detailed tracking of all changes with user attribution and timestamps
    • SOC 2 Compliance: Meet security compliance requirements with comprehensive activity logging
    • Security Investigation: Quickly investigate any unauthorized or suspicious activities
    • Change Management: Keep track of all configuration changes and prompt updates across your organization

    Implementation Details

    • Access: Available to org owners & admins across all workspaces
    • Retention: Indefinite storage of all audit logs

     You can view audit logs in the Admin Settings page here.  

    Like