Stay informed about Portkey's newest releases, features, and improvements
Mistral's latest large model — Mistral Large 2, a 123B parameter model with a 128k context window is now available on Portkey.
✅ Multilingual, highly efficient, and excels in coding, math, and reasoning.
And surprisingly, it is on par with Meta’s Llama 3.1 405B!! Try out the new Mistral Large 2 with Portkey👇
Day 0 support for all 3 of Meta's newest Llama 3.1 models on Portkey! Available on Groq, Fireworks, and Together AI.
GPT-4o mini is a game-changer for AI accessibility. It is now available on Portkey!
✅ 60% cheaper than GPT-3.5 Turbo
✅ Outperforms competitors on key benchmarks
✅ Multimodal: supports both text and vision
Mistral's newly released Codestral Mamba model - a revolutionary 7B parameter coding model based on the Mamba architecture, with linear time inference, 256k token context, and Apache 2.0 license, is now available on Portkey!
Mistral Integration Docs - https://portkey.ai/docs/welcome/integration-guides/mistral-ai
When using function calling, you can now ensure that the model 100% calls one of your specified functions by setting tool_choice: "required" from the right sidebar in prompts playground.
This param is currently supported for OpenAI models. Here's a detailed description for what each value of tool_choice does:
Passing a new OAuth 2.0 access token every time you have to make a Vertex request is tiring right? Portkey now has a flawless solution for you - just add your Service Account JSON to Portkey vault once, and seamlessly route to Vertex AI models using Portkey's virtual key system!
Head to the Virtual key tab and just add your Vertex details - get a corresponding key that you can use anywhere on Portkey.
Cleaner, nicer, more easier to navigate! Do you like the redesign? React to this post and let us know!
You can install it easily as a standalone app, and keep it handy for all your LLM monitoring, prompts, and gateway needs!
This week, we are starting to enforce the limits on Portkey's Dev plan as per our pricing, which includes:
For users who want more advanced features, upgrading to the Pro Plan is easy. We've made it more affordable - it starts at $49 now, from the earlier $99. Here's what's included in the Pro plan:
Just head to "Settings" -> "Billing" in the Portkey app and add your card details.
Please Note: Your existing saved prompts (even if more than 3) will keep working, and your app will continue to function normally - NONE of your requests will ever fail. We'll stop logging requests beyond the 10k/month limit on the Dev plan though.
JACoB - Just Another Coding Bot uses Portkey to
