The latest improvements to Portkey's AI gateway, observability suite and prompt management
Portkey features for observability, gateway, and prompt management are now supported for Mistral models on AWS Bedrock.
Calling them is incredibly easy - just change Virtual key to AWS Bedrock and model name to Mistral models.
Explore AWS Bedrock <> Portkey docs here.
Fireworks is one of the fastest inference providers in the world for state of the art, open source LLMs.
We're thrilled to announce that all Fireworks models and endpoints now benefit from Portkey's Observability Suite, AI Gateway capability, and Prompts platform.
Portkey supports Fireworks':
Plus, Fireworks' advanced structured output capabilities:
Jina AI launched the world's first open source embedding model that supports 8K context length. This embedding model is now integrated with Portkey through our open source Gateway.
This means - you get full-stack observability, interoperability, reliability, and security for all of your Jina AI API calls. And since it's Portkey, we make it an absolute breeze for you to switch from OpenAI embeddings or Cohere reranker to Jina AI - without changing any of your underlying core code!
Postman's engineering team shares their journey of taking Postbot to production with Portkey. By focusing on familiar products, prompt and workflow management, and effectively handling non-determinism, Postman has successfully implemented LLMs into production with Postbot.
Meron Ogbai adds better Gemini support & Luke Vanagas adds better Anthropic support. Give them kudos!
If you'd like to contribute to the Gateway, check out open issues here.
Reduce one hop to your provider to fetch tool schema when the queries are semantically similar
Trace your requests across different metadata keys easily and see all the logs in one place without having to manually add the filters
Portkey's filters are getting more powerful - you can now search your logs or analytics by Config IDs
Hear from Div Garg (MultiOn) & Chinmay Joshi (Quizizz) on how they are using multimodal models (vision, audio, image) in production
Portkey's CEO Rohit Agarwal is heading to SaaSBoomi's flagship event, holler on Discord if you're also attending and would like to catch up with Rohit!