Last month, the Portkey team, in partnership with Postman, organized the first #LLMsinProd event in Bengaluru.

We had some of the brightest AI engineers, leaders, researchers, PMs, and founders come together to discuss the best methods of productionizing Gen AI systems.

• Portkey's co-founder Rohit shared how the AI Gateway pattern is becoming a crucial middleware for shipping enterprise-ready Gen AI products.
• AI assistant architectures are evolving! Rajaswa & Nitish from Postman shared how they are using a custom agent architecture that allows for controlled agency, fine-grained execution, and easy extensibility.
• DSPy is democratizing LLM prompting & optimization unlike anything else! Ganaraj is using DSPy at his e-com firm to normalize product attributes across millions of items, as well as for translating Sanskrit texts to English.

We wrote a detailed note about these latest trends and what they mean for your org.

 Read the article here.