New Integration: Nvidia's Triton Inference Server on AI Gateway
🎉 Exciting news!
Portkey now supports Nvidia's Triton Inference Server.
Big Thanks to Tapan Sharma for contributing to Portkey's open-source AI gateway with the integration.
Triton is NVIDIA's inference server that makes AI model deployment lightning-fast and scalable across multiple GPUs and CPUs.