New Integration: Inference.net (wholesaler of LLM inference tokens)
New Feature
Portkey now natively integrates with Inference.net, which is a "wholesaler" of LLM inference tokens for open source models like Llama 3. Inference.net is 50-90% cheaper than leading inference providers in the market, and could be especially useful for batch inference jobs!
