Deploy Portkey in Your Cloud
We're excited to announce that Portkey now offers seamless deployment options for enterprise customers, allowing you to host and manage Portkey within your own cloud infrastructure. Portkey is designed from the ground up to meet the needs of large-scale, mission-critical organizations that require full control, security, and compliance.
Flexible Deployment Options
Portkey supports a wide range of cloud platforms, making it easy to integrate with your existing infrastructure:
- Amazon Web Services (AWS)
- Microsoft Azure
- Google Cloud Platform (GCP)
- Cloudflare Workers
- F5 App Stack
Whether you're running on public cloud, private cloud, or hybrid environments, Portkey adapts to your deployment preferences.
Scalable Architecture
Portkey's architecture is designed to scale effortlessly, ensuring reliable performance even under heavy loads. By separating the data plane and control plane, Portkey allows you to independently scale and optimize each component based on your specific requirements.
Portkey architecture comprises of:
Data Plane (In Customer VPC):
The data plane resides within your own Virtual Private Cloud (VPC), ensuring that your data remains secure and isolated. It hosts the AI gateway, which handles the processing of API requests and responses. The data plane includes:
- AI Gateway: The core component that routes and processes API requests to the appropriate AI models or services.
- Attached Cache: A high-performance caching layer that stores frequently accessed data, reducing latency and improving response times.
- Optional Log Store: A dedicated storage system for capturing and storing detailed logs of API requests and responses. You can choose to host the log store within your VPC for added security and control.
The data plane can be horizontally scaled to handle increased traffic, ensuring optimal performance and reliability.
Control Plane (In Portkey VPC):
The control plane is hosted within Portkey's secure VPC, providing a centralized management and monitoring interface for your Portkey deployment. It includes:
- Control Panel UI: A user-friendly web interface that allows you to configure and manage your Portkey deployment, define policies, and monitor performance metrics.
- Metrics Store: A scalable storage system that collects and aggregates various performance metrics from the data plane, enabling real-time monitoring and analytics.
- Transactional Database: A reliable and consistent database that stores configuration data, user information, and other critical metadata required for the functioning of the control plane.
- Optional Log Store: If you choose to host the log store within Portkey's VPC, it will be part of the control plane, providing a centralized location for log aggregation and analysis.
The control plane ensures the smooth operation and governance of your Portkey deployment while abstracting away the complexities of infrastructure management.
To learn more about Portkey's data plane and control plane architecture, click here.
Enhanced Security and Compliance
By deploying Portkey in your own cloud, you gain complete control over data security, privacy, and compliance. Your sensitive data remains within your trusted environment, adhering to your organization's security policies and regulatory requirements.
Portkey provides comprehensive security features, including:
- Secure API key management
- Granular access controls
- Encryption of data at rest and in transit
- Audit logging and monitoring
With Portkey, you can confidently integrate AI capabilities into your applications while maintaining the highest standards of security and compliance.
Getting Started
To get started with deploying Portkey in your cloud, schedule a call with us directly here.