Portkey AI
Portkey is the production AI platform built for LLM teams — providing routing, observability, guardrails, and agent governance across 1,600+ models. Portkey is being acquired by Palo Alto Networks to secure the rise of AI agents at enterprise scale.
With an OpenAI-compatible API, SOC 2 Type II certified infrastructure, and an open-source core with over 11,600 GitHub stars, Portkey enables teams to deploy reliable, cost-efficient, and secure AI in minutes.
Portkey AI Product Suite
Eight integrated modules covering every layer of your AI stack — from gateway routing to agent governance.
Core Platform
AI Gateway
- Connect to 1,600+ LLMs through a single API
- Intelligent routing, fallbacks, and load balancing
- Semantic caching to reduce costs and latency
- Automatic retries with configurable strategies
- OpenAI-compatible drop-in replacement
Observability
- Full-stack LLM monitoring and real-time insights
- Request tracing across models and providers
- Cost attribution per team, user, or endpoint
- Evaluation pipelines for every AI interaction
- Latency, error, and token usage dashboards
Guardrails
- Real-time input and output filtering
- PII detection and redaction
- Content moderation at the gateway layer
- Custom logic and regex-based rules
- Block, redact, or alert on policy violations
Developer Tools
Prompt Engineering
- Centralised prompt library with version control
- A/B test prompts and models without code changes
- Deploy prompt updates instantly to production
- Track performance across prompt versions
- Team collaboration on prompt management
Model Catalog
- Browse and compare 1,600+ models across providers
- Cost, latency, and context window benchmarks
- Capability comparisons across model families
- Filter by use case, modality, and provider
- Direct integration with the AI Gateway
Agents
- Full support for agentic and multi-step workflows
- End-to-end agent trace visibility
- Tool call logging and inspection
- Agent-level access control and policy enforcement
- MCP server governance built in
Security & Governance
Security & Compliance
- SOC 2 Type II certified infrastructure
- Virtual key management for LLM providers
- PII protection and data residency controls
- Full audit trails for every LLM request
- Managed cloud or self-hosted deployment
MCP Gateway
- Secure Model Context Protocol gateway
- Govern every tool call agents make
- Observable MCP traffic across all servers
- Access control per agent and tool
- Integrates with existing security stack