One high-performance gateway for service, LLM, and MCP traffic.
An open source HTTP and gRPC gateway that handles traditional application traffic and AI-native protocols in one data plane. Route, secure, observe, and govern services, LLM provider traffic, MCP tools, and agent-to-agent communication without stitching together separate gateways.
LLM Gateway
Route to OpenAI, Claude, Gemini, or any self-hosted model with credentialing and failover.
MCP / A2A
Native protocol support for Model Context Protocol and agent-to-agent traffic.
APIs & Services
HTTP, gRPC, and TCP traffic — observable by default with mTLS and OIDC built in.
Solo.ioEverything you need for agent traffic — in one binary.
One control plane for service traffic, LLM routing, MCP, A2A, and inference — with policy and observability that the platform team actually trusts.
Run any north–south or east–west traffic through a single binary. Zero-config TLS, OIDC, mTLS-rotation, native Envoy compatibility for those who want it.
Drop-in OpenAI-compatible API in front of OpenAI, Anthropic, Bedrock, Gemini, Vertex, Cohere, OSS Llama runs — with per-team token budgets, semantic caching and prompt redaction.
Latency-aware, cost-aware, model-aware routing for self-hosted inference. Plug-in vLLM, TGI, Triton; agentgateway picks the warmest replica.
Discover, sign, scope and observe every tool call your agents make. Treat MCP servers like microservices — with versioning, RBAC, and audit trails out of the box.
agentgateway speaks the Agent-to-Agent protocol natively. Route invocations between LangChain, CrewAI, ADK and your own runtime — with identity, tracing, and replay.
OpenTelemetry by default. Per-tool, per-agent, per-tenant counters. OPA-evaluated allow/deny on every hop, with tamper-evident audit logs.
Getting started
Quick start
Get started with agentgateway in less than 5 minutes — local-first.
MCP connectivity guide
Connect agentgateway to MCP servers with built-in discovery and auth.
Deployment options
Binary, Docker, or Kubernetes — pick what fits your stack.
Popular integrations
FOUNDATION
"One of the biggest open security problems today is how to do MCP security effectively. While there are a lot of problems in this space that the community doesn't know how to address, the agentgateway project provides a first step toward addressing some of the important issues with basic role-based access control and visibility of actions to MCP servers. I look forward to seeing how this project adapts and evolves to handle the complex, evolving threats in this space under open source governance."
What could be improved?
Your feedback helps us improve assistant answers and identify docs gaps we should fix.
Need more help? Join us on Discord: https://discord.gg/y9efgEmppm
Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here: https://search.solo.io/.
