Skip to content

agentgateway

One high-performance gateway for service, LLM, and MCP traffic.

An open source HTTP and gRPC gateway that handles traditional application traffic and AI-native protocols in one data plane. Route, secure, observe, and govern services, LLM provider traffic, MCP tools, and agent-to-agent communication without stitching together separate gateways.

Part of The Linux Foundation

LLM Gateway

Route to OpenAI, Claude, Gemini, or any self-hosted model with credentialing and failover.

MCP

MCP / A2A

Native protocol support for Model Context Protocol and agent-to-agent traffic.

APIs & Services

HTTP, gRPC, and TCP traffic — observable by default with mTLS and OIDC built in.

SOURCES · CLIENTSAGENTGATEWAY · CONTROL PLANEDESTINATIONS · MODELS & AGENTSCLI / IDEClaude, Codex, OpenCodeAI agentsLangSmith, CrewAI, ADKApps & clientsAI agentsOpenAIAnthropicMCP / A2A endpointsREST · MCP · API toolsLLM GatewayInference RoutingMCP / A2A gatewayREQUEST · INBOUNDROUTE · SECURE · OBSERVE · GOVERNRESPONSE · OUTBOUND
Contributing Companies
The Linux FoundationLinux Foundation
Solo.ioSolo.io
MicrosoftMicrosoft
AppleApple
AlibabaAlibaba
AdobeAdobe
AWSAWS
CiscoCisco
SalesforceSalesforce
HuaweiHuawei
AmdocsAmdocs

Everything you need for agent traffic — in one binary.

One control plane for service traffic, LLM routing, MCP, A2A, and inference — with policy and observability that the platform team actually trusts.

Service Gateway
HTTP, gRPC, TCP — observable by default.

Run any north–south or east–west traffic through a single binary. Zero-config TLS, OIDC, mTLS-rotation, native Envoy compatibility for those who want it.

HTTP/2gRPCmTLSTLS-1.3
LLM Gateway
Route, fail over, and budget across 12+ model backends.

Drop-in OpenAI-compatible API in front of OpenAI, Anthropic, Bedrock, Gemini, Vertex, Cohere, OSS Llama runs — with per-team token budgets, semantic caching and prompt redaction.

OpenAIAnthropicBedrockGeminiVertex
Inference Routing
Smart routing across self-hosted GPU pools.

Latency-aware, cost-aware, model-aware routing for self-hosted inference. Plug-in vLLM, TGI, Triton; agentgateway picks the warmest replica.

vLLMTGITriton
MCP
MCP Gateway
A control plane for the Model Context Protocol.

Discover, sign, scope and observe every tool call your agents make. Treat MCP servers like microservices — with versioning, RBAC, and audit trails out of the box.

DiscoveryRBACAudit
A2A
A2A Gateway
Bridge agents written in any framework.

agentgateway speaks the Agent-to-Agent protocol natively. Route invocations between LangChain, CrewAI, ADK and your own runtime — with identity, tracing, and replay.

LangChainCrewAIADKIdentity
Security & Observability
Per-call traces, logs, and policy decisions.

OpenTelemetry by default. Per-tool, per-agent, per-tenant counters. OPA-evaluated allow/deny on every hop, with tamper-evident audit logs.

OTELOPAAuditPII-shield

Getting started

View all docs →
# Install the agentgateway binary
$ curl -sL https://agentgateway.dev/install | bash
 
# Run with a config file
$ agentgateway -f config.yaml
 
# INFO agentgateway: Listening on 0.0.0.0:3000
# INFO agentgateway: Admin UI at http://localhost:15000/ui/
# yaml-language-server: $schema=https://agentgateway.dev/schema/config
binds:
- port: 3000
listeners:
- routes:
- policies:
cors:
allowOrigins: ["*"]
allowHeaders: [content-type, cache-control]
a2a: {}
backends:
- host: localhost:9999
# Install Gateway API CRDs
$ kubectl apply --server-side --force-conflicts \
-f https://github.com/kubernetes-sigs/gateway-api/releases/download/v1.5.0/standard-install.yaml
 
# Install agentgateway CRDs via Helm
$ helm upgrade -i agentgateway-crds \
oci://cr.agentgateway.dev/charts/agentgateway-crds \
--create-namespace --namespace agentgateway-system \
--version v1.1.0 \
--set controller.image.pullPolicy=Always
 
# Install agentgateway via Helm
$ helm upgrade -i agentgateway \
oci://cr.agentgateway.dev/charts/agentgateway \
--namespace agentgateway-system \
--version v1.1.0 \
--set controller.image.pullPolicy=Always \
--set controller.extraEnv.KGW_ENABLE_GATEWAY_API_EXPERIMENTAL_FEATURES=true \
--wait
# Run agentgateway in a container
$ docker run -p 3000:3000 -p 15000:15000 \
-v $(pwd)/config.yaml:/etc/agentgateway/config.yaml \
ghcr.io/agentgateway/agentgateway:latest \
-f /etc/agentgateway/config.yaml

Quick start

Get started with agentgateway in less than 5 minutes — local-first.

MCP

MCP connectivity guide

Connect agentgateway to MCP servers with built-in discovery and auth.

Deployment options

Binary, Docker, or Kubernetes — pick what fits your stack.

Popular integrations

LLM Providers
OpenAI
OpenAIModels
Anthropic
AnthropicModels
Gemini
GeminiModels
Bedrock
BedrockModels
Azure OpenAI
Azure OpenAIModels
Mistral
MistralModels
DeepSeek
DeepSeekModels
Ollama
OllamaModels
Vertex AI
Vertex AIModels
Meta
Meta / LlamaModels
xAI
xAIModels
Perplexity
PerplexityModels
Replicate
ReplicateModels
Snowflake
SnowflakeModels
Agents & Frameworks
Claude Code
Claude CodeTools
Cursor
CursorTools
Codex
CodexTools
VS Code
VS CodeTools
OpenCode
OpenCodeTools
OpenClaw
OpenClawFrameworks
Pi.dev
Pi.devTools
GitHub CLI
GitHub CLITools
CrewAI
CrewAIFrameworks
Google ADK
Google ADKFrameworks
LangGraph
LangGraphFrameworks
LangChain
LangChainFrameworks
agentgateway
agentgatewayFrameworks
kagent
kagentFrameworks
Hermes
HermesFrameworks
NemoClaw
NemoClawFrameworks
Hugging Face
Hugging FaceModels
NVIDIA
NVIDIA NIMModels
Databricks
DatabricksModels
Dev Tools & MCP
MCP
MCPProtocol
A2A
A2AProtocol
GitHub
GitHubMCP
Slack
SlackMCP
Postgres
PostgresMCP
Docker
DockerPlatform
Vault
VaultSecurity
Grafana
GrafanaObservability
Infrastructure
Kubernetes
KubernetesPlatform
OpenTelemetry
OpenTelemetryObservability
AWS
AWSPlatform
Google Cloud
Google CloudPlatform
GKE
GKEPlatform
Langfuse
LangfuseObservability
Prometheus
PrometheusObservability
Datadog
DatadogObservability
Sentry
SentryObservability
PagerDuty
PagerDutyObservability
W&B
Weights & BiasesObservability
HashiCorp
HashiCorpSecurity
Built in the open

Join the community

Calling all agent-curious tool-builders, platform engineers, and AI enthusiasts — come help shape the future of agentic connectivity.

THE LINUX
FOUNDATION

"One of the biggest open security problems today is how to do MCP security effectively. While there are a lot of problems in this space that the community doesn't know how to address, the agentgateway project provides a first step toward addressing some of the important issues with basic role-based access control and visibility of actions to MCP servers. I look forward to seeing how this project adapts and evolves to handle the complex, evolving threats in this space under open source governance."

Agentgateway assistant

Ask me anything about agentgateway configuration, features, or usage.

Note: AI-generated content might contain errors; please verify and test all returned information.

Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.

Switching topics? Starting a new conversation improves accuracy.
↑↓ navigate select esc dismiss

What could be improved?

Your feedback helps us improve assistant answers and identify docs gaps we should fix.

Need more help? Join us on Discord: https://discord.gg/y9efgEmppm

Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here: https://search.solo.io/.