For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.
Providers
Configure agentgateway for specific LLM providers like OpenAI, Anthropic, Gemini, and more.
Learn how to configure agentgateway for a particular LLM.
Custom providers
Use custom providers for self-hosted or non-managed LLM providers when you want to declare supported API formats, upstream paths, and backend targets explicitly.
OpenAI-compatible providers
Popular OpenAI-compatible providers include Mistral, DeepSeek, Groq, Together AI, Perplexity, and Fireworks AI.
Amazon Bedrock
Configure Amazon Bedrock as an LLM provider for agentgateway.
Anthropic
Configure Anthropic Claude as an LLM provider for agentgateway.
Azure
Configuration and setup for Azure AI services provider
Gemini
Configure Google Gemini as an LLM provider for agentgateway.
OpenAI
Configure OpenAI as an LLM provider for agentgateway.
OpenAI-compatible providers
Configure OpenAI-compatible providers like Mistral, DeepSeek, or Groq with custom host and path …
Vertex AI
Configure Google Vertex AI as an LLM provider for agentgateway.
Custom providers
Configure self-hosted and non-managed LLM providers with explicit API formats, paths, and backend …
Ollama
Configure agentgateway to route LLM traffic to Ollama for local model inference
vLLM
Configure agentgateway to route traffic to vLLM for self-hosted model inference
Multiple endpoints
Configure access to multiple OpenAI API endpoints like chat completions, embeddings, and models …
Mock LLM with httpbun
Set up httpbun as a mock OpenAI-compatible LLM backend for testing without API keys.
