Skip to content
CTRL K
    Docs Standalone Kubernetes Models Blog Enterprise Community Get Started GitHub
    🎯 New workshop: Govern AI Costs in Real Time — Hands-On with agentgateway agentgateway has joined the Agentic AI Foundation — Learn more

    For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

    Page as Markdown
    Providers
    Configure agentgateway for specific LLM providers like OpenAI, Anthropic, Gemini, and more.
    Learn how to configure agentgateway for a particular LLM.
    OpenAI-compatible providers

    Popular OpenAI-compatible providers include Mistral, DeepSeek, Groq, Together AI, Perplexity, and Fireworks AI.
    Amazon Bedrock
    Configure Amazon Bedrock as an LLM provider for agentgateway.
    Anthropic
    Configure Anthropic Claude as an LLM provider for agentgateway.
    Azure
    Configuration and setup for Azure AI services provider
    Gemini
    Configure Google Gemini as an LLM provider for agentgateway.
    OpenAI
    Configure OpenAI as an LLM provider for agentgateway.
    OpenAI-compatible providers
    Configure OpenAI-compatible providers like Mistral, DeepSeek, or Groq with custom host and path …
    Vertex AI
    Configure Google Vertex AI as an LLM provider for agentgateway.
    Ollama
    Configure agentgateway to route LLM traffic to Ollama for local model inference
    vLLM
    Configure agentgateway to route traffic to vLLM for self-hosted model inference
    Multiple endpoints
    Configure access to multiple OpenAI API endpoints like chat completions, embeddings, and models …
    Mock LLM with httpbun
    Set up httpbun as a mock OpenAI-compatible LLM backend for testing without API keys.
    AboutModel aliasing
    Was this page helpful?
    

    
Agentgateway assistant
    


    Ask me anything about agentgateway configuration, features, or usage.
    Note: AI-generated content might contain errors; please verify and test all returned information.
    Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.
    Switching topics? Starting a new conversation improves accuracy.

    ↑↓ navigate
↵ select
esc dismiss
    

    

    What could be improved?
    Your feedback helps us improve assistant answers and identify docs gaps we should fix.
    Need more help? Join us on Discord:
https://discord.gg/y9efgEmppm
    Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here:
https://search.solo.io/.