> ## Documentation Index
> Fetch the complete documentation index at: https://agno-v2-codex-docs-audit-20260719-0149.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Model Providers

> Setup guides for model providers and API adapters available in Agno.

Browse the provider guides available in this documentation. Capabilities vary by provider endpoint and model ID.

## Provider APIs

<CardGroup cols={3}>
  <Card title="Anthropic" icon="brain" iconType="duotone" href="/models/providers/native/anthropic/overview">
    Call Anthropic's Messages API with Claude models.
  </Card>

  <Card title="Cohere" icon="robot" iconType="duotone" href="/models/providers/native/cohere/overview">
    Call Cohere's Chat API with Command models.
  </Card>

  <Card title="DashScope" icon="robot" iconType="duotone" href="/models/providers/native/dashscope/overview">
    Run Qwen models through Alibaba Cloud DashScope.
  </Card>

  <Card title="DeepSeek" icon="robot" iconType="duotone" href="/models/providers/native/deepseek/overview">
    Send chat and reasoning requests to DeepSeek.
  </Card>

  <Card title="Google Gemini" icon="google" iconType="duotone" href="/models/providers/native/google/overview">
    Generate content with Google's Gemini API.
  </Card>

  <Card title="Google Gemini Interactions" icon="google" iconType="duotone" href="/models/providers/native/google/gemini-interactions">
    Google's stateful Interactions API and managed agents.
  </Card>

  <Card title="Inception" icon="robot" iconType="duotone" href="/models/providers/native/inception/overview">
    Inception Labs Mercury diffusion models.
  </Card>

  <Card title="Meta" icon="meta" iconType="duotone" href="/models/providers/native/meta/overview">
    Meta Llama native and OpenAI-compatible adapters.
  </Card>

  <Card title="MiniMax" icon="robot" iconType="duotone" href="/models/providers/native/minimax/overview">
    Send OpenAI-compatible requests to MiniMax.
  </Card>

  <Card title="Mistral" icon="wind" iconType="duotone" href="/models/providers/native/mistral/overview">
    Call Mistral's Chat Completions API.
  </Card>

  <Card title="OpenAI Chat Completions" icon="robot" iconType="duotone" href="/models/providers/native/openai/completion/overview">
    Use OpenAI's Chat Completions interface.
  </Card>

  <Card title="OpenAI Responses" icon="robot" iconType="duotone" href="/models/providers/native/openai/responses/overview">
    Use OpenAI's Responses interface and built-in tools.
  </Card>

  <Card title="Perplexity" icon="question" iconType="duotone" href="/models/providers/native/perplexity/overview">
    Run Perplexity Sonar models and retain URL citations.
  </Card>

  <Card title="Vercel v0" icon="robot" iconType="duotone" href="/models/providers/native/vercel/overview">
    Vercel v0 models for web application generation.
  </Card>

  <Card title="xAI" icon="x" iconType="duotone" href="/models/providers/native/xai/overview">
    Run Grok models through xAI.
  </Card>

  <Card title="Xiaomi MiMo" icon="robot" iconType="duotone" href="/models/providers/native/xiaomi/overview">
    Send OpenAI-compatible requests to Xiaomi MiMo.
  </Card>
</CardGroup>

## Local Runtimes

<CardGroup cols={3}>
  <Card title="llama.cpp" icon="robot" iconType="duotone" href="/models/providers/local/llama-cpp/overview">
    Local GGUF model inference with llama.cpp.
  </Card>

  <Card title="LM Studio" icon="laptop" iconType="duotone" href="/models/providers/local/lmstudio/overview">
    Connect to LM Studio's local model server.
  </Card>

  <Card title="Ollama" icon="robot" iconType="duotone" href="/models/providers/local/ollama/overview">
    Ollama Chat and Responses API adapters.
  </Card>

  <Card title="vLLM" icon="server" iconType="duotone" href="/models/providers/local/vllm/overview">
    vLLM high-throughput inference.
  </Card>
</CardGroup>

## Cloud Platforms

<CardGroup cols={3}>
  <Card title="AWS Bedrock" icon="cloud" iconType="duotone" href="/models/providers/cloud/aws-bedrock/overview">
    Call models through the Amazon Bedrock Converse API.
  </Card>

  <Card title="Claude via AWS Bedrock" icon="brain" iconType="duotone" href="/models/providers/cloud/aws-claude/overview">
    Anthropic Claude models via AWS Bedrock.
  </Card>

  <Card title="Azure AI Foundry" icon="microsoft" iconType="duotone" href="/models/providers/cloud/azure-ai-foundry/overview">
    Connect to Azure AI Foundry inference endpoints.
  </Card>

  <Card title="Azure AI Foundry Claude" icon="brain" iconType="duotone" href="/models/providers/cloud/azure-foundry-claude/overview">
    Anthropic Claude models via Azure AI Foundry.
  </Card>

  <Card title="Azure OpenAI" icon="microsoft" iconType="duotone" href="/models/providers/cloud/azure-openai/overview">
    Connect to an Azure OpenAI deployment.
  </Card>

  <Card title="Vertex AI Claude" icon="brain" iconType="duotone" href="/models/providers/cloud/vertexai-claude/overview">
    Anthropic Claude models via Google Vertex AI.
  </Card>

  <Card title="IBM WatsonX" icon="robot" iconType="duotone" href="/models/providers/cloud/ibm-watsonx/overview">
    Run foundation models through IBM watsonx.ai.
  </Card>
</CardGroup>

## Hosted Inference and Gateways

<CardGroup cols={3}>
  <Card title="AI/ML API" icon="robot" iconType="duotone" href="/models/providers/gateways/aimlapi/overview">
    Route OpenAI-compatible requests through AI/ML API.
  </Card>

  <Card title="Cerebras" icon="robot" iconType="duotone" href="/models/providers/gateways/cerebras/overview">
    Call Cerebras models with the native SDK.
  </Card>

  <Card title="Cerebras OpenAI" icon="robot" iconType="duotone" href="/models/providers/gateways/cerebras-openai/overview">
    Call Cerebras through its OpenAI-compatible endpoint.
  </Card>

  <Card title="Cloudflare" icon="cloudflare" iconType="duotone" href="/models/providers/gateways/cloudflare/overview">
    Cloudflare AI Gateway unified API.
  </Card>

  <Card title="CometAPI" icon="comet" iconType="duotone" href="/models/providers/gateways/cometapi/overview">
    Route OpenAI-compatible requests through CometAPI.
  </Card>

  <Card title="DeepInfra" icon="infinity" iconType="duotone" href="/models/providers/gateways/deepinfra/overview">
    Send OpenAI-compatible requests to DeepInfra.
  </Card>

  <Card title="Fireworks" icon="fire" iconType="duotone" href="/models/providers/gateways/fireworks/overview">
    Send OpenAI-compatible requests to Fireworks AI.
  </Card>

  <Card title="Groq" icon="bolt" iconType="duotone" href="/models/providers/gateways/groq/overview">
    Run hosted models through GroqCloud.
  </Card>

  <Card title="Hugging Face" icon="robot" iconType="duotone" href="/models/providers/gateways/huggingface/overview">
    Call models through Hugging Face Inference Providers.
  </Card>

  <Card title="LangDB" icon="database" iconType="duotone" href="/models/providers/gateways/langdb/overview">
    Route model requests through LangDB.
  </Card>

  <Card title="LiteLLM" icon="lightbulb" iconType="duotone" href="/models/providers/gateways/litellm/overview">
    LiteLLM unified model interface.
  </Card>

  <Card title="LiteLLM OpenAI" icon="lightbulb" iconType="duotone" href="/models/providers/gateways/litellm-openai/overview">
    Connect to a LiteLLM OpenAI-compatible endpoint.
  </Card>

  <Card title="Nebius Token Factory" icon="star" iconType="duotone" href="/models/providers/gateways/nebius/overview">
    Run hosted models through Nebius Token Factory.
  </Card>

  <Card title="Neosantara" icon="robot" iconType="duotone" href="/models/providers/gateways/neosantara/overview">
    Send OpenAI-compatible requests to Neosantara.
  </Card>

  <Card title="Nexus" icon="link" iconType="duotone" href="/models/providers/gateways/nexus/overview">
    Route model requests through Nexus.
  </Card>

  <Card title="NVIDIA" icon="robot" iconType="duotone" href="/models/providers/gateways/nvidia/overview">
    Connect to NVIDIA-hosted model endpoints.
  </Card>

  <Card title="OpenRouter" icon="route" iconType="duotone" href="/models/providers/gateways/openrouter/overview">
    OpenRouter Chat Completions and Responses API adapters.
  </Card>

  <Card title="Portkey" icon="key" iconType="duotone" href="/models/providers/gateways/portkey/overview">
    Route requests through the Portkey AI Gateway.
  </Card>

  <Card title="Requesty" icon="robot" iconType="duotone" href="/models/providers/gateways/requesty/overview">
    Route model requests through Requesty.
  </Card>

  <Card title="SambaNova" icon="server" iconType="duotone" href="/models/providers/gateways/sambanova/overview">
    Run hosted models through SambaNova Cloud.
  </Card>

  <Card title="SiliconFlow" icon="robot" iconType="duotone" href="/models/providers/gateways/siliconflow/overview">
    Send OpenAI-compatible requests to SiliconFlow.
  </Card>

  <Card title="Together" icon="users" iconType="duotone" href="/models/providers/gateways/together/overview">
    Run hosted models through Together AI.
  </Card>

  <Card title="Tuning Engines" icon="robot" iconType="duotone" href="/models/providers/gateways/tuning-engines/overview">
    Connect to a governed OpenAI-compatible endpoint.
  </Card>
</CardGroup>

## Model String Key Catalog

These are the canonical provider keys registered by the v2.7.4 model-string resolver. Similar keys can select different API adapters.

| Category                      | Canonical keys                                                                                                                                                                                                                                                                                                                                  |
| ----------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Provider APIs                 | `anthropic`, `cohere`, `dashscope`, `deepseek`, `google`, `google-interactions`, `inception`, `internlm`, `llama-openai`, `meta`, `minimax`, `mistral`, `moonshot`, `open-responses`, `openai`, `openai-chat`, `openai-responses`, `perplexity`, `vercel`, `xai`, `xiaomi`                                                                      |
| Local runtimes                | `llama-cpp`, `lmstudio`, `ollama`, `ollama-responses`, `vllm`                                                                                                                                                                                                                                                                                   |
| Cloud platforms               | `aws-bedrock`, `aws-claude`, `azure-ai-foundry`, `azure-foundry-claude`, `azure-openai`, `ibm`, `vertexai-claude`                                                                                                                                                                                                                               |
| Hosted inference and gateways | `aimlapi`, `cerebras`, `cerebras-openai`, `cloudflare`, `cometapi`, `deepinfra`, `fireworks`, `groq`, `huggingface`, `langdb`, `litellm`, `litellm-openai`, `n1n`, `nebius`, `neosantara`, `nexus`, `nvidia`, `openrouter`, `openrouter-responses`, `portkey`, `requesty`, `sambanova`, `siliconflow`, `together`, `tokenlab`, `tuning-engines` |

Use canonical keys in new configuration. See [Model as String](/models/model-as-string) for parsing rules and API-variant examples.

## SDK Adapters Without Dedicated Guides

The SDK also exports these provider adapters, but this documentation does not yet include setup guides for them:

| Adapter  | Import                                      | Related documentation                                   |
| -------- | ------------------------------------------- | ------------------------------------------------------- |
| InternLM | `from agno.models.internlm import InternLM` | [InternLM reference](/reference/models/internlm)        |
| Moonshot | `from agno.models.moonshot import MoonShot` | [Moonshot examples](/examples/models/moonshot/overview) |
| N1N      | `from agno.models.n1n import N1N`           | [N1N reference](/reference/models/n1n)                  |

<Warning>
  In v2.7.4, the `InternLM` default `base_url` already ends in `/chat/completions`, and the inherited OpenAI client appends that route again. The `internlm:model_id` string therefore sends requests to a duplicated path. Until the adapter is fixed, instantiate the class with `base_url="https://internlm-chat.intern-ai.org.cn/puyu/api/v1"` instead of using the string form.
</Warning>

Feature support still depends on the selected model ID and endpoint. Verify both before deployment.

## Developer Resources

* [OpenAI-compatible and Open Responses adapters](/models/providers/openai-like)
* [Compatibility overview](/models/compatibility)
* [Base model reference](/reference/models/model)
