AgentOS markAgentOS
Install AgentOS

Providers and Models

AgentOS supports multiple LLM providers through one configuration surface. You can run direct single-model mode or enable AgentOS Router for tiered routing.

Use this page when you need to configure a provider, inspect model support, or choose between direct model mode and router mode.

Inspect Providers

List provider metadata from the local install:

agentos providers list
agentos providers list --json

Show runtime provider diagnostics from the running gateway:

agentos providers status
agentos providers status openrouter --json
agentos providers status --probe-models

providers list does not require a running gateway. providers status does.

Configure a Provider

Interactive:

agentos providers configure openrouter

Non-interactive onboarding-style configuration:

export OPENROUTER_API_KEY="sk-..."
agentos configure provider --provider openrouter --api-key-env OPENROUTER_API_KEY

Direct provider examples:

agentos configure provider --provider openai --model gpt-5.4-mini --api-key-env OPENAI_API_KEY
agentos configure provider --provider anthropic --model claude-sonnet-4-6 --api-key-env ANTHROPIC_API_KEY
agentos configure provider --provider gemini --model gemini-2.5-flash --api-key-env GEMINI_API_KEY
agentos configure provider --provider ollama --model llama3.1

Prefer environment-variable references for API keys so secrets are not written directly into configuration files.

Onboarding-Verified Providers

This build exposes onboarding support for:

  • OpenRouter (default provider)
  • Bankr LLM Gateway
  • OpenAI
  • Anthropic
  • Ollama
  • DeepSeek
  • Gemini
  • DashScope / Qwen
  • Moonshot AI
  • Zhipu / Z.AI
  • Baidu Qianfan
  • Volcengine Ark

The provider registry may contain additional compatible providers for advanced or self-hosted setups. Use agentos providers list on your install for the current catalog.

Model Inspection

List models:

agentos models list

If runtime-backed model inspection cannot connect, start the gateway: 

agentos gateway run

For provider metadata that does not require the gateway, use:

agentos providers list

Direct Model vs Router

Direct model mode:

agentos configure router --router disabled
agentos configure provider --provider openai --model gpt-5.4-mini --api-key-env OPENAI_API_KEY

Router mode:

agentos configure router --router recommended
Mode Use when
Direct model You are testing one exact model, reproducing provider behavior, or auditing provider billing.
Router mode You want normal personal-agent use where cost and task complexity vary by turn.

For routing details, see features/agentos-router.md.

Provider Troubleshooting

Start with:

agentos doctor
agentos providers status
agentos diagnostics on

Check:

  • the API key environment variable is set in the gateway process environment;
  • the model id matches the provider;
  • the base URL is correct for compatible APIs;
  • proxy settings match your network;
  • router is disabled when debugging one exact provider/model;
  • the gateway was restarted after config changes.