LLM Providers

Configure OpenRouter, Anthropic, or OpenAI to power your AI assistant.

Agenistrator supports multiple LLM providers. You can configure one or more providers and choose which models to use.

Recommendation: We recommend OpenRouter for most users. It provides access to models from all major providers with a single API key, offers free models for trying things out, and has the best integration experience with Agenistrator.

Supported Providers

A unified API that aggregates models from OpenAI, Anthropic, Google, Meta, and many other providers.

Getting an API Key:

  1. Go to openrouter.ai
  2. Create an account or sign in
  3. Navigate to Keys
  4. Create a new key

Default Chat Model: OpenAI: gpt-oss-120b - Free tier (good for trying things out)

Why OpenRouter?

  • One API key for hundreds of models across providers
  • Free models available for testing and light use
  • Pay-per-use pricing with no subscriptions
  • Automatic failover and uptime optimization
  • Easy to switch between models without changing providers

Anthropic

Direct access to Anthropic’s Claude models.

Getting an API Key:

  1. Go to console.anthropic.com
  2. Create an account or sign in
  3. Navigate to Settings → API Keys
  4. Create a new API key

Default Chat Model: Claude Haiku 4.5 - Quick responses, cost-effective

Note: Anthropic does not provide embedding models. Use OpenRouter or OpenAI to get access to embedding models for semantic search.

OpenAI

Direct access to OpenAI’s GPT models.

Getting an API Key:

  1. Go to platform.openai.com
  2. Create an account or sign in
  3. Navigate to API Keys
  4. Click Create new secret key
  5. Copy the key (you won’t see it again)

Default Chat Model: gpt-4o-mini - Fast, affordable, capable

Default Embedding Model: text-embedding-3-small (for semantic search)

Choosing the Best Model

The default models are selected for accessibility and cost, not peak performance. For state-of-the-art results, check the LLM Arena Leaderboard to see current top performers.

Adding a Provider

  1. Go to Agenistrator → Settings
  2. In the Providers tab, click Add Provider
  3. Select the provider type
  4. Enter a descriptive name
  5. Paste your API key
  6. Click Save
Provider settings

Provider settings with multiple LLM providers configured

Multiple Providers

You can add multiple providers. This may be useful for quickly switching between models for comparison. Models from all providers appear in the model selector under their provider name.

You can add multiple providers of the same type, which may be useful for load balancing requests across accounts.

Rate Limiting

Each provider has a Tokens Per Minute (TPM) setting:

  • Set to 0 for no limit
  • Set a value to throttle requests
  • Helps stay within provider rate limits
  • Frontend waits when limit is reached

Costs

All costs are charged by your LLM provider, not by Agenistrator:

  • Agenistrator is free and open source
  • You pay only for API usage to your provider
  • Monitor costs in your provider’s dashboard
  • Set usage limits in provider settings if available
  • Free models are available for testing and light use