LibrariEval System
LeaderboardDocsPricingSign UpLogin
Librari Evals — Docs

Browse Supported LLM Models

See which model deployments are wired up for runs and the Extract API, which are chat vs embedding, with per-deployment pricing and limits.

Want to know which models you can actually pick from when running a manual test or scheduling one? This page is the menu. It's read-only — Model Deployments are managed by super-admins on a system level — but it's the canonical place to check pricing, deployment IDs, and what providers are plumbed in.

What it looks like

The Supported LLM Models view showing a sortable table with columns Maker, Model, Version, Provider, Deployment, Modality, Max Tokens, Input dollars per million, Output dollars per million. Eighteen rows span Amazon Nova (Micro, Lite, Pro), Anthropic Claude Opus and Sonnet and Haiku, DeepSeek R1, Google Gemini, Meta Llama 3.1 / 3.3, OpenAI GPT 5.2 / 5.4 / 5.4 mini, and xAI Grok — most served via AWS Bedrock, with Azure for OpenAI and Grok and Google for Gemini. Result counter reads 18 results.
  1. Search box (filters by maker, model, provider, release)
  2. Result count
  3. Sortable columns

The columns

ColumnWhat it is
MakerThe company that made the model — Anthropic, OpenAI, Meta, Google, Amazon, DeepSeek, xAI, etc.
ModelThe model family — Opus, Sonnet, Haiku, GPT, Gemini, Nova Micro/Lite/Pro, Llama 3.1 / 3.3, R1, Grok, etc.
VersionThe specific version of the model. Same family, different snapshots.
ProviderThe platform serving the model — AWS Bedrock, Azure, Google, etc. The same model often shows up under multiple providers.
DeploymentThe provider-specific deployment identifier (e.g. us.anthropic.claude-opus-4-7 on AWS Bedrock or gpt-5.4 on Azure). This is the string the actual API call uses.
ModalityWhat the deployment does. Chat deployments run extractions — they're the ones you pick for tests and send to the Extract API. Embedding deployments turn text into vectors and can only be used by the embedding endpoint. See Chat vs embedding deployments below.
Max TokensThe output token cap for this deployment. Blank for embedding deployments, which don't generate text.
Input $/MCost in USD per million input tokens for this deployment. For an embedding deployment this is the whole price — there's no output side.
Output $/MCost in USD per million output tokens, which is usually a few times higher than input. Blank or zero for embedding deployments.

Chat vs embedding deployments

Every deployment is one of two kinds, and they're not interchangeable:

  • Chat — the default, and what every deployment was before the column existed. These run structured extractions: manual tests, scheduled tests, pre-populating ground truth, and the Extract API.
  • Embedding — turns a batch of text chunks into vectors (for search and similarity, not for reading a document). These are served by a separate embedding endpoint and never show up in the test-run pickers.

If you send an embedding deployment's ID to the Extract API, the request is rejected before anything is charged, with a 400 whose type is deployment_modality_mismatch. The Extract API error table has the full shape. The reverse is also blocked — a chat deployment can't be asked for embeddings.

How to use it

Three common reads:

  • "Which models can I pick from in Manual Test Run?" — every Chat row in this table is selectable in Run a Manual Test and Schedule Recurring Tests, provided the underlying provider key is configured (see Manage LLM Provider API Keys). Embedding rows aren't offered there — search "embedding" to see which ones exist.
  • "How expensive is X?" — sort by Input $/M or Output $/M to compare. Remember to multiply by your typical doc length and the number of docs in your test set before deciding.
  • "What's the Bedrock deployment ID for Opus 4.7?" — search "opus" and copy the Deployment column.

What's not here

  • Newly-released models that haven't been wired up yet. If you need a model that isn't in the list, ask the system admin — adding a deployment is a super-admin action.
  • Your own deployments via "Bring Your Own Keys" — the Manage LLM Provider API Keys page is where you set up a key that lets Librari Evals call a provider on your behalf; the deployments themselves still need to exist in the supported-models catalog before you can pick them.

On this page