CompareLLM
CompareLLM.ai
Live
LeaderboardModelsCompareStacksBest ofGuidesNewsMethod
…
CompareLLM
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

  1. Home
  2. Models
  3. Codestral 25.01
Mistral

Codestral 25.01

Codestral 25.01 is a Mistral closed-API catalog model. Latest preference Elo in this catalog is 1,320 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 51.8% (seed-bootstrap (Aug 1, 2026)). List output price is $0.9/1M. Context window is 256k tokens. Mistral code-specialist model. Numbers below are dated snapshots, not a guarantee on your traffic mix.

At a glance

Codestral 25.01 is a Mistral closed-API catalog model. Latest preference Elo in this catalog is 1,320 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 51.8% (seed-bootstrap (Aug 1, 2026)). List output price is $0.9/1M. Context window is 256k tokens. Mistral code-specialist model. Numbers below are dated snapshots, not a guarantee on your traffic mix.
Last updated Aug 1, 2026
All 69 vsSave Model

Compare Codestral 25.01 against

Capability Profile

Codestral 25.01 Benchmark Percentiles

Plotted against all active catalog models (50th percentile = catalog median).

Codestral 25.01
Median (50)

Dimensional Scorecards

Reasoning
12%
Coding
17%
Math
11%
Speed
81%
Value
63%
Context
44%
Standout Competencies

Ranks in the top tier (≥75th percentile) for Speed.

Benchmark Specifications

Dated snapshot metrics aggregated from official evaluators and API providers.

Preference Elo1,320
seed-bootstrap · Aug 1, 2026
Coding Elo1,402
seed-bootstrap · Aug 1, 2026
LiveBench54%
seed-bootstrap · Aug 1, 2026
SWE-bench51.8%
seed-bootstrap · Aug 1, 2026
GPQA Diamond58.4%
seed-bootstrap · Aug 1, 2026
Time to first token150 ms
seed-bootstrap · Aug 1, 2026
Output speed148 tok/s
seed-bootstrap · Aug 1, 2026
Input price$0.3/1M
seed-bootstrap · Aug 1, 2026
Output price$0.9/1M
seed-bootstrap · Aug 1, 2026
Context window256k
seed-bootstrap · Aug 1, 2026
Benchmark MetricReported ScoreObserved Source
Preference Elo1,320seed-bootstrap · Aug 1, 2026
Coding Elo1,402seed-bootstrap · Aug 1, 2026
LiveBench54%seed-bootstrap · Aug 1, 2026
SWE-bench51.8%seed-bootstrap · Aug 1, 2026
GPQA Diamond58.4%seed-bootstrap · Aug 1, 2026
Time to first token150 msseed-bootstrap · Aug 1, 2026
Output speed148 tok/sseed-bootstrap · Aug 1, 2026
Input price$0.3/1Mseed-bootstrap · Aug 1, 2026
Output price$0.9/1Mseed-bootstrap · Aug 1, 2026
Context window256kseed-bootstrap · Aug 1, 2026

Compare with every model

Search or pick any catalog row. Suggested matchups first, then the full list.

Dedicated vs hub →
Codestral 25.01 vs Mistral Large 3 (next mistral)Codestral 25.01 vs DeepSeek V3Codestral 25.01 vs GPT-4oCodestral 25.01 vs Command ACodestral 25.01 vs Gemini 2.5 FlashCodestral 25.01 vs Gemini 2.5 Pro
Showing 69 of 69 comparisons
Codestral 25.01 vs Claude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo: −304SWE: −27.4%
Codestral 25.01 vs Claude Fable 5Anthropic
Compare

Anthropic top-tier long-horizon model. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo: −296SWE: −28.2%
Codestral 25.01 vs GPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo: −288SWE: −25.8%
Codestral 25.01 vs Claude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo: −278SWE: −26.6%
Codestral 25.01 vs Grok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo: −272SWE: −17.3%
Codestral 25.01 vs Claude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger long-horizon agent traces.

Elo: −254SWE: −24.1%
Codestral 25.01 vs Gemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo: −250SWE: −22.8%
Codestral 25.01 vs Claude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo: −248SWE: −25%
Codestral 25.01 vs OpenAI: o3 MiniOpenAI
Compare

Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.

Elo: −240SWE: −26.7%
Codestral 25.01 vs GPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo: −238SWE: −16.6%
Codestral 25.01 vs GLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo: −238SWE: −24.6%
Codestral 25.01 vs Claude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo: −236SWE: −22%
Codestral 25.01 vs Gemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo: −232SWE: −20.6%
Codestral 25.01 vs GPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo: −228SWE: −18.6%
Codestral 25.01 vs GPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo: −220SWE: −19.2%
Codestral 25.01 vs DeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo: −216SWE: −19.8%
Codestral 25.01 vs Gemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo: −210SWE: −20.6%
Codestral 25.01 vs Kimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo: −208SWE: −22%
Codestral 25.01 vs Claude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo: −204SWE: −18.3%
Codestral 25.01 vs Qwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo: −198SWE: −16%
Codestral 25.01 vs MoonshotAI: Kimi K2.5Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.

Elo: −195SWE: −19.5%
Codestral 25.01 vs OpenAI: o1OpenAI
Compare

Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.

Elo: −192SWE: +2.9%
Codestral 25.01 vs Gemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo: −186SWE: −19%
Codestral 25.01 vs Gemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo: −175SWE: −24%
Codestral 25.01 vs Qwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo: −175SWE: −15.7%
Codestral 25.01 vs GLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo: −172SWE: −17.5%
Codestral 25.01 vs Gemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo: −170SWE: −15%
Codestral 25.01 vs DeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo: −170SWE: −19.4%
Codestral 25.01 vs Claude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo: −170SWE: −20.7%
Codestral 25.01 vs Grok 4xAI
Compare

Previous xAI flagship.

Elo: −168SWE: −6.8%
Codestral 25.01 vs MiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo: −158SWE: −24%
Codestral 25.01 vs Yi-Lightning01.AI
Compare

01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo: −155SWE: −11.6%
Codestral 25.01 vs Seed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo: −152SWE: −11.4%
Codestral 25.01 vs Doubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo: −150SWE: −10.3%
Codestral 25.01 vs Llama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo: −148SWE: −5.3%
Codestral 25.01 vs GPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo: −146SWE: −10%
Codestral 25.01 vs MoonshotAI: Kimi K2 0711Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.

Elo: −145SWE: −14%
Codestral 25.01 vs Mistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo: −136SWE: −3.6%
Codestral 25.01 vs Claude Sonnet 4Anthropic
Compare

First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.

Elo: −135SWE: −11%
Codestral 25.01 vs Ernie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo: −130SWE: −5.2%
Codestral 25.01 vs Qwen 2.5 PlusAlibaba
Compare

Alibaba balanced flagship API model with high-throughput general reasoning.

Elo: −125SWE: −7.4%
Codestral 25.01 vs OpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo: −125SWE: −4.6%
Codestral 25.01 vs Qwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo: −120SWE: −7.6%
Codestral 25.01 vs Claude Haiku 4.5Anthropic
Compare

Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo: −118SWE: −6.4%
Codestral 25.01 vs Yi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo: −110SWE: −2%
Codestral 25.01 vs Qwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo: −105SWE: −13.4%
Codestral 25.01 vs Kimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo: −100SWE: +0.8%
Codestral 25.01 vs Llama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo: −92SWE: −0.6%
Codestral 25.01 vs GPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo: −90SWE: −0.6%
Codestral 25.01 vs Grok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo: −85SWE: +0.4%
Codestral 25.01 vs Qwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo: −78SWE: −7%
Codestral 25.01 vs Llama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo: −50SWE: −6.6%
Codestral 25.01 vs DeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo: −45SWE: −8.7%
Codestral 25.01 vs Claude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo: −42SWE: −18.5%
Codestral 25.01 vs Doubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo: −40SWE: +5.8%
Codestral 25.01 vs DeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo: −38SWE: −13.4%
Codestral 25.01 vs Gemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo: −30SWE: −12%
Codestral 25.01 vs Command ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo: −24SWE: +9.2%
Codestral 25.01 vs GPT-4oOpenAI
Compare

Previous OpenAI flagship. Still a common compare baseline on legacy pages.

Elo: −15SWE: −3%
Codestral 25.01 vs DeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo: +10SWE: +3.2%
Codestral 25.01 vs Gemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo: +25SWE: +3.8%
Codestral 25.01 vs Llama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo: +35SWE: +6.7%
Codestral 25.01 vs Claude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo: +40SWE: +2.8%
Codestral 25.01 vs GPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo: +48SWE: +10.6%
Codestral 25.01 vs Gemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo: +60SWE: +13.8%
Codestral 25.01 vs GPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo: +65SWE: +18.6%
Codestral 25.01 vs Claude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo: +72SWE: +13.4%
Codestral 25.01 vs Llama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo: +80SWE: +11.6%
Codestral 25.01 vs Claude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo: +96SWE: +15.6%

Related news

  • launch · Jan 14, 2025

    Codestral 25.01: Mistral’s code-specialist row

Frequently asked questions

Plain-English methodology and leaderboard answers

Codestral 25.01 is a Mistral closed-API model. Mistral code-specialist model.

Elo is a crowd vote on which hidden answer people liked more — not a school test. What is Elo?