Pairwise benchmark snapshot · Aug 16, 2026
This page compares Codestral 25.01 (Mistral) and Gemini 3 Flash (Google) using the latest snapshots we have as of Aug 16, 2026. On preference Elo, Gemini 3 Flash is ahead by 175 points (1,495 vs 1,320; seed-bootstrap (Aug 1, 2026)). On SWE-bench coding, Gemini 3 Flash resolves 75.8% versus 51.8% (seed-bootstrap (Aug 1, 2026)). Gemini 3 Flash streams faster (190 tok/s) while Codestral 25.01 is the cheaper output token ($0.9/1M). Gemini 3 Flash has the larger context window (1M tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.
Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
175 pts advantage
42 tok/s faster
$2.10/1M cheaper
Simulate monthly production API costs based on published $/1M tokens.
Codestral 25.01 is estimated to save $38.50/month ($462/year).
Higher SWE-bench (75.8%).
Lower output list price ($0.9/1M).
Lower TTFT (95 ms).
Larger window (1M).
Gemini 3 Flash is the side marked multimodal in the catalog.
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | Gemini 3 Flash | Higher SWE-bench (75.8%). |
| High-volume chat | Codestral 25.01 | Lower output list price ($0.9/1M). |
| Voice / low-latency UI | Gemini 3 Flash | Lower TTFT (95 ms). |
| Long-document RAG | Gemini 3 Flash | Larger window (1M). |
| Screenshots / vision | Gemini 3 Flash | Gemini 3 Flash is the side marked multimodal in the catalog. |
March 2026 speed SKU. Still a useful cheap-coding compare even after 3.6/3.7 Flash.
Jan 2025 code model. Still a valid cheap-coding compare. Not a chatbot.
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/codestral-25-vs-gemini-3-flash/opengraph-image for crawlers.
Verified head-to-head card
