Pairwise benchmark snapshot · Aug 17, 2026noindex (thin pair)
This page compares Claude Haiku 4.5 (Anthropic) and Google: Gemini 2.5 Pro Preview 06-05 (Google) using the latest snapshots we have as of Aug 17, 2026. Claude Haiku 4.5 wins on output price at $5/1M. Google: Gemini 2.5 Pro Preview 06-05 has the larger context window (1M tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Anthropic
Claude Haiku 4.5Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).
Auto-discovered from OpenRouter (google/gemini-2.5-pro-preview). Preview until a second source matches.
Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
No shared data
No shared data
$5.00/1M cheaper
Simulate monthly production API costs in USD (US Dollar).
Claude Haiku 4.5 is estimated to save $83.75/month ($1,005/year).
Need SWE-bench on both sides.
Lower output list price ($5/1M).
Need TTFT on both sides.
Larger window (1M).
Claude Haiku 4.5 is the side marked multimodal in the catalog.
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | insufficient data | Need SWE-bench on both sides. |
| High-volume chat | Claude Haiku 4.5 | Lower output list price ($5/1M). |
| Voice / low-latency UI | insufficient data | Need TTFT on both sides. |
| Long-document RAG | Google: Gemini 2.5 Pro Preview 06-05 | Larger window (1M). |
| Screenshots / vision | Claude Haiku 4.5 | Claude Haiku 4.5 is the side marked multimodal in the catalog. |
$1/$5 hosted Claude vs a cheap long-context open sibling. The alternative-to-Sonnet pair that is honest.
Huge window, cheap hosted lists. The Haiku alternative that is actually open-weight.
Official Anthropic list $1/$5. This is the SKU behind “cheapest Claude alternative” that is still Claude.
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/claude-haiku-4-5-vs-gemini-2-5-pro-preview/opengraph-image for crawlers.
Verified head-to-head card
