Pairwise benchmark snapshot · Aug 17, 2026noindex (thin pair)
In this head-to-head showdown, Google: Gemma 4 26B A4B is more budget-friendly at $0.34/1M per 1M output tokens. Review the complete breakdown below to determine which model best fits your performance and budget requirements.
Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).
Auto-discovered from OpenRouter (google/gemma-4-26b-a4b-it). Preview until a second source matches.
Speed, cost, and intelligence tradeoffs across the Anthropic lineup
Single model data
No latency data
$0.33999999999999997 / 1M output
Relative percentile scores computed across all active models in the benchmark catalog.
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
Category wins across reasoning intelligence, generation speed, and token cost.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
| Benchmark | Claude Haiku 4.5 | Google: Gemma 4 26B A4B | Advantage Delta |
|---|---|---|---|
| Preference Elo | — | — | |
| Coding Elo | — | — | |
| LiveBench | — | — | |
| SWE-bench | — | — | |
| GPQA Diamond | — | — | |
| Time to first token | — | — | |
| Output speed | 175 tok/s | — | — |
| Input price | $0.07/1M | Google: Gemma 4 26B A4B (+$0.93/1M) | |
| Output price | $0.34/1M | Google: Gemma 4 26B A4B (+$4.66/1M) | |
| Context window | Google: Gemma 4 26B A4B (+62k) |
Simulate monthly production API costs in USD (US Dollar).
Google: Gemma 4 26B A4B is estimated to save $102.45/month ($1,229/year).
Need SWE-bench on both sides.
Lower output list price ($0.34/1M).
Need TTFT on both sides.
Larger window (262k).
Claude Haiku 4.5 is the side marked multimodal in the catalog.
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | insufficient data | Need SWE-bench on both sides. |
| High-volume chat | Google: Gemma 4 26B A4B | Lower output list price ($0.34/1M). |
| Voice / low-latency UI | insufficient data | Need TTFT on both sides. |
| Long-document RAG | Google: Gemma 4 26B A4B | Larger window (262k). |
| Screenshots / vision | Claude Haiku 4.5 | Claude Haiku 4.5 is the side marked multimodal in the catalog. |
$1/$5 hosted Claude vs a cheap long-context open sibling. The alternative-to-Sonnet pair that is honest.
Huge window, cheap hosted lists. The Haiku alternative that is actually open-weight.
Official Anthropic list $1/$5. This is the SKU behind “cheapest Claude alternative” that is still Claude.
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/claude-haiku-4-5-vs-gemma-4-26b-a4b-it/opengraph-image for crawlers.
Verified head-to-head card
