Pairwise benchmark snapshot · Aug 1, 2026
This page compares Claude 3.5 Haiku (Anthropic) and Gemini 3 Pro (Google) using the latest snapshots we have as of Aug 1, 2026. On preference Elo, Gemini 3 Pro is ahead by 328 points (1,552 vs 1,224; seed-bootstrap (Aug 1, 2026)). On SWE-bench coding, Gemini 3 Pro resolves 72.4% versus 36.2% (seed-bootstrap (Aug 1, 2026)). Claude 3.5 Haiku streams faster (140 tok/s) while Claude 3.5 Haiku is the cheaper output token ($4/1M). Gemini 3 Pro has the larger context window (2M tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Anthropic
Claude 3.5 HaikuPrevious cheap Claude. Haiku 4.5 is the current $1/$5 SKU.
Google frontier multimodal model with a multi-million-token context window.
Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
328 pts advantage
48 tok/s faster
$1.00/1M cheaper
Simulate monthly production API costs based on published $/1M tokens.
Claude 3.5 Haiku is estimated to save $30.75/month ($369/year).
Higher SWE-bench (72.4%).
Lower output list price ($4/1M).
Lower TTFT (110 ms).
Larger window (2M).
Both accept images. Defaulting to the higher-Elo side (Gemini 3 Pro).
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | Gemini 3 Pro | Higher SWE-bench (72.4%). |
| High-volume chat | Claude 3.5 Haiku | Lower output list price ($4/1M). |
| Voice / low-latency UI | Claude 3.5 Haiku | Lower TTFT (110 ms). |
| Long-document RAG | Gemini 3 Pro | Larger window (2M). |
| Screenshots / vision | Gemini 3 Pro | Both accept images. Defaulting to the higher-Elo side (Gemini 3 Pro). |
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/claude-3-5-haiku-vs-gemini-3-pro/opengraph-image for crawlers.
Verified head-to-head card
