Claude 3.5 Haiku is a Anthropic closed-API catalog model. Latest preference Elo in this catalog is 1,224 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 36.2% (seed-bootstrap (Aug 1, 2026)). List output price is $4/1M. Context window is 200k tokens. Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU. Numbers below are dated snapshots, not a guarantee on your traffic mix.
Compare Claude 3.5 Haiku against
Plotted against all active catalog models (50th percentile = catalog median).
Ranks in the top tier (≥75th percentile) for Speed.
Dated snapshot metrics aggregated from official evaluators and API providers.
| Benchmark Metric | Reported Score | Observed Source |
|---|---|---|
| Preference Elo | 1,224 | seed-bootstrap · Aug 1, 2026 |
| LiveBench | 44.8% | seed-bootstrap · Aug 1, 2026 |
| SWE-bench | 36.2% | seed-bootstrap · Aug 1, 2026 |
| GPQA Diamond | 54.1% | seed-bootstrap · Aug 1, 2026 |
| Time to first token | 110 ms | seed-bootstrap · Aug 1, 2026 |
| Output speed | 140 tok/s | seed-bootstrap · Aug 1, 2026 |
| Input price | $0.8/1M | seed-bootstrap · Aug 1, 2026 |
| Output price | $4/1M | seed-bootstrap · Aug 1, 2026 |
| Context window | 200k | seed-bootstrap · Aug 1, 2026 |
Search or pick any catalog row. Suggested matchups first, then the full list.
Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).
Anthropic top-tier long-horizon model. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).
OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).
Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.
xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.
Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger long-horizon agent traces.
Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.
Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.
Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.
OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.
Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).
Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.
Google frontier multimodal model with a multi-million-token context window.
OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.
OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.
Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.
Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).
Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.
Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.
Alibaba flagship. Strong math and multilingual code.
Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.
Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.
Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.
Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.
Alibaba specialized open reasoning model competing with frontier closed reasoning models.
Zhipu flagship. Strong Chinese/English coding and agents.
Google experimental reasoning model that visualizes thoughts in real-time.
DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.
First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.
MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.
01.AI ultra-fast reasoning model delivering top LiveBench efficiency.
ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.
ByteDance flagship enterprise model with ultra-low token cost and 128k context.
Meta natively multimodal open-weight flagship.
OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.
Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.
Mistral European flagship with strong function calling.
First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.
Baidu current multimodal enterprise foundation model with broad Chinese knowledge.
Alibaba balanced flagship API model with high-throughput general reasoning.
OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.
Open-weight Qwen3 mixture-of-experts.
Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).
01.AI full-scale dense model for complex instruction following.
Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.
Moonshot ultra-long context model supporting up to 2 million tokens per request.
Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.
Cost-efficient GPT-5 distill for high-volume agents.
Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.
Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.
Meta flagship open-weight 405B dense foundation model with 128k context window.
DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.
Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.
ByteDance high-speed lightweight model priced at sub-cent levels.
Open-weights reasoning model trained with large-scale RL.
Previous Google long-context flagship.
Cohere enterprise RAG and tool-use model.
Previous OpenAI flagship. Still a common compare baseline on legacy pages.
Prior DeepSeek flagship. Baseline for v3 vs v4.
Previous Google speed workhorse.
Previous Meta 70B open-weight workhorse.
2024 workhorse. Still a high-intent compare against GPT-4o.
Legacy small OpenAI model. Useful as a cheap baseline.
First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.
GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.
Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.
Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.
Plain-English methodology and leaderboard answers
Elo is a crowd vote on which hidden answer people liked more — not a school test. What is Elo?
