CompareLLM
CompareLLM.ai
Live
LeaderboardModelsCompareStacksBest ofGuidesNewsMethod
…
CompareLLM
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

  1. Home
  2. Models
  3. Claude Haiku 4.5
Anthropic

Claude Haiku 4.5

Claude Haiku 4.5 is a Anthropic closed-API catalog model. Latest preference Elo in this catalog is 1,438 (seed-bootstrap (Aug 16, 2026)). SWE-bench sits at 58.2% (seed-bootstrap (Aug 16, 2026)). List output price is $5/1M. Context window is 200k tokens. Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page). Numbers below are dated snapshots, not a guarantee on your traffic mix.

At a glance

Claude Haiku 4.5 is a Anthropic closed-API catalog model. Latest preference Elo in this catalog is 1,438 (seed-bootstrap (Aug 16, 2026)). SWE-bench sits at 58.2% (seed-bootstrap (Aug 16, 2026)). List output price is $5/1M. Context window is 200k tokens. Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page). Numbers below are dated snapshots, not a guarantee on your traffic mix.
Last updated Aug 16, 2026
All 69 vsSave Model

Compare Claude Haiku 4.5 against

Capability Profile

Claude Haiku 4.5 Benchmark Percentiles

Plotted against all active catalog models (50th percentile = catalog median).

Claude Haiku 4.5
Median (50)

Dimensional Scorecards

Reasoning
36%
Coding
28%
Math
36%
Speed
93%
Value
28%
Context
36%
Standout Competencies

Ranks in the top tier (≥75th percentile) for Speed.

Benchmark Specifications

Dated snapshot metrics aggregated from official evaluators and API providers.

Preference Elo1,438
seed-bootstrap · Aug 16, 2026
Coding Elo1,446
seed-bootstrap · Aug 16, 2026
LiveBench62.4%
seed-bootstrap · Aug 16, 2026
SWE-bench58.2%
seed-bootstrap · Aug 16, 2026
GPQA Diamond74%
seed-bootstrap · Aug 16, 2026
Time to first token95 ms
seed-bootstrap · Aug 16, 2026
Output speed175 tok/s
seed-bootstrap · Aug 16, 2026
Input price$1/1M
openrouter · Aug 16, 2026
Output price$5/1M
openrouter · Aug 16, 2026
Context window200k
openrouter · Aug 16, 2026
Benchmark MetricReported ScoreObserved Source
Preference Elo1,438seed-bootstrap · Aug 16, 2026
Coding Elo1,446seed-bootstrap · Aug 16, 2026
LiveBench62.4%seed-bootstrap · Aug 16, 2026
SWE-bench58.2%seed-bootstrap · Aug 16, 2026
GPQA Diamond74%seed-bootstrap · Aug 16, 2026
Time to first token95 msseed-bootstrap · Aug 16, 2026
Output speed175 tok/sseed-bootstrap · Aug 16, 2026
Input price$1/1Mopenrouter · Aug 16, 2026
Output price$5/1Mopenrouter · Aug 16, 2026
Context window200kopenrouter · Aug 16, 2026

Compare with every model

Search or pick any catalog row. Suggested matchups first, then the full list.

Dedicated vs hub →
Claude Haiku 4.5 vs Claude 3.5 Haiku (previous haiku)Claude Haiku 4.5 vs Qwen3 235BClaude Haiku 4.5 vs Qwen 2.5 PlusClaude Haiku 4.5 vs OpenAI o1-miniClaude Haiku 4.5 vs Yi-LargeClaude Haiku 4.5 vs Ernie 4.5 Turbo
Showing 69 of 69 comparisons
Claude Haiku 4.5 vs Claude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo: −186SWE: −21%
Claude Haiku 4.5 vs Claude Fable 5Anthropic
Compare

Anthropic top-tier long-horizon model. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo: −178SWE: −21.8%
Claude Haiku 4.5 vs GPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo: −170SWE: −19.4%
Claude Haiku 4.5 vs Claude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo: −160SWE: −20.2%
Claude Haiku 4.5 vs Grok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo: −154SWE: −10.9%
Claude Haiku 4.5 vs Claude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger long-horizon agent traces.

Elo: −136SWE: −17.7%
Claude Haiku 4.5 vs Gemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo: −132SWE: −16.4%
Claude Haiku 4.5 vs Claude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo: −130SWE: −18.6%
Claude Haiku 4.5 vs OpenAI: o3 MiniOpenAI
Compare

Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.

Elo: −122SWE: −20.3%
Claude Haiku 4.5 vs GPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo: −120SWE: −10.2%
Claude Haiku 4.5 vs GLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo: −120SWE: −18.2%
Claude Haiku 4.5 vs Claude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo: −118SWE: −15.6%
Claude Haiku 4.5 vs Gemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo: −114SWE: −14.2%
Claude Haiku 4.5 vs GPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo: −110SWE: −12.2%
Claude Haiku 4.5 vs GPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo: −102SWE: −12.8%
Claude Haiku 4.5 vs DeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo: −98SWE: −13.4%
Claude Haiku 4.5 vs Gemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo: −92SWE: −14.2%
Claude Haiku 4.5 vs Kimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo: −90SWE: −15.6%
Claude Haiku 4.5 vs Claude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo: −86SWE: −11.9%
Claude Haiku 4.5 vs Qwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo: −80SWE: −9.6%
Claude Haiku 4.5 vs MoonshotAI: Kimi K2.5Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.

Elo: −77SWE: −13.1%
Claude Haiku 4.5 vs OpenAI: o1OpenAI
Compare

Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.

Elo: −74SWE: +9.3%
Claude Haiku 4.5 vs Gemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo: −68SWE: −12.6%
Claude Haiku 4.5 vs Gemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo: −57SWE: −17.6%
Claude Haiku 4.5 vs Qwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo: −57SWE: −9.3%
Claude Haiku 4.5 vs GLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo: −54SWE: −11.1%
Claude Haiku 4.5 vs Gemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo: −52SWE: −8.6%
Claude Haiku 4.5 vs DeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo: −52SWE: −13%
Claude Haiku 4.5 vs Claude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo: −52SWE: −14.3%
Claude Haiku 4.5 vs Grok 4xAI
Compare

Previous xAI flagship.

Elo: −50SWE: −0.4%
Claude Haiku 4.5 vs MiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo: −40SWE: −17.6%
Claude Haiku 4.5 vs Yi-Lightning01.AI
Compare

01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo: −37SWE: −5.2%
Claude Haiku 4.5 vs Seed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo: −34SWE: −5%
Claude Haiku 4.5 vs Doubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo: −32SWE: −3.9%
Claude Haiku 4.5 vs Llama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo: −30SWE: +1.1%
Claude Haiku 4.5 vs GPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo: −28SWE: −3.6%
Claude Haiku 4.5 vs MoonshotAI: Kimi K2 0711Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.

Elo: −27SWE: −7.6%
Claude Haiku 4.5 vs Mistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo: −18SWE: +2.8%
Claude Haiku 4.5 vs Claude Sonnet 4Anthropic
Compare

First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.

Elo: −17SWE: −4.6%
Claude Haiku 4.5 vs Ernie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo: −12SWE: +1.2%
Claude Haiku 4.5 vs Qwen 2.5 PlusAlibaba
Compare

Alibaba balanced flagship API model with high-throughput general reasoning.

Elo: −7SWE: −1%
Claude Haiku 4.5 vs OpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo: −7SWE: +1.8%
Claude Haiku 4.5 vs Qwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo: −2SWE: −1.2%
Claude Haiku 4.5 vs Yi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo: +8SWE: +4.4%
Claude Haiku 4.5 vs Qwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo: +13SWE: −7%
Claude Haiku 4.5 vs Kimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo: +18SWE: +7.2%
Claude Haiku 4.5 vs Llama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo: +26SWE: +5.8%
Claude Haiku 4.5 vs GPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo: +28SWE: +5.8%
Claude Haiku 4.5 vs Grok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo: +33SWE: +6.8%
Claude Haiku 4.5 vs Qwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo: +40SWE: −0.6%
Claude Haiku 4.5 vs Llama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo: +68SWE: −0.2%
Claude Haiku 4.5 vs DeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo: +73SWE: −2.3%
Claude Haiku 4.5 vs Claude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo: +76SWE: −12.1%
Claude Haiku 4.5 vs Doubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo: +78SWE: +12.2%
Claude Haiku 4.5 vs DeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo: +80SWE: −7%
Claude Haiku 4.5 vs Gemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo: +88SWE: −5.6%
Claude Haiku 4.5 vs Command ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo: +94SWE: +15.6%
Claude Haiku 4.5 vs GPT-4oOpenAI
Compare

Previous OpenAI flagship. Still a common compare baseline on legacy pages.

Elo: +103SWE: +3.4%
Claude Haiku 4.5 vs Codestral 25.01Mistral
Compare

Mistral code-specialist model.

Elo: +118SWE: +6.4%
Claude Haiku 4.5 vs DeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo: +128SWE: +9.6%
Claude Haiku 4.5 vs Gemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo: +143SWE: +10.2%
Claude Haiku 4.5 vs Llama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo: +153SWE: +13.1%
Claude Haiku 4.5 vs Claude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo: +158SWE: +9.2%
Claude Haiku 4.5 vs GPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo: +166SWE: +17%
Claude Haiku 4.5 vs Gemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo: +178SWE: +20.2%
Claude Haiku 4.5 vs GPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo: +183SWE: +25%
Claude Haiku 4.5 vs Claude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo: +190SWE: +19.8%
Claude Haiku 4.5 vs Llama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo: +198SWE: +18%
Claude Haiku 4.5 vs Claude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo: +214SWE: +22%

Related news

  • compare · Aug 16, 2026

    Haiku 4.5 vs Llama 4 Scout: cheap Claude versus cheap open Llama

  • launch · Apr 8, 2026

    Llama 4 Scout: long-context open sibling of Maverick

  • launch · Oct 22, 2025

    Claude Haiku 4.5 at $1/$5: the cheap Claude people actually ship

Frequently asked questions

Plain-English methodology and leaderboard answers

Claude Haiku 4.5 is a Anthropic closed-API model. Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo is a crowd vote on which hidden answer people liked more — not a school test. What is Elo?