Pairwise benchmark snapshot · Aug 16, 2026
This page compares Claude Haiku 4.5 (Anthropic) and Llama 4 Scout (Meta) using the latest snapshots we have as of Aug 16, 2026. On preference Elo, Claude Haiku 4.5 is ahead by 26 points (1,438 vs 1,412; seed-bootstrap (Aug 16, 2026)). On SWE-bench coding, Claude Haiku 4.5 resolves 58.2% versus 52.4% (seed-bootstrap (Aug 16, 2026)). Claude Haiku 4.5 streams faster (175 tok/s) while Llama 4 Scout is the cheaper output token ($0.3/1M). Llama 4 Scout has the larger context window (1.3M tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Anthropic
Claude Haiku 4.5Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).
Meta
Llama 4 ScoutMeta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.
Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
26 pts advantage
20 tok/s faster
$4.70/1M cheaper
Simulate monthly production API costs based on published $/1M tokens.
Llama 4 Scout is estimated to save $102.00/month ($1,224/year).
Higher SWE-bench (58.2%).
Lower output list price ($0.3/1M).
Lower TTFT (95 ms).
Larger window (1.3M).
Both accept images. Defaulting to the higher-Elo side (Claude Haiku 4.5).
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | Claude Haiku 4.5 | Higher SWE-bench (58.2%). |
| High-volume chat | Llama 4 Scout | Lower output list price ($0.3/1M). |
| Voice / low-latency UI | Claude Haiku 4.5 | Lower TTFT (95 ms). |
| Long-document RAG | Llama 4 Scout | Larger window (1.3M). |
| Screenshots / vision | Claude Haiku 4.5 | Both accept images. Defaulting to the higher-Elo side (Claude Haiku 4.5). |
$1/$5 hosted Claude vs a cheap long-context open sibling. The alternative-to-Sonnet pair that is honest.
Huge window, cheap hosted lists. The Haiku alternative that is actually open-weight.
Official Anthropic list $1/$5. This is the SKU behind “cheapest Claude alternative” that is still Claude.
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/claude-haiku-4-5-vs-llama-4-scout/opengraph-image for crawlers.
Verified head-to-head card
