Pairwise benchmark snapshot · Aug 17, 2026noindex (thin pair)
This page compares Claude 3.7 Sonnet (Anthropic) and OpenAI: GPT-5.4 Image 2 (OpenAI) using the latest snapshots we have as of Aug 17, 2026. Claude 3.7 Sonnet wins on output price at $15/1M. OpenAI: GPT-5.4 Image 2 has the larger context window (272k tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Anthropic
Claude 3.7 SonnetHybrid-reasoning Sonnet from 2025. Kept for historical compare pages.
OpenAI
OpenAI: GPT-5.4 Image 2Auto-discovered from OpenRouter (openai/gpt-5.4-image-2). Preview until a second source matches.
thinking_budgetReasoning models scale test-time compute by generating hidden chain-of-thought (CoT) tokens. These tokens are billed at standard output rates and directly expand latency (TTFT) in exchange for higher GPQA Diamond and SWE-bench Verified problem resolve rates.
Official evaluation benchmark budget for SWE-bench and LiveBench.
"thinking": {
"type": "enabled",
"budget_tokens": 16384
}"reasoning": {
"effort": "medium",
"max_tokens": 3200
}Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
No shared data
No shared data
Same price
Simulate monthly production API costs in USD (US Dollar).
Claude 3.7 Sonnet is estimated to save $175.00/month ($2,100/year).
Need SWE-bench on both sides.
Lower output list price ($15/1M).
Need TTFT on both sides.
Larger window (272k).
Claude 3.7 Sonnet is the side marked multimodal in the catalog.
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | insufficient data | Need SWE-bench on both sides. |
| High-volume chat | Claude 3.7 Sonnet | Lower output list price ($15/1M). |
| Voice / low-latency UI | insufficient data | Need TTFT on both sides. |
| Long-document RAG | OpenAI: GPT-5.4 Image 2 | Larger window (272k). |
| Screenshots / vision | Claude 3.7 Sonnet | Claude 3.7 Sonnet is the side marked multimodal in the catalog. |
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/claude-3-7-sonnet-vs-gpt-5-4-image-2/opengraph-image for crawlers.
Verified head-to-head card