GPT-4o vs GPT-4o mini benchmark

GPT-4o mini1,272

LiveBenchGPT-4o (+6.1%)

GPT-4o54.2%

GPT-4o mini48.1%

SWE-benchGPT-4o (+13.6%)

GPT-4o54.8%

GPT-4o mini41.2%

GPQA DiamondGPT-4o (+13.1%)

GPT-4o73.2%

GPT-4o mini60.1%

Time to first tokenGPT-4o mini (+50 ms)

GPT-4o180 ms

GPT-4o mini130 ms

Output speedGPT-4o mini (+50 tok/s)

GPT-4o110 tok/s

GPT-4o mini160 tok/s

Input priceGPT-4o mini (+$2.35/1M)

GPT-4o$2.5/1M

GPT-4o mini$0.15/1M

Output priceGPT-4o mini (+$9.4/1M)

GPT-4o$10/1M

GPT-4o mini$0.6/1M

Context window

GPT-4o128k

GPT-4o mini128k

All GPT-4o matchups →|All GPT-4o mini matchups →

Benchmark	GPT-4o	GPT-4o mini	Advantage Delta
Preference Elo	1,335 lmarena · Aug 17, 2026	1,272 lmarena · Aug 17, 2026	GPT-4o (+63)
LiveBench	54.2% livebench · Aug 17, 2026	48.1% livebench · Aug 17, 2026	GPT-4o (+6.1%)
SWE-bench	54.8% swebench · Aug 17, 2026	41.2% swebench · Aug 17, 2026	GPT-4o (+13.6%)
GPQA Diamond	73.2% seed-bootstrap · Aug 1, 2026	60.1% seed-bootstrap · Aug 1, 2026	GPT-4o (+13.1%)
Time to first token	180 ms seed-bootstrap · Aug 1, 2026	130 ms seed-bootstrap · Aug 1, 2026	GPT-4o mini (+50 ms)
Output speed	110 tok/s seed-bootstrap · Aug 1, 2026	160 tok/s seed-bootstrap · Aug 1, 2026	GPT-4o mini (+50 tok/s)
Input price	$2.5/1M openrouter · Aug 17, 2026	$0.15/1M openrouter · Aug 17, 2026	GPT-4o mini (+$2.35/1M)
Output price	$10/1M openrouter · Aug 17, 2026	$0.6/1M openrouter · Aug 17, 2026	GPT-4o mini (+$9.4/1M)
Context window	128k openrouter · Aug 17, 2026	128k openrouter · Aug 17, 2026	—

Interactive Simulator (USD)

Workload Cost & Savings Calculator

Simulate monthly production API costs in USD (US Dollar).

Save up to 94% with GPT-4o mini

Monthly Volume50M tokens/mo

Quick Presets:

Token Ratio (In vs Out)70% In / 30% Out

RAG / Search (10% out)Coding / Chat (50% out)

GPT-4o$237.50 / mo

In: $87.5Out: $150

GPT-4o mini$14.25 / mo

In: $5.25Out: $9

Estimated Cost Delta

GPT-4o mini is estimated to save $223.25/month ($2,679/year).

Based on 50M tokens (30% gen)

Key Selection Recommendations

1
GPT-4o:Pick GPT-4o when repo-level coding accuracy is the constraint.
2
GPT-4o mini:Pick GPT-4o mini when you are optimizing output cost.
3
GPT-4o mini:Pick GPT-4o mini when time-to-first-token matters more than peak Elo.

Recommended Workload Routing

Repo / coding agentsGPT-4o

Higher SWE-bench (54.8%).

High-volume chatGPT-4o mini

Lower output list price ($0.6/1M).

Voice / low-latency UIGPT-4o mini

Lower TTFT (130 ms).

Long-document RAGGPT-4o

Larger window (128k).

Screenshots / visionGPT-4o

Both accept images. Defaulting to the higher-Elo side (GPT-4o).

Target Workload	Recommended Pick	Evaluation Rationale
Repo / coding agents	GPT-4o	Higher SWE-bench (54.8%).
High-volume chat	GPT-4o mini	Lower output list price ($0.6/1M).
Voice / low-latency UI	GPT-4o mini	Lower TTFT (130 ms).
Long-document RAG	GPT-4o	Larger window (128k).
Screenshots / vision	GPT-4o	Both accept images. Defaulting to the higher-Elo side (GPT-4o).

Related Editorial Dispatches & Benchmark Notes

View all news

newsMay 13, 2024

GPT-4o stays as the 2024 compare anchor people still search

Deprecated for buying. Kept because “4o vs sonnet” is still a typed query.

Community Sentiment

Cast Your Matchup Vote

0 total votes

Community Discussions (0)

No comments posted on this matchup yet. Be the first to share an evaluation note!

Share card

The real PNG is generated at /compare/gpt-4o-vs-gpt-4o-mini/opengraph-image for crawlers.

PNG

CompareLLM Matrix

Verified head-to-head card

LIVE

OpenAI

GPT-4o

Elo 1,335

LiveBench54.2%

SWE-bench54.8%

Speed110 tok/s

Output cost$10/1M

OpenAI

GPT-4o mini

Elo 1,272

LiveBench48.1%

SWE-bench41.2%

Speed160 tok/s

Output cost$0.6/1M

Frequently Asked Questions

Which is better overall, GPT-4o or GPT-4o mini?: GPT-4o has the higher preference Elo in our latest snapshot (1,335). “Better” still depends on coding, price, and latency — see the table.
Which is better at coding, GPT-4o or GPT-4o mini?: GPT-4o leads SWE-bench at 54.8% vs 41.2%. SWE-bench is one harness, not your repo.
Which is cheaper to run in production?: GPT-4o mini output tokens are $0.6/1M versus $10/1M. Input prices and retry rates still move the real bill.
Which is faster, GPT-4o or GPT-4o mini?: GPT-4o mini has the lower time-to-first-token (130 ms vs 180 ms). Tokens/sec is a separate column if you care about long completions.
Which has the larger context window?: GPT-4o accepts 128k tokens versus 128k.
Can I self-host either model?: Neither model is marked open-weights here. You are comparing hosted APIs.
Are these scores from CompareLLM’s own evals?: No. V1 aggregates public leaderboards (and optional first-party latency pings). Each cell names its source and date. Read /methodology.
What does preference Elo mean on this page?: Preference Elo is a crowd vote from LMArena / Arena. People see two hidden answers and pick the one they like more. The model that wins more often gets a higher Elo. That means people preferred it — not that it passed a school test. It is not SWE-bench, not accuracy, and not a number we invent. GPT-4o and GPT-4o mini Elo cells are dated snapshots from the named source — we do not compute Arena ourselves.

Similar Head-to-Head Comparisons

GPT-4o vs GPT-4 Turbo (previous gpt-flagship)GPT-4o vs OpenAI: o1 (next gpt-flagship)GPT-4o mini vs OpenAI o1-mini (next gpt-mini)GPT-5 vs GPT-4o GPT-4.5 Orion vs GPT-4o GPT-5.6 Sol vs GPT-4o

GPT-4o vs GPT-4o mini benchmark

Capability Percentiles

Relative percentile scores computed across all active models in the benchmark catalog.

Capability Matchup Radar

Multi-Dimensional Capability Radar

Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.

Tap any node to inspect

Percentile 0–100

Dimensional AdvantageGPT-4o 3/6

Benchmark

GPT-4o

GPT-4o mini

Advantage Delta

Preference Elo

1,335

1,272

GPT-4o (+63)

LiveBench

54.2%

48.1%

GPT-4o (+6.1%)

SWE-bench

54.8%

41.2%

GPT-4o (+13.6%)

GPQA Diamond

73.2%

60.1%

GPT-4o (+13.1%)

Time to first token

180 ms

130 ms

GPT-4o mini (+50 ms)

Output speed

110 tok/s

160 tok/s

GPT-4o mini (+50 tok/s)

Input price

$2.5/1M

$0.15/1M

GPT-4o mini (+$2.35/1M)

Output price

$10/1M

$0.6/1M

GPT-4o mini (+$9.4/1M)

Context window

128k

128k