CompareLLM
CompareLLM.ai
Live
LeaderboardModelsCompareStacksBest ofGuidesNewsMethod
…
CompareLLM
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

  1. Home
  2. Models
  3. Qwen 2.5 Plus
Alibaba

Qwen 2.5 Plus

Qwen 2.5 Plus is a Alibaba closed-API catalog model. Latest preference Elo in this catalog is 1,445 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 59.2% (seed-bootstrap (Aug 1, 2026)). List output price is $1/1M. Context window is 128k tokens. Alibaba balanced flagship API model with high-throughput general reasoning. Numbers below are dated snapshots, not a guarantee on your traffic mix.

At a glance

Qwen 2.5 Plus is a Alibaba closed-API catalog model. Latest preference Elo in this catalog is 1,445 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 59.2% (seed-bootstrap (Aug 1, 2026)). List output price is $1/1M. Context window is 128k tokens. Alibaba balanced flagship API model with high-throughput general reasoning. Numbers below are dated snapshots, not a guarantee on your traffic mix.
Last updated Aug 1, 2026
All 69 vsSave Model

Compare Qwen 2.5 Plus against

Capability Profile

Qwen 2.5 Plus Benchmark Percentiles

Plotted against all active catalog models (50th percentile = catalog median).

Qwen 2.5 Plus
Median (50)

Dimensional Scorecards

Reasoning
43%
Coding
34%
Math
44%
Speed
64%
Value
61%
Context
15%

Benchmark Specifications

Dated snapshot metrics aggregated from official evaluators and API providers.

Preference Elo1,445
seed-bootstrap · Aug 1, 2026
Coding Elo1,460
seed-bootstrap · Aug 1, 2026
LiveBench63.5%
seed-bootstrap · Aug 1, 2026
SWE-bench59.2%
seed-bootstrap · Aug 1, 2026
GPQA Diamond75.8%
seed-bootstrap · Aug 1, 2026
Time to first token180 ms
seed-bootstrap · Aug 1, 2026
Output speed110 tok/s
seed-bootstrap · Aug 1, 2026
Input price$0.25/1M
seed-bootstrap · Aug 1, 2026
Output price$1/1M
seed-bootstrap · Aug 1, 2026
Context window128k
seed-bootstrap · Aug 1, 2026
Benchmark MetricReported ScoreObserved Source
Preference Elo1,445seed-bootstrap · Aug 1, 2026
Coding Elo1,460seed-bootstrap · Aug 1, 2026
LiveBench63.5%seed-bootstrap · Aug 1, 2026
SWE-bench59.2%seed-bootstrap · Aug 1, 2026
GPQA Diamond75.8%seed-bootstrap · Aug 1, 2026
Time to first token180 msseed-bootstrap · Aug 1, 2026
Output speed110 tok/sseed-bootstrap · Aug 1, 2026
Input price$0.25/1Mseed-bootstrap · Aug 1, 2026
Output price$1/1Mseed-bootstrap · Aug 1, 2026
Context window128kseed-bootstrap · Aug 1, 2026

Compare with every model

Search or pick any catalog row. Suggested matchups first, then the full list.

Dedicated vs hub →
Qwen 2.5 Plus vs Qwen 2.5 Coder 32B (next qwen)Qwen 2.5 Plus vs OpenAI o1-miniQwen 2.5 Plus vs Qwen3 235BQwen 2.5 Plus vs Ernie 4.5 TurboQwen 2.5 Plus vs Claude Haiku 4.5Qwen 2.5 Plus vs Claude Sonnet 4
Showing 69 of 69 comparisons
Qwen 2.5 Plus vs Claude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo: −179SWE: −20%
Qwen 2.5 Plus vs Claude Fable 5Anthropic
Compare

Anthropic top-tier long-horizon model. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo: −171SWE: −20.8%
Qwen 2.5 Plus vs GPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo: −163SWE: −18.4%
Qwen 2.5 Plus vs Claude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo: −153SWE: −19.2%
Qwen 2.5 Plus vs Grok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo: −147SWE: −9.9%
Qwen 2.5 Plus vs Claude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger long-horizon agent traces.

Elo: −129SWE: −16.7%
Qwen 2.5 Plus vs Gemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo: −125SWE: −15.4%
Qwen 2.5 Plus vs Claude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo: −123SWE: −17.6%
Qwen 2.5 Plus vs OpenAI: o3 MiniOpenAI
Compare

Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.

Elo: −115SWE: −19.3%
Qwen 2.5 Plus vs GPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo: −113SWE: −9.2%
Qwen 2.5 Plus vs GLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo: −113SWE: −17.2%
Qwen 2.5 Plus vs Claude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo: −111SWE: −14.6%
Qwen 2.5 Plus vs Gemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo: −107SWE: −13.2%
Qwen 2.5 Plus vs GPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo: −103SWE: −11.2%
Qwen 2.5 Plus vs GPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo: −95SWE: −11.8%
Qwen 2.5 Plus vs DeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo: −91SWE: −12.4%
Qwen 2.5 Plus vs Gemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo: −85SWE: −13.2%
Qwen 2.5 Plus vs Kimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo: −83SWE: −14.6%
Qwen 2.5 Plus vs Claude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo: −79SWE: −10.9%
Qwen 2.5 Plus vs Qwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo: −73SWE: −8.6%
Qwen 2.5 Plus vs MoonshotAI: Kimi K2.5Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.

Elo: −70SWE: −12.1%
Qwen 2.5 Plus vs OpenAI: o1OpenAI
Compare

Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.

Elo: −67SWE: +10.3%
Qwen 2.5 Plus vs Gemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo: −61SWE: −11.6%
Qwen 2.5 Plus vs Gemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo: −50SWE: −16.6%
Qwen 2.5 Plus vs Qwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo: −50SWE: −8.3%
Qwen 2.5 Plus vs GLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo: −47SWE: −10.1%
Qwen 2.5 Plus vs Gemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo: −45SWE: −7.6%
Qwen 2.5 Plus vs DeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo: −45SWE: −12%
Qwen 2.5 Plus vs Claude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo: −45SWE: −13.3%
Qwen 2.5 Plus vs Grok 4xAI
Compare

Previous xAI flagship.

Elo: −43SWE: +0.6%
Qwen 2.5 Plus vs MiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo: −33SWE: −16.6%
Qwen 2.5 Plus vs Yi-Lightning01.AI
Compare

01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo: −30SWE: −4.2%
Qwen 2.5 Plus vs Seed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo: −27SWE: −4%
Qwen 2.5 Plus vs Doubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo: −25SWE: −2.9%
Qwen 2.5 Plus vs Llama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo: −23SWE: +2.1%
Qwen 2.5 Plus vs GPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo: −21SWE: −2.6%
Qwen 2.5 Plus vs MoonshotAI: Kimi K2 0711Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.

Elo: −20SWE: −6.6%
Qwen 2.5 Plus vs Mistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo: −11SWE: +3.8%
Qwen 2.5 Plus vs Claude Sonnet 4Anthropic
Compare

First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.

Elo: −10SWE: −3.6%
Qwen 2.5 Plus vs Ernie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo: −5SWE: +2.2%
Qwen 2.5 Plus vs OpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo: +0SWE: +2.8%
Qwen 2.5 Plus vs Qwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo: +5SWE: −0.2%
Qwen 2.5 Plus vs Claude Haiku 4.5Anthropic
Compare

Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo: +7SWE: +1%
Qwen 2.5 Plus vs Yi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo: +15SWE: +5.4%
Qwen 2.5 Plus vs Qwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo: +20SWE: −6%
Qwen 2.5 Plus vs Kimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo: +25SWE: +8.2%
Qwen 2.5 Plus vs Llama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo: +33SWE: +6.8%
Qwen 2.5 Plus vs GPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo: +35SWE: +6.8%
Qwen 2.5 Plus vs Grok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo: +40SWE: +7.8%
Qwen 2.5 Plus vs Qwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo: +47SWE: +0.4%
Qwen 2.5 Plus vs Llama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo: +75SWE: +0.8%
Qwen 2.5 Plus vs DeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo: +80SWE: −1.3%
Qwen 2.5 Plus vs Claude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo: +83SWE: −11.1%
Qwen 2.5 Plus vs Doubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo: +85SWE: +13.2%
Qwen 2.5 Plus vs DeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo: +87SWE: −6%
Qwen 2.5 Plus vs Gemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo: +95SWE: −4.6%
Qwen 2.5 Plus vs Command ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo: +101SWE: +16.6%
Qwen 2.5 Plus vs GPT-4oOpenAI
Compare

Previous OpenAI flagship. Still a common compare baseline on legacy pages.

Elo: +110SWE: +4.4%
Qwen 2.5 Plus vs Codestral 25.01Mistral
Compare

Mistral code-specialist model.

Elo: +125SWE: +7.4%
Qwen 2.5 Plus vs DeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo: +135SWE: +10.6%
Qwen 2.5 Plus vs Gemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo: +150SWE: +11.2%
Qwen 2.5 Plus vs Llama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo: +160SWE: +14.1%
Qwen 2.5 Plus vs Claude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo: +165SWE: +10.2%
Qwen 2.5 Plus vs GPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo: +173SWE: +18%
Qwen 2.5 Plus vs Gemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo: +185SWE: +21.2%
Qwen 2.5 Plus vs GPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo: +190SWE: +26%
Qwen 2.5 Plus vs Claude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo: +197SWE: +20.8%
Qwen 2.5 Plus vs Llama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo: +205SWE: +19%
Qwen 2.5 Plus vs Claude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo: +221SWE: +23%

Frequently asked questions

Plain-English methodology and leaderboard answers

Qwen 2.5 Plus is a Alibaba closed-API model. Alibaba balanced flagship API model with high-throughput general reasoning.

Elo is a crowd vote on which hidden answer people liked more — not a school test. What is Elo?