CompareLLM
CompareLLM.ai
Live
LeaderboardModelsCompareStacksBest ofGuidesNewsMethod
…
CompareLLM
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

  1. Home
  2. Models
  3. Yi-Lightning
01.AIFrontier Model

Yi-Lightning

Yi-Lightning is a 01.AI closed-API frontier model. Latest preference Elo in this catalog is 1,475 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 63.4% (seed-bootstrap (Aug 1, 2026)). List output price is $0.14/1M. Context window is 16k tokens. 01.AI ultra-fast reasoning model delivering top LiveBench efficiency. Numbers below are dated snapshots, not a guarantee on your traffic mix.

At a glance

Yi-Lightning is a 01.AI closed-API frontier model. Latest preference Elo in this catalog is 1,475 (seed-bootstrap (Aug 1, 2026)). SWE-bench sits at 63.4% (seed-bootstrap (Aug 1, 2026)). List output price is $0.14/1M. Context window is 16k tokens. 01.AI ultra-fast reasoning model delivering top LiveBench efficiency. Numbers below are dated snapshots, not a guarantee on your traffic mix.
Last updated Aug 1, 2026
All 69 vsSave Model

Compare Yi-Lightning against

Capability Profile

Yi-Lightning Benchmark Percentiles

Plotted against all active catalog models (50th percentile = catalog median).

Yi-Lightning
Median (50)

Dimensional Scorecards

Reasoning
56%
Coding
44%
Math
56%
Speed
78%
Value
89%
Context
2%
Standout Competencies

Ranks in the top tier (≥75th percentile) for Value, Speed.

Benchmark Specifications

Dated snapshot metrics aggregated from official evaluators and API providers.

Preference Elo1,475
seed-bootstrap · Aug 1, 2026
Coding Elo1,480
seed-bootstrap · Aug 1, 2026
LiveBench65%
seed-bootstrap · Aug 1, 2026
SWE-bench63.4%
seed-bootstrap · Aug 1, 2026
GPQA Diamond78%
seed-bootstrap · Aug 1, 2026
Time to first token150 ms
seed-bootstrap · Aug 1, 2026
Output speed130 tok/s
seed-bootstrap · Aug 1, 2026
Input price$0.14/1M
seed-bootstrap · Aug 1, 2026
Output price$0.14/1M
seed-bootstrap · Aug 1, 2026
Context window16k
seed-bootstrap · Aug 1, 2026
Benchmark MetricReported ScoreObserved Source
Preference Elo1,475seed-bootstrap · Aug 1, 2026
Coding Elo1,480seed-bootstrap · Aug 1, 2026
LiveBench65%seed-bootstrap · Aug 1, 2026
SWE-bench63.4%seed-bootstrap · Aug 1, 2026
GPQA Diamond78%seed-bootstrap · Aug 1, 2026
Time to first token150 msseed-bootstrap · Aug 1, 2026
Output speed130 tok/sseed-bootstrap · Aug 1, 2026
Input price$0.14/1Mseed-bootstrap · Aug 1, 2026
Output price$0.14/1Mseed-bootstrap · Aug 1, 2026
Context window16kseed-bootstrap · Aug 1, 2026

Compare with every model

Search or pick any catalog row. Suggested matchups first, then the full list.

Dedicated vs hub →
Yi-Lightning vs Yi-Large (previous other)Yi-Lightning vs Ernie 4.5 Turbo (next other)Yi-Lightning vs MiniMax M2.5Yi-Lightning vs Seed 2.1 TurboYi-Lightning vs Doubao Pro 1.5Yi-Lightning vs Llama 4 Maverick
Showing 69 of 69 comparisons
Yi-Lightning vs Claude Opus 5Anthropic
Compare

Anthropic current default flagship. Official API $5/$25 per 1M tokens and a 1M context window (Anthropic, Jul 24 2026).

Elo: −149SWE: −15.8%
Yi-Lightning vs Claude Fable 5Anthropic
Compare

Anthropic top-tier long-horizon model. Official API $10/$50 per 1M tokens (Claude Platform pricing, Aug 2026).

Elo: −141SWE: −16.6%
Yi-Lightning vs GPT-5.6 SolOpenAI
Compare

OpenAI 5.6 flagship tier. Official API $5/$30 per 1M tokens (OpenAI pricing, Jul 30 2026 update left Sol unchanged).

Elo: −133SWE: −14.2%
Yi-Lightning vs Claude Opus 4.8Anthropic
Compare

Prior Opus generation still billed at $5/$25. Kept as a compare baseline against Opus 5.

Elo: −123SWE: −15%
Yi-Lightning vs Grok 4.6xAI
Compare

xAI Aug 12 2026 post-training refresh of Grok 4.5. Same $2/$6 API price, 500k context, stronger agentic traces.

Elo: −117SWE: −5.7%
Yi-Lightning vs Claude Opus 4.6Anthropic
Compare

Follow-on Opus release. Slightly behind 4.5 on official SWE-bench bash-only in the last published sweep; stronger long-horizon agent traces.

Elo: −99SWE: −12.5%
Yi-Lightning vs Gemini 3.6 ProGoogle
Compare

Current Google Pro-class multimodal model. Long context, strong coding, billed like the 3.x Pro tier.

Elo: −95SWE: −11.2%
Yi-Lightning vs Claude Opus 4.5Anthropic
Compare

Anthropic frontier coding and computer-use model. SWE-bench leader on the official mini-SWE-agent harness in the Feb 2026 refresh.

Elo: −93SWE: −13.4%
Yi-Lightning vs OpenAI: o3 MiniOpenAI
Compare

Auto-discovered from OpenRouter (openai/o3-mini). Preview until a second source matches.

Elo: −85SWE: −15.1%
Yi-Lightning vs GPT-5OpenAI
Compare

OpenAI flagship reasoning model for 2025–26. Strong general preference Elo and multimodal coverage.

Elo: −83SWE: −5%
Yi-Lightning vs GLM-5.3Zhipu
Compare

Z.ai Aug 14 2026 post-train of the GLM-5.2 744B base. Coding-plan live; open weights promised after a two-week safety review (z.ai/blog/glm-5.3).

Elo: −83SWE: −13%
Yi-Lightning vs Claude Sonnet 5Anthropic
Compare

Anthropic workhorse. Official $2/$10 per 1M tokens made permanent on Aug 10 2026.

Elo: −81SWE: −10.4%
Yi-Lightning vs Gemini 3 ProGoogle
Compare

Google frontier multimodal model with a multi-million-token context window.

Elo: −77SWE: −9%
Yi-Lightning vs GPT-5.6 TerraOpenAI
Compare

OpenAI 5.6 mid tier. Official API $2/$12 per 1M after the Jul 30 2026 price cut.

Elo: −73SWE: −7%
Yi-Lightning vs GPT-4.5 OrionOpenAI
Compare

OpenAI largest dense non-reasoning model with expansive world knowledge and reduced hallucinations.

Elo: −65SWE: −7.6%
Yi-Lightning vs DeepSeek V4 ProDeepSeek
Compare

Open-weight-adjacent DeepSeek flagship. High reasoning density per dollar.

Elo: −61SWE: −8.2%
Yi-Lightning vs Gemini 3.7 FlashGoogle
Compare

Google Aug 13 2026 workhorse. Official intro price $0.75/$3.75 per 1M through Dec 31 2026; 1,048,576-token context (Google blog).

Elo: −55SWE: −9%
Yi-Lightning vs Kimi K3Moonshot
Compare

Moonshot AI frontier flagship reasoning and agent swarm model with 256k context and top-tier SWE-bench coding capability.

Elo: −53SWE: −10.4%
Yi-Lightning vs Claude Sonnet 4.5Anthropic
Compare

Workhorse Anthropic model: most of Opus coding quality at a mid-tier price.

Elo: −49SWE: −6.7%
Yi-Lightning vs Qwen 3 MaxAlibaba
Compare

Alibaba flagship. Strong math and multilingual code.

Elo: −43SWE: −4.4%
Yi-Lightning vs MoonshotAI: Kimi K2.5Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2.5). Preview until a second source matches.

Elo: −40SWE: −7.9%
Yi-Lightning vs OpenAI: o1OpenAI
Compare

Auto-discovered from OpenRouter (openai/o1). Preview until a second source matches.

Elo: −37SWE: +14.5%
Yi-Lightning vs Gemini 3.6 FlashGoogle
Compare

Google Jul 21 workhorse. Now shares the 3.7 Flash introductory $0.75/$3.75 rate through Dec 31 2026.

Elo: −31SWE: −7.4%
Yi-Lightning vs Gemini 3 FlashGoogle
Compare

Fast Google frontier-adjacent model. Near-top official SWE-bench at a fraction of Opus price.

Elo: −20SWE: −12.4%
Yi-Lightning vs Qwen QwQ 32BAlibaba
Compare

Alibaba specialized open reasoning model competing with frontier closed reasoning models.

Elo: −20SWE: −4.1%
Yi-Lightning vs GLM-5.2Zhipu
Compare

Zhipu flagship. Strong Chinese/English coding and agents.

Elo: −17SWE: −5.9%
Yi-Lightning vs Gemini 2.0 Flash ThinkingGoogle
Compare

Google experimental reasoning model that visualizes thoughts in real-time.

Elo: −15SWE: −3.4%
Yi-Lightning vs DeepSeek V4 FlashDeepSeek
Compare

DeepSeek Jul 31 2026 price-performance SKU. Public listings put it near $0.14/$0.28 per 1M tokens.

Elo: −15SWE: −7.8%
Yi-Lightning vs Claude Opus 4Anthropic
Compare

First Claude 4 Opus generation. Baseline for opus 4 vs opus 5.

Elo: −15SWE: −9.1%
Yi-Lightning vs Grok 4xAI
Compare

Previous xAI flagship.

Elo: −13SWE: +4.8%
Yi-Lightning vs MiniMax M2.5MiniMax
Compare

MiniMax coding model. Tied near the top of official SWE-bench bash-only in Feb 2026.

Elo: −3SWE: −12.4%
Yi-Lightning vs Seed 2.1 TurboByteDance
Compare

ByteDance Seed 2.1 Turbo, listed on public model timelines as an Aug 10 2026 API drop.

Elo: +3SWE: +0.2%
Yi-Lightning vs Doubao Pro 1.5ByteDance
Compare

ByteDance flagship enterprise model with ultra-low token cost and 128k context.

Elo: +5SWE: +1.3%
Yi-Lightning vs Llama 4 MaverickMeta
Compare

Meta natively multimodal open-weight flagship.

Elo: +7SWE: +6.3%
Yi-Lightning vs GPT-5.6 LunaOpenAI
Compare

OpenAI 5.6 fast/cheap tier. Official API $0.20/$1.20 per 1M after the Jul 30 80% Luna cut.

Elo: +9SWE: +1.6%
Yi-Lightning vs MoonshotAI: Kimi K2 0711Moonshot
Compare

Auto-discovered from OpenRouter (moonshotai/kimi-k2). Preview until a second source matches.

Elo: +10SWE: −2.4%
Yi-Lightning vs Mistral Large 3Mistral
Compare

Mistral European flagship with strong function calling.

Elo: +19SWE: +8%
Yi-Lightning vs Claude Sonnet 4Anthropic
Compare

First Sonnet 4 generation. Bridge between 3.5/3.7 and Sonnet 5.

Elo: +20SWE: +0.6%
Yi-Lightning vs Ernie 4.5 TurboBaidu
Compare

Baidu current multimodal enterprise foundation model with broad Chinese knowledge.

Elo: +25SWE: +6.4%
Yi-Lightning vs Qwen 2.5 PlusAlibaba
Compare

Alibaba balanced flagship API model with high-throughput general reasoning.

Elo: +30SWE: +4.2%
Yi-Lightning vs OpenAI o1-miniOpenAI
Compare

OpenAI high-speed, cost-effective reasoning model optimized for STEM, math, and code generation.

Elo: +30SWE: +7%
Yi-Lightning vs Qwen3 235BAlibaba
Compare

Open-weight Qwen3 mixture-of-experts.

Elo: +35SWE: +4%
Yi-Lightning vs Claude Haiku 4.5Anthropic
Compare

Anthropic cheap/fast Claude SKU. Official Claude Platform list price $1/$5 per 1M tokens (Anthropic Haiku page).

Elo: +37SWE: +5.2%
Yi-Lightning vs Yi-Large01.AI
Compare

01.AI full-scale dense model for complex instruction following.

Elo: +45SWE: +9.6%
Yi-Lightning vs Qwen 2.5 Coder 32BAlibaba
Compare

Alibaba dedicated open-weight code generation model with near-frontier SWE-bench Verified coding capability.

Elo: +50SWE: −1.8%
Yi-Lightning vs Kimi Chat 1.5Moonshot
Compare

Moonshot ultra-long context model supporting up to 2 million tokens per request.

Elo: +55SWE: +12.4%
Yi-Lightning vs Llama 4 ScoutMeta
Compare

Meta open-weight Llama 4 long-context sibling of Maverick. Common public API lists sit near $0.08–$0.30 / $0.30–$0.70 per 1M; we store a conservative hosted list until OpenRouter overwrites.

Elo: +63SWE: +11%
Yi-Lightning vs GPT-5 miniOpenAI
Compare

Cost-efficient GPT-5 distill for high-volume agents.

Elo: +65SWE: +11%
Yi-Lightning vs Grok 3xAI
Compare

Previous xAI generation before Grok 4. Kept for grok 3 vs grok 4.

Elo: +70SWE: +12%
Yi-Lightning vs Qwen3.8 27BAlibaba
Compare

Alibaba open-weight 27B drop dated Aug 14 2026. Dense enough to self-host; not a frontier MoE.

Elo: +77SWE: +4.6%
Yi-Lightning vs Llama 3.1 405BMeta
Compare

Meta flagship open-weight 405B dense foundation model with 128k context window.

Elo: +105SWE: +5%
Yi-Lightning vs DeepSeek Coder V2DeepSeek
Compare

DeepSeek open-weight Mixture-of-Experts coding model supporting 338 programming languages and 128k context.

Elo: +110SWE: +2.9%
Yi-Lightning vs Claude 3.7 SonnetAnthropic
Compare

Hybrid-reasoning Sonnet from 2025. Kept for historical compare pages.

Elo: +113SWE: −6.9%
Yi-Lightning vs Doubao Lite 1.5ByteDance
Compare

ByteDance high-speed lightweight model priced at sub-cent levels.

Elo: +115SWE: +17.4%
Yi-Lightning vs DeepSeek R1DeepSeek
Compare

Open-weights reasoning model trained with large-scale RL.

Elo: +117SWE: −1.8%
Yi-Lightning vs Gemini 2.5 ProGoogle
Compare

Previous Google long-context flagship.

Elo: +125SWE: −0.4%
Yi-Lightning vs Command ACohere
Compare

Cohere enterprise RAG and tool-use model.

Elo: +131SWE: +20.8%
Yi-Lightning vs GPT-4oOpenAI
Compare

Previous OpenAI flagship. Still a common compare baseline on legacy pages.

Elo: +140SWE: +8.6%
Yi-Lightning vs Codestral 25.01Mistral
Compare

Mistral code-specialist model.

Elo: +155SWE: +11.6%
Yi-Lightning vs DeepSeek V3DeepSeek
Compare

Prior DeepSeek flagship. Baseline for v3 vs v4.

Elo: +165SWE: +14.8%
Yi-Lightning vs Gemini 2.5 FlashGoogle
Compare

Previous Google speed workhorse.

Elo: +180SWE: +15.4%
Yi-Lightning vs Llama 3.3 70BMeta
Compare

Previous Meta 70B open-weight workhorse.

Elo: +190SWE: +18.3%
Yi-Lightning vs Claude 3.5 SonnetAnthropic
Compare

2024 workhorse. Still a high-intent compare against GPT-4o.

Elo: +195SWE: +14.4%
Yi-Lightning vs GPT-4o miniOpenAI
Compare

Legacy small OpenAI model. Useful as a cheap baseline.

Elo: +203SWE: +22.2%
Yi-Lightning vs Gemini 1.5 ProGoogle
Compare

First million-token Gemini Pro. Baseline for 1.5 vs 2.5 vs 3.x Pro.

Elo: +215SWE: +25.4%
Yi-Lightning vs GPT-4 TurboOpenAI
Compare

GPT-4 Turbo 128k. Historical flagship for gpt-4 turbo vs gpt-4o / gpt-5.

Elo: +220SWE: +30.2%
Yi-Lightning vs Claude 3 OpusAnthropic
Compare

Original Claude 3 flagship. Kept so opus 3 vs later Opus and vs GPT-4o still resolve.

Elo: +227SWE: +25%
Yi-Lightning vs Llama 3.1 70BMeta
Compare

Llama 3.1 70B instruct. Predecessor to 3.3 70B and Llama 4.

Elo: +235SWE: +23.2%
Yi-Lightning vs Claude 3.5 HaikuAnthropic
Compare

Previous cheap Claude. Haiku 4.5 is the current $1/$5 SKU.

Elo: +251SWE: +27.2%

Frequently asked questions

Plain-English methodology and leaderboard answers

Yi-Lightning is a 01.AI closed-API model. 01.AI ultra-fast reasoning model delivering top LiveBench efficiency.

Elo is a crowd vote on which hidden answer people liked more — not a school test. What is Elo?

Where this model ranks in Stack Engine

cheapest hosted API

Output price first among models we still consider usable for chat.

#4