CompareLLM
CompareLLM.ai
Live
Explore
Compare
Decide
Track
Learn
…
CompareLLM
CompareLLM.ai
Precision Benchmarks

Programmatic, dated AI model benchmarks, head-to-head comparisons, and Stack Engine presets.

Daily ingest · 06:00 UTC

Analytics & Benchmarks

  • AI Model Leaderboard
  • Head-to-Head Compare Hub
  • Models Directory
  • Stack Engine Presets
  • Frontier Models
  • Open Weights Catalog

Guides & Intent Lists

  • Best LLM Lists (2026)
  • Best Coding LLM
  • Best Cheap LLM
  • Fastest Low-Latency LLM
  • Claude vs GPT Benchmark
  • What is Elo?
  • Methodology Guides
  • News & Dispatches

Transparency & API

  • Evaluation Methodology
  • Benchmark Changelog
  • Public JSON API
  • llms.txt Specification
  • Privacy Policy
  • Sign In / Account

© 2026 CompareLLM. Public benchmark data aggregated from Arena Elo, LiveBench, SWE-bench & OpenRouter.

Every score has a dated snapshot.

Theme:
Currency:
  1. Home
  2. Changelog
  3. Aug 17, 2026
Daily Ingestion Audit

Aug 17, 2026

Detailed breakdown of all metric changes logged on this date.

Recorded Updates (43)

gemini-3-7-flashgemini-3-7-flash Input price 0.375 → 0.188 (openrouter).
deepseek-v4-prodeepseek-v4-pro Input price 0.435 → 1.32 (openrouter).
deepseek-v4-flash-latestdeepseek-v4-flash-latest Input price 0.067 → 0.06 (openrouter).
kimi-latestkimi-latest Output price 14 → 13 (openrouter).
command-r-08-2024command-r-08-2024 Output price 0.6 → 10 (openrouter).
deepseek-v4-flash-latestdeepseek-v4-flash-latest Output price 0.134 → 0.121 (openrouter).
qwen-2-5-coder-32b-instructAuto-promoted Qwen2.5 Coder 32B Instruct to active (openrouter, livebench, swebench, lmarena).
claude-opus-5claude-opus-5 Output price 50 → 25 (openrouter).
deepseek-v4-flashdeepseek-v4-flash Context window 1048576 → 1310720 (openrouter).
nemotron-3-5-lightningnemotron-3-5-lightning Output price 0.25 → 0.2 (openrouter).
qwen2-5-vl-72b-instructqwen2-5-vl-72b-instruct Output price 0.75 → 1 (openrouter).
glm-5-2glm-5-2 Output price 0.968 → 1.92 (openrouter).
glm-5-2glm-5-2 Input price 0.308 → 0.6 (openrouter).
deepseek-v4-prodeepseek-v4-pro Output price 0.87 → 3.96 (openrouter).
glm-5-2glm-5-2 Context window 1048576 → 128000 (openrouter).
glm-5-2glm-5-2 Input price 0.308 → 1.19 (openrouter).
qwen3-6-35b-a3bqwen3-6-35b-a3b Input price 0.15 → 0.14 (openrouter).
deepseek-v4-flashdeepseek-v4-flash Input price 0.14 → 0.083 (openrouter).
qwen3-vl-235b-a22b-instructqwen3-vl-235b-a22b-instruct Input price 0.26 → 0.21 (openrouter).
nemotron-3-5-lightningnemotron-3-5-lightning Input price 0.1 → 0.08 (openrouter).
kimi-latestkimi-latest Input price 2.8 → 2.6 (openrouter).
glm-5-2glm-5-2 Context window 1048576 → 204800 (openrouter).
gemma-4-26b-a4b-itgemma-4-26b-a4b-it Input price 0.12 → 0.07 (openrouter).
gemma-4-26b-a4b-itgemma-4-26b-a4b-it Output price 0.4 → 0.34 (openrouter).
glm-5-2glm-5-2 Output price 0.968 → 0 (openrouter).
qwen-2-5-coder-32b-instructNew Coding Elo for qwen-2-5-coder-32b-instruct: 1495 (lmarena).
kimi-k2-6kimi-k2-6 Input price 0.542 → 0.95 (openrouter).
qwen-2-5-coder-32b-instructNew Preference Elo for qwen-2-5-coder-32b-instruct: 1425 (lmarena).
glm-5-2glm-5-2 Output price 0.968 → 3.74 (openrouter).
deepseek-v4-flash-latestdeepseek-v4-flash-latest Context window 1048576 → 1310720 (openrouter).
qwen-2-5-coder-32b-instructNew LiveBench for qwen-2-5-coder-32b-instruct: 64.8 (livebench).
qwen3-vl-235b-a22b-instructqwen3-vl-235b-a22b-instruct Output price 1.04 → 1.9 (openrouter).
command-r-08-2024command-r-08-2024 Input price 0.15 → 2.5 (openrouter).
deepseek-v4-flashdeepseek-v4-flash Output price 0.28 → 0.165 (openrouter).
claude-opus-5claude-opus-5 Input price 10 → 5 (openrouter).
kimi-k2-6kimi-k2-6 Output price 2.28 → 4 (openrouter).
minimax-m1minimax-m1 Input price 0.4 → 0.55 (openrouter).
deepseek-v4-prodeepseek-v4-pro Input price 0.435 → 1.32 (openrouter).
gemini-3-7-flashgemini-3-7-flash Output price 1.875 → 0.938 (openrouter).
qwen-2-5-coder-32b-instructNew SWE-bench for qwen-2-5-coder-32b-instruct: 65.2 (swebench).
glm-5-2glm-5-2 Input price 0.308 → 0 (openrouter).
deepseek-v4-prodeepseek-v4-pro Output price 0.87 → 3.96 (openrouter).
qwen2-5-vl-72b-instructqwen2-5-vl-72b-instruct Input price 0.25 → 0.8 (openrouter).
Back to Full Changelog