What is preference Elo?

Preference Elo is a crowd vote from LMArena / Arena. People see two hidden answers and pick the one they like more. The model that wins more often gets a higher Elo. That means people preferred it — not that it passed a school test. It is not SWE-bench, not accuracy, and not a number we invent.

Does a higher Elo mean a better coding model?

No. Use SWE-bench and coding Elo for repo work. Preference Elo is chat-style human taste.

Benchmark Specification

High (Blind Prompts)

Preference Elo (LMArena / Arena)

Crowdsourced blind pairwise human preference battles. Users prompt two anonymous models and vote on the superior response; Bradley-Terry Elo is computed over hundreds of thousands of comparisons. Ingested from official verified public snapshots.

Full explainer: What is Elo on an AI leaderboard?

Primary EvaluatorLMSYS / Chatbot Arena

Update CadenceDaily snapshots

Leaderboard LinkView full table

Top Performing Models

Top 15 verified

Top Performing Models

Frequently asked questions

Top Performing Models

Frequently asked questions