Pairwise benchmark snapshot · Aug 17, 2026
This page compares Codestral 25.01 (Mistral) and Kimi Chat 1.5 (Moonshot) using the latest snapshots we have as of Aug 17, 2026. On preference Elo, Kimi Chat 1.5 is ahead by 100 points (1,420 vs 1,320; lmarena (Aug 17, 2026)). On SWE-bench coding, Codestral 25.01 resolves 51.8% versus 51% (swebench (Aug 17, 2026)). Codestral 25.01 streams faster (148 tok/s) while Kimi Chat 1.5 is the cheaper output token ($0.8/1M). Kimi Chat 1.5 has the larger context window (2M tokens). Every cell below is a dated snapshot from a named public source — we do not invent missing scores, and we do not run SWE-bench ourselves.
Moonshot
Kimi Chat 1.5Moonshot ultra-long context model supporting up to 2 million tokens per request.
Instant pairwise benchmark recalculation across 400+ LLMs
Category wins across intelligence, speed, and pricing efficiency.
Preference Elo, Coding proficiency, SWE-bench & LiveBench accuracy
Generation throughput and time to first token responsiveness
Cost per million tokens and max context window length
Each spoke is a skill. Farther from the center is better (0–100th percentile). Tap any dot to inspect details.
100 pts advantage
53 tok/s faster
$0.10/1M cheaper
Simulate monthly production API costs based on published $/1M tokens.
Kimi Chat 1.5 is estimated to save $5.00/month ($60/year).
Higher SWE-bench (51.8%).
Lower output list price ($0.8/1M).
Lower TTFT (150 ms).
Larger window (2M).
Kimi Chat 1.5 is the side marked multimodal in the catalog.
| Target Workload | Recommended Pick | Evaluation Rationale |
|---|---|---|
| Repo / coding agents | Codestral 25.01 | Higher SWE-bench (51.8%). |
| High-volume chat | Kimi Chat 1.5 | Lower output list price ($0.8/1M). |
| Voice / low-latency UI | Codestral 25.01 | Lower TTFT (150 ms). |
| Long-document RAG | Kimi Chat 1.5 | Larger window (2M). |
| Screenshots / vision | Kimi Chat 1.5 | Kimi Chat 1.5 is the side marked multimodal in the catalog. |
No comments posted on this matchup yet. Be the first to share an evaluation note!
The real PNG is generated at /compare/codestral-25-vs-kimi-1-5-long/opengraph-image for crawlers.
Verified head-to-head card
