Matches word count

Test: Write N of X

Avg. Score
80.2%
Scenarios
5

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.00085.4s100%
2Inception Mercury 299.8%$0.00091.2s98%
3GPT-5.4 Nano (Reasoning)99.9%$0.00104.4s99%
4GPT-6 Luna (Reasoning, High)99.9%$0.00047.4s99%
5GPT-6 Luna (Reasoning, Medium)100.0%$0.00048.4s100%
6Muse Glimmer 30B (Reasoning, Medium)100.0%$0.001310.4s100%
7GPT-5.4 Mini (Reasoning)99.9%$0.00313.8s99%
8Nemotron 3 Super100.0%$0.000015.3s100%
9GPT-5.6 Luna (Reasoning, Medium)99.8%$0.00353.7s99%
10GPT-6.1 Sol (Reasoning, Medium)100.0%$0.00389.9s100%
11GPT-5 Nano100.0%$0.000819.2s100%
12Muse Spark 1.1 (Reasoning, Minimal)99.6%$0.00494.4s97%
13Muse Spark 1.1 (Reasoning, Medium)99.7%$0.00565.3s98%
14Muse Spark 1.2 (Reasoning, Medium)99.9%$0.00687.0s99%
15Qwen 3.7 Flash (Reasoning)99.9%$0.000727.6s99%
16Muse Spark 1.3 (Reasoning, Medium)100.0%$0.006312.7s100%
17GPT-5.199.8%$0.00739.2s99%
18GPT-5 Mini99.2%$0.002411.6s93%
19Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.000535.3s100%
20GPT-OSS 120B99.8%$0.000433.4s98%
21GPT-5.299.7%$0.00879.6s98%
22Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.0118.5s100%
23o4 Mini99.5%$0.006914.8s96%
24Thinking Machines Inkling Small (Reasoning, High)100.0%$0.004332.7s100%
25GPT-5.4 (Reasoning)99.7%$0.009811.2s98%
26GPT-5.6 Sol (Reasoning, Medium)100.0%$0.0146.0s100%
27Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.0139.9s100%
28Claude Sonnet 5.5 (Reasoning)100.0%$0.0147.5s100%
29Qwen 3.8 Flash (Reasoning)100.0%$0.001349.5s100%
30Qwen 3.6 35B100.0%$0.006837.0s100%
31Z.AI GLM 5 Turbo100.0%$0.01125.2s100%
32Claude Haiku 5.5 (Reasoning, Max)100.0%$0.005942.6s100%
33 Kimi K3 (Reasoning, High)100.0%$0.01324.0s100%
34Qwen 3.5 Flash100.0%$0.003654.0s100%
35Qwen 3.8 27B (Reasoning, XHigh)100.0%$0.007743.3s100%
36Grok 4.3 (Reasoning)100.0%$0.009239.1s100%
37Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.01231.4s100%
38GPT-5.5 (Reasoning, Medium)99.9%$0.0217.7s99%
39GPT-5.5 (Reasoning, Low)99.5%$0.0196.8s94%
40GPT-598.4%$0.01318.1s91%
41Gemini 3 Flash (Preview, Reasoning)100.0%$0.01828.6s100%
42o4 Mini High99.4%$0.01036.6s94%
43Mistral Large 4.0 (Reasoning)100.0%$0.01059.1s100%
44Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.01450.1s100%
45GPT-4.194.6%$0.00202.5s67%
46Gemini 3.6 Flash (Reasoning)100.0%$0.02813.2s100%
47Claude Opus 5.5 (Reasoning)100.0%$0.02910.9s100%
48ByteDance Seed 1.699.1%$0.00611.0m93%
49Claude Opus 4.796.6%$0.0173.3s83%
50Qwen 3.5 35B100.0%$0.01749.8s100%
51Claude Opus 4.7 (Reasoning)96.7%$0.0173.8s83%
52Z.AI GLM 5.2 (Reasoning, High)97.2%$0.01029.8s83%
53Gemini 3.1 Flash Lite92.7%$0.00051.1s62%
54Claude Opus 4.8 (Reasoning, Low)96.9%$0.0195.7s83%
55Aion 3.5 (Reasoning, High)98.2%$0.008426.6s75%
56GPT-6 Sol (Reasoning, Medium)94.7%$0.00366.2s62%
57DeepSeek V4 Pro 0813 (Reasoning, High)98.0%$0.007923.8s72%
58Gemini 3 Flash (Preview)93.0%$0.00111.5s58%
59Grok 4.5 (Reasoning, High)99.8%$0.02245.2s98%
60Qwen 3.6 Flash98.0%$0.008324.3s72%
61GPT-4o, Aug. 6th (temp=0)94.8%$0.00482.2s61%
62Gemini 3.1 Flash Lite (Reasoning)92.1%$0.00051.2s57%
63GPT-4o, Aug. 6th (temp=1)93.3%$0.00482.0s60%
64Claude Sonnet 4.6 (Reasoning)100.0%$0.03519.6s100%
65Xiaomi MIMO v2.6 Pro96.0%$0.002430.7s63%
66Gemini 3.5 Flash (Reasoning)100.0%$0.03916.0s100%
67Qwen 3.5 27B100.0%$0.0191.3m100%
68GPT-5.4 Mini (Reasoning, Low)92.1%$0.00182.4s51%
69GPT-5.593.6%$0.00863.6s59%
70Claude Opus 5 (Reasoning)98.9%$0.03711.9s95%
71Claude Opus 4.8 (Reasoning)94.9%$0.0185.1s70%
72Z.AI GLM 5100.0%$0.0161.6m100%
73Gemini 3.1 Flash Lite (Preview)89.7%$0.00051.1s48%
74Grok 4.6 (Reasoning, High)100.0%$0.0271.1m100%
75Claude Haiku 5.5 (Adaptive)91.6%$0.00116.7s46%
76Grok 4.7 (Reasoning, High)96.0%$0.01325.5s61%
77Kimi K2.599.9%$0.0162.0m99%
78Kimi K2.699.9%$0.0152.0m99%
79GPT-5.4 (Reasoning, Low)87.4%$0.00433.6s46%
80Qwen 3.7 Max100.0%$0.03759.2s100%
81Claude Opus 4.6 (Reasoning)100.0%$0.05019.6s100%
82GPT-6 Sol87.0%$0.00173.3s41%
83ByteDance Seed 2.0 Lite95.3%$0.00551.0m61%
84GPT-4o Mini (temp=1)90.9%$0.000342.7s50%
85Hy4 Preview (Reasoning, High)100.0%$0.0212.0m100%
86Thinking Machines Inkling (Reasoning)99.8%$0.0132.3m98%
87Nemotron 3 Nano90.0%$0.000422.7s40%
88GPT-5.4 Nano (Reasoning, Low)86.2%$0.00072.9s35%
89Aion 3.5 Mini (Reasoning, High)91.5%$0.002836.9s46%
90Claude Opus 5 (Reasoning, Low)97.4%$0.03713.1s74%
91Z.AI GLM 4.7 Flash96.8%$0.00261.8m69%
92Qwen 3.5 Plus (2026-04-20)98.0%$0.0141.4m72%
93Z.AI GLM 5.1100.0%$0.0222.1m100%
94MiniMax M390.5%$0.003046.3s45%
95MiniMax M2.788.3%$0.002227.8s38%
96Kimi K3 (Reasoning, Low)88.4%$0.007714.7s39%
97Qwen 3.5 9B98.0%$0.00162.2m72%
98GPT-5.481.9%$0.00282.9s33%
99Z.AI GLM 4.7100.0%$0.00983.0m100%
100GPT-4o Mini (temp=0)84.1%$0.000310.7s30%
101Claude Haiku 5.5 (Reasoning, Medium)82.5%$0.00096.4s30%
102GPT-5.6 Terra (Reasoning, Medium)82.4%$0.00433.2s33%
103GPT-4.1 Nano78.7%$0.00012.2s30%
104Qwen 3.6 Max Preview100.0%$0.0341.9m100%
105Gemini 3.6 Flash (Reasoning, Minimal)81.7%$0.00311.3s30%
106GPT-5.6 Terra81.6%$0.00252.0s29%
107Qwen 3.5 122B97.5%$0.0271.1m71%
108GPT-4.1 Mini79.9%$0.00042.3s27%
109Gemini 2.5 Pro86.0%$0.01310.9s40%
110GPT-5.4 Mini79.5%$0.00091.1s25%
111Gemma 4 31B (Reasoning)100.0%$0.00193.7m100%
112Gemini 3.5 Flash (Reasoning, Minimal)81.3%$0.00331.4s26%
113DeepSeek V4 Flash 0731 (Reasoning, High)85.2%$0.000637.9s34%
114Gemma 4 31B80.2%$0.000313.2s24%
115Gemma 4 26B79.1%$0.00026.5s22%
116Gemma 4 26B (Reasoning)100.0%$0.00273.9m100%
117Xiaomi MIMO v2.6 Flash80.3%$0.000319.3s23%
118Qwen 3.6 27B95.9%$0.0201.4m61%
119Claude Opus 4.581.5%$0.0124.4s28%
120Claude Opus 4.680.4%$0.0126.0s30%
121GPT-5.6 Sol75.4%$0.00473.0s24%
122Claude Haiku 5.5 (Reasoning, Low)75.9%$0.00085.8s19%
123Z.AI GLM 5.3 Flash (Reasoning, Low)72.1%$0.00014.8s21%
124DeepSeek V3 (2024-12-26)72.2%$0.00063.8s21%
125GPT-5.4 Nano71.1%$0.00041.4s20%
126Gemini 3.5 Flash Lite (Reasoning, Minimal)73.2%$0.0007937ms17%
127Xiaomi MIMO v2.572.9%$0.00167.3s21%
128Claude Sonnet 4.574.1%$0.00704.1s25%
129Grok 4.2073.2%$0.00181.8s18%
130Gemini 2.5 Flash Lite (Reasoning)70.3%$0.00054.5s19%
131Gemini 3.5 Flash Lite (Reasoning)71.6%$0.0007833ms16%
132DeepSeek V3 (2025-03-24)71.5%$0.00056.5s17%
133Mistral Large 368.3%$0.00102.7s18%
134Claude Sonnet 4.674.8%$0.00713.5s20%
135Aion 3.093.8%$0.0261.2m53%
136GPT-5.6 Luna66.0%$0.00091.5s18%
137Mistral Medium 3.168.1%$0.00092.9s16%
138Grok 4.5 (Reasoning, Low)87.1%$0.02037.2s35%
139Gemini 2.5 Flash Lite66.9%$0.0002711ms14%
140DeepSeek V4 Flash66.8%$0.00014.7s14%
141DeepSeek V4 Pro (Reasoning)91.1%$0.00752.1m48%
142Laguna XS 2.163.5%$0.00013.3s15%
143Gemini 3.1 Pro (Preview)100.0%$0.0751.0m100%
144ByteDance Seed 2.0 Mini96.5%$0.00313.3m66%
145Grok 4.20 (Reasoning)78.7%$0.009128.1s20%
146MiniMax M2.570.4%$0.001217.6s12%
147Ministral 3 14B63.0%$0.00031.3s12%
148Aion 2.074.2%$0.003534.4s16%
149Claude Sonnet 467.6%$0.00703.8s14%
150Z.AI GLM 4.561.3%$0.00063.7s12%
151Qwen 3.5 397B A17B100.0%$0.0303.5m100%
152Ministral 3 8B59.0%$0.00031.0s11%
153Claude Sonnet 5 (Reasoning, Low)63.3%$0.00695.1s16%
154Gemma 3 27B58.9%$0.00023.8s11%
155Z.AI GLM 4.672.5%$0.003648.5s19%
156Hermes 3 405B60.3%$0.000011.0s8%
157Claude Opus 567.8%$0.0175.8s18%
158Gemma 3 12B56.2%$0.00013.1s6%
159DeepSeek V4 Pro57.9%$0.00128.9s8%
160DeepSeek V4 Flash (Reasoning)56.0%$0.00014.9s7%
161DeepSeek-V2 Chat55.9%$0.00038.1s8%
162Aion 3.0 Mini74.6%$0.00431.0m17%
163Mistral Small 4 (Reasoning)58.9%$0.001414.4s8%
164Qwen 3.5 Plus (2026-02-15)57.6%$0.00096.6s5%
165DeepSeek V3.154.5%$0.00048.5s8%
166Claude Sonnet 5 (Reasoning)57.4%$0.00695.0s12%
167Xiaomi MIMO v2.5 Pro56.1%$0.00147.5s7%
168Gemini 2.5 Flash (Reasoning)61.7%$0.006612.0s8%
169Ministral 3 3B52.1%$0.0002716ms4%
170Mistral Small 3.2 24B51.3%$0.00022.3s5%
171Mistral Medium 3.5 (Reasoning)49.6%$0.00311.4s9%
172Mistral Large 4.051.4%$0.00083.4s4%
173Qwen 2.5 72B49.7%$0.00073.1s5%
174Z.AI GLM 4.5 Air50.8%$0.00069.4s6%
175Mistral Small 448.9%$0.00031.5s3%
176Llama 3.1 70B45.7%$0.00151.3s6%
177Claude Sonnet 551.6%$0.00685.3s9%
178Claude Haiku 4.548.5%$0.00232.3s3%
179Qwen 3 32B46.7%$0.000410.7s4%
180Claude Opus 476.9%$0.03521.6s22%
181Laguna S 2.146.9%$0.000113.6s2%
182Mistral Medium 3.542.8%$0.00311.4s5%
183Gemini 2.5 Flash41.3%$0.00051.1s1%
184DeepSeek V3.242.3%$0.00056.1s1%
185Cohere Command R+ (Aug. 2024)44.9%$0.00512.7s3%
186ByteDance Seed 1.6 Flash46.6%$0.001017.0s0%
187Qwen 3 235B A22B Instruct 250739.6%$0.00025.2s0%
188Grok 4.340.4%$0.00201.7s0%
189Cydonia 24B V4.136.8%$0.00052.4s0%
190GPT-6 Luna31.8%$0.00012.8s0%
191Arcee AI: Trinity Mini31.3%$0.00011.7s0%
192Writer: Palmyra X530.3%$0.00188.3s0%
193Mistral NeMO22.0%$0.00032.4s0%
194Ministral 8B18.8%$0.00021.4s0%
195Thinking Machines Inkling25.0%$0.001714.1s0%
196Mistral Large 223.5%$0.00423.0s0%
197Hermes 3 70B17.3%$0.00074.8s0%
198Ministral 3B14.1%$0.0001710ms0%
199WizardLM 2 8x22b18.5%$0.001519.8s0%
200Gemma 3 4B3.8%$0.00011.9s0%
80.22%

Individual Scenarios

words

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100 – – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)10010010010010010010010010010099.9%
GPT-6 Sol10010010010010010010010010010099.9%
Claude Sonnet 4.510010010010010010010010010010099.9%
Gemma 3 12B10010010010010010010010010010099.9%
Ministral 3 14B10010010010010010010010010010099.9%
Claude Opus 4.610010010010010010010010010010099.9%
Claude Opus 410010010010010010010010010010099.9%
GPT-4.1 Mini10010010010010010010010010010099.9%
Gemma 3 27B10010010010010010010010010010099.9%
Claude Opus 510010010010010010010010010010099.9%
MiniMax M2.51001001001001001001001001009899.8%
GPT-4.1 Nano1001001001001001001001001009899.8%
Claude Sonnet 5 (Reasoning, Low)1001001001001001001001001009899.8%
Gemini 2.5 Flash Lite (Reasoning)1001001001001001001001001009899.8%
Claude Haiku 4.51001001001001001001001001009899.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001001001001001001009899.8%
Xiaomi MIMO v2.5 Pro1001001001001001001001001009899.8%
Qwen 3.5 Plus (2026-02-15)1001001001001001001001001009899.8%
Cohere Command R+ (Aug. 2024)1001001001001001001001001009899.8%
GPT-5.6 Terra1001001001001001001001001009899.8%
Mistral Medium 3.11001001001001001001001001009899.8%
Mistral Small 41001001001001001001001001009899.8%
DeepSeek V4 Flash (Reasoning)100100100100100100100100989899.7%
Mistral Small 4 (Reasoning)100100100100100100100100989899.7%
DeepSeek-V2 Chat100100100100100100100100989899.6%
Mistral Small 3.2 24B100100100100100100100100989899.6%
Claude Opus 5 (Reasoning)100100100100100100100100989899.6%
Xiaomi MIMO v2.510010010010010010010098989899.5%
Aion 2.010010010010010010010098989899.5%
DeepSeek V4 Flash10010010010010010010098989899.5%
Claude Opus 5 (Reasoning, Low)10010010010010010010098989899.5%
Grok 4.31001001001001001009898989899.3%
Claude Sonnet 5 (Reasoning)1001001001001001009898989899.3%
Z.AI GLM 4.51001001001001001009898989899.3%
Claude Opus 4.51001001001001001009898989899.3%
Laguna S 2.1100100100100100989898989899.2%
DeepSeek V3.1100100100100100989898989899.2%
Mistral Large 3100100100100100989898989899.2%
Xiaomi MIMO v2.6 Pro100100100100100100100100989299.0%
Mistral Large 4.010010010010098989898989899.0%
Laguna XS 2.1100100100100100100100100989299.0%
DeepSeek V3 (2025-03-24)100100100100100100100100989299.0%
Cydonia 24B V4.110010010010098989898989298.4%
Ministral 3 8B100100989898989898989298.1%
Claude Sonnet 4.61001001001001001009898929298.1%
DeepSeek V3.2100100100100100989898929297.9%
DeepSeek V3 (2024-12-26)10010010010098989898929297.8%
Claude Sonnet 5100100989898989898929297.5%
Xiaomi MIMO v2.6 Flash1001001001001001009898987797.2%
Ministral 3 3B10010010010098989898987796.9%
Writer: Palmyra X51001001001001001009898927796.6%
Mistral Medium 3.5 (Reasoning)100100100100100929292929296.1%
Gemini 2.5 Flash100100100100100989292927795.2%
Hermes 3 405B10010010010010010010098985495.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100925494.5%
Mistral Medium 3.5100100989292929292929294.4%
Z.AI GLM 4.5 Air9898989898989292925492.1%
Arcee AI: Trinity Mini9292929292929292927790.7%
Qwen 2.5 72B10098989898989292775490.7%
Thinking Machines Inkling10010010010010098989898990.2%
Qwen 3 32B10010010010098989292922790.0%
Aion 3.0 Mini10010010010010010010010098089.8%
Llama 3.1 70B9892929292927777775484.5%
GPT-5.6 Luna9898929292929277545484.2%
Grok 4.20 (Reasoning)10010010010010010010000070.0%
GPT-6 Luna9877777777545454542765.0%
WizardLM 2 8x22b1001001009898775420062.9%
Claude Haiku 5.5 (Reasoning, Medium)9892929292777700062.2%
Claude Haiku 5.5 (Adaptive)1001001001009292000058.4%
Mistral NeMO10098987777772700055.6%
Claude Haiku 5.5 (Reasoning, Low)92927790 – – – – – 54.2%
Hermes 3 70B100989892920000048.1%
Ministral 8B9898925490000035.2%
Ministral 3B98989227272000034.5%
Mistral Large 298982200000020.1%
Gemma 3 4B5427200000008.3%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100100 – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)10010010010010010010010010010099.9%
Gemma 4 31B10010010010010010010010010010099.9%
Gemini 3.5 Flash (Reasoning, Minimal)10010010010010010010010010010099.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010010010010010010010010010099.9%
Gemini 3.1 Flash Lite (Preview)10010010010010010010010010010099.9%
Gemini 2.5 Pro10010010010010010010010010010099.9%
Xiaomi MIMO v2.6 Pro1001001001001001001001001009899.8%
MiniMax M31001001001001001001001001009899.8%
Claude Haiku 5.5 (Adaptive)1001001001001001001001001009899.8%
Gemini 2.5 Flash (Reasoning)1001001001001001001001001009899.8%
Claude Opus 4.71001001001001001001001001009899.8%
Gemini 2.5 Flash Lite (Reasoning)1001001001001001001001001009899.8%
DeepSeek V3 (2025-03-24)1001001001001001001001001009899.8%
Ministral 3 3B1001001001001001001001001009899.8%
GPT-5.51001001001001001001001001009899.8%
GPT-4.1 Nano1001001001001001001001001009899.8%
Claude Sonnet 4.61001001001001001001001001009899.8%
Xiaomi MIMO v2.6 Flash100100100100100100100100989899.7%
Mistral Large 4.0100100100100100100100100989899.7%
GPT-5.4100100100100100100100100989899.7%
Mistral Small 4 (Reasoning)100100100100100100100100989899.7%
GPT-5.6 Luna100100100100100100100100989899.6%
Qwen 3.5 Plus (2026-02-15)10010010010010010010098989899.5%
Z.AI GLM 4.510010010010010010010098989899.5%
GPT-4.110010010010010010010098989899.5%
GPT-4.1 Mini10010010010010010010098989899.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001001001009898989899.3%
GPT-4o, Aug. 6th (temp=1)1001001001001001009898989899.3%
ByteDance Seed 1.6 Flash1001001001001001001001001009299.2%
Claude Opus 4100100100100100989898989899.2%
Claude Opus 4.7 (Reasoning)100100100100100100100100989299.0%
DeepSeek V3 (2024-12-26)100100100100100100100100989299.0%
GPT-5.4 Nano100100100100100100100100989299.0%
GPT-5.6 Terra100100100100100100100100989299.0%
MiniMax M2.510010010010010010010098989298.9%
GPT-5.4 Mini10010010010010010010098989298.9%
Grok 4.2010010010010010010010098989298.8%
Xiaomi MIMO v2.5100100100100100989898989298.6%
DeepSeek V4 Flash (Reasoning)100100100100100989898989298.5%
GPT-4o, Aug. 6th (temp=0)9898989898989898989898.4%
Qwen 2.5 72B100100100100100100100100929298.4%
DeepSeek-V2 Chat100100100100100100100100929298.4%
Z.AI GLM 4.61001001009898989898989298.2%
Claude Opus 5 (Reasoning, Low)1001001001001001009898929298.1%
Gemini 2.5 Flash Lite100100100100100989898929297.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001001001001001001007797.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001001001001001001007797.7%
Claude Sonnet 41001001009898989898929297.6%
Xiaomi MIMO v2.5 Pro1001001001001001009898987797.2%
Aion 2.0100100100100100100100100927797.0%
Gemma 3 12B100100100100100989898927796.4%
Claude Opus 5 (Reasoning)1001001009892929292929295.2%
Claude Opus 4.8 (Reasoning, Low)10010010010010010010098985495.0%
Ministral 3 8B100100989898989292927794.8%
Claude Opus 4.610098989898989292927794.6%
DeepSeek V4 Flash100100100100100989898925494.0%
Claude Opus 4.510010010010098989898925493.9%
Claude Sonnet 5 (Reasoning, Low)100100989898929292777792.7%
Claude Opus 510098989898989277777791.7%
Mistral Small 3.2 24B10098989898989277777791.6%
Nemotron 3 Nano100100100100100100100100100290.2%
Qwen 3.5 122B100100100100100100100100100090.0%
Laguna S 2.11001001009898927777777789.8%
Cohere Command R+ (Aug. 2024)10098989898927777777789.5%
DeepSeek V4 Pro10098929292929277777789.2%
Hermes 3 405B100100100100100100989292088.3%
Mistral Medium 3.1100100989892929277775488.2%
Mistral Small 410010010010098927777775487.6%
Claude Sonnet 4.510098989292929277775487.4%
DeepSeek V3.11001001009898929277542783.9%
Ministral 3 14B10098927777777777777783.3%
Laguna XS 2.110010010010098927754545482.8%
Grok 4.3100100989292929277272779.9%
Grok 4.20 (Reasoning)100100100100100100100980079.8%
GPT-6 Luna9898929292777777542778.7%
Gemma 3 27B10098989292927777272778.3%
Claude Sonnet 5 (Reasoning)9898989892777754542777.5%
Qwen 3 32B100100100100929292779977.2%
Qwen 3 235B A22B Instruct 250710010098929277775454274.6%
Claude Haiku 5.5 (Reasoning, Medium)10010010098929292270070.2%
Claude Sonnet 51009292927777775427269.1%
Mistral Medium 3.5 (Reasoning)7777777777777754542767.6%
Claude Haiku 4.5100100100987754542727964.6%
Gemini 2.5 Flash989292777777542727963.2%
Z.AI GLM 4.5 Air1001009877775427279958.0%
Mistral Medium 3.5987777777754542727957.9%
Cydonia 24B V4.1989277545454922044.1%
DeepSeek V3.2100989277542220042.7%
Writer: Palmyra X592927754279000035.2%
Claude Haiku 5.5 (Reasoning, Low)9800 – – – – – – – 32.8%
WizardLM 2 8x22b1009898000000029.7%
Ministral 3B929254000000023.8%
Thinking Machines Inkling92549000000015.5%
Hermes 3 70B77540000000013.1%
Arcee AI: Trinity Mini77540000000013.1%
Ministral 8B10020000000010.2%
Mistral NeMO920000000009.2%
Llama 3.1 70B270000000002.8%
Gemma 3 4B00000000000.0%
Mistral Large 200000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100 – – – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100100100 – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)10010010010010010010010010010099.9%
GPT-5.6 Sol (Reasoning, Medium)1001001001001001001001001009899.8%
GPT-5.5 (Reasoning, Medium)1001001001001001001001001009899.8%
Kimi K3 (Reasoning, High)1001001001001001001001001009899.8%
GPT-5.11001001001001001001001001009899.8%
GPT-5.4 Mini (Reasoning)1001001001001001001001001009899.8%
GPT-5.4 Nano (Reasoning)1001001001001001001001001009899.8%
Muse Spark 1.1 (Reasoning, Minimal)1001001001001001001001001009899.8%
Claude Haiku 5.5 (Reasoning, Medium)1001001001001001001001001009899.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001001001001001001009899.8%
GPT-5.4 (Reasoning)1001001001001001001001001009899.8%
GPT-4o, Aug. 6th (temp=0)1001001001001001001001001009899.8%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100989899.7%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100989899.7%
Gemini 2.5 Pro100100100100100100100100989899.7%
GPT-5.5100100100100100100100100989899.6%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100989899.6%
MiniMax M2.710010010010010010010098989899.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010010010010010010098989899.5%
GPT-5.6 Terra1001001001001001009898989899.3%
GPT-4o Mini (temp=1)1001001001001001001001001009299.2%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100989299.0%
Kimi K3 (Reasoning, Low)10010010010010010010098989298.9%
Claude Opus 4.7 (Reasoning)10010010010010010010098989298.9%
Gemma 4 26B10010010010010010010098989298.9%
Claude Opus 4.8 (Reasoning)1001001001001001009898989298.7%
Claude Opus 4.5100100100100100100100100929298.4%
GPT-6 Sol10010010010010010010098929298.3%
GPT-4.1 Mini1001001001001001009898929298.1%
GPT-5.41001001001001001009898929298.1%
Claude Opus 4100100100100100989898929297.9%
GPT-5.6 Sol100100989898989898929297.5%
GPT-5.4 (Reasoning, Low)1001001001001001009898987797.2%
Claude Opus 4.6100100100100100989898987797.1%
GPT-4.11001001001001001009898927796.6%
GPT-4o, Aug. 6th (temp=1)1001001001001001009892927796.0%
GPT-5.4 Mini10010010010098989892927795.7%
Xiaomi MIMO v2.6 Flash1001001001001001001001001005495.4%
Z.AI GLM 5.2 (Reasoning, High)10010010010010010010098777795.3%
Mistral Medium 3.110010010010098989292927795.1%
DeepSeek V4 Flash 0731 (Reasoning, High)10010010010010010010092777794.7%
Claude Opus 510010010010098989892925493.3%
MiniMax M31001001001001001009292925493.0%
Grok 4.20 (Reasoning)1001001001001001001001001002792.7%
DeepSeek V4 Pro (Reasoning)1001001001001001001001001002792.7%
GPT-4.1 Nano1001001009898989292925492.5%
Claude Opus 4.710010010010098989898775492.4%
Xiaomi MIMO v2.5100100100100100929277777791.6%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100990.9%
Xiaomi MIMO v2.6 Pro100100100100100100100100100990.9%
Z.AI GLM 4.61001001001001001009877775490.7%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
GPT-5.6 Luna10010010010098989892545489.4%
Aion 3.010010010010010010010010092089.2%
Aion 2.010010010010010010010010077087.7%
GPT-5.4 Nano1001001009898927777775487.5%
Gemma 3 27B100100100989898927777985.1%
Gemini 2.5 Flash Lite10010098989892929277285.1%
Gemini 2.5 Flash Lite (Reasoning)1001001001009892927777984.7%
Claude Sonnet 4.6100100100989892927777984.5%
MiniMax M2.510010098989292929277084.3%
DeepSeek V4 Flash10010010010010098987754983.6%
Qwen 3.5 Plus (2026-02-15)100100100989898777754280.5%
Aion 3.0 Mini100100100100100100777727078.2%
Claude Sonnet 4.510010010010010098777727078.0%
Grok 4.201001001001001009892772277.1%
DeepSeek V4 Pro10010010098989277549273.1%
Llama 3.1 70B100100989892775427272770.2%
Nemotron 3 Nano10010010010010010010000070.0%
Z.AI GLM 4.51009898989254545427968.4%
DeepSeek V3 (2025-03-24)100989892927754542066.7%
Ministral 3 14B1001001009292777722064.2%
Xiaomi MIMO v2.5 Pro10010098927754542727063.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001009898927727272062.3%
Mistral Small 4 (Reasoning)1001001001001005427272061.0%
Hermes 3 405B10098989892772792060.3%
DeepSeek V3 (2024-12-26)1001009892925427279060.0%
Z.AI GLM 4.5 Air1001001001009877992059.6%
Claude Haiku 4.5100100989877772792059.0%
Mistral Small 3.2 24B10010010098982727279058.8%
Gemini 2.5 Flash (Reasoning)1001001009292542722056.9%
Claude Sonnet 498929277545427272052.4%
DeepSeek V3.11007754545454542727950.9%
DeepSeek V4 Flash (Reasoning)98929277542727279250.7%
Laguna XS 2.110010092777754000050.1%
Qwen 3 32B100100777754542720049.1%
Mistral NeMO10010092775427200045.2%
Mistral Large 310010010027272727270043.7%
Mistral Large 2989277775427000042.6%
DeepSeek-V2 Chat9292545454542700042.6%
Ministral 8B100989277270000039.6%
Mistral Medium 3.5 (Reasoning)9892929290000038.4%
DeepSeek V3.210098772799999034.9%
Ministral 3 8B10098545492000031.6%
ByteDance Seed 1.6 Flash100100100000000030.0%
Arcee AI: Trinity Mini9877772790000029.0%
Mistral Medium 3.510077772700000028.2%
Mistral Small 41009854992000027.2%
Qwen 2.5 72B9277542792200026.3%
Claude Sonnet 5 (Reasoning, Low)9254542799220024.8%
Mistral Large 4.01001009999200023.8%
Claude Sonnet 5 (Reasoning)7754542799222023.5%
Grok 4.31009827200000022.7%
Ministral 3 3B985454220000020.9%
Cydonia 24B V4.110054272700000020.8%
GPT-6 Luna77542000000013.3%
Laguna S 2.127272720000008.4%
Thinking Machines Inkling772000000007.9%
Qwen 3 235B A22B Instruct 2507540000000005.4%
Gemma 3 12B279200000003.8%
Claude Sonnet 599222000002.3%
Ministral 3B99220000002.1%
Gemma 3 4B90000000000.9%
Writer: Palmyra X500000000000.0%
Gemini 2.5 Flash00000000000.0%
Cohere Command R+ (Aug. 2024)00000000000.0%
Hermes 3 70B00000000000.0%
WizardLM 2 8x22b00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100 – – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100 – – – – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
ByteDance Seed 1.610010010010010010010010010010099.9%
Muse Spark 1.2 (Reasoning, Medium)1001001001001001001001001009899.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001001001001001001009899.8%
Nemotron 3 Super1001001001001001001001001009899.8%
GPT-5.4 Mini (Reasoning)1001001001001001001001001009899.8%
GPT-5 Nano1001001001001001001001001009899.8%
GPT-6 Luna (Reasoning, High)1001001001001001001001001009899.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001001001001001001009899.8%
GPT-5 Mini1001001001001001001001001009899.8%
GPT-4o Mini (temp=0)1001001001001001001001001009899.8%
GPT-5.4 (Reasoning)100100100100100100100100989899.7%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100989899.6%
o4 Mini High10010010010010010010098989899.5%
GPT-5.110010010010010010010098989899.5%
GPT-4o, Aug. 6th (temp=1)10010010010010010010098989899.5%
GPT-5.21001001001001001009898989899.4%
Gemini 3 Flash (Preview)1001001001001001009898989899.3%
GPT-5.51001001001001001009898989899.3%
Inception Mercury 21001001001001001001001001009299.2%
Xiaomi MIMO v2.6 Flash1001001001001001001001001009299.2%
Muse Spark 1.1 (Reasoning, Minimal)10010010010010010010098989298.9%
GPT-4.110010010010010010010098989298.9%
Claude Opus 4.71001001001001001009898989298.7%
Z.AI GLM 4.7 Flash100100100100100100100100929298.4%
Gemini 3.1 Flash Lite (Reasoning)1001001009898989898989298.2%
GPT-4o Mini (temp=1)100100100100100989898929297.9%
GPT-5.5 (Reasoning, Low)1001001001001001001001001007797.7%
Gemini 3.1 Flash Lite1001001009898989898929297.6%
Claude Opus 4.7 (Reasoning)1001001001001001009892929297.5%
Claude Opus 4.510010010010010010010098987797.4%
Gemini 3.5 Flash (Reasoning, Minimal)10010010010010010010098987797.4%
GPT-4o, Aug. 6th (temp=0)100100100100100989892929297.3%
Claude Opus 4.8 (Reasoning, Low)1001001001001001009898987797.2%
GPT-6 Sol10010010010098989292929296.5%
Gemma 4 31B1001001009898989898927796.1%
Gemma 4 26B10098989898929292929295.5%
Z.AI GLM 5.2 (Reasoning, High)1001001001001001001001001005495.4%
Aion 3.0 Mini100100100100100100100100985495.2%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100985495.2%
GPT-51001001001001001009898777795.1%
GPT-5.4 (Reasoning, Low)100100989898989292927794.8%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100989892777794.4%
Claude Opus 4.610010010010098989892777794.2%
Claude Opus 4.8 (Reasoning)100100100100100989292777793.8%
Grok 4.5 (Reasoning, Low)100100100100100100100100982792.6%
Claude Sonnet 4.6100100989898929292925491.7%
Grok 4.20 (Reasoning)100100100100100100100100100990.9%
GPT-4.1 Mini100100989892929277777790.6%
GPT-5.6 Terra1001001009898989892922790.5%
MiniMax M3100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100090.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
MiniMax M2.71001001001001001001009898089.7%
GPT-5.4 Nano (Reasoning, Low)100100100100100100989898089.5%
GPT-5.410098989892929277772785.4%
Kimi K3 (Reasoning, Low)100100100100100100989827983.3%
GPT-5.4 Mini100100100989898927754081.8%
Gemini 2.5 Pro10098929292777777545481.4%
DeepSeek V3 (2025-03-24)100100100989292929227079.4%
Claude Sonnet 410010010098989898922078.7%
DeepSeek V3 (2024-12-26)100100100989292775454076.7%
GPT-5.6 Terra (Reasoning, Medium)100100989292925454542776.3%
GPT-5.6 Sol9898927777777754545475.9%
DeepSeek V4 Pro (Reasoning)1001001001001009292540073.8%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100279073.6%
Z.AI GLM 4.610010098989277545454272.9%
Llama 3.1 70B10010098989277545427971.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010010098927777540069.9%
Claude Opus 4100100100987777772727068.5%
Aion 3.5 Mini (Reasoning, High)1001001001001001007700067.7%
Aion 2.0100100100100100987700067.6%
GPT-4.1 Nano1001009892777754542065.4%
Grok 4.2010010010098927754272065.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)9898929292775499963.2%
GPT-5.4 Nano10010092777754272727959.2%
Gemini 3.5 Flash Lite (Reasoning)929292927754272727058.2%
Hermes 3 405B100100989877772700057.9%
GPT-5.6 Luna98927777775454279256.8%
Xiaomi MIMO v2.5100929277775427279055.7%
Mistral Large 2100100100927777000054.7%
Claude Sonnet 51009277775454272727253.8%
Gemma 3 12B1009292929254220052.6%
Gemini 2.5 Flash Lite98987777545427270051.4%
MiniMax M2.5100100100100929000050.1%
Claude Sonnet 4.510010098777727990049.9%
Mistral Medium 3.1100929292779000046.3%
Mistral Medium 3.5 (Reasoning)1009898775427222046.0%
Claude Sonnet 5 (Reasoning, Low)989277545454990044.7%
Z.AI GLM 4.5 Air100989892542000044.5%
Gemini 2.5 Flash Lite (Reasoning)989892772727920043.2%
Ministral 3 8B777777777727900042.4%
Claude Opus 51007754545454922040.4%
Gemini 2.5 Flash1001001009290000040.1%
Gemini 2.5 Flash (Reasoning)1001001007799220039.9%
Z.AI GLM 4.510010092272727992039.4%
DeepSeek-V2 Chat1007777542727000036.3%
Mistral Small 4 (Reasoning)100927727279920034.4%
Mistral Large 398777754279000034.3%
Mistral Medium 3.5100777727279990033.7%
Qwen 2.5 72B100100775420000033.3%
Ministral 3 3B10092775490000033.2%
Laguna XS 2.19892775490000033.1%
Cohere Command R+ (Aug. 2024)92775454279900032.2%
Ministral 3 14B100100100990000031.8%
DeepSeek V4 Flash100100772700000030.5%
Laguna S 2.110010054990000027.2%
Gemma 3 27B9892272790000025.5%
Hermes 3 70B10010054000000025.4%
Mistral Large 4.07777542790000024.5%
Claude Sonnet 5 (Reasoning)777754922200022.3%
DeepSeek V3.11005454000000020.7%
Xiaomi MIMO v2.5 Pro985454200000020.7%
DeepSeek V3.21007727200000020.6%
Cydonia 24B V4.11007727200000020.6%
DeepSeek V4 Flash (Reasoning)1001002000000020.2%
Mistral Small 498929000000020.0%
Arcee AI: Trinity Mini545427200000013.6%
Qwen 3 32B10099200000012.0%
DeepSeek V4 Pro77270000000010.5%
Qwen 3 235B A22B Instruct 250777270000000010.5%
Claude Haiku 4.5980000000009.9%
Ministral 3B980000000009.8%
Ministral 8B920000000009.2%
Qwen 3.5 Plus (2026-02-15)772200000008.1%
Writer: Palmyra X52727920000006.5%
Mistral Small 3.2 24B549200000006.4%
Thinking Machines Inkling279000000003.6%
ByteDance Seed 1.6 Flash270000000002.7%
GPT-6 Luna99220000002.2%
Grok 4.320000000000.2%
Mistral NeMO00000000000.0%
Gemma 3 4B00000000000.0%
WizardLM 2 8x22b00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100100 – – – – – – 100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)1001001001001001001001001009899.8%
Z.AI GLM 5 Turbo1001001001001001001001001009899.8%
Thinking Machines Inkling Small (Reasoning, High)1001001001001001001001001009899.8%
GPT-6 Luna (Reasoning, High)1001001001001001001001001009899.8%
GPT-6 Luna (Reasoning, Medium)1001001001001001001001001009899.8%
GPT-5.4 Mini (Reasoning)1001001001001001001001001009899.8%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100989899.7%
Qwen 3.6 27B10010010010010010010098989899.5%
GPT-5.110010010010010010010098989899.5%
Qwen 3.7 Flash (Reasoning)10010010010010010010098989899.5%
GPT-5.4 Nano (Reasoning)10010010010010010010098989899.5%
Kimi K2.51001001001001001009898989899.4%
Kimi K2.61001001001001001009898989899.4%
GPT-5.6 Luna (Reasoning, Medium)1001001001001001009898989899.3%
GPT-OSS 120B1001001001001001001001001009299.2%
Grok 4.5 (Reasoning, High)100100100100100100100100989299.1%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100989299.1%
GPT-5.2100100100100100100100100989299.1%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100989299.0%
GPT-5.4 (Reasoning)100100100100100100100100989299.0%
Thinking Machines Inkling (Reasoning)10010010010010010010098989298.9%
Claude Opus 5 (Reasoning, Low)100100100100100100100100929298.4%
Z.AI GLM 5.2 (Reasoning, High)1001001001001001001001001007797.7%
o4 Mini High10010010010010010010098987797.4%
Qwen 3.5 122B10010010010010010010098987797.4%
o4 Mini100100100100100989892929297.3%
GPT-5100100989898989892929296.9%
GPT-5 Mini10010010010098989898927796.3%
ByteDance Seed 1.6100100100100100989892927795.8%
Claude Opus 4.8 (Reasoning, Low)1001001001001001009877777793.0%
Claude Opus 4.71001001009892929292777792.2%
Aion 3.5 (Reasoning, High)100100100100100100100100100990.9%
Qwen 3.6 Flash100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100090.0%
Aion 3.5 Mini (Reasoning, High)10010010010010010010010098089.8%
Qwen 3.5 Plus (2026-04-20)10010010010010010010010098089.8%
DeepSeek V4 Pro (Reasoning)1001001001001001001009892089.0%
Claude Opus 4.7 (Reasoning)100100989898987777775487.9%
Z.AI GLM 4.7 Flash10010010010010010010010054085.3%
ByteDance Seed 2.0 Mini10010010010010010010010027082.7%
Claude Opus 4.8 (Reasoning)1001001001009892927754982.2%
Grok 4.7 (Reasoning, High)1001001001001001001001000080.0%
Aion 3.0100100100100100100100980079.8%
GPT-4o, Aug. 6th (temp=0)100989898989898920078.3%
GPT-4.110010098989892777727977.9%
ByteDance Seed 2.0 Lite100100100100100100100549076.3%
GPT-6 Sol (Reasoning, Medium)10010010010010098545427273.4%
GPT-4o, Aug. 6th (temp=1)98989898929277549071.8%
MiniMax M31001001001001001009800069.8%
GPT-5.510010010098927777279969.1%
Claude Haiku 5.5 (Reasoning, Low)1001000 – – – – – – – 66.7%
Gemini 3.1 Flash Lite989892777777545427265.7%
Gemini 3 Flash (Preview)100929292927754542265.7%
GPT-5.4 Mini (Reasoning, Low)1001001009898777720065.3%
Mistral Large 31001001009892925490064.5%
Claude Sonnet 5 (Reasoning)1001009892925454540064.3%
Gemini 3.1 Flash Lite (Reasoning)100929292925454279962.1%
Grok 4.20 (Reasoning)100100100100100100200060.2%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100000060.0%
Kimi K3 (Reasoning, Low)10010010010010098000059.8%
GPT-4o Mini (temp=1)100100989292542792257.6%
Claude Sonnet 4.5100100100989254920055.5%
Claude Sonnet 5 (Reasoning, Low)1009892927777900054.7%
Laguna XS 2.110010092927754900052.4%
MiniMax M2.7100100100989827000052.4%
Gemini 2.5 Pro1001009892929000049.2%
Gemini 3.1 Flash Lite (Preview)9892777754542792049.1%
GPT-5.4 (Reasoning, Low)100100775454272790044.8%
Grok 4.5 (Reasoning, Low)100100100100270000042.7%
GPT-5.4 Nano (Reasoning, Low)100929277542000041.7%
GPT-6 Sol92927777549200040.4%
GPT-4.1 Nano1009877272727000035.8%
Ministral 3 14B100987754270000035.7%
GPT-5.6 Terra (Reasoning, Medium)10098925492200035.7%
Claude Sonnet 5100100982799900035.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)9877545490000029.2%
Gemma 3 12B1009877900000028.5%
Ministral 3 8B100100542700000028.1%
DeepSeek V3 (2024-12-26)10010077000000027.7%
DeepSeek V4 Flash989254992000026.4%
GPT-5.47777545420000026.4%
Grok 4.20989854000000025.0%
Gemini 2.5 Flash Lite (Reasoning)7754545400000023.8%
GPT-5.4 Mini1001009200000021.1%
GPT-4o Mini (temp=0)777754000000020.9%
Aion 2.0100920000000019.2%
Xiaomi MIMO v2.5100920000000019.2%
GPT-5.6 Terra985427922000019.2%
MiniMax M2.598920000000019.1%
Claude Opus 498920000000019.1%
Claude Opus 4.5100779000000018.7%
DeepSeek V3.1100770000000017.7%
DeepSeek V4 Pro92770000000017.0%
Claude Opus 4.6922727922000016.0%
DeepSeek V3.2100542000000015.5%
Gemini 3.6 Flash (Reasoning, Minimal)545427920000014.5%
Claude Opus 577549000000014.0%
Writer: Palmyra X5772727000000013.2%
Qwen 3 235B A22B Instruct 2507100272000000012.9%
DeepSeek V3 (2025-03-24)98270000000012.6%
Gemini 2.5 Flash (Reasoning)92270000000012.0%
GPT-4.1 Mini77279200000011.6%
Mistral Medium 3.177279000000011.4%
DeepSeek V4 Flash (Reasoning)9892000000010.9%
Xiaomi MIMO v2.6 Flash10000000000010.0%
Arcee AI: Trinity Mini9820000000010.0%
Aion 3.0 Mini10000000000010.0%
Laguna S 2.110000000000010.0%
GPT-5.4 Nano10000000000010.0%
Mistral Large 4.010000000000010.0%
Mistral Small 410000000000010.0%
Gemma 3 4B980000000009.8%
Ministral 3 3B980000000009.8%
Claude Sonnet 4920000000009.2%
Claude Haiku 4.5920000000009.2%
Gemini 3.5 Flash (Reasoning, Minimal)5427920000009.2%
Gemini 2.5 Flash770000000007.8%
Thinking Machines Inkling770000000007.7%
Gemma 3 27B2727200000005.6%
Qwen 3 32B540000000005.4%
Gemma 4 31B279922000004.9%
GPT-5.6 Sol279200000003.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)279000000003.6%
Cohere Command R+ (Aug. 2024)270000000002.8%
DeepSeek-V2 Chat270000000002.7%
Gemma 4 26B92200000001.3%
Z.AI GLM 4.690000000000.9%
ByteDance Seed 1.6 Flash90000000000.9%
Gemini 2.5 Flash Lite20000000000.2%
Claude Sonnet 4.620000000000.2%
Gemini 3.5 Flash Lite (Reasoning)00000000000.0%
Qwen 3.5 Plus (2026-02-15)00000000000.0%
GPT-5.6 Luna00000000000.0%
Mistral Small 4 (Reasoning)00000000000.0%
Z.AI GLM 4.5 Air00000000000.0%
Cydonia 24B V4.100000000000.0%
GPT-6 Luna00000000000.0%
Qwen 2.5 72B00000000000.0%
Grok 4.300000000000.0%
Xiaomi MIMO v2.5 Pro00000000000.0%
Mistral Medium 3.5 (Reasoning)00000000000.0%
Z.AI GLM 4.500000000000.0%
Mistral Medium 3.500000000000.0%
Mistral Large 200000000000.0%
Hermes 3 405B00000000000.0%
Llama 3.1 70B00000000000.0%
Mistral Small 3.2 24B00000000000.0%
WizardLM 2 8x22b00000000000.0%
Hermes 3 70B00000000000.0%
Mistral NeMO00000000000.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%