Past progressive (was/were + -ing) overuse

Test: Bad Writing Habits

Avg. Score
88.6%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-4.1 Mini99.9%$0.002719.0s99%
2Inception Mercury 299.7%$0.00327.0s96%
3GPT-5.6 Luna100.0%$0.01515.8s100%
4GPT-5.6 Luna (Reasoning, Medium)100.0%$0.01718.0s100%
5o4 Mini99.8%$0.01525.7s97%
6GPT-6 Luna (Reasoning, Medium)99.7%$0.001643.0s95%
7GPT-5.4 Nano99.2%$0.005726.3s93%
8GPT-6 Luna99.5%$0.001332.6s90%
9GPT-4o, Aug. 6th (temp=1)99.7%$0.01824.4s95%
10GPT-5.4 Nano (Reasoning, Low)99.0%$0.005520.6s90%
11o4 Mini High100.0%$0.02547.2s100%
12GPT-4.199.8%$0.01844.7s96%
13GPT-5 Mini99.7%$0.010057.4s96%
14Grok 4.5 (Reasoning, Low)99.9%$0.0181.1m97%
15GPT-5 Nano99.6%$0.00421.4m95%
16GPT-5.4 Mini (Reasoning, Low)98.2%$0.01516.8s88%
17GPT-5.6 Terra (Reasoning, Medium)100.0%$0.04435.2s100%
18GPT-6 Luna (Reasoning, High)99.1%$0.002357.1s88%
19GPT-5.6 Terra100.0%$0.04636.9s100%
20GPT-6 Sol99.6%$0.02751.4s95%
21GPT-5.4 Mini (Reasoning)98.6%$0.02228.1s88%
22Qwen 3.7 Flash (Reasoning)98.7%$0.001055.2s84%
23Grok 4.397.6%$0.006930.5s80%
24GPT-OSS 120B99.3%$0.00151.8m90%
25Grok 4.5 (Reasoning, High)99.9%$0.0301.6m98%
26GPT-4o Mini (temp=1)97.7%$0.001234.8s77%
27GPT-4o Mini (temp=0)97.9%$0.001234.8s76%
28Nemotron 3 Nano98.1%$0.00101.1m81%
29Nemotron 3 Super98.5%$0.00001.4m83%
30GPT-6 Sol (Reasoning, Medium)99.2%$0.0311.0m90%
31GPT-5.4 Nano (Reasoning)96.8%$0.006124.5s76%
32GPT-5.4100.0%$0.0491.4m100%
33Grok 4.3 (Reasoning)99.9%$0.0212.3m99%
34Grok 4.20 (Reasoning)98.4%$0.0181.5m88%
35GPT-5.2100.0%$0.0561.5m100%
36Gemini 3.5 Flash Lite (Reasoning)94.8%$0.00356.6s67%
37GPT-5.1100.0%$0.0541.8m99%
38GPT-4o, Aug. 6th (temp=0)97.0%$0.02322.7s73%
39Gemini 3.8 Flash (Reasoning, Medium)95.4%$0.01418.0s70%
40GPT-5.4 Mini96.2%$0.01516.8s68%
41Mistral Small 4 (Reasoning)92.9%$0.002230.2s66%
42GPT-6.1 Sol (Reasoning, Medium)98.5%$0.0311.6m81%
43DeepSeek V3 (2025-03-24)94.5%$0.001439.4s63%
44ByteDance Seed 1.6 Flash93.9%$0.001327.3s61%
45GPT-5.4 (Reasoning, Low)99.0%$0.0551.4m87%
46Qwen 3.5 Plus (2026-02-15)94.4%$0.006031.5s62%
47Qwen 3 235B A22B Instruct 250794.8%$0.001159.2s65%
48Gemini 3.5 Flash Lite (Reasoning, Minimal)92.9%$0.00356.3s58%
49Grok 4.2094.3%$0.009345.7s66%
50Writer: Palmyra X594.3%$0.01122.0s62%
51Mistral Large 4.093.7%$0.00631.1m68%
52GPT-5.6 Sol100.0%$0.1051.2m100%
53Qwen 2.5 72B91.6%$0.001036.7s62%
54Qwen 3.6 Flash93.6%$0.01041.4s63%
55GPT-5.6 Sol (Reasoning, Medium)100.0%$0.1081.2m100%
56Hermes 3 405B93.3%$0.003253.2s62%
57Gemini 3.7 Flash (Reasoning, Medium)93.2%$0.01218.2s58%
58DeepSeek-V2 Chat92.9%$0.002153.3s61%
59GPT-5100.0%$0.0652.8m100%
60Gemini 2.5 Flash (Reasoning)92.8%$0.01121.5s57%
61Qwen 3.6 35B94.0%$0.00831.0m62%
62Gemini 2.5 Flash Lite91.3%$0.00099.5s52%
63Gemini 2.5 Flash92.0%$0.005210.6s53%
64DeepSeek V3 (2024-12-26)92.6%$0.002154.6s58%
65Hermes 3 70B93.9%$0.00101.2m58%
66Arcee AI: Trinity Mini90.5%$0.00039.2s51%
67Z.AI GLM 4.5 Air92.8%$0.002958.2s57%
68Claude Haiku 5.5 (Adaptive)90.5%$0.001819.3s52%
69Z.AI GLM 4.591.5%$0.005142.1s56%
70Thinking Machines Inkling94.3%$0.00751.5m61%
71Qwen 3.8 Flash (Reasoning)97.0%$0.00643.1m75%
72Xiaomi MIMO v2.6 Pro94.4%$0.00332.0m65%
73Mistral Small 490.1%$0.001418.2s49%
74Cohere Command R+ (Aug. 2024)93.1%$0.02052.5s58%
75Claude Sonnet 4.592.9%$0.03538.1s60%
76Gemini 2.5 Flash Lite (Reasoning)89.7%$0.002830.8s49%
77Muse Spark 1.3 (Reasoning, Medium)94.7%$0.0251.8m65%
78DeepSeek V4 Pro 0813 (Reasoning, High)94.5%$0.0251.8m65%
79GPT-5.4 (Reasoning)99.4%$0.0892.6m93%
80Claude Opus 4.8 (Reasoning, Low)94.7%$0.07141.9s69%
81Grok 4.6 (Reasoning, High)96.8%$0.0422.5m75%
82Mistral Medium 3.188.6%$0.004836.5s50%
83Qwen 3.6 27B95.4%$0.0252.3m67%
84GPT-5.5100.0%$0.1391.7m100%
85Mistral Medium 3.5 (Reasoning)88.3%$0.01818.0s51%
86Muse Glimmer 30B (Reasoning, Medium)89.2%$0.003843.4s48%
87Gemini 3.6 Flash (Reasoning, Minimal)89.5%$0.01714.3s47%
88Mistral NeMO86.3%$0.000510.1s45%
89GPT-5.5 (Reasoning, Low)100.0%$0.1391.8m100%
90Kimi K2.595.7%$0.0193.2m73%
91Claude Haiku 5.5 (Reasoning, Low)88.7%$0.001515.4s41%
92DeepSeek V4 Flash86.5%$0.000631.6s48%
93GPT-5.5 (Reasoning, Medium)100.0%$0.1421.8m100%
94Mistral Medium 3.587.8%$0.01818.2s49%
95Qwen 3 32B89.1%$0.001554.6s45%
96ByteDance Seed 2.0 Lite92.8%$0.0122.2m59%
97Cydonia 24B V4.187.1%$0.001444.8s46%
98ByteDance Seed 1.694.0%$0.0132.5m60%
99Claude Sonnet 489.6%$0.03243.7s52%
100Muse Spark 1.1 (Reasoning, Medium)87.6%$0.01523.9s44%
101Claude Haiku 5.5 (Reasoning, Medium)85.4%$0.001414.9s40%
102GPT-4.1 Nano84.8%$0.000713.3s39%
103Aion 3.0 Mini87.6%$0.00531.2m48%
104Gemini 3.6 Flash (Reasoning)90.8%$0.04432.5s50%
105Mistral Large 385.0%$0.003330.3s42%
106Mistral Large 285.7%$0.01329.4s45%
107Muse Spark 1.2 (Reasoning, Medium)87.7%$0.01838.3s45%
108Qwen 3.5 9B88.8%$0.00111.4m43%
109Grok 4.7 (Reasoning, High)99.0%$0.0743.9m87%
110WizardLM 2 8x22b89.1%$0.00261.8m48%
111Gemma 3 4B82.4%$0.000220.0s41%
112Claude Sonnet 5.5 (Reasoning)90.3%$0.04236.9s47%
113Xiaomi MIMO v2.6 Flash88.8%$0.00081.8m47%
114Qwen 3.6 Max Preview96.7%$0.0503.5m76%
115Muse Spark 1.1 (Reasoning, Minimal)85.3%$0.01219.2s39%
116Qwen 3.5 Plus (2026-04-20)91.7%$0.0171.8m48%
117Thinking Machines Inkling (Reasoning)98.1%$0.0255.1m82%
118Qwen 3.5 Flash85.9%$0.002547.5s39%
119Llama 3.1 70B84.5%$0.001529.4s38%
120Thinking Machines Inkling Small (Reasoning, High)89.0%$0.00881.7m48%
121DeepSeek V4.1 Flash (Reasoning, High)84.2%$0.002935.4s38%
122Gemini 3.5 Flash (Reasoning, Minimal)84.1%$0.01812.0s37%
123Mistral Large 4.0 (Reasoning)94.4%$0.0233.4m61%
124Aion 2.084.8%$0.00641.3m43%
125Gemma 3 12B83.0%$0.000441.3s36%
126Qwen 3.5 397B A17B91.3%$0.0143.0m56%
127Qwen 3.8 27B (Reasoning, XHigh)97.5%$0.0404.7m76%
128 Kimi K3 (Reasoning, High)90.2%$0.0441.8m55%
129Claude Sonnet 5 (Reasoning, Low)85.0%$0.03138.4s43%
130DeepSeek V4 Flash (Reasoning)81.7%$0.000731.1s34%
131Claude Opus 4.8 (Reasoning)89.0%$0.07141.7s53%
132MiniMax M2.783.8%$0.00401.1m38%
133Xiaomi MIMO v2.5 Pro84.0%$0.008553.5s36%
134Claude Sonnet 583.8%$0.02733.5s39%
135Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.0835.9m100%
136Laguna XS 2.179.2%$0.000314.4s29%
137Hy4 Preview (Reasoning, High)95.5%$0.0404.4m66%
138Z.AI GLM 5 Turbo79.1%$0.008133.2s34%
139Aion 3.083.5%$0.0241.0m38%
140Kimi K2.699.4%$0.0586.5m93%
141Qwen 3.5 122B85.5%$0.0251.1m34%
142Claude Opus 5.5 (Reasoning)89.5%$0.09256.0s54%
143Gemini 3.1 Flash Lite (Preview)75.4%$0.00308.4s31%
144Laguna S 2.177.0%$0.000522.1s30%
145Z.AI GLM 5.183.6%$0.0141.5m38%
146DeepSeek V3.281.5%$0.00141.9m39%
147Ministral 3 3B77.7%$0.000511.1s24%
148DeepSeek V4 Pro (Reasoning)88.4%$0.0153.1m45%
149Gemini 3.1 Flash Lite75.0%$0.003012.1s28%
150Z.AI GLM 5.3 Flash (Reasoning, Low)79.8%$0.00051.1m30%
151Z.AI GLM 5.2 (Reasoning, High)80.3%$0.0111.0m32%
152Z.AI GLM 581.3%$0.00841.2m31%
153ByteDance Seed 2.0 Mini90.9%$0.00454.9m56%
154Gemini 3.1 Pro (Preview)92.7%$0.1071.8m57%
155Claude Opus 4.584.5%$0.07053.4s45%
156Aion 3.5 Mini (Reasoning, High)83.4%$0.0112.4m38%
157Gemini 3.1 Flash Lite (Reasoning)74.8%$0.003011.9s22%
158Claude Sonnet 5 (Reasoning)78.9%$0.03038.9s32%
159Qwen 3.5 35B78.9%$0.0181.0m31%
160DeepSeek V4 Pro76.6%$0.00481.3m32%
161Xiaomi MIMO v2.574.4%$0.005431.8s26%
162DeepSeek V4 Flash 0731 (Reasoning, High)81.7%$0.00222.6m37%
163Claude Opus 4.685.4%$0.0781.2m44%
164Claude Haiku 4.573.6%$0.01121.6s26%
165Gemini 3.5 Flash (Reasoning)84.9%$0.07137.6s35%
166Claude Opus 5 (Reasoning, Low)86.4%$0.0971.0m46%
167Gemma 3 27B74.1%$0.000652.6s25%
168Claude Opus 5 (Reasoning)85.2%$0.0981.0m48%
169Gemini 2.5 Pro75.2%$0.03636.2s34%
170Gemini 3 Flash (Preview, Reasoning)72.7%$0.01230.1s26%
171Kimi K3 (Reasoning, Low)80.2%$0.0281.1m27%
172Ministral 8B69.4%$0.000410.4s23%
173Ministral 3 14B69.3%$0.000711.7s21%
174MiniMax M2.573.6%$0.00341.3m27%
175Qwen 3.5 27B80.2%$0.0201.6m26%
176Claude Opus 4.6 (Reasoning)84.8%$0.0881.4m39%
177Gemma 4 26B71.2%$0.000955.1s21%
178Ministral 3 8B68.2%$0.000819.6s18%
179Gemma 4 31B (Reasoning)76.6%$0.00142.2m24%
180Ministral 3B66.8%$0.00018.1s16%
181Z.AI GLM 5.3 Flash (Reasoning, Max)89.5%$0.00316.5m54%
182Claude Opus 578.8%$0.08250.1s35%
183Gemma 4 31B72.3%$0.00101.6m21%
184Qwen 3.7 Max85.3%$0.0682.3m34%
185Gemma 4 26B (Reasoning)73.3%$0.00132.0m22%
186Aion 3.5 (Reasoning, High)71.9%$0.0221.3m23%
187DeepSeek V3.169.5%$0.00201.8m24%
188MiniMax M375.6%$0.00603.1m29%
189Gemini 3 Flash (Preview)63.0%$0.007819.6s16%
190Claude Sonnet 4.667.1%$0.03139.3s18%
191Claude Opus 491.7%$0.2091.4m55%
192Z.AI GLM 4.661.6%$0.006551.5s14%
193Claude Sonnet 4.6 (Reasoning)69.4%$0.0601.2m20%
194Claude Opus 4.766.2%$0.06930.4s19%
195Mistral Small 3.2 24B80.5%$0.00695.7m30%
196Z.AI GLM 4.760.9%$0.0101.4m12%
197Z.AI GLM 4.7 Flash51.6%$0.00171.2m8%
198Claude Opus 4.7 (Reasoning)62.2%$0.07632.0s12%
199Z.AI GLM 5.3 (Reasoning, Max)86.8%$0.0667.3m43%
200Claude Haiku 5.5 (Reasoning, Max)54.7%$0.0314.7m34%
88.59%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Mistral NeMO100100100100100100.0%
ByteDance Seed 2.0 Lite1001001001009899.7%
Qwen 3.5 35B1001001001009899.6%
Mistral Small 41001001001009899.6%
Kimi K3 (Reasoning, High)1001001001009799.5%
MiniMax M2.71001001001009699.3%
Xiaomi MIMO v2.5 Pro1001001001009699.3%
Claude Opus 4.8 (Reasoning)1001001001009599.0%
Thinking Machines Inkling Small (Reasoning, High)1001001001009598.9%
DeepSeek V3.11001001001009498.8%
Mistral Medium 3.11001001001009498.8%
Qwen 3.5 9B1001001001009398.7%
Aion 2.01001001001008997.8%
Qwen 3.6 27B1001001001008697.2%
Gemma 4 31B (Reasoning)1001001001008396.6%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001008296.5%
Claude Sonnet 51001001001008296.4%
ByteDance Seed 1.6 Flash1001001001008296.4%
Z.AI GLM 5.3 (Reasoning, Max)1001001001008096.0%
Claude Opus 5 (Reasoning, Low)1001001001008096.0%
Mistral Large 4.01001001001008096.0%
GPT-4.1 Nano1001001001007895.6%
DeepSeek V4 Pro (Reasoning)1001001001007895.5%
Claude Sonnet 41001001001007394.5%
Cohere Command R+ (Aug. 2024)1001001001007194.2%
Claude Sonnet 4.61001001001007194.2%
Claude Sonnet 4.6 (Reasoning)1001001001007094.0%
Gemini 2.5 Flash (Reasoning)1001001001007094.0%
Mistral Large 21001001001007094.0%
Qwen 3.5 27B1001001001006993.7%
Claude Haiku 5.5 (Reasoning, Medium)1001001001006793.3%
Gemma 3 27B100100100867792.7%
Mistral Medium 3.5 (Reasoning)1001001001006392.6%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001006392.6%
Qwen 3.6 Flash1001001001006192.2%
Claude Sonnet 4.5100100100827992.2%
Mistral Large 3100100100797891.3%
DeepSeek V3.21001001001005090.0%
Claude Sonnet 5 (Reasoning)1001001001005089.9%
Z.AI GLM 4.61001001001004889.6%
Qwen 2.5 72B100100100747389.4%
Qwen 3.5 Flash1001001001004589.0%
Gemma 3 4B1001001001004589.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001004087.9%
Hermes 3 405B1001001001003386.7%
MiniMax M310010081816685.5%
Gemini 3 Flash (Preview, Reasoning)1001001001002785.5%
WizardLM 2 8x22b1001001001001282.4%
Gemini 3.1 Flash Lite (Preview)100100100100681.2%
Arcee AI: Trinity Mini100100100100080.0%
Mistral Medium 3.510010010087077.3%
Laguna S 2.110010010073275.0%
Z.AI GLM 4.7100100100443174.9%
Mistral Small 3.2 24B10010086444274.5%
Qwen 3 32B10010010068073.6%
Xiaomi MIMO v2.51001009276073.6%
Aion 3.5 (Reasoning, High)10010010064072.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010090482071.6%
Laguna XS 2.110010010056071.2%
Gemini 3.1 Flash Lite (Reasoning)10010084492070.6%
Ministral 3B10010010050070.0%
Ministral 3 8B10010010028867.1%
Gemini 3.1 Flash Lite10010059412164.2%
Gemma 4 26B1001008136063.3%
Ministral 3 14B1001001002060.4%
Gemma 4 26B (Reasoning)100100570051.4%
Z.AI GLM 4.7 Flash100100295046.8%
Gemini 3 Flash (Preview)93842120043.5%
Ministral 3 3B1008900037.8%
Ministral 8B6352505034.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Mistral Small 410010010010010099.9%
Gemini 3.7 Flash (Reasoning, Medium)1001001001009899.6%
Claude Opus 4.6 (Reasoning)1001001001009899.6%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009899.6%
Z.AI GLM 51001001001009899.6%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009699.2%
ByteDance Seed 2.0 Lite1001001001009599.1%
Z.AI GLM 5.11001001001009598.9%
Claude Sonnet 51001001001009498.8%
Qwen 3.6 35B1001001001009398.7%
DeepSeek V3 (2024-12-26)1001001001009398.6%
Claude Opus 5 (Reasoning, Low)100100100999498.5%
Claude Opus 41001001001009198.1%
Claude Haiku 5.5 (Adaptive)1001001001008997.8%
Cohere Command R+ (Aug. 2024)1001001001008897.6%
MiniMax M2.71001001001008697.3%
Claude Opus 4.8 (Reasoning, Low)1001001001008697.1%
Claude Opus 4.61001001001008596.9%
ByteDance Seed 1.61001001001008296.5%
Mistral Large 3100100100938996.4%
Gemini 2.5 Flash Lite (Reasoning)100100100938996.4%
GPT-OSS 120B1001001001008095.9%
Claude Opus 4.5100100100958395.7%
Z.AI GLM 4.5 Air1001001001007895.6%
GPT-4o, Aug. 6th (temp=1)1001001001007795.5%
Claude Sonnet 4.6 (Reasoning)1001001001007795.3%
Kimi K3 (Reasoning, Low)1001001001007695.2%
Mistral Large 4.01001001001007695.2%
Aion 3.01001001001007394.7%
Mistral Medium 3.51001001001007394.5%
GPT-4o Mini (temp=1)1001001001007294.5%
DeepSeek V4 Pro (Reasoning)100100100947694.0%
DeepSeek V3 (2025-03-24)1001001001006993.9%
GPT-5 Nano10010099898093.5%
DeepSeek V4 Flash1001001001006192.2%
Ministral 3 3B100100100946792.2%
ByteDance Seed 2.0 Mini1001001001006091.9%
Mistral Small 3.2 24B1001001001005991.8%
Qwen 3.5 35B100100100965890.8%
Claude Opus 5.5 (Reasoning)100100100876690.6%
Z.AI GLM 4.5100100100806989.9%
Claude Opus 5 (Reasoning)100100100806789.2%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100934888.3%
Claude Opus 4.8 (Reasoning)1001001001004188.3%
Ministral 3B100100100894887.5%
Gemini 3 Flash (Preview, Reasoning)1001001001003787.3%
Claude Opus 5100100100834986.4%
Gemini 3.5 Flash (Reasoning)1001001001003186.2%
Hy4 Preview (Reasoning, High)1001001001002785.4%
Claude Sonnet 4.61001001001002584.9%
Claude Sonnet 5 (Reasoning, Low)10010082786184.3%
Z.AI GLM 5.2 (Reasoning, High)100100100645483.6%
Laguna XS 2.11001001001001883.6%
GPT-4o, Aug. 6th (temp=0)1001001001001783.5%
Z.AI GLM 5 Turbo100100100912583.1%
Aion 2.010010097615382.1%
Cydonia 24B V4.1100100100634481.3%
MiniMax M3100100100100581.0%
Gemini 2.5 Pro10010092594980.0%
Gemma 4 26B (Reasoning)100100100100080.0%
Claude Sonnet 4.5100100100100080.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100080.0%
Ministral 3 14B100100100100080.0%
GPT-4.1 Nano100100100643479.6%
Arcee AI: Trinity Mini100100100554179.3%
Llama 3.1 70B10010086544877.7%
Mistral Large 210010010088077.6%
Gemma 4 31B (Reasoning)10010080683877.3%
DeepSeek V4.1 Flash (Reasoning, High)10010010082076.4%
Claude Haiku 5.5 (Reasoning, Low)10010029 – – 76.4%
Claude Sonnet 5 (Reasoning)10010010080075.9%
Claude Haiku 5.5 (Reasoning, Medium)10010074732875.0%
Gemma 3 4B10010092562374.2%
DeepSeek V4 Flash (Reasoning)10010010071074.1%
WizardLM 2 8x22b100100100482173.8%
Qwen 2.5 72B10010069662572.2%
Aion 3.5 (Reasoning, High)1009466594071.9%
Gemini 3.5 Flash (Reasoning, Minimal)10010010056071.2%
DeepSeek V4 Pro10010073612070.7%
DeepSeek V3.21001009748068.9%
Xiaomi MIMO v2.510010010037868.9%
Hermes 3 405B10010010037067.5%
MiniMax M2.510010064343266.1%
Gemini 3.1 Flash Lite1001006664065.9%
Writer: Palmyra X51001008041064.3%
Claude Sonnet 41001007246063.6%
Laguna S 2.110010010015063.0%
Gemini 3 Flash (Preview)1001006933060.4%
Z.AI GLM 4.71001001000060.0%
Gemini 2.5 Flash Lite100100800056.0%
Mistral NeMO1006664262155.3%
Claude Opus 4.7 (Reasoning)100826131054.9%
Z.AI GLM 4.6100746630054.1%
Gemma 4 26B10010032121050.9%
Ministral 8B10080710050.1%
Claude Opus 4.7100884913049.9%
Gemma 3 27B73736914045.8%
DeepSeek V3.110068330040.2%
Gemma 4 31B10010000040.0%
Claude Haiku 4.510088101039.5%
Gemini 3.1 Flash Lite (Preview)804623221437.2%
Gemini 3.1 Flash Lite (Reasoning)1007900035.8%
Ministral 3 8B10040284034.4%
Z.AI GLM 4.7 Flash10037290033.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Mistral Large 21001001001009899.6%
Mistral Large 4.01001001001009599.0%
Aion 2.01001001001009598.9%
Z.AI GLM 4.5100100100979698.5%
Hermes 3 405B1001001001009298.5%
Laguna S 2.11001001001009298.5%
Qwen 3.5 35B1001001001009098.0%
DeepSeek V4.1 Flash (Reasoning, High)1001001001008997.8%
Gemini 2.5 Flash Lite (Reasoning)1001001001008997.8%
Gemma 4 31B1001001001008897.6%
Xiaomi MIMO v2.5 Pro1001001001008797.4%
Mistral Medium 3.11001001001008797.4%
DeepSeek V4 Flash1001001001008697.2%
Ministral 3B1001001001008496.8%
Gemini 2.5 Flash1001001001008096.0%
Qwen 3.6 35B1001001001007995.8%
Claude Opus 4.8 (Reasoning)1001001001007895.5%
Xiaomi MIMO v2.6 Pro1001001001007795.3%
Mistral Small 41001001001007795.3%
Mistral Medium 3.5100100100957694.2%
Ministral 3 14B1001001001006793.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001006392.5%
Gemma 3 12B100100100976592.3%
Hy4 Preview (Reasoning, High)1001001001006192.2%
Qwen 3.5 Flash1001001001006192.1%
Thinking Machines Inkling100100100976291.9%
Claude Sonnet 5 (Reasoning, Low)10010098976191.4%
Z.AI GLM 51001001001005390.7%
Z.AI GLM 5.2 (Reasoning, High)1001001001005190.1%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100925890.0%
Gemma 4 26B (Reasoning)100100100896089.7%
Aion 3.01001001001004589.0%
Aion 3.0 Mini1001001001004589.0%
Gemini 3.1 Flash Lite (Preview)1001001001004488.8%
Z.AI GLM 5.3 (Reasoning, Max)100100100885588.7%
DeepSeek V4 Pro100100100915188.3%
DeepSeek V3.2100100100855688.2%
Gemini 3 Flash (Preview, Reasoning)100100100964588.2%
Nemotron 3 Super100100100974087.4%
Mistral Small 4 (Reasoning)1001001001003687.2%
Gemma 3 27B10010084757386.3%
Laguna XS 2.11001001001002985.8%
Claude Sonnet 5.5 (Reasoning)1001001001002584.9%
Claude Opus 5 (Reasoning)100100100863784.7%
Qwen 3 235B A22B Instruct 25071001001001002184.3%
Gemini 3.1 Flash Lite (Reasoning)1001001001001983.7%
MiniMax M2.71001001001001583.0%
Claude Sonnet 4.510010092774582.9%
Claude Opus 5100100100971682.5%
Gemini 2.5 Pro10010096803682.4%
Aion 3.5 Mini (Reasoning, High)100100100100080.0%
Kimi K3 (Reasoning, Low)100100100100080.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100080.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100080.0%
Llama 3.1 70B100100100100080.0%
Cohere Command R+ (Aug. 2024)100100100100080.0%
Arcee AI: Trinity Mini10010010093078.7%
Claude Sonnet 5 (Reasoning)10010010089077.8%
MiniMax M3100100100532275.0%
Gemini 3 Flash (Preview)1001008969071.5%
Xiaomi MIMO v2.5100100100411270.6%
Ministral 3 8B10010072502870.2%
Claude Haiku 4.510010010049069.9%
Z.AI GLM 5 Turbo100878675069.6%
Gemma 4 26B100998657068.4%
Claude Opus 5 (Reasoning, Low)10010088291766.9%
DeepSeek V4 Flash (Reasoning)10010010029065.8%
Claude Sonnet 510010079262165.1%
Claude Haiku 5.5 (Adaptive)10010010025064.9%
Ministral 8B1001009132064.7%
Gemini 3.1 Flash Lite10010010010061.9%
Claude Sonnet 4.6 (Reasoning)1001008029061.7%
Claude Opus 4.71001001000060.0%
DeepSeek V3.11001007015056.9%
Z.AI GLM 4.795824720048.7%
Z.AI GLM 4.7 Flash10071480043.7%
Claude Opus 4.7 (Reasoning)908600035.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)10010010010010099.9%
Xiaomi MIMO v2.5 Pro1001001001009799.4%
Claude Opus 4.61001001001009699.3%
Claude Opus 4.7 (Reasoning)1001001001009599.0%
MiniMax M31001001001009298.5%
Llama 3.1 70B1001001001009298.5%
Cohere Command R+ (Aug. 2024)1001001001009298.5%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009097.9%
Qwen 3.7 Max1001001001008897.6%
Qwen 3.8 27B (Reasoning, XHigh)1001001001008897.6%
Mistral Medium 3.5 (Reasoning)1001001001008897.6%
Qwen 3 32B100100100968496.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001008096.0%
Gemma 4 31B (Reasoning)1001001001007795.3%
DeepSeek V4.1 Flash (Reasoning, High)1001001001007294.4%
Kimi K3 (Reasoning, High)1001001001007294.4%
ByteDance Seed 1.61001001001006893.7%
Mistral Large 4.0100100100947593.7%
DeepSeek V4 Flash (Reasoning)1001001001006893.6%
Qwen 3.6 27B1001001001006693.2%
Claude Opus 4.8 (Reasoning, Low)1001001001006693.2%
Mistral Large 3100100100868093.0%
Thinking Machines Inkling Small (Reasoning, High)1001001001006492.8%
Gemini 2.5 Flash Lite1001001001006492.8%
Claude Opus 51001001001005891.6%
Z.AI GLM 4.6100100100827691.5%
Gemini 3.8 Flash (Reasoning, Medium)1001001001005691.2%
Gemma 3 4B100100100807691.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001005090.0%
Qwen 3.5 Flash100100100757489.8%
Qwen 3.5 35B1001001001004989.8%
Z.AI GLM 5.11001001001004789.5%
Gemini 2.5 Flash (Reasoning)1001001001004789.4%
Claude Sonnet 5.5 (Reasoning)100100100776889.0%
DeepSeek V4 Flash100100100895588.8%
Claude Opus 4.8 (Reasoning)10010097944687.6%
Claude Opus 41001001001003486.8%
Mistral Large 210010091727186.8%
Z.AI GLM 5.3 (Reasoning, Max)100100100904486.7%
Claude Sonnet 4.51001001001003186.1%
Mistral NeMO1001001001002985.8%
Claude Sonnet 4.6 (Reasoning)1001001001002885.6%
Gemini 2.5 Flash1001001001002384.6%
Gemini 3 Flash (Preview, Reasoning)100100100814184.6%
Qwen 3.5 27B1001001001002084.0%
DeepSeek V3.21001001001001983.7%
Kimi K3 (Reasoning, Low)1001001001001783.5%
Qwen 2.5 72B100100100793783.2%
Aion 2.01001001001001482.7%
Gemma 3 12B100100100100881.5%
Mistral Small 4 (Reasoning)10010090813681.4%
MiniMax M2.7100100100100781.4%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100581.0%
ByteDance Seed 2.0 Lite100100100100480.8%
Gemini 3.1 Flash Lite (Reasoning)100100100574680.7%
Claude Opus 4.7100100100712980.0%
Aion 3.5 Mini (Reasoning, High)100100100100080.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100080.0%
ByteDance Seed 1.6 Flash100100100100080.0%
Ministral 3 3B100100100100080.0%
DeepSeek V3.1100100100802079.9%
GPT-4o Mini (temp=0)1001009694478.8%
Gemini 3.5 Flash (Reasoning, Minimal)10010010092078.5%
DeepSeek V3 (2024-12-26)10010010091078.1%
Gemini 3.1 Flash Lite10010010085077.0%
Claude Haiku 4.5100100100671776.7%
Laguna S 2.1100100100513276.6%
Mistral Small 410010010079075.8%
Aion 3.010010010071074.2%
Arcee AI: Trinity Mini1001009271072.6%
DeepSeek V4 Pro10010073474172.4%
Z.AI GLM 5 Turbo10010010060072.0%
Mistral Small 3.2 24B10010010053070.6%
Gemma 4 31B10010010052070.4%
Gemma 4 26B (Reasoning)10010010046069.2%
MiniMax M2.510010010040068.1%
Claude Opus 4.51001008648568.0%
Ministral 3B10010010039067.9%
Gemini 3.1 Flash Lite (Preview)100100100151565.9%
Qwen 3 235B A22B Instruct 25071001009229064.3%
Claude Sonnet 4.61009454511162.1%
Z.AI GLM 51001001000060.0%
Gemini 2.5 Flash Lite (Reasoning)1001001000060.0%
Gemma 3 27B1001001000060.0%
Laguna XS 2.11001001000060.0%
GPT-4.1 Nano100100735055.8%
Gemma 4 26B100827218054.3%
Cydonia 24B V4.1100814739053.4%
Ministral 3 14B10088640050.4%
Gemini 2.5 Pro1001002611047.4%
Gemini 3 Flash (Preview)100684619046.6%
Ministral 8B10083330043.3%
Ministral 3 8B10062290038.2%
Z.AI GLM 4.71004700029.4%
Xiaomi MIMO v2.51001300022.5%
Z.AI GLM 4.7 Flash622100016.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
ByteDance Seed 2.0 Lite1001001001009999.8%
Kimi K2.61001001001009899.6%
Nemotron 3 Super1001001001009799.3%
Z.AI GLM 4.71001001001009699.3%
Qwen 3.6 27B1001001001009498.8%
Claude Sonnet 4.51001001001009398.7%
Z.AI GLM 5.11001001001009298.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009298.3%
Claude Opus 5.5 (Reasoning)1001001001008997.8%
Claude Sonnet 51001001001008997.8%
Laguna XS 2.11001001001008997.8%
Qwen 3.5 Flash1001001001008897.6%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001008897.6%
Z.AI GLM 4.51001001001008797.4%
Z.AI GLM 4.5 Air1001001001008697.2%
Cohere Command R+ (Aug. 2024)1001001001008496.8%
DeepSeek V3.21001001001008496.7%
Gemini 3.5 Flash (Reasoning)1001001001007895.6%
Claude Opus 4.5100100100968095.2%
Claude Sonnet 4.6 (Reasoning)1001001001007595.0%
Claude Haiku 4.5100100100908494.8%
Z.AI GLM 51001001001007394.7%
Arcee AI: Trinity Mini1001001001007194.1%
Gemma 3 27B1001001001007094.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006893.6%
Hermes 3 405B1001001001006793.3%
Claude Opus 5 (Reasoning)1001001001006693.2%
Mistral Medium 3.5 (Reasoning)1001001001006592.9%
Gemini 3.1 Flash Lite (Preview)100100100848092.9%
DeepSeek V4 Pro (Reasoning)1001001001006092.1%
Hy4 Preview (Reasoning, High)1001001001005991.8%
Gemini 2.5 Flash (Reasoning)1001001001005490.9%
DeepSeek V4 Pro100100100777790.8%
Claude Sonnet 5 (Reasoning, Low)1001001001005390.7%
Cydonia 24B V4.11001001001005390.6%
Aion 3.0 Mini1001001001005290.4%
Gemma 3 4B100100100757590.1%
Gemini 3 Flash (Preview, Reasoning)1001001001005090.0%
Gemma 4 31B1001001001004889.7%
Aion 3.01001001001004789.3%
Ministral 8B100100100915388.9%
DeepSeek V4 Flash1001001001004388.6%
ByteDance Seed 1.6 Flash100100100934888.1%
Gemini 2.5 Flash Lite1001001001003486.9%
Aion 3.5 Mini (Reasoning, High)1001001001003386.7%
GPT-4.1 Nano1001001001003086.0%
Mistral Large 3100100100913885.9%
Gemini 3 Flash (Preview)1001001001002985.8%
Mistral Medium 3.1100100100983185.8%
Claude Sonnet 5 (Reasoning)1001001001002084.0%
Claude Opus 4.8 (Reasoning)100100100962183.5%
Ministral 3 14B1001001001001583.0%
Aion 2.0100100100833082.6%
MiniMax M3100100100813182.4%
Claude Opus 4.7 (Reasoning)100100100585181.8%
Mistral NeMO100100100931581.6%
Ministral 3 8B1008884736281.4%
Gemini 2.5 Pro100100100644080.8%
Claude Sonnet 4.6100100100100080.0%
Gemma 4 26B100100100100080.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100080.0%
Mistral Small 4100100100100080.0%
Gemini 3.1 Flash Lite100100100702178.2%
MiniMax M2.5100100100652678.2%
Gemma 3 12B10010010086478.0%
Xiaomi MIMO v2.510010072655377.9%
Thinking Machines Inkling Small (Reasoning, High)100100100492474.6%
Ministral 3B1001008579072.8%
Z.AI GLM 4.7 Flash10010087531170.0%
Kimi K3 (Reasoning, High)100100100282270.0%
Gemini 2.5 Flash Lite (Reasoning)10010086312668.7%
Kimi K3 (Reasoning, Low)10010010037067.5%
Z.AI GLM 5 Turbo10010010031667.3%
Claude Opus 4.71001009536066.2%
Aion 3.5 (Reasoning, High)1001009129064.0%
MiniMax M2.710010010016063.1%
Mistral Small 3.2 24B1001001006061.2%
Z.AI GLM 4.61001001000060.0%
Llama 3.1 70B1001001000060.0%
Claude Opus 51001004737056.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemini 2.5 Flash Lite1001001001009899.6%
Xiaomi MIMO v2.6 Flash1001001001009398.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009298.5%
MiniMax M2.51001001001009298.3%
Qwen 3.6 27B1001001001009198.3%
ByteDance Seed 1.6 Flash1001001001008897.7%
Z.AI GLM 5.2 (Reasoning, High)100100100998897.6%
Gemini 3.6 Flash (Reasoning)1001001001008797.4%
Claude Sonnet 4.61001001001008797.4%
Claude Sonnet 5 (Reasoning, Low)1001001001008597.0%
ByteDance Seed 2.0 Mini1001001001008597.0%
Ministral 8B1001001001008496.8%
Z.AI GLM 5.11001001001008196.2%
Claude Opus 4.6 (Reasoning)100100100948495.5%
Claude Opus 4.61001001001007795.3%
Mistral Medium 3.1100100100978095.2%
Gemini 3.7 Flash (Reasoning, Medium)1001001001007595.0%
Gemini 3.5 Flash (Reasoning)1001001001007394.7%
Qwen 3.5 Flash1001001001007093.9%
WizardLM 2 8x22b1001001001006593.1%
Aion 3.5 Mini (Reasoning, High)1001001001006091.9%
Claude Opus 5 (Reasoning)1001001001006091.9%
Z.AI GLM 4.7 Flash1001001001004989.9%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100767089.2%
Qwen 3 32B1001001001004689.2%
Aion 2.01001001001004188.3%
DeepSeek V3.2100100100845587.9%
Claude Sonnet 5 (Reasoning)1001001001003987.9%
Mistral Large 31001001001003887.6%
DeepSeek V3 (2025-03-24)1001001001003787.5%
ByteDance Seed 2.0 Lite1001001001003687.3%
Claude Opus 4.5100100100954087.1%
Claude Opus 4.8 (Reasoning)10010080797787.0%
Claude Opus 4.8 (Reasoning, Low)10010090806687.0%
Mistral Small 4 (Reasoning)100100100973286.0%
Claude Opus 5 (Reasoning, Low)100100100972985.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001002484.8%
DeepSeek V4 Flash (Reasoning)100100100675584.3%
Z.AI GLM 5 Turbo1001001001002184.2%
GPT-4o Mini (temp=1)1001001001001983.8%
Gemini 2.5 Flash (Reasoning)1001001001001182.2%
Qwen 2.5 72B100100100575381.8%
Mistral NeMO10010092674180.1%
Qwen 3.5 27B100100100100080.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100080.0%
Claude Sonnet 4.5100100100100080.0%
MiniMax M2.7100100100100080.0%
DeepSeek-V2 Chat100100100100080.0%
Gemini 2.5 Flash100100100100080.0%
Arcee AI: Trinity Mini100100100100080.0%
Laguna S 2.110010010098179.9%
Xiaomi MIMO v2.510010010098079.6%
Gemini 3 Flash (Preview, Reasoning)100100100702679.3%
Claude Sonnet 410010010095078.9%
Hermes 3 70B100100100682578.5%
Gemma 4 26B (Reasoning)100100100702178.2%
DeepSeek V4.1 Flash (Reasoning, High)10010010090077.9%
Z.AI GLM 5100100100642577.7%
GPT-4.1 Nano1001009593077.7%
Gemini 3 Flash (Preview)1001009981877.6%
GPT-4o, Aug. 6th (temp=0)100100100771077.2%
Claude Haiku 4.5100100100523377.0%
Aion 3.0100100100433876.2%
Mistral Medium 3.510010010081076.2%
Gemma 4 26B10010010068173.9%
Gemini 2.5 Flash Lite (Reasoning)10010010060071.9%
Mistral Large 210010093471971.8%
Kimi K3 (Reasoning, High)10010010056371.8%
Claude Sonnet 4.6 (Reasoning)1001009463071.3%
Aion 3.0 Mini10010010055071.0%
DeepSeek V4 Flash10010010047069.3%
Kimi K3 (Reasoning, Low)10010010041068.3%
Aion 3.5 (Reasoning, High)10010010040068.1%
Ministral 3 8B10010010037067.5%
Llama 3.1 70B10010010035066.9%
MiniMax M3100100100171566.4%
DeepSeek V3.110010058512166.0%
Mistral Medium 3.5 (Reasoning)10010010019063.7%
Mistral Small 41001007128059.9%
Ministral 3 14B1001004746058.6%
Gemini 3.1 Flash Lite1001007610057.1%
Gemma 4 31B (Reasoning)1001005426055.9%
Gemini 3.1 Flash Lite (Reasoning)1001004237055.9%
Claude Sonnet 510090807055.5%
Gemini 2.5 Pro1005342383253.1%
Claude Opus 5100100487051.0%
Gemini 3.1 Flash Lite (Preview)1001002617048.6%
Claude Opus 4.78677680046.1%
DeepSeek V4 Pro1001001611045.3%
Gemma 3 12B10065488044.2%
Gemma 3 4B10094270044.2%
Ministral 3 3B100100150043.0%
Mistral Small 3.2 24B10010000040.0%
Ministral 3B10010000040.0%
Z.AI GLM 4.610045250034.1%
Gemma 3 27B10057110033.6%
Gemma 4 31B984700029.0%
Claude Opus 4.7 (Reasoning)843200023.1%
Z.AI GLM 4.7891085022.5%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Claude Opus 4.6 (Reasoning)1001001001009799.4%
Claude Haiku 5.5 (Adaptive)1001001001009498.8%
DeepSeek V3.21001001001009398.6%
GPT-5.4 Nano (Reasoning, Low)100100100969498.1%
Claude Opus 4.61001001001009098.0%
Qwen 3.8 27B (Reasoning, XHigh)1001001001008897.6%
Gemini 3.1 Flash Lite100100100979097.4%
Qwen 3 32B1001001001008697.3%
Gemini 2.5 Flash (Reasoning)1001001001008597.0%
GPT-5.4 Nano1001001001008597.0%
Claude Sonnet 5 (Reasoning)1001001001008496.7%
Hermes 3 70B1001001001008496.7%
Xiaomi MIMO v2.6 Flash1001001001008095.9%
Muse Spark 1.3 (Reasoning, Medium)1001001001007995.8%
GPT-5.4 Mini (Reasoning, Low)100100100948495.6%
ByteDance Seed 1.6 Flash1001001001007795.4%
GPT-4.1 Nano1001001001007795.3%
Z.AI GLM 5 Turbo1001001001007695.2%
Mistral Large 4.0 (Reasoning)1001001001007494.8%
Kimi K2.51001001001007494.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001007494.7%
Qwen 3.5 9B1001001001007494.7%
Aion 3.0 Mini100100100947894.3%
Qwen 3.5 397B A17B1001001001006592.9%
Aion 2.01001001001006592.9%
Qwen 3.5 Plus (2026-02-15)1001001001006392.6%
DeepSeek V4 Pro100100100917192.4%
Mistral Large 4.01001001001006292.3%
Aion 3.5 Mini (Reasoning, High)100100100996192.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100847691.9%
Hy4 Preview (Reasoning, High)1001001001005991.9%
Xiaomi MIMO v2.5 Pro100100100817891.6%
Gemini 3.1 Pro (Preview)10010093917191.0%
DeepSeek V3 (2024-12-26)1001001001005390.6%
MiniMax M2.710010094817890.5%
Qwen 3.6 Flash1001001001005190.3%
Gemma 3 4B100100100975490.1%
Claude Sonnet 5 (Reasoning, Low)100100100787290.0%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001004789.3%
ByteDance Seed 2.0 Lite1001001001004689.2%
Gemini 2.5 Pro10010099836088.3%
Gemini 3.1 Flash Lite (Preview)100100100736988.3%
Claude Opus 5.5 (Reasoning)1001001001003787.4%
Claude Sonnet 41001001001003787.3%
Writer: Palmyra X51001001001003587.1%
Claude Haiku 4.5100100100864987.0%
Z.AI GLM 4.51001001001003386.7%
Xiaomi MIMO v2.6 Pro1001001001003286.5%
Muse Spark 1.2 (Reasoning, Medium)10010098963886.5%
DeepSeek V4 Flash1001001001003186.2%
Mistral Small 4 (Reasoning)1001001001002384.5%
Muse Spark 1.1 (Reasoning, Medium)10010095804784.4%
Mistral Medium 3.5100100100684983.3%
Claude Opus 5100100100714583.1%
Gemini 2.5 Flash100100100961782.7%
Qwen 3.8 Flash (Reasoning)1001001001001082.0%
Mistral Medium 3.1100100100981081.8%
Gemini 3 Flash (Preview)10010082735381.6%
Claude Opus 5 (Reasoning)100100100100881.5%
Z.AI GLM 5.2 (Reasoning, High)10010088803881.2%
Muse Glimmer 30B (Reasoning, Medium)10010096723480.4%
GPT-5.4 Nano (Reasoning)100100100614180.4%
Qwen 3.5 122B100100100100080.0%
DeepSeek V4 Pro (Reasoning)100100100100080.0%
Mistral Small 3.2 24B100100100100080.0%
Z.AI GLM 4.610010083595479.2%
Muse Spark 1.1 (Reasoning, Minimal)100100100682578.6%
Claude Opus 4.510010010093078.6%
DeepSeek V4 Flash 0731 (Reasoning, High)10010077615378.0%
Qwen 3.5 27B1001009594077.8%
Mistral Medium 3.5 (Reasoning)10010010085076.9%
Claude Haiku 5.5 (Reasoning, Medium)10010010084076.8%
Kimi K3 (Reasoning, Low)10010010083076.6%
Z.AI GLM 5.3 (Reasoning, Max)1001009786076.5%
Gemini 3.8 Flash (Reasoning, Medium)100100100463576.3%
Gemini 3.6 Flash (Reasoning)100100100631976.3%
Mistral Large 310010010077075.5%
Claude Opus 4.8 (Reasoning)10010010068073.5%
Laguna S 2.11001008972673.4%
ByteDance Seed 2.0 Mini100100100541273.2%
Gemma 3 27B10010068553170.9%
Qwen 3.6 35B100100100322170.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100272169.7%
Claude Opus 4.7 (Reasoning)1009672423669.2%
Claude Opus 5 (Reasoning, Low)1001009643568.8%
Xiaomi MIMO v2.51001007566068.3%
Kimi K3 (Reasoning, High)10010068393368.1%
Aion 3.5 (Reasoning, High)1001007064066.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)100898459166.5%
MiniMax M2.5100100100211166.2%
Gemini 3.5 Flash (Reasoning)10010087251765.9%
Ministral 3 14B10010010027065.4%
DeepSeek V3.110010010026065.3%
DeepSeek V4.1 Flash (Reasoning, High)100967553064.9%
Gemma 4 31B1001006353063.2%
Qwen 3.5 35B1007159532762.1%
Thinking Machines Inkling Small (Reasoning, High)1001007726060.6%
Claude Sonnet 4.61001001000060.0%
Ministral 3B1001001000060.0%
Gemini 3 Flash (Preview, Reasoning)100836352059.6%
Llama 3.1 70B1001007720059.3%
Aion 3.0100100950059.0%
Ministral 8B1001004840057.6%
Claude Opus 4.71001006616056.4%
Qwen 3.7 Max10010036242156.0%
Qwen 3.5 Flash100100730054.6%
Claude Sonnet 5.5 (Reasoning)10091774054.2%
Gemma 3 12B1001003210248.7%
Z.AI GLM 4.7 Flash100603416041.9%
Gemma 4 31B (Reasoning)10063352040.0%
MiniMax M31009170039.6%
Gemma 4 26B (Reasoning)10060310038.1%
Gemma 4 26B978700036.8%
Z.AI GLM 4.7422550014.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-5100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Opus 5100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
GPT-5.4100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Hermes 3 405B100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral NeMO100100100100100100.0%
DeepSeek V3 (2024-12-26)1001001001009999.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009999.7%
GPT-6 Sol1001001001009699.3%
GPT-5.4 Mini1001001001009298.4%
Aion 3.0 Mini1001001001008997.8%
Cohere Command R+ (Aug. 2024)1001001001008897.6%
Z.AI GLM 4.5 Air1001001001008897.6%
Thinking Machines Inkling (Reasoning)1001001001008797.3%
GPT-4o, Aug. 6th (temp=0)1001001001008697.1%
Mistral Small 410010099978997.1%
WizardLM 2 8x22b1001001001008496.7%
GPT-4.11001001001008396.6%
GPT-5.4 Mini (Reasoning)100100100948796.2%
Hermes 3 70B1001001001008196.2%
GPT-5 Mini1001001001008096.0%
Claude Opus 41001001001007995.9%
Inception Mercury 2100100100898694.9%
GPT-5.4 Nano1001001001007294.4%
Grok 4.20 (Reasoning)1001001001007294.4%
Cydonia 24B V4.11001001001007194.3%
DeepSeek V4 Flash (Reasoning)1001001001007194.2%
Qwen 3.8 27B (Reasoning, XHigh)100100100868594.2%
GPT-5.4 Mini (Reasoning, Low)1001001001006693.3%
GPT-5.4 (Reasoning)100100100887893.3%
Qwen 2.5 72B100100100848192.9%
DeepSeek V3 (2025-03-24)100100100927192.6%
Claude Sonnet 4.510010098976792.3%
GPT-6 Sol (Reasoning, Medium)1001001001005991.9%
Qwen 3.7 Flash (Reasoning)100100100857491.7%
GPT-5.4 Nano (Reasoning, Low)100100100887091.6%
GPT-OSS 120B1001001001005691.2%
Muse Spark 1.3 (Reasoning, Medium)1001001001005390.6%
Grok 4.7 (Reasoning, High)100100100955790.3%
GPT-4o Mini (temp=1)1001001001005190.1%
Mistral Medium 3.5 (Reasoning)100100100945589.9%
Claude Sonnet 5.5 (Reasoning)1001001001004889.6%
Claude Opus 4.8 (Reasoning)10010094924886.7%
Claude Opus 4.510010085786886.1%
Claude Opus 4.8 (Reasoning, Low)10010096844685.2%
Claude Sonnet 5 (Reasoning)100100100636385.0%
Gemma 3 12B10010091825084.5%
DeepSeek V4.1 Flash (Reasoning, High)100100100754684.1%
Kimi K2.51001001001001983.7%
Mistral Large 3100100100862983.1%
Nemotron 3 Nano100100100644882.3%
Qwen 3.8 Flash (Reasoning)10010086764982.2%
Mistral Medium 3.1100100100951682.1%
ByteDance Seed 2.0 Mini100100100674281.8%
DeepSeek-V2 Chat100100100772880.9%
Hy4 Preview (Reasoning, High)100100100861980.9%
Qwen 3.6 35B100100100100080.0%
Llama 3.1 70B100100100100080.0%
Mistral Small 3.2 24B100100100100080.0%
Arcee AI: Trinity Mini100100100100080.0%
Claude Sonnet 5100100100821879.9%
Mistral Small 4 (Reasoning)1009688773679.5%
Grok 4.6 (Reasoning, High)100100100722479.3%
Qwen 3 32B100100100722278.7%
Claude Opus 5 (Reasoning)10010077665078.6%
Gemini 3.5 Flash Lite (Reasoning)10010088545178.5%
Thinking Machines Inkling10010010092078.3%
Qwen 3 235B A22B Instruct 250710010096474677.8%
Gemini 3.8 Flash (Reasoning, Medium)10010086743077.8%
Ministral 3 8B100100100741377.4%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010080604677.0%
Xiaomi MIMO v2.6 Pro1001009986077.0%
Mistral Large 4.010010010078075.6%
DeepSeek V4 Flash10010079722274.8%
Gemini 2.5 Flash10010076722674.7%
GPT-5.4 Nano (Reasoning)10010086642374.6%
Writer: Palmyra X5100100100541774.2%
Qwen 3.5 397B A17B1009272535274.0%
Kimi K3 (Reasoning, High)10010077454373.1%
Qwen 3.6 Max Preview1009380593072.6%
Grok 4.310010071632772.2%
Grok 4.2010010074454071.9%
Z.AI GLM 4.610010087481970.8%
DeepSeek V3.21007979692570.5%
ByteDance Seed 2.0 Lite1001008762069.9%
ByteDance Seed 1.6 Flash1001008062769.9%
Z.AI GLM 5.110010095391269.4%
Claude Sonnet 5 (Reasoning, Low)10010010044068.8%
Z.AI GLM 4.5100949148768.1%
DeepSeek V4 Pro (Reasoning)1001007467068.1%
Claude Haiku 5.5 (Reasoning, Medium)1001009635667.5%
Muse Glimmer 30B (Reasoning, Medium)10010063491865.9%
MiniMax M31009854542365.7%
Laguna S 2.1100797667765.6%
Claude Opus 5 (Reasoning, Low)1001006554063.8%
Qwen 3.5 Plus (2026-02-15)100877846162.6%
DeepSeek V4 Pro 0813 (Reasoning, High)100848344062.3%
Gemini 2.5 Pro100817548762.2%
Aion 2.01001009415061.7%
Xiaomi MIMO v2.6 Flash100837943061.1%
Xiaomi MIMO v2.5100100919060.0%
Laguna XS 2.11009245431959.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100716160058.4%
Gemini 2.5 Flash (Reasoning)10096829257.8%
Gemini 2.5 Flash Lite100100890057.8%
Mistral Large 21001005328256.7%
MiniMax M2.5100887221056.1%
Thinking Machines Inkling Small (Reasoning, High)100966816056.0%
Claude Sonnet 41008353291455.9%
Claude Haiku 5.5 (Adaptive)10010033271955.8%
Claude Sonnet 4.61001004632055.5%
DeepSeek V3.11001003837055.0%
Claude Haiku 5.5 (Reasoning, Max)7831 – – – 54.1%
Claude Haiku 4.510098710053.8%
ByteDance Seed 1.610090790053.7%
Gemini 2.5 Flash Lite (Reasoning)100857210053.4%
Muse Spark 1.1 (Reasoning, Medium)1001003530053.0%
Gemma 3 4B1001003923052.6%
Z.AI GLM 5.3 (Reasoning, Max)100100580051.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)9086820051.5%
Kimi K3 (Reasoning, Low)100100525051.3%
Claude Opus 4.71001003021050.2%
Qwen 3.6 Flash100744828050.1%
Ministral 3 3B10074685049.3%
GPT-4.1 Nano100100430048.7%
Gemini 3.6 Flash (Reasoning, Minimal)1001002616048.5%
Qwen 3.6 27B95903322047.9%
Aion 3.0100615126047.4%
Claude Opus 5.5 (Reasoning)89695219346.5%
Gemini 3.5 Flash (Reasoning, Minimal)100100330046.5%
Muse Spark 1.1 (Reasoning, Minimal)95615222045.9%
Z.AI GLM 5 Turbo100604820045.6%
Aion 3.5 Mini (Reasoning, High)100683717044.3%
Ministral 8B100100130042.5%
Claude Sonnet 4.6 (Reasoning)100100120042.4%
Gemini 3.7 Flash (Reasoning, Medium)75743224040.9%
Claude Opus 4.7 (Reasoning)10076280040.8%
Claude Opus 4.6 (Reasoning)7975380038.4%
Ministral 3 14B100313127037.9%
Muse Spark 1.2 (Reasoning, Medium)10062250037.2%
Qwen 3.5 9B10072110036.6%
Xiaomi MIMO v2.5 Pro10057230036.0%
Z.AI GLM 51006740034.1%
Mistral Large 4.0 (Reasoning)10043252034.1%
Claude Haiku 5.5 (Reasoning, Low)10000 – – 33.5%
Z.AI GLM 4.71005780032.9%
Claude Opus 4.68962130032.8%
MiniMax M2.790242315932.4%
Aion 3.5 (Reasoning, High)10041170031.7%
Z.AI GLM 5.2 (Reasoning, High)1005300030.6%
Gemini 3.1 Flash Lite1005100030.2%
Qwen 3.5 Flash1004900029.8%
Gemini 3.1 Flash Lite (Preview)7340280028.2%
Gemini 3 Flash (Preview)5946260026.3%
Qwen 3.5 Plus (2026-04-20)100760022.7%
DeepSeek V4 Pro100800021.5%
Z.AI GLM 4.7 Flash771700018.9%
Gemini 3.6 Flash (Reasoning)4533150018.6%
Gemini 3.1 Pro (Preview)691260017.4%
Gemini 3.1 Flash Lite (Reasoning)363450014.9%
Qwen 3.5 122B63000012.5%
Gemma 3 27B50830012.3%
Ministral 3B61000012.2%
Qwen 3.5 27B54000010.9%
Qwen 3.5 35B47500010.4%
Gemma 4 26B (Reasoning)4600009.1%
DeepSeek V4 Flash 0731 (Reasoning, High)4100008.1%
Gemma 4 26B3300006.5%
Gemini 3 Flash (Preview, Reasoning)3000006.0%
Gemma 4 31B (Reasoning)2500004.9%
Gemini 3.5 Flash (Reasoning)750002.4%
Gemma 4 31B1200002.3%
Qwen 3.7 Max700001.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Mistral Small 4 (Reasoning)10010010010010099.9%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 99.7%
Hy4 Preview (Reasoning, High)1001001001009799.4%
GPT-5.11001001001009799.3%
Z.AI GLM 5.11001001001009699.2%
Qwen 3 32B1001001001009398.7%
Mistral Medium 3.5 (Reasoning)1001001001009398.6%
Qwen 3.5 Plus (2026-02-15)1001001001009298.5%
Claude Opus 5 (Reasoning, Low)1001001001009198.1%
Gemma 3 27B1001001001009097.9%
GPT-5.4 Mini (Reasoning, Low)1001001001008797.4%
Gemma 3 12B1001001001008496.7%
Mistral NeMO1001001001008496.7%
Qwen 3.6 35B1001001001008096.0%
Xiaomi MIMO v2.6 Pro100100100928695.5%
GPT-6 Luna (Reasoning, Medium)1001001001007695.1%
Qwen 3.6 Flash1001001001007595.0%
Xiaomi MIMO v2.51001001001007494.7%
Thinking Machines Inkling (Reasoning)1001001001007394.6%
Gemini 2.5 Flash (Reasoning)1001001001007294.5%
DeepSeek V4 Flash100100100918094.0%
Aion 3.0100100100987093.6%
Mistral Medium 3.51001001001006893.5%
Gemini 2.5 Flash Lite1001001001006793.3%
GPT-6 Sol100100100887893.3%
Qwen 3.5 Flash10010098848393.0%
GPT-5.4 Mini (Reasoning)1001001001006593.0%
Writer: Palmyra X51001001001006593.0%
Mistral Large 4.0100100100976792.8%
ByteDance Seed 2.0 Mini100100100976692.7%
GPT-6 Luna (Reasoning, High)1001001001006392.7%
Kimi K3 (Reasoning, High)100100100966792.6%
Qwen 3.6 Max Preview1001001001006192.2%
DeepSeek V4 Pro (Reasoning)1001001001006192.1%
DeepSeek V4 Pro1001001001006092.0%
Gemma 3 4B1001001001005891.6%
GPT-5.4 Nano (Reasoning)1001001001005891.6%
Aion 2.01001001001005891.5%
Gemma 4 31B1001001001005791.5%
Claude Opus 4.8 (Reasoning, Low)1001001001005691.2%
GPT-6 Luna1001001001005590.9%
Claude Haiku 4.510010090847990.7%
Hermes 3 405B1001001001005190.1%
Ministral 8B1001001001004889.7%
Muse Spark 1.2 (Reasoning, Medium)100100100806889.5%
Qwen 3.8 Flash (Reasoning)1001001001004789.5%
Llama 3.1 70B1001001001004488.8%
Qwen 3.5 397B A17B1001001001004388.6%
Gemini 2.5 Flash1001001001004388.6%
Gemini 3.8 Flash (Reasoning, Medium)1001001001004188.1%
Gemini 3.5 Flash (Reasoning)100100100835787.9%
GPT-5.4 Mini1001001001003887.6%
Thinking Machines Inkling1001001001003787.5%
DeepSeek V4 Flash (Reasoning)10010092816487.4%
Claude Opus 5100100100736487.3%
Claude Opus 4.51001001001003486.8%
Z.AI GLM 5.2 (Reasoning, High)100100100765886.7%
Muse Spark 1.3 (Reasoning, Medium)10010095756386.5%
DeepSeek-V2 Chat1001001001003186.2%
Aion 3.0 Mini1001001001003086.0%
Claude Opus 4.6100100100765385.9%
Mistral Large 31001001001002985.8%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001002384.6%
Muse Glimmer 30B (Reasoning, Medium)100100100715184.2%
Qwen 3.5 122B10010094873683.5%
Qwen 3.5 27B100100100981682.9%
GPT-6.1 Sol (Reasoning, Medium)100100100942082.9%
Kimi K2.510010075696982.7%
Claude Opus 4100100100674281.8%
Gemini 2.5 Pro10010084665681.1%
DeepSeek V3 (2024-12-26)100100100891681.0%
Gemini 3.5 Flash (Reasoning, Minimal)10010075676381.0%
Ministral 3 3B100100100653580.0%
Xiaomi MIMO v2.5 Pro100100100100080.0%
Laguna XS 2.1100100100100080.0%
Z.AI GLM 4.710010010099079.9%
Xiaomi MIMO v2.6 Flash100100100564379.8%
DeepSeek V3.2100100100584079.7%
ByteDance Seed 2.0 Lite1001009695278.5%
Claude Sonnet 5.5 (Reasoning)10010010090078.0%
Mistral Small 4100100100533577.8%
Z.AI GLM 5 Turbo10010096652777.5%
Claude Haiku 5.5 (Reasoning, Medium)10010010086077.2%
MiniMax M2.71009581704077.2%
Mistral Medium 3.1100100100591875.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010010077075.3%
DeepSeek V4.1 Flash (Reasoning, High)10010097681075.1%
MiniMax M310010010075075.1%
Z.AI GLM 51001009082374.9%
Claude Opus 4.6 (Reasoning)1001009182074.7%
Ministral 3B1007966646274.0%
Gemma 4 26B (Reasoning)10010010063072.5%
Gemma 4 26B100100100441772.2%
Z.AI GLM 4.7 Flash10010010061072.1%
Qwen 3.5 35B10010010056071.3%
Aion 3.5 (Reasoning, High)1001009066071.3%
Muse Spark 1.1 (Reasoning, Medium)10010010050070.0%
Claude Opus 5.5 (Reasoning)100878178069.1%
Gemini 3.1 Flash Lite100100100291668.9%
Z.AI GLM 5.3 (Reasoning, Max)10010010042068.4%
Gemma 4 31B (Reasoning)100948660068.1%
Aion 3.5 Mini (Reasoning, High)10010062621567.9%
Mistral Large 210010086331767.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010067442366.6%
Gemini 3 Flash (Preview)10010064332063.4%
Claude Opus 5 (Reasoning)928665601162.8%
MiniMax M2.5100966353062.6%
Claude Sonnet 5 (Reasoning)10010063311060.8%
Gemini 3.1 Flash Lite (Reasoning)1001008716060.4%
DeepSeek V3.110010041261857.1%
Claude Sonnet 4.6 (Reasoning)1001007211056.7%
Claude Sonnet 5886653482155.1%
Gemini 3 Flash (Preview, Reasoning)100854635854.9%
DeepSeek V4 Flash 0731 (Reasoning, High)99926516054.3%
Claude Opus 4.7100100450049.0%
Claude Sonnet 5 (Reasoning, Low)1001002615048.1%
Ministral 3 8B100100330046.5%
Qwen 3.5 9B1005323151240.4%
Claude Opus 4.7 (Reasoning)10010000040.0%
Muse Spark 1.1 (Reasoning, Minimal)10033170030.1%
Claude Sonnet 4.6854600026.0%
Z.AI GLM 4.65938253025.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
GPT-5.4 Nano1001001001009899.7%
Arcee AI: Trinity Mini1001001001009699.2%
GPT-4.1 Mini1001001001009599.0%
Grok 4.5 (Reasoning, High)1001001001009298.5%
Gemini 3.6 Flash (Reasoning)1001001001008997.9%
GPT-5.4 Nano (Reasoning)1001001001008997.8%
Claude Opus 51001001001008897.5%
Qwen 3.6 27B100100100998696.9%
DeepSeek V3 (2024-12-26)1001001001008496.8%
Grok 4.3100100100968896.7%
Claude Sonnet 5.5 (Reasoning)1001001001008396.6%
Thinking Machines Inkling (Reasoning)1001001001008296.5%
Llama 3.1 70B1001001001008096.0%
Claude Sonnet 4.51001001001007995.8%
Aion 3.0 Mini1001001001007595.0%
GPT-5.4 Mini (Reasoning, Low)1001001001007594.9%
Cohere Command R+ (Aug. 2024)1001001001007494.8%
Mistral Large 4.01001001001007394.7%
Qwen 2.5 72B1001001001006993.9%
GPT-5.4 Mini (Reasoning)100100100967393.9%
Mistral NeMO100100100888093.6%
GPT-4o, Aug. 6th (temp=0)1001001001006893.6%
Mistral Small 4 (Reasoning)100100100927493.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006392.6%
Grok 4.20 (Reasoning)100100100897392.3%
Gemma 3 4B1001001001006092.0%
Grok 4.7 (Reasoning, High)1001001001005691.3%
Qwen 3 235B A22B Instruct 25071001001001005390.6%
GPT-4o Mini (temp=1)1001001001005290.4%
Claude Opus 4.8 (Reasoning, Low)1001001001005090.0%
ByteDance Seed 1.6100100100964688.4%
Claude Opus 5.5 (Reasoning)100100100717188.3%
ByteDance Seed 2.0 Lite100100100806288.3%
Gemini 2.5 Flash Lite (Reasoning)1001001001004188.1%
Qwen 3.6 Max Preview1001001001003887.7%
Thinking Machines Inkling10010094756186.1%
Qwen 3.7 Flash (Reasoning)1001001001002985.8%
GPT-4o Mini (temp=0)100100100923785.8%
Grok 4.6 (Reasoning, High)10010077747384.8%
Claude Sonnet 5 (Reasoning, Low)100100100774784.8%
GPT-5.4 Mini100100100843784.4%
Qwen 3.6 35B100100100932884.4%
Gemma 3 27B100100100972283.9%
ByteDance Seed 2.0 Mini100100100833683.8%
Claude Haiku 5.5 (Adaptive)100100100674381.8%
Laguna XS 2.1100100100713881.8%
Qwen 3.7 Max100100100732880.2%
Z.AI GLM 5.2 (Reasoning, High)10010093931580.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100080.0%
Qwen 3.5 Plus (2026-04-20)100100100100080.0%
Aion 3.0100100100100080.0%
MiniMax M2.7100100100100080.0%
DeepSeek V3 (2025-03-24)100100100100080.0%
Hermes 3 70B100100100100080.0%
Claude Opus 5 (Reasoning)10010084743678.9%
Gemini 3.1 Pro (Preview)1009276655978.4%
DeepSeek V4 Pro 0813 (Reasoning, High)10010010084076.9%
Kimi K3 (Reasoning, High)10010010083076.6%
Qwen 3.6 Flash10010084772176.4%
Aion 3.5 Mini (Reasoning, High)1009087802576.4%
Qwen 3.5 Plus (2026-02-15)10010099701376.3%
Mistral Medium 3.1100100100621775.8%
Mistral Large 4.0 (Reasoning)1009891701975.8%
Claude Opus 4.51009870595075.5%
Claude Sonnet 5100100100442874.3%
DeepSeek V4 Flash 0731 (Reasoning, High)10010070643373.5%
Z.AI GLM 4.510010096482173.1%
Z.AI GLM 4.5 Air10010010058071.6%
ByteDance Seed 1.6 Flash10010010056071.3%
MiniMax M31001009258671.2%
Claude Opus 4.8 (Reasoning)1001007977071.2%
Gemma 3 12B10010010052070.4%
Gemini 3.6 Flash (Reasoning, Minimal)1001008268070.1%
Mistral Large 310010073403669.8%
DeepSeek V4 Flash10010010047069.5%
Gemini 3.5 Flash (Reasoning, Minimal)100100100321268.7%
Thinking Machines Inkling Small (Reasoning, High)1001008656068.3%
Qwen 3.5 Flash10010010037067.5%
WizardLM 2 8x22b1001007364067.5%
Muse Spark 1.1 (Reasoning, Minimal)100100100211767.4%
DeepSeek V3.2100908854066.4%
GPT-4.1 Nano1001007755066.3%
Mistral Small 3.2 24B1008978313065.6%
DeepSeek V4.1 Flash (Reasoning, High)1001009235065.5%
Aion 2.010010010025065.1%
Claude Opus 4.610010061431764.0%
Mistral Small 4100797263062.6%
Claude Opus 4.7 (Reasoning)1001008722262.3%
Mistral Medium 3.5 (Reasoning)1009959431162.1%
Claude Opus 41001001006462.0%
Grok 4.20100757158561.8%
Claude Opus 4.6 (Reasoning)1001008623061.7%
Claude Opus 5 (Reasoning, Low)1008046453260.5%
Xiaomi MIMO v2.6 Flash1001007825060.5%
Kimi K3 (Reasoning, Low)1001001000060.0%
DeepSeek V4 Pro (Reasoning)1001001000060.0%
Qwen 3.5 9B1001001000060.0%
Z.AI GLM 5.3 (Reasoning, Max)100796159059.8%
Muse Glimmer 30B (Reasoning, Medium)1009563211859.4%
Ministral 3 3B100100828058.0%
Claude Sonnet 4100806841057.8%
Mistral Medium 3.5100846138056.6%
Xiaomi MIMO v2.51001004535056.1%
Gemini 3.5 Flash Lite (Reasoning)90854643052.9%
Z.AI GLM 5100100537052.2%
Laguna S 2.11009233191752.1%
Xiaomi MIMO v2.5 Pro10081750051.2%
Muse Spark 1.1 (Reasoning, Medium)10084720051.2%
Mistral Large 2100815223051.2%
Muse Spark 1.2 (Reasoning, Medium)100746021051.1%
Ministral 8B100865317051.1%
Ministral 3 14B10077750050.5%
Gemini 3.1 Flash Lite76694948749.9%
Aion 3.5 (Reasoning, High)100844616049.3%
Z.AI GLM 5.193534540547.1%
Z.AI GLM 4.710068635047.1%
DeepSeek V3.1100992611047.1%
Gemma 4 26B10086480046.8%
Gemini 3 Flash (Preview, Reasoning)100853211045.8%
Claude Haiku 4.5100100260045.1%
MiniMax M2.510072520044.9%
DeepSeek V4 Flash (Reasoning)100100168044.8%
Cydonia 24B V4.110080430044.6%
Claude Sonnet 5 (Reasoning)100593428044.2%
Claude Opus 4.7100643223043.9%
Claude Sonnet 4.6100494228043.9%
Gemini 3.1 Flash Lite (Preview)78454541041.6%
Ministral 3B10079290041.6%
DeepSeek V4 Pro10060413040.9%
Ministral 3 8B10010000040.0%
Qwen 3.5 122B10050490039.9%
Gemini 3.1 Flash Lite (Reasoning)1009100038.1%
Gemma 4 31B7563510037.9%
Qwen 3.5 397B A17B77751414035.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)1006270033.9%
Z.AI GLM 4.7 Flash1006800033.6%
Gemma 4 26B (Reasoning)1005030030.6%
Z.AI GLM 5 Turbo6239340027.0%
Gemini 2.5 Pro9619120025.4%
Qwen 3.5 27B873900025.2%
Gemini 3.5 Flash (Reasoning)1002100024.1%
Qwen 3.5 35B565100021.4%
Claude Sonnet 4.6 (Reasoning)100000020.0%
Z.AI GLM 4.658000011.6%
Gemma 4 31B (Reasoning)341600010.0%
Gemini 3 Flash (Preview)100000.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
GPT-4.1100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Ministral 3 3B100100100100100100.0%
DeepSeek V4 Flash1001001001009999.9%
GPT-5.4 Nano (Reasoning, Low)1001001001009899.6%
Qwen 3.5 122B1001001001009799.4%
Grok 4.3 (Reasoning)1001001001009398.6%
GPT-5.4 Nano (Reasoning)1001001001009198.1%
Gemma 4 31B (Reasoning)1001001001009098.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008997.8%
o4 Mini1001001001008697.3%
Qwen 3.5 Plus (2026-02-15)1001001001008396.6%
GPT-5.4 Nano100100100919196.6%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001008196.2%
GPT-5.4 Mini (Reasoning, Low)100100100988296.0%
Qwen 3.8 Flash (Reasoning)1001001001007895.7%
Qwen 3.5 Plus (2026-04-20)1001001001007695.2%
Grok 4.31001001001007494.8%
Qwen 3.6 Flash1001001001007394.6%
Z.AI GLM 5.1100100100898494.5%
Kimi K2.61001001001007294.4%
Hermes 3 405B1001001001007194.1%
Gemma 3 27B1001001001007094.0%
Gemma 4 26B (Reasoning)10010093918493.5%
Thinking Machines Inkling1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Ministral 3 14B10010098907793.2%
Z.AI GLM 4.51001001001006392.6%
Qwen 3.6 35B1001001001006091.9%
Aion 3.0 Mini100100100956591.9%
Kimi K3 (Reasoning, High)100100100976291.9%
Mistral Medium 3.51001001001005891.6%
Laguna S 2.11001001001005891.6%
Thinking Machines Inkling Small (Reasoning, High)100100100995991.5%
Gemini 2.5 Flash Lite (Reasoning)1001001001005791.3%
Qwen 3.5 Flash1001001001005691.1%
Qwen 3.7 Max1001001001005591.0%
Claude Opus 4.8 (Reasoning)100100100807590.9%
Muse Glimmer 30B (Reasoning, Medium)1001001001005490.8%
Gemini 3.5 Flash (Reasoning)1001001001005390.5%
Gemma 4 26B1001001001005390.5%
Z.AI GLM 4.5 Air1001001001005390.5%
GPT-6.1 Sol (Reasoning, Medium)1001001001005290.4%
Qwen 2.5 72B1001001001005290.4%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001004789.4%
Claude Sonnet 4.51001001001004789.3%
Claude Haiku 5.5 (Reasoning, Medium)100100100905488.8%
Mistral Large 21001001001004488.8%
Gemini 3.1 Pro (Preview)1001001001004388.6%
Z.AI GLM 5 Turbo1001001001004188.3%
Qwen 3.6 27B1001001001004088.0%
Qwen 3.5 35B100100100796087.9%
Gemini 3.8 Flash (Reasoning, Medium)100100100974087.5%
Nemotron 3 Nano1001001001003787.5%
Mistral Medium 3.1100100100875087.3%
Gemini 2.5 Pro100100100706587.0%
Gemini 3.1 Flash Lite (Reasoning)1001001001003186.1%
Qwen 3.5 397B A17B1001001001002785.5%
Kimi K2.5100100100794584.7%
Thinking Machines Inkling (Reasoning)1001001001002284.3%
Claude Opus 5.5 (Reasoning)10010096636083.8%
Gemini 3 Flash (Preview, Reasoning)1009482776383.2%
Claude Opus 4.510010093635882.9%
Gemini 3.7 Flash (Reasoning, Medium)1001001001001081.9%
Aion 2.010010097832781.6%
Claude Opus 4100100100733481.4%
Hermes 3 70B100100100100681.2%
Xiaomi MIMO v2.6 Pro100100100634281.1%
Z.AI GLM 510010010095980.8%
Gemini 3 Flash (Preview)100100100881680.7%
DeepSeek-V2 Chat10010097555180.6%
Claude Opus 4.61001009999480.4%
Claude Opus 4.7 (Reasoning)100100100100080.0%
Kimi K3 (Reasoning, Low)100100100100080.0%
Claude Opus 4.7100100100100080.0%
DeepSeek V3.1100100100100080.0%
DeepSeek V3 (2025-03-24)100100100100080.0%
Mistral NeMO100100100100080.0%
Gemini 3.6 Flash (Reasoning)100100100494779.2%
Ministral 3 8B10010010094078.8%
Grok 4.6 (Reasoning, High)100100100633178.8%
DeepSeek V3.210010010091078.3%
Claude Opus 5 (Reasoning)10010010091078.1%
Z.AI GLM 4.710010010088077.7%
Claude Haiku 5.5 (Adaptive)100100100652177.3%
Mistral Large 4.0100100100483777.0%
Gemini 2.5 Flash (Reasoning)10010095771276.8%
Mistral Large 310010010084076.7%
Hy4 Preview (Reasoning, High)10010010083076.6%
Qwen 3.8 27B (Reasoning, XHigh)10010010083076.5%
MiniMax M2.7100100100631876.1%
Gemini 3.5 Flash (Reasoning, Minimal)10010090721875.8%
Z.AI GLM 4.6100100100532575.6%
Muse Spark 1.1 (Reasoning, Medium)10010010071575.1%
Claude Opus 5 (Reasoning, Low)10010010073074.7%
Claude Opus 510010010073074.7%
Ministral 8B10010010071074.2%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010010068073.6%
Aion 3.5 Mini (Reasoning, High)1001008877073.0%
Gemini 3.1 Flash Lite1009183513872.4%
DeepSeek V4.1 Flash (Reasoning, High)10010010060071.9%
DeepSeek V3 (2024-12-26)1008371683771.8%
Xiaomi MIMO v2.51001008171070.4%
Xiaomi MIMO v2.6 Flash10010010051070.3%
Z.AI GLM 4.7 Flash1001008163269.4%
Aion 3.0100100100212068.3%
Claude Sonnet 5 (Reasoning)10010010036067.2%
Gemini 3.1 Flash Lite (Preview)10010064363366.7%
Mistral Medium 3.5 (Reasoning)1009375481866.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010079291764.9%
Aion 3.5 (Reasoning, High)1001008038063.7%
Z.AI GLM 5.3 (Reasoning, Max)1008786232063.2%
DeepSeek V4 Pro (Reasoning)10010010015063.1%
Claude Opus 4.6 (Reasoning)1007867461761.5%
DeepSeek V4 Pro98777556061.2%
Muse Spark 1.2 (Reasoning, Medium)959159402061.0%
Claude Sonnet 5.5 (Reasoning)1001001000060.0%
Claude Sonnet 51001001000060.0%
Gemma 3 4B1001007325059.5%
Claude Haiku 4.51001004641057.4%
Qwen 3.5 27B1001003628052.8%
MiniMax M310094670052.2%
Claude Sonnet 4.6 (Reasoning)1001004413051.5%
Muse Spark 1.1 (Reasoning, Minimal)100744621048.2%
DeepSeek V4 Flash (Reasoning)100100250045.1%
Z.AI GLM 5.2 (Reasoning, High)1009300038.6%
Ministral 3B1008500037.0%
Claude Sonnet 5 (Reasoning, Low)10046370036.7%
Claude Sonnet 4.6828020032.9%
Muse Spark 1.3 (Reasoning, Medium)54514311232.2%
MiniMax M2.58645260031.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Hermes 3 70B100100100100100100.0%
GPT-5.5 (Reasoning, Medium)1001001001009999.8%
DeepSeek V3 (2025-03-24)1001001001009899.6%
Qwen 3.7 Flash (Reasoning)1001001001009398.6%
Laguna XS 2.11001001001009298.5%
Mistral Large 4.01001001001008997.8%
GPT-4o Mini (temp=0)1001001001008897.7%
Mistral Medium 3.5 (Reasoning)100100100998897.5%
GPT-5.4 Nano1001001001008797.5%
Grok 4.5 (Reasoning, Low)1001001001008797.3%
Qwen 3.6 27B1001001001008396.5%
Gemini 3.8 Flash (Reasoning, Medium)1001001001008296.4%
ByteDance Seed 1.6 Flash1001001001008096.0%
GPT-5.4 (Reasoning)1001001001007995.8%
Kimi K2.610010094948895.1%
Mistral Large 2100100100948094.8%
Mistral Large 4.0 (Reasoning)100100100996993.8%
Claude Sonnet 4.5100100100947493.7%
Thinking Machines Inkling (Reasoning)100100100868293.7%
Qwen 3 235B A22B Instruct 25071001001001006793.5%
GPT-6 Sol (Reasoning, Medium)100100100887993.3%
Claude Sonnet 41001001001006793.3%
Arcee AI: Trinity Mini1001001001006593.1%
Gemini 3.1 Pro (Preview)100100100848193.0%
Z.AI GLM 5.3 (Reasoning, Max)10010098867992.7%
Grok 4.31001001001006192.2%
DeepSeek V4 Flash100100100916992.1%
Claude Sonnet 5 (Reasoning, Low)100100100986091.8%
GPT-5.4 Mini (Reasoning)100100100847291.2%
Claude Opus 5.5 (Reasoning)1001001001005691.1%
GPT-6 Luna (Reasoning, High)1001001001005591.0%
Claude Opus 5 (Reasoning, Low)1001001001005490.8%
Kimi K3 (Reasoning, High)100100100836790.1%
GPT-5.4 Mini (Reasoning, Low)10010095866989.9%
Mistral Medium 3.11001001001004789.5%
Mistral Small 4 (Reasoning)100100100747389.5%
Qwen 3.8 27B (Reasoning, XHigh)100100100935289.0%
DeepSeek V3.210010096895988.9%
Claude Haiku 5.5 (Reasoning, Low)89 – – – – 88.9%
Hermes 3 405B1001001001004088.1%
Muse Spark 1.1 (Reasoning, Minimal)100100100766387.9%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100875287.7%
Claude Sonnet 5100100100875187.6%
Qwen 3.6 Max Preview10010093776787.5%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
Qwen 2.5 72B100100100864586.2%
Qwen 3.6 Flash10010098884586.2%
Claude Haiku 5.5 (Adaptive)10010098933986.1%
Nemotron 3 Super100100100755385.6%
Gemini 3.7 Flash (Reasoning, Medium)10010094924285.6%
Grok 4.20 (Reasoning)10010081746884.7%
Xiaomi MIMO v2.510010097873583.8%
GPT-5.4 (Reasoning, Low)100100100724282.8%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100644281.2%
Kimi K2.510010088783580.2%
Grok 4.20100100100554580.0%
Gemini 3.5 Flash (Reasoning)100100100100080.0%
Claude Sonnet 5.5 (Reasoning)100100100100080.0%
Mistral Small 4100100100100080.0%
GPT-4.1 Nano100100100100080.0%
Claude Opus 410010010094078.8%
Qwen 3.6 35B100100100702378.7%
Claude Haiku 5.5 (Reasoning, Medium)10010010092078.3%
Gemma 3 4B10010088663076.8%
DeepSeek V4 Pro (Reasoning)10010010083076.6%
MiniMax M2.7100100100443776.4%
Laguna S 2.110010010082076.3%
Claude Opus 4.8 (Reasoning)10010098602276.0%
Z.AI GLM 4.5 Air100100100601875.6%
Mistral Small 3.2 24B100100100443174.8%
Gemini 3.5 Flash Lite (Reasoning)1008784643774.5%
Xiaomi MIMO v2.5 Pro1001009474073.6%
Z.AI GLM 4.51001008478072.5%
Qwen 3.5 Plus (2026-02-15)10010010061072.2%
Claude Opus 4.8 (Reasoning, Low)1001009749069.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001009650069.3%
Qwen 3.5 9B1001007469068.7%
Llama 3.1 70B10010085371667.7%
Claude Opus 5 (Reasoning)10010010038067.6%
Qwen 3.5 397B A17B1009776442067.4%
Aion 3.01001007264067.1%
Mistral Medium 3.510010060561466.1%
Xiaomi MIMO v2.6 Pro1009564561466.1%
Gemini 2.5 Flash Lite10010053532165.5%
Gemini 3.6 Flash (Reasoning)10010010025064.9%
Claude Opus 51001008336063.7%
DeepSeek V4 Pro1008685361263.6%
Claude Sonnet 5 (Reasoning)10010010015063.0%
Mistral NeMO1001007242063.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)1008365481662.3%
GPT-5.4 Mini1001009021062.1%
Thinking Machines Inkling1001001008061.6%
Gemini 3 Flash (Preview)1001006641061.2%
Thinking Machines Inkling Small (Reasoning, High)1001006438060.5%
Qwen 3.5 Flash1001001002060.3%
Gemini 3.1 Flash Lite (Reasoning)1001001000060.0%
Claude Opus 4.6 (Reasoning)100908327059.9%
Gemini 3.5 Flash (Reasoning, Minimal)1001006427058.2%
Xiaomi MIMO v2.6 Flash1008569201658.0%
ByteDance Seed 2.0 Mini100945341057.8%
Gemma 4 31B876851423857.4%
Gemma 4 31B (Reasoning)100100830056.6%
MiniMax M2.5100805744056.2%
Aion 3.0 Mini1001005724056.1%
Claude Haiku 5.5 (Reasoning, Max)56 – – – – 56.0%
Ministral 8B1007156321955.6%
Mistral Large 3100756239155.3%
DeepSeek V4.1 Flash (Reasoning, High)100675844053.5%
Qwen 3.5 Plus (2026-04-20)1001004621053.4%
Muse Spark 1.2 (Reasoning, Medium)1001003526352.7%
Cydonia 24B V4.1100655346052.7%
Claude Opus 4.5100100552051.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100595639050.9%
Gemini 2.5 Flash100100490049.9%
Gemma 3 12B100706314049.3%
Claude Sonnet 4.6100100400048.0%
Gemini 3.1 Flash Lite (Preview)10095395047.9%
Gemma 4 26B100693729047.0%
DeepSeek V3.1100842915045.5%
Aion 3.5 Mini (Reasoning, High)100100179045.1%
Qwen 3.5 35B82775214045.0%
Muse Glimmer 30B (Reasoning, Medium)10096270044.6%
Z.AI GLM 5 Turbo100763113044.0%
Muse Spark 1.1 (Reasoning, Medium)66644339042.3%
Gemini 2.5 Pro1009880041.3%
Claude Opus 4.710010050041.1%
Z.AI GLM 510092102040.8%
DeepSeek V4 Flash (Reasoning)100453521040.1%
Qwen 3 32B10086110039.4%
Claude Opus 4.69153510039.1%
Gemma 4 26B (Reasoning)61554035038.3%
Ministral 3B10066250038.1%
Gemini 3.1 Flash Lite7953478037.3%
Qwen 3.5 27B10059260037.1%
Aion 2.09172210036.9%
MiniMax M36954530035.3%
Gemini 3 Flash (Preview, Reasoning)10048260034.9%
Claude Sonnet 4.6 (Reasoning)7948410033.6%
Claude Opus 4.7 (Reasoning)1006150033.2%
Z.AI GLM 5.2 (Reasoning, High)856900030.8%
Aion 3.5 (Reasoning, High)8558100030.4%
Ministral 3 14B59363122330.4%
Claude Haiku 4.510023210028.7%
Z.AI GLM 5.1974200027.7%
Z.AI GLM 4.61003300026.5%
Kimi K3 (Reasoning, Low)57461711026.5%
Ministral 3 8B646070026.3%
Z.AI GLM 4.7 Flash675600024.7%
Ministral 3 3B4743290023.8%
Qwen 3.5 122B882800023.3%
Z.AI GLM 4.7602780018.9%
Gemma 3 27B611850016.8%
Qwen 3.7 Max4400008.7%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Mistral Small 410010010010010099.9%
Gemini 2.5 Flash Lite (Reasoning)1001001001009999.9%
Claude Opus 41001001001009799.5%
Thinking Machines Inkling1001001001009599.0%
Mistral Large 31001001001009598.9%
GPT-5 Nano1001001001009498.8%
Claude Haiku 5.5 (Reasoning, Low)10010096 – – 98.6%
WizardLM 2 8x22b1001001001009298.5%
Mistral Large 21001001001008697.3%
DeepSeek V4 Flash (Reasoning)1001001001008496.9%
Gemma 4 31B (Reasoning)1001001001008496.7%
Gemini 3 Flash (Preview)1001001001008396.7%
Claude Sonnet 41001001001008396.6%
Gemma 3 4B1001001001008096.0%
Aion 3.5 Mini (Reasoning, High)1001001001007494.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001007394.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001007394.7%
DeepSeek V3.11001001001006593.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001005591.0%
Gemini 2.5 Pro1001001001005591.0%
MiniMax M2.51001001001005490.9%
DeepSeek V4 Pro (Reasoning)1001001001005390.6%
Cohere Command R+ (Aug. 2024)1001001001005290.4%
Claude Opus 4.610010096876189.0%
DeepSeek V4 Pro100100100974688.6%
DeepSeek V3 (2025-03-24)1001001001004188.3%
Claude Haiku 5.5 (Reasoning, Medium)1001001001004088.0%
Claude Opus 4.5100100100944487.6%
Claude Sonnet 4.6 (Reasoning)1001001001003486.9%
Claude Opus 51001001001003486.9%
Xiaomi MIMO v2.5 Pro1001001001002985.8%
Z.AI GLM 4.61001001001002885.6%
Gemma 3 12B1001001001002584.9%
Mistral Medium 3.1100100100714182.4%
Claude Sonnet 4.61001001001001182.2%
Claude Haiku 5.5 (Adaptive)100100100100180.2%
Qwen 3.5 35B100100100100080.0%
Mistral Small 3.2 24B100100100100080.0%
Aion 3.5 (Reasoning, High)10010010092078.5%
Claude Opus 5 (Reasoning)10010083753478.5%
Ministral 3 3B10010010089077.8%
Ministral 3 14B1009477714076.4%
Laguna S 2.110010073604074.7%
Claude Haiku 4.51001007868069.1%
Laguna XS 2.1100817146059.6%
Z.AI GLM 4.7 Flash100100520050.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Z.AI GLM 5 Turbo1001001001009599.1%
DeepSeek V4 Flash (Reasoning)1001001001009298.5%
Mistral Large 4.01001001001008997.9%
Claude Opus 4.8 (Reasoning, Low)1001001001008697.1%
Claude Sonnet 4.61001001001008697.1%
DeepSeek V4.1 Flash (Reasoning, High)1001001001008496.9%
Mistral Medium 3.5 (Reasoning)100100100939196.8%
Mistral NeMO1001001001008396.5%
Nemotron 3 Nano1001001001008296.5%
Claude Sonnet 5.5 (Reasoning)1001001001008096.0%
Claude Sonnet 41001001001008096.0%
Qwen 3 235B A22B Instruct 25071001001001007995.8%
Claude Opus 5 (Reasoning)10010098918895.5%
ByteDance Seed 2.0 Lite1001001001007494.8%
Gemini 2.5 Flash Lite10010097888894.5%
Mistral Small 4 (Reasoning)10010097938194.3%
Claude Opus 4.7100100100957594.1%
Mistral Small 4100100100987294.0%
MiniMax M2.71001001001006793.5%
Aion 2.0100100100877792.9%
Aion 3.5 Mini (Reasoning, High)100100100986492.5%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001005891.6%
Hermes 3 405B1001001001005891.6%
Llama 3.1 70B100100100956291.4%
Ministral 8B1001001001005791.3%
Gemini 3.1 Flash Lite (Preview)1001001001005691.2%
ByteDance Seed 2.0 Mini100100100837290.9%
Ministral 3 8B1001001001005390.7%
Gemma 3 12B100100100797490.6%
Arcee AI: Trinity Mini1001001001005190.1%
Claude Opus 4.610010099916090.0%
Gemini 2.5 Pro1001001001005090.0%
Mistral Medium 3.51001001001005090.0%
Aion 3.010010086818189.5%
Claude Sonnet 5 (Reasoning, Low)1001001001004589.0%
Cohere Command R+ (Aug. 2024)1001001001004488.8%
Gemini 2.5 Flash Lite (Reasoning)100100100845988.6%
Claude Opus 4.6 (Reasoning)100100100974488.2%
Claude Sonnet 51001001001003987.9%
Qwen 3 32B1001001001003887.7%
Gemini 2.5 Flash (Reasoning)1001001001003687.3%
GPT-4.1 Nano100100100855087.0%
DeepSeek V4 Pro (Reasoning)100100100706386.5%
Z.AI GLM 5.2 (Reasoning, High)1001001001002685.2%
Z.AI GLM 4.5 Air1001001001002585.1%
Qwen 3.5 35B100100100725385.0%
Gemini 3 Flash (Preview, Reasoning)100100100883484.4%
Laguna S 2.1100100100893083.7%
DeepSeek-V2 Chat10010073696982.2%
Ministral 3 3B100100100100781.4%
Claude Haiku 4.510010084685280.8%
Z.AI GLM 5.1100100100100280.4%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100280.4%
MiniMax M310010099891480.3%
Xiaomi MIMO v2.5100100100100180.2%
Cydonia 24B V4.110010083635580.1%
Z.AI GLM 5.3 (Reasoning, Max)100100100100080.0%
Gemma 4 31B (Reasoning)100100100100080.0%
Aion 3.0 Mini100100100100080.0%
Mistral Small 3.2 24B100100100100080.0%
Ministral 3B10010010099079.8%
ByteDance Seed 1.6100100100732178.9%
Claude Opus 5 (Reasoning, Low)10010010094078.8%
Claude Opus 4100100100791278.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100771478.1%
DeepSeek V3 (2024-12-26)10010010084076.7%
Claude Opus 4.5100100100503276.5%
Kimi K3 (Reasoning, Low)10010010080076.0%
Qwen 2.5 72B10010010080076.0%
DeepSeek V4 Flash1001008383173.4%
Gemma 4 31B1001009371072.7%
Ministral 3 14B10010010063072.5%
DeepSeek V4 Pro10010010053070.5%
Aion 3.5 (Reasoning, High)1001009258070.0%
Gemma 3 27B10010010050069.9%
Z.AI GLM 510010080323268.6%
Gemma 3 4B10010010034066.8%
Claude Sonnet 4.6 (Reasoning)10010010029065.8%
Gemini 3 Flash (Preview)1001007342063.0%
Z.AI GLM 4.7 Flash100807252060.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001003060.6%
Claude Opus 5857164441856.3%
MiniMax M2.5100100750055.0%
DeepSeek V3.110077667050.0%
WizardLM 2 8x22b10086576049.7%
Xiaomi MIMO v2.5 Pro100100330046.5%
DeepSeek V3.2100483224040.8%
Z.AI GLM 4.71006700033.3%
Z.AI GLM 4.67459280032.3%
Laguna XS 2.11003050027.1%
Claude Opus 4.7 (Reasoning)1003100026.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Mistral NeMO100100100100100100.0%
Claude Opus 4.51001001001009899.7%
DeepSeek V4 Pro (Reasoning)1001001001009799.4%
Cydonia 24B V4.11001001001009799.3%
GPT-5 Mini1001001001009699.2%
Claude Opus 4.6 (Reasoning)1001001001009198.2%
Xiaomi MIMO v2.6 Pro1001001001009098.0%
DeepSeek V4 Flash (Reasoning)1001001001009097.9%
ByteDance Seed 1.61001001001008897.7%
DeepSeek-V2 Chat1001001001008897.5%
Z.AI GLM 4.7 Flash1001001001008797.4%
Xiaomi MIMO v2.51001001001008697.2%
Laguna XS 2.11001001001008697.2%
Z.AI GLM 5.11001001001008597.0%
DeepSeek V3 (2025-03-24)1001001001008597.0%
Claude Opus 4.61001001001008296.4%
Kimi K3 (Reasoning, High)1001001001008196.2%
MiniMax M2.71001001001008096.1%
Qwen 3.6 35B1001001001007795.5%
Aion 3.01001001001007795.4%
Claude Opus 4.8 (Reasoning, Low)100100100908695.2%
MiniMax M31001001001007394.6%
ByteDance Seed 2.0 Lite1001001001007094.0%
Gemma 3 4B1001001001006893.5%
Gemini 3.1 Flash Lite (Preview)1001001001006593.1%
Aion 2.0100100100848092.6%
Mistral Small 4 (Reasoning)100100100877692.5%
Xiaomi MIMO v2.5 Pro100100100956792.3%
Mistral Small 3.2 24B1001001001006192.2%
Claude Haiku 4.5100100100827892.1%
Z.AI GLM 51001001001006091.9%
Claude Haiku 5.5 (Adaptive)1001001001005891.6%
DeepSeek V4 Pro100100100925689.7%
DeepSeek V3.11001001001004488.8%
Laguna S 2.11001001001004488.7%
Mistral Medium 3.51001001001004388.6%
Mistral Medium 3.5 (Reasoning)100100100776588.4%
Claude Opus 5 (Reasoning, Low)100100100746387.4%
Claude Opus 5 (Reasoning)10010083826886.6%
Aion 3.0 Mini100100100755786.4%
Mistral Large 2100100100874486.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001003086.0%
Claude Sonnet 4.51001001001002584.9%
MiniMax M2.5100100100992083.9%
DeepSeek V3 (2024-12-26)100100100100781.4%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100901681.1%
DeepSeek V4.1 Flash (Reasoning, High)100100100100080.0%
Mistral Large 3100100100100080.0%
Cohere Command R+ (Aug. 2024)100100100100080.0%
Ministral 3 3B100100100100080.0%
Claude Sonnet 4.6 (Reasoning)10010010098079.6%
Gemini 2.5 Pro100100100641976.6%
Gemma 3 27B100100100612176.4%
Claude Haiku 5.5 (Reasoning, Low)1001001000 – 75.0%
Claude Opus 5.5 (Reasoning)10010010074074.8%
Mistral Medium 3.1100100100383574.8%
Claude Sonnet 5 (Reasoning, Low)1001009281074.7%
Claude Haiku 5.5 (Reasoning, Medium)10010080741173.1%
ByteDance Seed 2.0 Mini10010010063072.7%
Z.AI GLM 5.2 (Reasoning, High)10010077711272.1%
Claude Opus 4.71001008268069.9%
Ministral 3 8B10010010047069.4%
Gemini 3 Flash (Preview)10010010045069.0%
Ministral 3 14B100100100301168.2%
Ministral 3B10010010038067.7%
Aion 3.5 (Reasoning, High)10010068521466.6%
DeepSeek V4 Flash10010010023064.7%
Claude Opus 510010065411664.4%
Claude Sonnet 51001001000060.0%
Ministral 8B1001001000060.0%
Claude Sonnet 5 (Reasoning)1001005722857.4%
Z.AI GLM 4.610081760051.3%
Claude Opus 4.7 (Reasoning)10083560047.8%
Claude Sonnet 4.61005400030.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)10010010010010099.9%
MiniMax M2.71001001001009899.6%
Gemini 2.5 Flash Lite1001001001009799.5%
DeepSeek V4 Pro1001001001009598.9%
Kimi K3 (Reasoning, Low)1001001001009498.8%
Claude Sonnet 51001001001009498.8%
Thinking Machines Inkling Small (Reasoning, High)1001001001009398.7%
MiniMax M2.51001001001009398.7%
Aion 3.5 (Reasoning, High)1001001001009298.3%
Claude Opus 41001001001009298.3%
DeepSeek V3 (2024-12-26)1001001001009198.1%
Claude Haiku 5.5 (Adaptive)1001001001008897.6%
Z.AI GLM 5 Turbo1001001001008296.4%
Qwen 2.5 72B1001001001008296.4%
Cohere Command R+ (Aug. 2024)1001001001008296.4%
Gemma 4 26B1001001001008196.2%
Mistral Medium 3.5100100100968596.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001007995.8%
Arcee AI: Trinity Mini1001001001007995.8%
DeepSeek V4 Flash1001001001007895.6%
GPT-4o, Aug. 6th (temp=0)100100100928394.9%
Claude Sonnet 5 (Reasoning)1001001001007394.6%
Claude Sonnet 5 (Reasoning, Low)1001001001007294.4%
Claude Haiku 4.51001001001007194.1%
Mistral Large 4.01001001001007094.0%
Claude Opus 4.51001001001006993.7%
DeepSeek V4 Pro (Reasoning)1001001001006893.6%
Gemma 3 4B1001001001006793.3%
Gemini 3.1 Flash Lite (Preview)100100100858193.1%
Claude Sonnet 4.6 (Reasoning)1001001001006292.4%
Gemini 2.5 Pro1001001001006092.0%
Claude Opus 5 (Reasoning)1001001001005891.6%
Llama 3.1 70B1001001001005891.6%
Mistral Small 3.2 24B1001001001005891.6%
Claude Opus 5 (Reasoning, Low)1001001001005390.6%
Claude Opus 4.6100100100985290.0%
Aion 2.01001001001004889.7%
Ministral 3 14B100100100796989.6%
Claude Opus 4.7100100100964788.6%
Mistral Medium 3.5 (Reasoning)100100100756788.3%
MiniMax M31001001001004088.1%
Ministral 8B1001001001003987.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1009996776887.8%
Claude Haiku 5.5 (Reasoning, Medium)1001001001003586.9%
Xiaomi MIMO v2.5100100100924286.8%
Qwen 3.5 Flash1001001001003386.7%
Claude Opus 51001001001003086.0%
WizardLM 2 8x22b100100100656485.9%
Hermes 3 70B1001001001002985.8%
DeepSeek V4 Flash (Reasoning)100100100794785.1%
GPT-4.1 Nano1001001001002384.7%
ByteDance Seed 1.61001001001002084.0%
Grok 4.20100100100793582.8%
Claude Opus 4.8 (Reasoning)1001001001001182.2%
Writer: Palmyra X5100100100921581.3%
Gemma 4 26B (Reasoning)100100100100080.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100080.0%
Qwen 3.5 35B100100100100080.0%
Gemma 3 12B100100100100080.0%
Ministral 3 8B100100100100080.0%
Aion 3.0 Mini100100100504679.2%
Gemini 3 Flash (Preview)100100100543978.7%
Hermes 3 405B100100100642577.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010010088077.6%
Qwen 3 32B1001009289076.3%
Ministral 3B10010087741775.7%
Z.AI GLM 4.5 Air10010010075075.0%
Z.AI GLM 5.1100100100531673.8%
Laguna S 2.110010010065073.0%
Mistral Large 31001008478072.3%
Z.AI GLM 4.71001008476072.0%
Gemini 3 Flash (Preview, Reasoning)10010010057071.4%
Mistral NeMO100938957067.9%
DeepSeek V3.1100848155064.0%
Xiaomi MIMO v2.5 Pro10010059292262.1%
Laguna XS 2.11001001000060.0%
Gemma 4 31B100100840056.9%
DeepSeek V3.2100912914046.7%
Z.AI GLM 4.610083210040.9%
Z.AI GLM 4.7 Flash000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)1001001001009999.9%
Claude Opus 5 (Reasoning, Low)1001001001009999.8%
Xiaomi MIMO v2.5 Pro1001001001009999.8%
Mistral Small 41001001001009799.5%
Gemini 3.1 Flash Lite1001001001009699.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009599.0%
Llama 3.1 70B1001001001009398.7%
Z.AI GLM 4.51001001001008997.8%
Claude Haiku 5.5 (Adaptive)1001001001008797.4%
Kimi K2.51001001001008697.1%
Z.AI GLM 4.71001001001008697.1%
Mistral Medium 3.5100100100959097.0%
Claude Opus 41001001001008496.9%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001008496.8%
Mistral Medium 3.11001001001008396.6%
Arcee AI: Trinity Mini1001001001008396.6%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008196.2%
Aion 2.01001001001007795.3%
Ministral 3 3B1001001001007695.3%
ByteDance Seed 1.6 Flash1001001001007595.1%
Mistral Large 4.0100100100987795.1%
Aion 3.5 (Reasoning, High)100100100958095.0%
Claude Haiku 5.5 (Reasoning, Low)10090 – – – 94.9%
Claude Sonnet 41001001001007394.6%
Xiaomi MIMO v2.6 Flash1001001001007394.5%
DeepSeek V3 (2024-12-26)100100100888294.1%
Claude Opus 4.8 (Reasoning)1001001001006993.9%
Claude Sonnet 51001001001006993.9%
Claude Opus 4.6 (Reasoning)1001001001006993.8%
GPT-4.1 Nano1001001001006392.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001006192.2%
Xiaomi MIMO v2.51001001001006092.1%
Ministral 8B1001001001005791.4%
DeepSeek V4 Flash100100100926290.9%
Aion 3.5 Mini (Reasoning, High)1001001001004789.5%
Z.AI GLM 4.7 Flash1001001001004689.2%
Z.AI GLM 5 Turbo1001001001004589.0%
Claude Opus 4.61001001001004488.8%
Laguna XS 2.1100100100766788.5%
ByteDance Seed 2.0 Lite100100100756788.5%
Claude Opus 5.5 (Reasoning)1001001001003586.9%
MiniMax M2.71001001001001583.0%
DeepSeek V4 Flash (Reasoning)1001001001001482.7%
Ministral 3B100100100882582.6%
MiniMax M3100100100872682.5%
Gemini 3.7 Flash (Reasoning, Medium)1001001001001081.9%
Claude Opus 5100100100100781.4%
Z.AI GLM 5.2 (Reasoning, High)100100100100581.0%
Claude Opus 4.510010010099580.8%
Kimi K3 (Reasoning, Low)100100100100080.0%
Claude Opus 5 (Reasoning)100100100100080.0%
Claude Haiku 4.5100100100100080.0%
Ministral 3 14B100100100100080.0%
Mistral NeMO100100100100080.0%
Mistral Medium 3.5 (Reasoning)10010097911279.9%
Z.AI GLM 5.1100100100772179.4%
Aion 3.0 Mini100100100494879.4%
DeepSeek V3.110010098573177.1%
Gemini 3 Flash (Preview)10010010077075.4%
Claude Haiku 5.5 (Reasoning, Medium)10010010050771.4%
Laguna S 2.110010010053070.5%
MiniMax M2.510010072571568.8%
Claude Opus 4.7 (Reasoning)100100970059.3%
Claude Sonnet 4.6 (Reasoning)998959391059.1%
Claude Sonnet 5 (Reasoning)100100798057.3%
Claude Opus 4.7998147322556.8%
Claude Sonnet 4.610094480048.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Claude Haiku 5.5 (Adaptive)1001001001009899.6%
Muse Glimmer 30B (Reasoning, Medium)1001001001009899.6%
MiniMax M2.71001001001009899.6%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009699.2%
Kimi K3 (Reasoning, High)1001001001009599.1%
Gemini 2.5 Flash Lite (Reasoning)1001001001009398.7%
Ministral 3B1001001001009198.1%
Gemini 2.5 Flash Lite1001001001008897.7%
Z.AI GLM 51001001001008897.5%
Xiaomi MIMO v2.5 Pro1001001001008897.5%
Claude Sonnet 51001001001008797.4%
Z.AI GLM 5.2 (Reasoning, High)100100100969097.1%
Mistral Medium 3.5 (Reasoning)1001001001008496.9%
Writer: Palmyra X51001001001008496.7%
Claude Sonnet 5.5 (Reasoning)1001001001008396.6%
Claude Sonnet 4.51001001001008296.3%
Qwen 3.8 Flash (Reasoning)1001001001008196.2%
Claude Opus 5 (Reasoning, Low)100100100908995.8%
Aion 3.5 (Reasoning, High)100100100908695.1%
Claude Sonnet 41001001001007595.0%
Claude Opus 5 (Reasoning)100100100928395.0%
Gemma 4 26B1001001001007494.7%
Aion 2.010010097948194.5%
Claude Opus 5.5 (Reasoning)1001001001007194.2%
ByteDance Seed 2.0 Mini1001001001007194.1%
Gemma 3 12B1001001001006492.8%
Gemma 4 31B100100100927192.6%
Gemini 3.1 Flash Lite (Preview)1001001001006392.6%
Claude Opus 410010096868092.5%
Claude Opus 4.61001001001006192.1%
DeepSeek V4 Pro100100100867191.3%
Hermes 3 405B1001001001005691.2%
Arcee AI: Trinity Mini100100100836890.2%
Gemini 3.1 Flash Lite1001001001004889.7%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001004789.3%
Z.AI GLM 4.71009884818088.6%
Claude Haiku 4.51001001001004288.4%
Gemma 4 26B (Reasoning)100100100746788.2%
Aion 3.5 Mini (Reasoning, High)1001001001004088.0%
Claude Sonnet 5 (Reasoning, Low)1001001001003887.7%
Claude Opus 4.8 (Reasoning)1001001001003687.3%
MiniMax M31001001001003687.3%
Qwen 2.5 72B100100100894386.5%
DeepSeek V3.1100100100686085.7%
Mistral Large 4.0100100100665985.0%
Z.AI GLM 5 Turbo100100100695484.7%
GPT-4.1 Nano1001001001002284.4%
Mistral Small 4 (Reasoning)10010097675683.9%
Gemini 3.5 Flash (Reasoning, Minimal)10010097813582.8%
Gemma 3 4B100100100595382.5%
Z.AI GLM 4.5 Air1001001001001182.3%
DeepSeek V3.2100100100793282.2%
DeepSeek V4.1 Flash (Reasoning, High)100100100100981.7%
DeepSeek V3 (2025-03-24)100100100555381.7%
Gemini 3.6 Flash (Reasoning, Minimal)100100100872081.4%
Aion 3.0100100100100080.0%
DeepSeek V4 Flash (Reasoning)100100100100080.0%
Z.AI GLM 4.6100100100100080.0%
Xiaomi MIMO v2.6 Flash100100100100080.0%
Aion 3.0 Mini10010010099079.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010010098079.6%
DeepSeek V4 Flash10010073734979.1%
Mistral Large 310010010094078.8%
Claude Sonnet 5 (Reasoning)100100100494378.5%
Claude Opus 4.510010086672475.4%
Gemini 2.5 Pro1008482614875.1%
Laguna XS 2.110010010069574.9%
Cohere Command R+ (Aug. 2024)10010010073074.5%
Mistral Medium 3.51001009280074.5%
Mistral NeMO1008885583172.4%
Hermes 3 70B10010010061072.2%
Cydonia 24B V4.110010010061072.1%
Mistral Medium 3.110010010058071.6%
Mistral Large 21001008174071.0%
Z.AI GLM 4.7 Flash100978869070.8%
Z.AI GLM 4.510010010050069.9%
Ministral 8B1001008957069.2%
Claude Opus 510010010045069.0%
Qwen 3 32B10010010036067.2%
Claude Opus 4.7 (Reasoning)100918260066.7%
Mistral Small 3.2 24B10010010030066.0%
Llama 3.1 70B1001009729065.3%
DeepSeek-V2 Chat10010062412265.1%
Gemini 3.1 Flash Lite (Reasoning)10010010025064.9%
Claude Sonnet 4.61007766523064.9%
Ministral 3 8B1001001000060.0%
Claude Opus 4.71001004839658.6%
Ministral 3 14B100100920058.3%
Claude Sonnet 4.6 (Reasoning)1001004741057.6%
Xiaomi MIMO v2.51001004541057.2%
Claude Opus 4.6 (Reasoning)100100810056.3%
WizardLM 2 8x22b1001005328056.1%
Z.AI GLM 5.11001005415053.7%
Gemini 3 Flash (Preview, Reasoning)1001005114052.9%
Gemini 3 Flash (Preview)100635543052.0%
Laguna S 2.1100100154043.7%