Useless dialogue additions

Test: Bad Writing Habits

Avg. Score
66.8%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.6 Luna (Reasoning, Medium)99.5%$0.01718.0s95%
2GPT-5.6 Luna99.5%$0.01515.8s93%
3GPT-6 Sol99.9%$0.02751.4s99%
4GPT-5.6 Terra99.3%$0.04636.9s94%
5GPT-6 Luna (Reasoning, High)97.5%$0.002357.1s75%
6GPT-6 Sol (Reasoning, Medium)98.7%$0.0311.0m86%
7GPT-6 Luna (Reasoning, Medium)97.0%$0.001643.0s70%
8GPT-6.1 Sol (Reasoning, Medium)99.5%$0.0311.6m92%
9GPT-6 Luna95.2%$0.001332.6s64%
10Claude Haiku 5.5 (Reasoning, Medium)89.5%$0.001414.9s61%
11Claude Haiku 5.5 (Reasoning, Low)86.9%$0.001515.4s61%
12DeepSeek V4.1 Flash (Reasoning, High)92.5%$0.002935.4s60%
13Muse Spark 1.3 (Reasoning, Medium)97.8%$0.0251.8m80%
14Muse Spark 1.1 (Reasoning, Medium)92.3%$0.01523.9s60%
15GPT-5.6 Terra (Reasoning, Medium)96.5%$0.04435.2s70%
16GPT-5.4 Mini87.2%$0.01516.8s54%
17Claude Haiku 5.5 (Adaptive)86.4%$0.001819.3s48%
18Qwen 3.5 35B93.3%$0.0181.0m58%
19Claude Sonnet 4.692.4%$0.03139.3s60%
20Muse Spark 1.2 (Reasoning, Medium)90.3%$0.01838.3s56%
21GPT-5.4 Mini (Reasoning)90.0%$0.02228.1s55%
22Kimi K3 (Reasoning, Low)91.8%$0.0281.1m63%
23Muse Glimmer 30B (Reasoning, Medium)88.6%$0.003843.4s48%
24Xiaomi MIMO v2.6 Pro92.5%$0.00332.0m61%
25Claude Sonnet 5.5 (Reasoning)89.9%$0.04236.9s62%
26Claude Opus 596.6%$0.08250.1s75%
27GPT-5.4 Mini (Reasoning, Low)84.0%$0.01516.8s47%
28Claude Haiku 5.5 (Reasoning, Max)100.0%$0.0314.7m100%
29Muse Spark 1.1 (Reasoning, Minimal)84.5%$0.01219.2s45%
30Qwen 3.6 35B91.4%$0.00831.0m46%
31Aion 3.089.5%$0.0241.0m55%
32Z.AI GLM 5.3 Flash (Reasoning, Low)86.4%$0.00051.1m48%
33Xiaomi MIMO v2.6 Flash90.2%$0.00081.8m54%
34Qwen 3.5 9B89.3%$0.00111.4m48%
35GPT-5.493.4%$0.0491.4m68%
36Claude Sonnet 587.0%$0.02733.5s48%
37Z.AI GLM 5.2 (Reasoning, High)87.1%$0.0111.0m46%
38Z.AI GLM 5 Turbo84.3%$0.008133.2s41%
39Aion 3.5 (Reasoning, High)88.1%$0.0221.3m53%
40GPT-5.6 Sol98.0%$0.1051.2m82%
41Qwen 3.5 397B A17B96.4%$0.0143.0m64%
42Qwen 3.6 Flash87.9%$0.01041.4s38%
43Qwen 3.7 Flash (Reasoning)87.7%$0.001055.2s37%
44GPT-5.6 Sol (Reasoning, Medium)98.6%$0.1081.2m78%
45Qwen 3.5 Flash84.5%$0.002547.5s35%
46Claude Haiku 4.579.8%$0.01121.6s38%
47DeepSeek V4 Pro82.0%$0.00481.3m45%
48 Kimi K3 (Reasoning, High)90.9%$0.0441.8m62%
49MiniMax M2.580.7%$0.00341.3m44%
50Grok 4.5 (Reasoning, Low)85.1%$0.0181.1m44%
51Claude Sonnet 4.6 (Reasoning)90.8%$0.0601.2m59%
52GPT-5.4 (Reasoning, Low)91.0%$0.0551.4m58%
53Z.AI GLM 5.184.9%$0.0141.5m46%
54Claude Opus 4.8 (Reasoning, Low)87.1%$0.07141.9s59%
55Qwen 3.6 Max Preview98.0%$0.0503.5m78%
56DeepSeek V3 (2025-03-24)79.4%$0.001439.4s32%
57Aion 3.0 Mini81.9%$0.00531.2m39%
58Claude Opus 5 (Reasoning, Low)93.2%$0.0971.0m68%
59Qwen 3 235B A22B Instruct 250777.9%$0.001159.2s36%
60Claude Opus 5 (Reasoning)94.0%$0.0981.0m66%
61Grok 4.5 (Reasoning, High)87.2%$0.0301.6m48%
62Mistral Small 4 (Reasoning)73.0%$0.002230.2s32%
63GPT-5 Mini76.6%$0.010057.4s38%
64Qwen 3.8 Flash (Reasoning)91.5%$0.00643.1m51%
65Claude Sonnet 5 (Reasoning)80.3%$0.03038.9s38%
66MiniMax M387.1%$0.00603.1m53%
67Claude Opus 5.5 (Reasoning)90.8%$0.09256.0s60%
68Mistral Small 471.4%$0.001418.2s27%
69Claude Opus 4.690.2%$0.0781.2m56%
70MiniMax M2.776.2%$0.00401.1m34%
71Qwen 3.8 27B (Reasoning, XHigh)97.1%$0.0404.7m79%
72GPT-5.4 Nano (Reasoning)70.8%$0.006124.5s30%
73Gemini 3.5 Flash Lite (Reasoning)72.5%$0.00356.6s22%
74DeepSeek V4 Flash 0731 (Reasoning, High)85.4%$0.00222.6m43%
75GPT-5.186.9%$0.0541.8m54%
76Grok 4.375.2%$0.006930.5s25%
77Claude Sonnet 5 (Reasoning, Low)79.6%$0.03138.4s34%
78Claude Opus 4.6 (Reasoning)92.0%$0.0881.4m58%
79Aion 3.5 Mini (Reasoning, High)84.4%$0.0112.4m44%
80Gemini 3.5 Flash Lite (Reasoning, Minimal)69.1%$0.00356.3s23%
81Z.AI GLM 577.9%$0.00841.2m31%
82Claude Sonnet 4.578.6%$0.03538.1s35%
83Claude Opus 4.784.7%$0.06930.4s43%
84Writer: Palmyra X567.9%$0.01122.0s28%
85Gemini 3.1 Flash Lite (Reasoning)72.4%$0.003011.9s17%
86Mistral Large 4.071.6%$0.00631.1m32%
87DeepSeek V4 Flash (Reasoning)70.0%$0.000731.1s22%
88DeepSeek V4 Pro 0813 (Reasoning, High)83.3%$0.0251.8m38%
89GPT-5.4 Nano65.7%$0.005726.3s27%
90GPT-589.7%$0.0652.8m63%
91GPT-5.4 Nano (Reasoning, Low)65.7%$0.005520.6s23%
92Qwen 3.5 122B80.1%$0.0251.1m28%
93Qwen 3.5 27B82.4%$0.0201.6m31%
94Claude Opus 4.8 (Reasoning)82.3%$0.07141.7s40%
95Grok 4.20 (Reasoning)77.7%$0.0181.5m30%
96DeepSeek V4 Flash65.8%$0.000631.6s19%
97Gemini 3.7 Flash (Reasoning, Medium)66.7%$0.01218.2s19%
98Grok 4.2066.4%$0.009345.7s24%
99Grok 4.6 (Reasoning, High)86.5%$0.0422.5m42%
100GPT-5.594.7%$0.1391.7m69%
101GPT-5.5 (Reasoning, Medium)94.9%$0.1421.8m71%
102GPT-5.5 (Reasoning, Low)95.4%$0.1391.8m68%
103Claude Opus 4.7 (Reasoning)80.3%$0.07632.0s35%
104GPT-5.4 (Reasoning)91.7%$0.0892.6m58%
105Claude Opus 4.577.4%$0.07053.4s40%
106Gemini 3.1 Flash Lite64.1%$0.003012.1s10%
107Qwen 3.5 Plus (2026-04-20)77.4%$0.0171.8m26%
108o4 Mini61.8%$0.01525.7s19%
109Qwen 3 32B61.6%$0.001554.6s20%
110Claude Sonnet 469.2%$0.03243.7s24%
111Z.AI GLM 5.3 Flash (Reasoning, Max)93.4%$0.00316.5m65%
112Gemini 3.8 Flash (Reasoning, Medium)61.8%$0.01418.0s15%
113ByteDance Seed 2.0 Lite76.8%$0.0122.2m25%
114Thinking Machines Inkling68.3%$0.00751.5m19%
115Qwen 3.7 Max85.9%$0.0682.3m42%
116Mistral Medium 3.157.0%$0.004836.5s14%
117Laguna S 2.152.1%$0.000522.1s14%
118Cydonia 24B V4.154.7%$0.001444.8s16%
119Grok 4.7 (Reasoning, High)92.4%$0.0743.9m57%
120Gemini 3.1 Flash Lite (Preview)55.7%$0.00308.4s6%
121Grok 4.3 (Reasoning)77.4%$0.0212.3m22%
122Qwen 3.8 Max (Reasoning, XHigh)97.4%$0.0835.9m80%
123o4 Mini High62.9%$0.02547.2s15%
124Kimi K2.575.9%$0.0193.2m31%
125Thinking Machines Inkling Small (Reasoning, High)64.5%$0.00881.7m17%
126Xiaomi MIMO v2.5 Pro59.2%$0.008553.5s10%
127Mistral Large 255.9%$0.01329.4s9%
128Hermes 3 405B56.1%$0.003253.2s10%
129Gemini 3.6 Flash (Reasoning, Minimal)47.6%$0.01714.3s14%
130ByteDance Seed 1.6 Flash43.9%$0.001327.3s11%
131Laguna XS 2.143.3%$0.000314.4s8%
132Xiaomi MIMO v2.552.3%$0.005431.8s5%
133Mistral Large 350.0%$0.003330.3s5%
134GPT-4.151.5%$0.01844.7s14%
135Gemini 3.1 Pro (Preview)85.6%$0.1071.8m34%
136Hy4 Preview (Reasoning, High)84.4%$0.0404.4m39%
137GPT-5.266.4%$0.0561.5m24%
138Ministral 3 14B40.6%$0.000711.7s4%
139Z.AI GLM 4.544.6%$0.005142.1s9%
140Qwen 3.6 27B66.7%$0.0252.3m18%
141DeepSeek V4 Pro (Reasoning)66.9%$0.0153.1m20%
142Gemini 3.6 Flash (Reasoning)52.8%$0.04432.5s13%
143ByteDance Seed 1.662.9%$0.0132.5m14%
144Mistral Medium 3.542.7%$0.01818.2s5%
145GPT-4o, Aug. 6th (temp=1)43.2%$0.01824.4s6%
146Gemini 2.5 Flash37.3%$0.005210.6s2%
147Gemma 4 31B (Reasoning)57.1%$0.00142.2m6%
148Hermes 3 70B43.6%$0.00101.2m5%
149Gemini 2.5 Flash Lite (Reasoning)39.0%$0.002830.8s1%
150Mistral Large 4.0 (Reasoning)66.8%$0.0233.4m23%
151Gemma 4 26B (Reasoning)55.5%$0.00132.0m3%
152Aion 2.043.2%$0.00641.3m8%
153Llama 3.1 70B36.6%$0.001529.4s0%
154WizardLM 2 8x22b48.6%$0.00261.8m7%
155Z.AI GLM 4.7 Flash39.1%$0.00171.2m6%
156Ministral 3B29.4%$0.00018.1s0%
157Mistral Medium 3.5 (Reasoning)36.8%$0.01818.0s3%
158Ministral 8B28.1%$0.000410.4s0%
159Z.AI GLM 4.740.4%$0.0101.4m10%
160Gemma 4 26B38.0%$0.000955.1s0%
161Gemini 2.5 Flash (Reasoning)34.1%$0.01121.5s1%
162GPT-5 Nano37.2%$0.00421.4m8%
163Z.AI GLM 4.638.0%$0.006551.5s0%
164Gemini 3 Flash (Preview, Reasoning)34.9%$0.01230.1s1%
165Arcee AI: Trinity Mini24.8%$0.00039.2s0%
166Kimi K2.689.5%$0.0586.5m52%
167Gemma 4 31B40.7%$0.00101.6m4%
168Gemini 2.5 Flash Lite23.7%$0.00099.5s0%
169Ministral 3 8B25.5%$0.000819.6s0%
170GPT-4.1 Nano24.0%$0.000713.3s0%
171Ministral 3 3B22.4%$0.000511.1s0%
172DeepSeek V3 (2024-12-26)33.1%$0.002154.6s0%
173DeepSeek-V2 Chat32.0%$0.002153.3s0%
174Gemini 3.5 Flash (Reasoning, Minimal)26.7%$0.01812.0s2%
175Gemini 2.5 Pro42.2%$0.03636.2s1%
176DeepSeek V3.238.2%$0.00141.9m5%
177Gemini 3 Flash (Preview)23.3%$0.007819.6s0%
178GPT-4.1 Mini20.3%$0.002719.0s0%
179Z.AI GLM 5.3 (Reasoning, Max)89.3%$0.0667.3m56%
180Thinking Machines Inkling (Reasoning)70.2%$0.0255.1m24%
181Qwen 3.5 Plus (2026-02-15)20.3%$0.006031.5s0%
182Z.AI GLM 4.5 Air23.5%$0.002958.2s0%
183Mistral NeMO10.9%$0.000510.1s0%
184GPT-4o Mini (temp=1)16.7%$0.001234.8s0%
185Claude Opus 482.3%$0.2091.4m45%
186Cohere Command R+ (Aug. 2024)25.6%$0.02052.5s0%
187DeepSeek V3.129.2%$0.00201.8m0%
188Gemma 3 27B15.1%$0.000652.6s0%
189Nemotron 3 Super22.6%$0.00001.4m0%
190Nemotron 3 Nano15.9%$0.00101.1m0%
191Inception Mercury 21.6%$0.00327.0s0%
192Gemma 3 4B3.1%$0.000220.0s0%
193Gemma 3 12B7.3%$0.000441.3s0%
194ByteDance Seed 2.0 Mini56.7%$0.00454.9m10%
195Qwen 2.5 72B3.6%$0.001036.7s0%
196GPT-4o, Aug. 6th (temp=0)7.5%$0.02322.7s0%
197GPT-4o Mini (temp=0)0.0%$0.001234.8s0%
198Gemini 3.5 Flash (Reasoning)32.8%$0.07137.6s1%
199GPT-OSS 120B6.8%$0.00151.8m0%
200Mistral Small 3.2 24B16.1%$0.00695.7m0%
66.76%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.51001001001009498.8%
Claude Sonnet 4.5100100100979698.6%
GPT-5.4 (Reasoning)1001001001009298.3%
GPT-5.4 Mini1001001001008997.9%
Claude Opus 5 (Reasoning)1001001001008997.9%
Claude Sonnet 5.5 (Reasoning)100100100998997.6%
Xiaomi MIMO v2.6 Pro100100100969297.5%
Muse Glimmer 30B (Reasoning, Medium)100100100969297.5%
Claude Opus 5.5 (Reasoning)100100100978997.3%
Grok 4.6 (Reasoning, High)1001001001008396.7%
GPT-5.410010097949296.5%
Kimi K3 (Reasoning, High)10010097948996.1%
GPT-5.11001001001007895.6%
Z.AI GLM 5.3 Flash (Reasoning, Max)1009997968795.6%
Claude Opus 5 (Reasoning, Low)1001001001007795.5%
GPT-5.6 Luna (Reasoning, Medium)100100100948395.4%
Kimi K2.6100100100898795.2%
Aion 3.5 (Reasoning, High)100100100928395.0%
GPT-5100100100858393.7%
Muse Spark 1.1 (Reasoning, Medium)10010097878393.4%
Muse Spark 1.2 (Reasoning, Medium)100100100976993.3%
GPT-6 Sol (Reasoning, Medium)100100100927593.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006693.2%
Qwen 3.8 Max (Reasoning, XHigh)100100100877592.3%
Hy4 Preview (Reasoning, High)1001001001005891.7%
Claude Haiku 5.5 (Adaptive)10010096837590.8%
GPT-5.5 (Reasoning, Low)1001001001005490.7%
Claude Haiku 5.5 (Reasoning, Medium)10010083838390.0%
GPT-5.4 Mini (Reasoning, Low)100100100875889.0%
Grok 4.5 (Reasoning, High)1001001001004288.3%
DeepSeek V4.1 Flash (Reasoning, High)100100100696987.8%
Claude Sonnet 5 (Reasoning)100100100756387.5%
Claude Haiku 5.5 (Reasoning, Low)1008775 – – 87.2%
Claude Opus 4100100100834886.3%
Claude Opus 4.8 (Reasoning)10010099666686.2%
Kimi K3 (Reasoning, Low)1008989807286.1%
Aion 3.5 Mini (Reasoning, High)1009483777585.9%
Qwen 3.7 Max10010088756685.8%
Claude Sonnet 4.6 (Reasoning)100100100755485.7%
Claude Opus 4.8 (Reasoning, Low)10010092835485.7%
Qwen 3.6 Max Preview100100100943485.6%
Claude Sonnet 4.610010080806384.3%
Qwen 3.5 Flash100100100695184.2%
Claude Opus 4.71009489835484.0%
Qwen 3 235B A22B Instruct 250710010099922583.1%
Claude Opus 4.610010092893483.0%
Claude Opus 4.7 (Reasoning)10010089834282.9%
Qwen 3.6 27B100100100724282.8%
Claude Opus 4.6 (Reasoning)10010092873482.5%
Cydonia 24B V4.110010088695482.2%
GPT-5.210010098644882.1%
Qwen 3.8 Flash (Reasoning)100100100100080.0%
Grok 4.5 (Reasoning, Low)100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
ByteDance Seed 2.0 Mini100100100752580.0%
Claude Haiku 4.510010089723779.7%
DeepSeek V4 Pro10010089832579.5%
Muse Spark 1.1 (Reasoning, Minimal)10010077754278.8%
Grok 4.20 (Reasoning)10010010094078.8%
Mistral Small 4 (Reasoning)100100100543477.5%
Gemini 3.5 Flash Lite (Reasoning)10010010080075.9%
Aion 3.0 Mini1008983802575.4%
GPT-5 Mini10010095661675.3%
Claude Opus 4.51009671634675.1%
ByteDance Seed 1.610010010069073.9%
Z.AI GLM 5.2 (Reasoning, High)10010080484273.9%
Z.AI GLM 510010069544673.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100481873.2%
ByteDance Seed 2.0 Lite10010010063072.5%
DeepSeek V4 Flash1009787541470.2%
MiniMax M2.71007769544669.3%
Gemini 3.8 Flash (Reasoning, Medium)967775663169.1%
Mistral Small 4967572544868.9%
DeepSeek-V2 Chat1001008063068.4%
Grok 4.310010010042068.3%
Aion 3.01008983541468.0%
o4 Mini100948363067.9%
Claude Sonnet 5100100100251467.8%
Gemini 3.6 Flash (Reasoning, Minimal)10010063383867.7%
Qwen 3 32B96968167067.7%
Writer: Palmyra X51007569543767.0%
Qwen 3.5 Plus (2026-04-20)10010010030066.1%
Xiaomi MIMO v2.6 Flash898766464265.9%
Z.AI GLM 5.3 (Reasoning, Max)1001008742065.6%
DeepSeek V4 Pro 0813 (Reasoning, High)10010069481065.4%
Grok 4.201009277371664.4%
Gemma 4 26B (Reasoning)10010010014062.8%
GPT-5.4 Nano (Reasoning)100946650062.0%
Gemini 3.7 Flash (Reasoning, Medium)966663503461.7%
Thinking Machines Inkling (Reasoning)1007554542561.4%
Z.AI GLM 4.5 Air876363514260.9%
MiniMax M3100837537059.0%
Z.AI GLM 4.7 Flash1001006625058.2%
Z.AI GLM 5.11008054421457.7%
DeepSeek V3 (2024-12-26)1001004242056.7%
Xiaomi MIMO v2.5 Pro100946918056.2%
DeepSeek V3 (2025-03-24)1001005425055.7%
WizardLM 2 8x22b1009742251455.6%
Claude Sonnet 5 (Reasoning, Low)100836325054.2%
o4 Mini High100896614053.9%
GPT-4.187756937053.5%
Mistral Large 4.0 (Reasoning)80695854052.2%
Gemma 4 31B (Reasoning)100100540050.7%
DeepSeek V4 Pro (Reasoning)1001002525050.0%
Z.AI GLM 5 Turbo9694580049.5%
GPT-5.4 Nano (Reasoning, Low)100843825049.5%
Grok 4.3 (Reasoning)100100420048.3%
Gemini 2.5 Flash100100370047.4%
Z.AI GLM 4.787753831046.2%
Kimi K2.510087420045.6%
GPT-5.4 Nano80695425045.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100545414044.2%
Thinking Machines Inkling100100100041.9%
Claude Sonnet 48987310041.4%
DeepSeek V4 Flash (Reasoning)100543120040.9%
Hermes 3 70B10010000040.0%
Gemini 3.5 Flash (Reasoning)1009100038.1%
Gemini 3.6 Flash (Reasoning)66503834037.7%
Thinking Machines Inkling Small (Reasoning, High)10042340035.2%
DeepSeek V3.11007500035.0%
Cohere Command R+ (Aug. 2024)10054180034.3%
Mistral Medium 3.51006300032.5%
Ministral 3 14B1005400030.7%
MiniMax M2.55446460029.1%
Gemini 3.1 Flash Lite (Reasoning)9425250028.7%
Ministral 3 8B10025140027.8%
Mistral Large 31003400026.8%
Gemini 3 Flash (Preview, Reasoning)7231200024.7%
Mistral Large 4.05731290023.4%
ByteDance Seed 1.6 Flash5139250022.9%
Z.AI GLM 4.5634900022.3%
Gemini 2.5 Flash Lite (Reasoning)1001000021.9%
Mistral Medium 3.1634200020.8%
Mistral Medium 3.5 (Reasoning)4842140020.7%
Gemma 4 26B545000020.7%
Qwen 3.5 Plus (2026-02-15)3834208020.0%
Z.AI GLM 4.6100000020.0%
Gemini 3.1 Flash Lite (Preview)37252014019.1%
GPT-4o, Aug. 6th (temp=1)544200019.0%
Hermes 3 405B80700017.4%
Llama 3.1 70B80000015.9%
GPT-5 Nano671000015.4%
Gemini 3.5 Flash (Reasoning, Minimal)372570013.8%
Gemma 4 31B481800013.2%
Laguna S 2.154700012.2%
Aion 2.0342000010.8%
Ministral 3B54000010.7%
GPT-4.1 Mini2518100010.5%
GPT-4o Mini (temp=1)361060010.3%
Gemini 3 Flash (Preview)4600009.2%
DeepSeek V3.225140007.8%
Mistral Large 23400006.8%
Gemma 3 12B2500005.0%
Ministral 8B2500005.0%
Laguna XS 2.110100003.8%
GPT-4.1 Nano1400002.8%
Gemini 2.5 Flash (Reasoning)1000001.9%
Gemini 3.1 Flash Lite600001.2%
Gemini 2.5 Pro000000.0%
GPT-OSS 120B000000.0%
Xiaomi MIMO v2.5000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
Gemini 2.5 Flash Lite000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 27B000000.0%
Nemotron 3 Nano000000.0%
Qwen 2.5 72B000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Aion 3.0100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)1001001001008997.9%
GPT-5.4 Mini1001001001008095.9%
GPT-5.6 Terra1001001001007595.0%
GPT-5.1100100100927793.8%
Gemini 3.1 Pro (Preview)1001001001005490.7%
Aion 3.5 (Reasoning, High)1001001001005490.7%
Claude Sonnet 5 (Reasoning)1001001001005490.7%
MiniMax M2.71001001001005490.7%
Muse Spark 1.2 (Reasoning, Medium)1001001001004288.3%
GPT-5.4 (Reasoning)1001001001004288.3%
Kimi K3 (Reasoning, Low)1001001001004288.3%
Claude Opus 4.8 (Reasoning, Low)1001001001004288.3%
Grok 4.5 (Reasoning, Low)1001001001004288.3%
GPT-5.41001001001004288.3%
Claude Opus 410010099835587.5%
Mistral Large 4.01001001001003486.8%
DeepSeek V4 Pro100100100805486.6%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001002585.0%
Xiaomi MIMO v2.6 Flash1001001001002585.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001002585.0%
GPT-6 Luna1001001001002585.0%
Arcee AI: Trinity Mini1001001001002585.0%
MiniMax M2.5100100100695484.6%
Gemini 3.8 Flash (Reasoning, Medium)100100100100080.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100080.0%
Qwen 3.8 Flash (Reasoning)100100100100080.0%
Grok 4.5 (Reasoning, High)100100100100080.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100080.0%
Z.AI GLM 5 Turbo100100100100080.0%
GPT-5.5 (Reasoning, Low)100100100100080.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100080.0%
Aion 3.5 Mini (Reasoning, High)100100100100080.0%
Claude Opus 4.8 (Reasoning)100100100100080.0%
Claude Opus 4.6100100100100080.0%
Mistral Large 4.0 (Reasoning)100100100100080.0%
Grok 4.20 (Reasoning)100100100100080.0%
Kimi K2.5100100100100080.0%
MiniMax M3100100100100080.0%
Qwen 3.5 122B100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
Claude Sonnet 5 (Reasoning, Low)100100100100080.0%
Claude Opus 4.5100100100752580.0%
Z.AI GLM 5100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
o4 Mini High100100100100080.0%
Qwen 3.7 Flash (Reasoning)100100100100080.0%
Qwen 3.6 27B100100100100080.0%
Aion 2.0100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100080.0%
Gemini 2.5 Flash (Reasoning)100100100100080.0%
GPT-5.4 Mini (Reasoning, Low)100100100100080.0%
Claude Haiku 4.5100100100100080.0%
DeepSeek V3 (2025-03-24)100100100100080.0%
Qwen 3 235B A22B Instruct 2507100100100100080.0%
Ministral 3 3B100100100100080.0%
Claude Sonnet 5.5 (Reasoning)100100100544279.0%
Qwen 3 32B10010083575078.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100632577.5%
ByteDance Seed 1.610010010080075.9%
Thinking Machines Inkling10010010075075.0%
Grok 4.2010010010069073.9%
Hermes 3 405B10010010069073.9%
Writer: Palmyra X510010010069073.9%
Mistral Small 410010010069073.9%
GPT-5.4 Nano (Reasoning, Low)100100100541473.5%
Kimi K3 (Reasoning, High)100100100422573.3%
DeepSeek V4 Flash10010010063072.5%
Gemini 3.1 Flash Lite1008069634270.6%
o4 Mini10010010042068.3%
Gemini 3.7 Flash (Reasoning, Medium)10010010025065.0%
Claude Opus 4.7 (Reasoning)10010010025065.0%
Thinking Machines Inkling Small (Reasoning, High)10010010025065.0%
Ministral 8B10010010025065.0%
DeepSeek V4 Pro (Reasoning)10010010018063.6%
Gemini 3.6 Flash (Reasoning)1001006354063.2%
GPT-5 Mini99897354063.0%
GPT-5.4 (Reasoning, Low)1001006342060.8%
DeepSeek V4 Flash (Reasoning)1001001000060.0%
GPT-4.11001001000060.0%
Xiaomi MIMO v2.5 Pro1001001000060.0%
Mistral Medium 3.5 (Reasoning)1001001000060.0%
Gemma 4 31B1001001000060.0%
Gemma 4 26B1001001000060.0%
Mistral Large 31001001000060.0%
DeepSeek V3.11001001000060.0%
DeepSeek V3.21001001000060.0%
Mistral Large 21001001000060.0%
Llama 3.1 70B1001001000060.0%
Mistral Medium 3.11001001000060.0%
WizardLM 2 8x22b1001001000060.0%
GPT-4.1 Nano1001001000060.0%
ByteDance Seed 1.6 Flash100776948059.0%
Cydonia 24B V4.11001006925058.9%
Gemini 3.5 Flash (Reasoning, Minimal)756963424258.1%
GPT-5.21001005425055.7%
GPT-5 Nano836057423455.1%
GPT-5.4 Nano100100630052.5%
Gemini 3.6 Flash (Reasoning, Minimal)100100540050.7%
Gemini 3.1 Flash Lite (Reasoning)100100540050.7%
Z.AI GLM 4.71001002525050.0%
GPT-5.4 Nano (Reasoning)100634242049.2%
GPT-4.1 Mini10080540046.6%
GPT-4o, Aug. 6th (temp=1)100634225045.8%
Ministral 3 14B100100250045.0%
Qwen 3.5 Plus (2026-02-15)83803425044.4%
Mistral Medium 3.5100100180043.6%
Gemma 4 31B (Reasoning)10010000040.0%
Gemma 4 26B (Reasoning)10010000040.0%
DeepSeek-V2 Chat10010000040.0%
Xiaomi MIMO v2.510010000040.0%
DeepSeek V3 (2024-12-26)10010000040.0%
Ministral 3 8B10010000040.0%
Hermes 3 70B10010000040.0%
Ministral 3B10010000040.0%
Laguna S 2.17258480035.8%
Gemini 3 Flash (Preview, Reasoning)1007500035.0%
Gemini 3.5 Flash (Reasoning)1006900033.9%
Gemini 3.1 Flash Lite (Preview)8063250033.4%
Gemini 3 Flash (Preview)42424242033.3%
Z.AI GLM 4.51005400030.7%
GPT-4o Mini (temp=1)1004200028.3%
Z.AI GLM 4.7 Flash1002500025.0%
Gemma 3 27B1002500025.0%
Nemotron 3 Nano1001400022.8%
Nemotron 3 Super100000020.0%
Gemini 2.5 Flash100000020.0%
Gemini 2.5 Flash Lite100000020.0%
Laguna XS 2.1100000020.0%
Mistral NeMO100000020.0%
GPT-OSS 120B6316140018.5%
Gemma 3 4B2525140012.8%
Z.AI GLM 4.5 Air421800011.9%
Cohere Command R+ (Aug. 2024)54000010.7%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Qwen 2.5 72B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.5100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001009999.7%
Z.AI GLM 5.11001001001009999.7%
DeepSeek V3 (2025-03-24)1001001001009799.4%
GPT-51001001001009799.3%
Claude Sonnet 5 (Reasoning, Low)1001001001009699.1%
DeepSeek V4 Pro1001001001009498.8%
Qwen 3 235B A22B Instruct 25071001001001009498.8%
GPT-5.21001001001009398.5%
GPT-6 Luna (Reasoning, Medium)1001001001009298.3%
GPT-5.4 Mini (Reasoning, Low)1001001001009298.3%
GPT-5.5 (Reasoning, Low)1001001001008997.9%
DeepSeek V4 Flash 0731 (Reasoning, High)10010099969497.8%
Claude Opus 4.6 (Reasoning)1001001001008897.6%
Muse Glimmer 30B (Reasoning, Medium)1001001001008797.3%
Qwen 3.7 Flash (Reasoning)1001001001008797.3%
GPT-5.4 Mini100100100978997.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001008697.1%
Z.AI GLM 5 Turbo100100100948996.6%
Claude Sonnet 4.6 (Reasoning)100100100948996.6%
DeepSeek V4 Flash (Reasoning)1001001001008296.3%
Z.AI GLM 5.3 (Reasoning, Max)1001001001008095.9%
Claude Opus 51001001001007795.5%
Xiaomi MIMO v2.6 Pro1001001001007595.0%
Z.AI GLM 5100100100928395.0%
Claude Opus 5 (Reasoning, Low)100100100948094.7%
MiniMax M310010092928994.5%
MiniMax M2.5100100100898394.5%
Qwen 3.6 Flash100100100977594.4%
Claude Opus 4.8 (Reasoning)100100100947794.2%
GPT-5.4 Mini (Reasoning)100100100977293.9%
Aion 3.5 Mini (Reasoning, High)1001001001006993.9%
Claude Haiku 5.5 (Reasoning, Low)10010080 – – 93.2%
Claude Sonnet 5.5 (Reasoning)100100100887793.1%
Mistral Large 4.0100100100838293.0%
Claude Opus 5.5 (Reasoning)100100100897292.3%
Grok 4.5 (Reasoning, High)100100100926992.2%
Grok 4.3 (Reasoning)1001001001006092.0%
Thinking Machines Inkling (Reasoning)1001001001005891.7%
Muse Spark 1.2 (Reasoning, Medium)1001001001005791.4%
Claude Opus 4.7 (Reasoning)10010089838391.2%
Xiaomi MIMO v2.6 Flash100100100965890.8%
Mistral Medium 3.11001001001005490.7%
Claude Opus 5 (Reasoning)100100100807290.4%
Kimi K3 (Reasoning, Low)100100100926090.3%
Claude Opus 4100100100836790.1%
Claude Opus 4.8 (Reasoning, Low)10010092827790.1%
Claude Haiku 5.5 (Adaptive)100100100757590.0%
Grok 4.310010087838089.9%
Qwen 3.5 Plus (2026-04-20)100100100965489.8%
Claude Haiku 4.510010096916389.7%
Aion 3.5 (Reasoning, High)10010096965789.6%
Kimi K2.510010097806989.2%
Claude Sonnet 5 (Reasoning)100100100875889.0%
Claude Haiku 5.5 (Reasoning, Medium)10010083807587.6%
Kimi K3 (Reasoning, High)10010097776387.4%
Grok 4.20 (Reasoning)100100100775887.1%
Claude Opus 4.61001001001003486.8%
Hermes 3 405B1001001001003486.8%
Mistral Large 310010097894686.5%
Claude Sonnet 41001001001003186.3%
Gemini 3.8 Flash (Reasoning, Medium)10010094696685.9%
Claude Sonnet 51009696805785.5%
DeepSeek V4.1 Flash (Reasoning, High)1001001001002585.0%
Writer: Palmyra X51009788696784.4%
Claude Opus 4.5100100100665483.9%
Mistral Small 4100100100635683.6%
Qwen 3.6 Max Preview1001001001001883.6%
o4 Mini1008383806682.5%
DeepSeek V4 Pro (Reasoning)100100100921481.1%
ByteDance Seed 2.0 Lite100100100634280.8%
Xiaomi MIMO v2.5 Pro10010084734680.8%
Grok 4.7 (Reasoning, High)100100100100080.0%
Qwen 3.5 122B10010010099079.7%
Grok 4.5 (Reasoning, Low)100100100722579.5%
Grok 4.2010010083713778.3%
GPT-5.4 Nano10010071685077.8%
Z.AI GLM 4.7 Flash10010010082076.3%
Mistral Large 4.0 (Reasoning)1008787585076.3%
Thinking Machines Inkling Small (Reasoning, High)10010096543176.1%
GPT-5 Mini908881794275.9%
GPT-5.4 Nano (Reasoning, Low)10010010074074.7%
Thinking Machines Inkling10010085632574.5%
Laguna S 2.11009672504672.8%
Z.AI GLM 4.5968573565472.7%
o4 Mini High10010071542570.0%
Laguna XS 2.110010077542070.0%
Mistral Large 299978766069.7%
Grok 4.6 (Reasoning, High)10010010048069.6%
ByteDance Seed 1.6 Flash10010091341868.6%
GPT-5.4 Nano (Reasoning)1008971542567.9%
Mistral Small 4 (Reasoning)10010058423767.4%
WizardLM 2 8x22b1001007850666.8%
ByteDance Seed 1.610010010025065.0%
Gemini 3.7 Flash (Reasoning, Medium)1001007531061.3%
DeepSeek V4 Flash1001006337059.9%
Gemini 3.5 Flash Lite (Reasoning)898563461459.3%
Cydonia 24B V4.11006557393659.3%
Ministral 3 14B1007563421158.1%
Qwen 3 32B87807542056.6%
GPT-4o, Aug. 6th (temp=1)928054302555.9%
Aion 2.092877211753.9%
Gemini 3.5 Flash (Reasoning, Minimal)100835430053.3%
Gemini 3.5 Flash (Reasoning)1005749341450.9%
Z.AI GLM 4.777726342050.6%
GPT-4.180726614046.4%
Gemini 3.1 Flash Lite (Reasoning)100664220045.5%
Ministral 3 8B9175547045.3%
Gemini 3.6 Flash (Reasoning)8877580044.7%
Z.AI GLM 4.5 Air100100100041.9%
Mistral Medium 3.5 (Reasoning)93693710041.7%
Qwen 3.6 27B100572525041.4%
Gemini 3.6 Flash (Reasoning, Minimal)655438282040.9%
DeepSeek V3 (2024-12-26)9654540040.5%
Gemma 4 26B (Reasoning)10010000040.0%
Ministral 3B10010000040.0%
GPT-5 Nano10071214039.3%
Gemini 3.5 Flash Lite (Reasoning, Minimal)69543431037.7%
DeepSeek-V2 Chat1007500035.0%
Gemma 4 31B (Reasoning)1006300032.5%
Gemma 3 12B66503011031.5%
DeepSeek V3.266483011031.1%
Qwen 3.5 Plus (2026-02-15)5651375029.7%
Hermes 3 70B1004800029.6%
ByteDance Seed 2.0 Mini7546250029.2%
Gemini 2.5 Flash1004400028.8%
DeepSeek V3.110025140027.8%
Gemini 3 Flash (Preview, Reasoning)1002500025.0%
Mistral Medium 3.567341410025.0%
Xiaomi MIMO v2.5694280023.9%
Gemini 2.5 Flash (Reasoning)5145210023.5%
GPT-4o Mini (temp=1)54361711023.4%
Nemotron 3 Super100000020.0%
Llama 3.1 70B100000020.0%
Gemma 3 27B543800018.3%
Qwen 2.5 72B80000015.9%
Z.AI GLM 4.63425140014.6%
Gemini 3 Flash (Preview)3122180014.1%
GPT-4.1 Mini69000013.9%
Arcee AI: Trinity Mini63000012.5%
Cohere Command R+ (Aug. 2024)63000012.5%
Gemma 3 4B63000012.5%
Mistral NeMO58000011.7%
Ministral 8B54000010.7%
Gemini 3.1 Flash Lite (Preview)37100009.3%
Gemma 4 31B4200008.3%
Gemma 4 26B25100006.9%
Gemini 2.5 Flash Lite2500005.0%
Gemini 3.1 Flash Lite2000003.9%
GPT-OSS 120B1800003.6%
Gemini 2.5 Pro000000.0%
Gemini 2.5 Flash Lite (Reasoning)000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Nemotron 3 Nano000000.0%
GPT-4.1 Nano000000.0%
Ministral 3 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
GPT-51001001001009999.9%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009999.7%
Aion 3.01001001001009999.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001009799.4%
Xiaomi MIMO v2.6 Flash1001001001009799.4%
GPT-5.4 Mini (Reasoning, Low)1001001001009799.4%
GPT-4.1100100100969698.2%
Claude Opus 5.5 (Reasoning)1001001001008797.3%
Qwen 3.6 Max Preview1001001001008797.3%
Claude Opus 5 (Reasoning)100100100949297.1%
Claude Opus 5100100100949297.1%
Kimi K3 (Reasoning, Low)1001001001008396.7%
Qwen 3.5 397B A17B1001001001008396.7%
GPT-5.4 Mini1001001001008396.7%
Muse Spark 1.1 (Reasoning, Medium)1001001001007795.5%
DeepSeek V4.1 Flash (Reasoning, High)1001001001007595.0%
Claude Sonnet 4.61001001001007595.0%
GPT-5.2100100100928395.0%
Xiaomi MIMO v2.5 Pro1001001001007595.0%
Hy4 Preview (Reasoning, High)100100100997594.7%
Claude Opus 4.8 (Reasoning)100100100977594.4%
GPT-5.11001001001007194.3%
GPT-5.5 (Reasoning, Medium)1001001001006993.9%
Claude Sonnet 41001001001006993.9%
DeepSeek V3 (2025-03-24)1001001001006993.9%
o4 Mini100100100927593.3%
Aion 3.0 Mini1001001001006693.2%
Muse Spark 1.1 (Reasoning, Minimal)100100100838092.6%
Z.AI GLM 5.3 (Reasoning, Max)1001001001006392.5%
Grok 4.5 (Reasoning, High)1001001001006392.5%
Muse Spark 1.3 (Reasoning, Medium)1001001001006392.5%
Aion 3.5 (Reasoning, High)1001001001006392.5%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006392.5%
ByteDance Seed 2.0 Lite1001001001006392.5%
Aion 3.5 Mini (Reasoning, High)100100100926992.2%
Claude Haiku 5.5 (Adaptive)100100100808091.8%
DeepSeek V4 Flash (Reasoning)100100100896991.7%
Grok 4.3100100100807590.9%
Claude Haiku 4.510010099975890.8%
Gemma 4 31B (Reasoning)1001001001005490.7%
Grok 4.5 (Reasoning, Low)100100100806989.8%
Z.AI GLM 5.2 (Reasoning, High)10010087877589.6%
Kimi K2.61001001001004889.6%
Claude Opus 4.6100100100836389.2%
Claude Opus 4.8 (Reasoning, Low)1009694837289.0%
Muse Spark 1.2 (Reasoning, Medium)1001001001004288.3%
GPT-5.4 (Reasoning)1001001001004288.3%
GPT-5.4 (Reasoning, Low)1001001001004288.3%
Mistral Small 4 (Reasoning)1001001001004288.3%
GPT-5 Mini100100100835888.2%
MiniMax M310010092776687.0%
GPT-5.4 Nano (Reasoning)100100100726387.0%
Claude Sonnet 5 (Reasoning, Low)1001001001003486.8%
GPT-5.4 Nano10010087776986.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100963786.5%
Qwen 3.7 Max100100100834685.9%
Claude Haiku 5.5 (Reasoning, Low)9280 – – – 85.6%
Claude Opus 4.7 (Reasoning)1001001001002585.0%
Qwen 3.5 Plus (2026-04-20)100100100695484.6%
Grok 4.201009983835483.8%
Claude Sonnet 510010089755483.6%
Z.AI GLM 510010099883083.3%
Gemini 3.7 Flash (Reasoning, Medium)1009183806383.2%
Claude Sonnet 4.51009292804882.2%
Claude Opus 5 (Reasoning, Low)100100100941481.5%
Hermes 3 405B100100100545481.4%
Writer: Palmyra X510010099832581.4%
WizardLM 2 8x22b100100100565081.2%
Claude Opus 4.710010087635480.5%
DeepSeek V4 Pro (Reasoning)10010087803480.0%
Xiaomi MIMO v2.6 Pro100100100100080.0%
ByteDance Seed 1.6100100100100080.0%
Qwen 3.5 Flash100100100100080.0%
MiniMax M2.71009989585480.0%
ByteDance Seed 2.0 Mini100100100424276.7%
Claude Sonnet 4.6 (Reasoning)1009694662576.1%
Laguna XS 2.1898969696376.0%
Qwen 3 32B948780664874.8%
Gemini 3.8 Flash (Reasoning, Medium)978069636374.2%
Grok 4.20 (Reasoning)10010083691874.1%
Mistral Large 210010010063072.5%
Claude Opus 4.51008980662572.0%
Kimi K2.51001009658070.8%
Z.AI GLM 5.11009663544270.7%
Z.AI GLM 5 Turbo10010063543470.0%
Thinking Machines Inkling (Reasoning)1001007569068.9%
Mistral Large 4.0 (Reasoning)100948069068.5%
Claude Sonnet 5 (Reasoning)1007563634268.3%
Hermes 3 70B10010010042068.3%
Mistral Large 4.01007563464665.9%
Qwen 3 235B A22B Instruct 2507100100100141064.7%
o4 Mini High1001006756064.7%
GPT-5.4 Nano (Reasoning, Low)1009488201663.6%
Cydonia 24B V4.11008066541462.6%
Thinking Machines Inkling Small (Reasoning, High)10010063252562.5%
Mistral Medium 3.189807563061.3%
Laguna S 2.11001007525060.0%
Z.AI GLM 4.5100726560059.4%
Qwen 3.6 27B776959464459.3%
DeepSeek V4 Flash100100920058.3%
Thinking Machines Inkling100756354058.2%
MiniMax M2.5100896634057.9%
GPT-4.1 Mini875450484656.8%
DeepSeek-V2 Chat1001006020055.9%
Z.AI GLM 4.5 Air10094780054.4%
ByteDance Seed 1.6 Flash100875825054.0%
Gemini 3.5 Flash Lite (Reasoning)1001003725052.4%
Gemma 4 31B100754234050.2%
Mistral Small 4100100480049.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100754625049.2%
DeepSeek V3 (2024-12-26)1001003014048.7%
Mistral Medium 3.5100834210046.9%
GPT-4o, Aug. 6th (temp=1)96754214045.2%
Ministral 3 14B100692525043.9%
Z.AI GLM 4.7 Flash95604810042.4%
Gemini 3.6 Flash (Reasoning)83665011042.2%
Gemini 3.6 Flash (Reasoning, Minimal)63544238039.2%
Xiaomi MIMO v2.5997570036.2%
Cohere Command R+ (Aug. 2024)8769250036.2%
GPT-4o Mini (temp=1)7265360034.6%
Gemini 3.5 Flash (Reasoning)10042310034.6%
Mistral Large 39448300034.3%
Mistral Medium 3.5 (Reasoning)7542250028.3%
Gemini 3 Flash (Preview, Reasoning)10031100028.2%
DeepSeek V3.2825800028.0%
Z.AI GLM 4.75754290027.8%
Z.AI GLM 4.68034180026.3%
Gemini 2.5 Flash (Reasoning)4832316624.7%
Ministral 3 8B1001470024.2%
Mistral NeMO1001800023.6%
Gemini 2.5 Flash Lite694500022.9%
Gemini 3 Flash (Preview)574250020.7%
Gemma 4 26B (Reasoning)100000020.0%
Gemini 2.5 Pro100000020.0%
Llama 3.1 70B100000020.0%
DeepSeek V3.14834100018.4%
Gemini 2.5 Flash632800018.1%
GPT-4.1 Nano87000017.3%
Ministral 8B87000017.3%
Gemini 3.1 Flash Lite (Reasoning)4218140014.7%
Gemini 3.1 Flash Lite (Preview)66000013.2%
Gemma 3 12B3018160012.8%
Aion 2.0371460011.3%
GPT-4o, Aug. 6th (temp=0)4800009.6%
Qwen 2.5 72B4800009.6%
Qwen 3.5 Plus (2026-02-15)31124009.4%
Gemini 3.5 Flash (Reasoning, Minimal)4500009.0%
Gemma 3 27B2560006.2%
GPT-OSS 120B2540005.9%
Ministral 3 3B2500005.0%
Arcee AI: Trinity Mini1800003.6%
Nemotron 3 Nano1100002.3%
Gemini 3.1 Flash Lite000000.0%
Gemma 4 26B000000.0%
Gemini 2.5 Flash Lite (Reasoning)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
GPT-5 Nano000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 4B000000.0%
Ministral 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Aion 3.0100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009999.7%
Xiaomi MIMO v2.5 Pro1001001001009999.7%
Hy4 Preview (Reasoning, High)1001001001009799.4%
Claude Sonnet 4.6 (Reasoning)1001001001009699.1%
Claude Opus 51001001001009699.1%
Qwen 3.6 35B1001001001009699.1%
Kimi K3 (Reasoning, Low)100100100999698.9%
MiniMax M2.71001001001009498.8%
Aion 3.0 Mini100100100999598.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100979698.6%
Grok 4.5 (Reasoning, High)1001001001009298.3%
Xiaomi MIMO v2.6 Pro1001001001009298.3%
GPT-6 Sol (Reasoning, Medium)1001001001008997.9%
GPT-5.2100100100999197.8%
Qwen 3 235B A22B Instruct 2507100100100979297.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001008797.3%
Claude Haiku 5.5 (Reasoning, Medium)1001001001008797.3%
GPT-51001001001008697.1%
Claude Opus 5 (Reasoning, Low)100100100929296.7%
Claude Opus 4.71001001001008396.7%
DeepSeek V3 (2025-03-24)1001001001008396.7%
Grok 4.7 (Reasoning, High)1001001001008095.9%
Muse Spark 1.1 (Reasoning, Medium)100100100968395.8%
GPT-5.11001001001007895.6%
Qwen 3.7 Max1001001001007795.5%
Qwen 3.8 Flash (Reasoning)1001001001007795.5%
Claude Sonnet 4.6100100100898795.2%
Muse Glimmer 30B (Reasoning, Medium)1001001001007595.0%
Xiaomi MIMO v2.6 Flash10010099967794.3%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100888394.3%
GPT-6 Luna (Reasoning, High)1001001001006993.9%
Claude Opus 4.7 (Reasoning)100100100898093.8%
Claude Sonnet 5.5 (Reasoning)10010099927793.5%
Writer: Palmyra X5100100100838393.3%
Z.AI GLM 5.2 (Reasoning, High)100100100966993.0%
GPT-5.5 (Reasoning, Low)1001001001006392.5%
GPT-5.6 Terra (Reasoning, Medium)1001001001006392.5%
Aion 3.5 Mini (Reasoning, High)1001001001006392.5%
Grok 4.6 (Reasoning, High)100100100877592.3%
MiniMax M3100100100877291.8%
Cydonia 24B V4.110010088888391.8%
Kimi K2.5100100100896991.7%
Aion 3.5 (Reasoning, High)1009994878091.7%
DeepSeek V4 Flash100100100966391.6%
DeepSeek V4 Pro (Reasoning)100100100886991.5%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100995891.4%
GPT-5.4 (Reasoning)1001001001005490.7%
Kimi K3 (Reasoning, High)1001001001005490.7%
DeepSeek V4 Pro100100100836990.6%
Qwen 3.5 122B100100100777590.5%
Claude Opus 4.8 (Reasoning)10010097926390.3%
Z.AI GLM 5 Turbo10010096896590.0%
Claude Opus 5 (Reasoning)100100100777289.9%
Z.AI GLM 5.11001001001004889.6%
Claude Opus 5.5 (Reasoning)1009689876988.2%
MiniMax M2.5100100100696987.8%
Claude Opus 4.51009994726385.5%
Claude Opus 4.8 (Reasoning, Low)1009992726385.0%
Gemma 4 31B (Reasoning)1001001001002585.0%
Claude Haiku 5.5 (Adaptive)100100100636385.0%
Claude Opus 4.6100100100635483.2%
WizardLM 2 8x22b969182805680.9%
Grok 4.201009592873180.8%
Qwen 3.6 27B100100100772580.3%
GPT-5.4 Nano1009182775179.9%
Kimi K2.610010010094078.8%
Claude Haiku 4.51009480724578.1%
GPT-5.4 Mini (Reasoning, Low)10010094544277.8%
Mistral Small 4 (Reasoning)1009996484477.3%
Claude Sonnet 510010010087077.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010010080075.9%
GPT-5.4 Mini (Reasoning)10010010080075.9%
Z.AI GLM 51001008989075.7%
Thinking Machines Inkling (Reasoning)10010010075075.0%
Grok 4.20 (Reasoning)928777774274.9%
Grok 4.5 (Reasoning, Low)1001009975074.7%
GPT-5.4 Nano (Reasoning)1008375694574.6%
Claude Sonnet 41001009475073.8%
Claude Sonnet 5 (Reasoning)10010010063072.5%
GPT-5.510010010063072.5%
GPT-5 Mini948474693871.9%
GPT-4o, Aug. 6th (temp=1)97979463771.6%
Gemini 3.1 Flash Lite (Preview)1001009263070.8%
o4 Mini High1008575751870.6%
Mistral Large 4.0817877734270.3%
Hermes 3 405B1001009656070.3%
Laguna S 2.1100968072069.5%
Claude Haiku 5.5 (Reasoning, Low)69 – – – – 69.4%
Muse Spark 1.1 (Reasoning, Minimal)10010010042068.3%
ByteDance Seed 1.610010010025065.0%
Claude Sonnet 5 (Reasoning, Low)10010010010061.9%
Grok 4.394836963061.8%
Gemini 3 Flash (Preview, Reasoning)1001001000060.0%
Gemma 4 26B1001001000060.0%
DeepSeek V3.21007266461459.7%
Mistral Small 41001005048059.6%
GPT-5.4 Nano (Reasoning, Low)959548381257.5%
Qwen 3 32B967554342556.7%
Mistral Large 4.0 (Reasoning)87775454755.7%
Qwen 3.5 Plus (2026-02-15)100100780055.6%
ByteDance Seed 2.0 Mini1001005418054.3%
Gemini 3.5 Flash Lite (Reasoning)100100660053.2%
Mistral Medium 3.11001003130052.2%
Gemini 3.7 Flash (Reasoning, Medium)100757510051.9%
Grok 4.3 (Reasoning)10089630050.4%
GPT-4.110075690048.9%
Laguna XS 2.180754642048.5%
Gemini 3.6 Flash (Reasoning)100963411048.2%
Gemini 3.6 Flash (Reasoning, Minimal)100663834047.7%
Aion 2.099653825746.8%
ByteDance Seed 1.6 Flash87575131045.2%
Thinking Machines Inkling10083420045.0%
Z.AI GLM 4.591694814044.4%
o4 Mini100100200043.9%
Mistral Large 2100632525042.5%
Z.AI GLM 4.7 Flash10066460042.4%
Gemini 2.5 Flash82564217840.9%
Gemma 4 26B (Reasoning)10010000040.0%
Mistral Large 369633416036.5%
Z.AI GLM 4.5 Air8363360036.3%
Ministral 3 14B1008000035.9%
Hermes 3 70B1008000035.9%
DeepSeek V3 (2024-12-26)8542420033.7%
Xiaomi MIMO v2.5604225201432.0%
DeepSeek-V2 Chat757500030.0%
Z.AI GLM 4.7785880029.0%
Gemini 3.1 Flash Lite6642250026.6%
Gemini 3.8 Flash (Reasoning, Medium)8725147026.6%
Gemini 2.5 Flash (Reasoning)685054025.5%
Gemini 3.5 Flash (Reasoning, Minimal)1002500025.0%
Nemotron 3 Nano1002200024.3%
GPT-4.1 Mini575400022.1%
Gemma 3 27B575400022.1%
Mistral Medium 3.55836110021.1%
Cohere Command R+ (Aug. 2024)663400020.1%
Gemma 4 31B100000020.0%
Llama 3.1 70B100000020.0%
Thinking Machines Inkling Small (Reasoning, High)5025210019.2%
Gemini 2.5 Pro25201818016.1%
Gemini 3 Flash (Preview)75000015.0%
Mistral Medium 3.5 (Reasoning)72000014.5%
Gemma 3 12B342100011.0%
GPT-4.1 Nano54000010.7%
Ministral 3B54000010.7%
DeepSeek V3.134110009.1%
GPT-5 Nano25180008.6%
Gemma 3 4B3000006.0%
Gemini 2.5 Flash Lite (Reasoning)2500005.0%
Gemini 3.1 Flash Lite (Reasoning)1800003.6%
Ministral 3 8B1600003.2%
Z.AI GLM 4.61400002.8%
GPT-4o Mini (temp=1)1000001.9%
Arcee AI: Trinity Mini1000001.9%
Gemini 3.5 Flash (Reasoning)000000.0%
GPT-OSS 120B000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
Gemini 2.5 Flash Lite000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Ministral 8B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Aion 3.0100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009699.1%
GPT-51001001001009498.9%
Mistral Medium 3.11001001001007595.0%
GPT-5 Mini10010096898594.0%
Claude Opus 4.6 (Reasoning)1001001001006993.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001006993.9%
Qwen 3 32B100100100838192.8%
Claude Opus 5 (Reasoning)1001001001006392.5%
Qwen 3.5 Plus (2026-04-20)1001001001006392.5%
Hermes 3 405B1001001001006392.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001005490.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001005490.7%
Gemini 2.5 Flash Lite1001001001005490.7%
GPT-5.11009794827589.5%
Claude Sonnet 5.5 (Reasoning)100100100836389.2%
Muse Spark 1.1 (Reasoning, Minimal)1001001001004288.3%
Z.AI GLM 51001001001004288.3%
Claude Opus 5.5 (Reasoning)100100100875488.0%
Z.AI GLM 4.7100100100804885.5%
Claude Opus 4.7 (Reasoning)1001001001002585.0%
Claude Opus 4.71001001001002585.0%
DeepSeek V4 Pro (Reasoning)1001001001002585.0%
ByteDance Seed 2.0 Lite1001001001002585.0%
GPT-5.4 (Reasoning)100100100100080.0%
Aion 3.5 Mini (Reasoning, High)100100100752580.0%
Claude Sonnet 4.6100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
DeepSeek V4 Flash (Reasoning)100100100100080.0%
Claude Sonnet 5100100100100080.0%
Z.AI GLM 4.5100100100100080.0%
GPT-5.4 Mini100100100100080.0%
Thinking Machines Inkling100100100100080.0%
Kimi K2.5100100100633479.3%
GPT-5.4 (Reasoning, Low)100100100544279.0%
Mistral Medium 3.5100100100544279.0%
Claude Haiku 4.5100100100424276.7%
MiniMax M2.710010092543475.9%
Claude Opus 4.8 (Reasoning, Low)10010075634275.8%
Cydonia 24B V4.110010072723475.8%
Grok 4.201008369674272.4%
Mistral Large 4.01001008280072.2%
DeepSeek V4 Flash 0731 (Reasoning, High)10010010054070.7%
Aion 3.0 Mini10010010054070.7%
Gemini 2.5 Flash10010010054070.7%
MiniMax M2.5100878780070.5%
Claude Opus 4.8 (Reasoning)100100100252570.0%
Writer: Palmyra X5100100100252570.0%
GPT-5.4 Nano (Reasoning)1009966483769.9%
Mistral Small 410010080422569.2%
Thinking Machines Inkling (Reasoning)10010010042068.3%
Gemini 3.6 Flash (Reasoning)1008363544268.2%
DeepSeek V4 Pro1008380422565.9%
GPT-5.21001006960065.8%
Mistral Small 4 (Reasoning)1001009234065.2%
Gemini 3.7 Flash (Reasoning, Medium)10010010025065.0%
Claude Sonnet 5 (Reasoning, Low)10010010025065.0%
Z.AI GLM 4.610010010025065.0%
Grok 4.310010010025065.0%
Mistral Medium 3.5 (Reasoning)1001006954064.6%
Aion 2.010010063421463.6%
Claude Haiku 5.5 (Reasoning, Low)10025 – – – 62.5%
ByteDance Seed 1.6 Flash1001006348062.1%
WizardLM 2 8x22b1001008025060.9%
Grok 4.6 (Reasoning, High)1001001000060.0%
Grok 4.3 (Reasoning)1001001000060.0%
Claude Sonnet 5 (Reasoning)1001001000060.0%
Gemma 4 26B (Reasoning)1001001000060.0%
Gemini 2.5 Pro1001001000060.0%
ByteDance Seed 2.0 Mini1001001000060.0%
Gemini 3.5 Flash Lite (Reasoning)1001001000060.0%
DeepSeek V3 (2025-03-24)1001001000060.0%
Llama 3.1 70B1001001000060.0%
Hermes 3 70B1001001000060.0%
Arcee AI: Trinity Mini1001001000060.0%
Grok 4.20 (Reasoning)1001008014058.7%
Gemini 3.1 Flash Lite (Reasoning)1001007514057.8%
DeepSeek V3.21001005425055.7%
Z.AI GLM 4.7 Flash10010025252555.0%
Mistral Large 4.0 (Reasoning)100100630052.5%
Mistral Small 3.2 24B100100630052.5%
Laguna S 2.1100872525047.3%
ByteDance Seed 1.6100100340046.8%
GPT-5.4 Nano (Reasoning, Low)806932251444.1%
Gemini 2.5 Flash (Reasoning)10010060041.2%
Z.AI GLM 4.5 Air10089120040.3%
Gemma 4 31B (Reasoning)10010000040.0%
o4 Mini High10010000040.0%
Mistral Large 310010000040.0%
GPT-4o, Aug. 6th (temp=1)10010000040.0%
GPT-4.1 Nano10010000040.0%
Mistral NeMO10010000040.0%
Ministral 3B10010000040.0%
GPT-4o Mini (temp=1)100582011037.9%
Ministral 3 14B6969250032.8%
Gemma 4 31B10034250031.8%
o4 Mini54423414028.6%
Xiaomi MIMO v2.51003400026.8%
GPT-5.4 Nano5450180024.3%
GPT-5 Nano34342918023.0%
Thinking Machines Inkling Small (Reasoning, High)100000020.0%
Gemma 4 26B100000020.0%
DeepSeek-V2 Chat100000020.0%
Mistral Large 2100000020.0%
GPT-4.1 Mini100000020.0%
Ministral 3 3B100000020.0%
Gemini 3.6 Flash (Reasoning, Minimal)58181410019.9%
Gemini 3.5 Flash (Reasoning, Minimal)633700019.9%
Laguna XS 2.1871000019.2%
DeepSeek V3.1692500018.9%
Gemini 3 Flash (Preview)482500014.6%
Qwen 3.5 Plus (2026-02-15)71000014.3%
Qwen 2.5 72B69000013.9%
Gemini 3.1 Flash Lite541400013.5%
GPT-4.1422500013.3%
Cohere Command R+ (Aug. 2024)422500013.3%
Gemma 3 27B2525140012.8%
Gemini 3 Flash (Preview, Reasoning)54000010.7%
Ministral 8B54000010.7%
DeepSeek V3 (2024-12-26)2500005.0%
Gemma 3 12B2500005.0%
Nemotron 3 Nano2000003.9%
Gemini 3.5 Flash (Reasoning)1000001.9%
Gemini 3.1 Flash Lite (Preview)000000.0%
GPT-OSS 120B000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
GPT-4o Mini (temp=0)000000.0%
Ministral 3 8B000000.0%
Gemma 3 4B000000.0%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.6 Terra1001001001009999.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009699.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009298.3%
Qwen 3.8 Max (Reasoning, XHigh)1001001001008997.9%
GPT-5.51001001001008997.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008797.3%
Claude Opus 5 (Reasoning)100100100948796.1%
GPT-6 Luna (Reasoning, Medium)100100100998095.6%
Aion 3.5 Mini (Reasoning, High)100100100898795.2%
Claude Haiku 5.5 (Adaptive)100100100948094.7%
GPT-5.5 (Reasoning, Medium)100100100918294.4%
Claude Opus 5 (Reasoning, Low)100100100898294.2%
Qwen 3.8 27B (Reasoning, XHigh)100100100878394.0%
Claude Sonnet 5100100100878093.2%
Claude Opus 5100100100927292.8%
Qwen 3.7 Max1001001001006392.5%
Aion 3.5 (Reasoning, High)10010097966992.5%
Claude Opus 5.5 (Reasoning)1009797927592.2%
Xiaomi MIMO v2.6 Flash10010097838092.0%
Muse Glimmer 30B (Reasoning, Medium)10010094897591.6%
Muse Spark 1.1 (Reasoning, Medium)10010099896991.5%
Grok 4.7 (Reasoning, High)10010094877591.1%
Grok 4.3 (Reasoning)1001001001005490.7%
Claude Opus 4.8 (Reasoning, Low)10010092877590.6%
Claude Haiku 5.5 (Reasoning, Medium)100100100806989.8%
Kimi K3 (Reasoning, High)1009996777589.3%
Xiaomi MIMO v2.6 Pro10010097826689.0%
Claude Sonnet 5.5 (Reasoning)1009997895087.0%
GPT-5.1999983777586.8%
Claude Sonnet 4.6 (Reasoning)1009794806386.6%
Claude Opus 4.8 (Reasoning)1009492836386.3%
Z.AI GLM 5.3 (Reasoning, Max)100100100803783.3%
Qwen 3.8 Flash (Reasoning)1009777756683.2%
Muse Spark 1.2 (Reasoning, Medium)1009696665883.1%
MiniMax M2.51008280807282.6%
DeepSeek V4 Pro 0813 (Reasoning, High)1009289874281.8%
Qwen 3.7 Flash (Reasoning)100100100100781.5%
Mistral Small 410010097723781.3%
GPT-5.4 (Reasoning, Low)10010071676681.0%
Grok 4.5 (Reasoning, High)100100100693480.7%
Z.AI GLM 5.11009989734280.6%
Claude Opus 4.610010082635780.2%
Qwen 3.5 397B A17B100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
Qwen 3.6 35B100100100100080.0%
GPT-5.4 Mini (Reasoning)10010094634279.6%
Mistral Large 4.01009275666579.6%
MiniMax M3838382806979.4%
GPT-5.4 Mini (Reasoning, Low)1009687664879.3%
GPT-5.41009782754279.1%
Claude Haiku 5.5 (Reasoning, Low)1008054 – – 77.7%
Claude Opus 41009385733677.3%
DeepSeek V4.1 Flash (Reasoning, High)1009494831476.9%
Claude Opus 4.7 (Reasoning)1008380754275.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010010080075.9%
Kimi K3 (Reasoning, Low)10010092542574.0%
Xiaomi MIMO v2.510010078484273.6%
Claude Sonnet 5 (Reasoning)949287691871.9%
Kimi K2.61009969543771.7%
Mistral Small 4 (Reasoning)10010071573071.6%
Qwen 3.5 9B10010072483771.4%
GPT-5.4 Mini10010075423770.7%
Qwen 3 235B A22B Instruct 2507100998965070.6%
ByteDance Seed 2.0 Lite1001008963070.4%
Aion 3.0100927575769.8%
Grok 4.6 (Reasoning, High)10010069483169.8%
Qwen 3.5 35B10010063581166.4%
GPT-594917474066.3%
Z.AI GLM 5.2 (Reasoning, High)1008069542565.5%
Claude Sonnet 5 (Reasoning, Low)1009489341065.3%
Z.AI GLM 51001008934064.7%
Claude Haiku 4.51001006654063.9%
Thinking Machines Inkling838266631661.8%
GPT-5 Mini807269632561.8%
Claude Opus 4.710010048342561.4%
Hy4 Preview (Reasoning, High)1001009710061.4%
GPT-4o, Aug. 6th (temp=1)100757554060.7%
Kimi K2.5100967234060.4%
Qwen 3.5 Plus (2026-04-20)1001001000060.0%
GPT-5.4 Nano (Reasoning)928275381059.2%
GPT-5.4 Nano726757544559.0%
DeepSeek V4 Pro1008948302558.4%
Writer: Palmyra X51006360422557.8%
Muse Spark 1.1 (Reasoning, Minimal)100885045056.6%
Xiaomi MIMO v2.5 Pro100946325056.3%
Hermes 3 70B1001006614056.0%
Qwen 3.5 122B1001005025055.0%
Aion 3.0 Mini100805442055.0%
Thinking Machines Inkling (Reasoning)1008348251454.1%
Gemini 3.5 Flash Lite (Reasoning)100100690053.9%
Hermes 3 405B1001005810053.6%
Gemini 3.8 Flash (Reasoning, Medium)1008754181053.5%
GPT-5.2716864441853.2%
Claude Sonnet 4.5755858373753.0%
Z.AI GLM 5 Turbo100894231052.4%
Ministral 8B100100540050.7%
Grok 4.2092634848050.1%
Z.AI GLM 4.7 Flash83635845049.8%
ByteDance Seed 1.6635454423749.6%
Grok 4.5 (Reasoning, Low)100753425046.8%
Laguna S 2.189575434046.8%
Grok 4.20 (Reasoning)9272690046.7%
Gemini 3.7 Flash (Reasoning, Medium)83803425044.4%
Qwen 3.5 Flash10080420044.2%
MiniMax M2.710063580044.2%
Claude Sonnet 480665418043.4%
Aion 2.096544218743.2%
DeepSeek V4 Pro (Reasoning)10087250042.3%
DeepSeek-V2 Chat63634834041.4%
Gemini 3.6 Flash (Reasoning, Minimal)928710101041.4%
GPT-4.18063630040.9%
DeepSeek V4 Flash69464642040.6%
GPT-5 Nano75605116040.5%
Gemini 3.1 Pro (Preview)10075250040.0%
Gemini 2.5 Flash Lite (Reasoning)10010000040.0%
Mistral Medium 3.510054420039.0%
Mistral Large 4.0 (Reasoning)83543018036.9%
Mistral Medium 3.5 (Reasoning)10069140036.7%
ByteDance Seed 2.0 Mini100373411036.4%
Laguna XS 2.110048340036.4%
o4 Mini High10063140035.3%
DeepSeek V3 (2025-03-24)75424214034.4%
Claude Opus 4.563572518633.6%
Cydonia 24B V4.1573832251132.7%
Mistral Medium 3.183312518031.5%
o4 Mini807500030.9%
Qwen 3 32B8348180029.9%
GPT-4o Mini (temp=1)995000029.7%
DeepSeek V4 Flash (Reasoning)69422510029.1%
GPT-5.4 Nano (Reasoning, Low)48393125028.6%
Mistral Large 310025180028.6%
Gemini 3.6 Flash (Reasoning)9220180025.9%
Mistral Large 210014140025.6%
Gemma 4 31B (Reasoning)1002500025.0%
Grok 4.31002500025.0%
Ministral 3 14B695400024.6%
Z.AI GLM 4.56034250023.8%
Gemini 3.5 Flash (Reasoning, Minimal)54421410023.7%
Qwen 3.5 27B34302525022.8%
Qwen 3.6 27B1001100022.3%
Llama 3.1 70B100000020.0%
Ministral 3 8B100000020.0%
Z.AI GLM 4.5 Air652960020.0%
Thinking Machines Inkling Small (Reasoning, High)6918100019.4%
Gemini 3 Flash (Preview)583700019.0%
Gemma 4 31B751800018.6%
GPT-4.1 Mini751800018.6%
ByteDance Seed 1.6 Flash573600018.5%
DeepSeek V3 (2024-12-26)484200017.9%
Gemini 3.5 Flash (Reasoning)4214140013.9%
Nemotron 3 Nano63000012.5%
Qwen 3.5 Plus (2026-02-15)46600010.4%
Gemini 2.5 Flash (Reasoning)341800010.4%
Z.AI GLM 4.73400006.8%
Gemini 2.5 Flash3400006.8%
DeepSeek V3.22500005.0%
Cohere Command R+ (Aug. 2024)2500005.0%
Gemma 4 26B (Reasoning)1000001.9%
Gemma 4 26B1000001.9%
Gemini 3 Flash (Preview, Reasoning)000000.0%
Gemini 2.5 Pro000000.0%
Z.AI GLM 4.6000000.0%
GPT-OSS 120B000000.0%
DeepSeek V3.1000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Nemotron 3 Super000000.0%
Gemini 2.5 Flash Lite000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Gemma 3 27B000000.0%
Qwen 2.5 72B000000.0%
WizardLM 2 8x22b000000.0%
GPT-4.1 Nano000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Ministral 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Haiku 5.5 (Reasoning, Max)100100 – – – 100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.7100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 3B100100100100100100.0%
Claude Opus 4.51001001001009498.8%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006993.9%
GPT-6.1 Sol (Reasoning, Medium)1001001001006392.5%
DeepSeek V4 Pro (Reasoning)1001001001006392.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001005490.7%
GPT-5.6 Sol1001001001005490.7%
Mistral Large 4.01001001001005490.7%
GPT-51009796876989.8%
GPT-5.5 (Reasoning, Low)10010096945889.5%
GPT-5.4 (Reasoning, Low)100100100755485.7%
Qwen 3.8 Flash (Reasoning)1001001001002585.0%
Z.AI GLM 5.11001001001002585.0%
Gemini 3.1 Flash Lite1001001001002585.0%
GPT-6 Luna1001001001002585.0%
DeepSeek V3 (2025-03-24)1001001001002585.0%
DeepSeek V4 Flash100100100635483.2%
Claude Opus 4100100100694282.2%
GPT-5.5 (Reasoning, Medium)10010087804281.6%
Hy4 Preview (Reasoning, High)100100100802580.9%
GPT-5.4100100100634280.8%
GPT-5.510010083694880.2%
Claude Opus 5.5 (Reasoning)100100100100080.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100080.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100080.0%
Qwen 3.7 Max100100100100080.0%
Grok 4.5 (Reasoning, High)100100100100080.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100080.0%
Grok 4.6 (Reasoning, High)100100100100080.0%
GPT-6 Luna (Reasoning, Medium)100100100100080.0%
Aion 3.5 Mini (Reasoning, High)100100100100080.0%
Claude Opus 4.8 (Reasoning)100100100100080.0%
Mistral Large 4.0 (Reasoning)100100100100080.0%
Aion 3.5 (Reasoning, High)100100100100080.0%
Qwen 3.5 397B A17B100100100100080.0%
Grok 4.3 (Reasoning)100100100100080.0%
Kimi K2.5100100100100080.0%
Claude Sonnet 5 (Reasoning)100100100100080.0%
Qwen 3.5 122B100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
Qwen 3.5 27B100100100100080.0%
GPT-5.4 Mini (Reasoning)100100100100080.0%
Qwen 3.5 Plus (2026-04-20)100100100100080.0%
Gemma 4 31B (Reasoning)100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100080.0%
Qwen 3.7 Flash (Reasoning)100100100100080.0%
Gemini 2.5 Pro100100100100080.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100080.0%
MiniMax M2.5100100100100080.0%
Xiaomi MIMO v2.5 Pro100100100100080.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100080.0%
Qwen 3.5 Flash100100100100080.0%
Gemma 4 31B100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100080.0%
Mistral Large 3100100100100080.0%
Aion 3.0 Mini100100100100080.0%
Claude Haiku 4.5100100100100080.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100080.0%
DeepSeek V3.1100100100100080.0%
DeepSeek V3.2100100100100080.0%
Grok 4.3100100100100080.0%
Llama 3.1 70B100100100100080.0%
Thinking Machines Inkling100100100100080.0%
Ministral 3 14B100100100100080.0%
Ministral 8B100100100100080.0%
GPT-5.4 (Reasoning)100100100633479.3%
GPT-5.4 Mini (Reasoning, Low)100100100544279.0%
Xiaomi MIMO v2.6 Pro100100100692578.9%
DeepSeek V4 Pro10010010083076.7%
GPT-5.6 Terra (Reasoning, Medium)10010083751474.4%
Kimi K3 (Reasoning, High)10010010063072.5%
DeepSeek V4 Flash (Reasoning)10010010054070.7%
GPT-5.4 Nano (Reasoning)10010063632570.0%
Kimi K3 (Reasoning, Low)10010010042068.3%
Grok 4.20 (Reasoning)10010010042068.3%
ByteDance Seed 1.610010010042068.3%
Qwen 3 32B1001009442067.1%
Z.AI GLM 5.2 (Reasoning, High)10010010025065.0%
Claude Opus 4.7 (Reasoning)10010010025065.0%
GPT-5 Nano10010010025065.0%
Mistral Small 4 (Reasoning)10010010025065.0%
Writer: Palmyra X510010010025065.0%
GPT-6 Luna (Reasoning, High)10010054252560.7%
Gemini 3.8 Flash (Reasoning, Medium)1001001000060.0%
Claude Opus 5 (Reasoning)1001001000060.0%
Grok 4.5 (Reasoning, Low)1001001000060.0%
Thinking Machines Inkling (Reasoning)1001001000060.0%
o4 Mini High1001001000060.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001000060.0%
Qwen 3.6 35B1001001000060.0%
Z.AI GLM 4.61001001000060.0%
Gemini 3.6 Flash (Reasoning, Minimal)1001001000060.0%
Mistral Medium 3.51001001000060.0%
Gemini 2.5 Flash1001001000060.0%
Qwen 3 235B A22B Instruct 25071001001000060.0%
Ministral 3 8B1001001000060.0%
GPT-4.1 Nano1001001000060.0%
Mistral NeMO1001001000060.0%
GPT-5.1100897534059.7%
GPT-5 Mini87806363058.2%
Claude Sonnet 41001006314055.3%
ByteDance Seed 2.0 Lite1001005414053.5%
Hermes 3 70B1001004225053.3%
ByteDance Seed 1.6 Flash77635450048.7%
Gemini 3 Flash (Preview)100100420048.3%
Hermes 3 405B100100420048.3%
GPT-OSS 120B10069690047.8%
o4 Mini100100340046.8%
Muse Spark 1.1 (Reasoning, Minimal)100100250045.0%
ByteDance Seed 2.0 Mini100100250045.0%
Xiaomi MIMO v2.5100100250045.0%
Nemotron 3 Super100100250045.0%
Mistral Medium 3.1100100250045.0%
Claude Sonnet 5.5 (Reasoning)100544225044.0%
GPT-5.4 Nano8769630043.7%
Laguna S 2.1100543425042.5%
Nemotron 3 Nano75634225040.8%
Gemini 3.6 Flash (Reasoning)10010000040.0%
Gemini 3.5 Flash (Reasoning)10010000040.0%
Grok 4.7 (Reasoning, High)10010000040.0%
Muse Glimmer 30B (Reasoning, Medium)10010000040.0%
GPT-4.110010000040.0%
Gemini 3.5 Flash (Reasoning, Minimal)10010000040.0%
Mistral Medium 3.5 (Reasoning)10010000040.0%
Gemini 2.5 Flash (Reasoning)10010000040.0%
GPT-4o, Aug. 6th (temp=0)10010000040.0%
Grok 4.2010010000040.0%
GPT-4o Mini (temp=1)10010000040.0%
Laguna XS 2.110010000040.0%
WizardLM 2 8x22b10010000040.0%
GPT-5.210075140037.8%
GPT-5.4 Nano (Reasoning, Low)6363540035.7%
Qwen 3.6 27B10042250033.3%
Claude Sonnet 4.51004200028.3%
Cydonia 24B V4.11003100026.3%
Aion 2.01002500025.0%
DeepSeek-V2 Chat1002500025.0%
Gemma 3 4B1002500025.0%
Qwen 3.5 Plus (2026-02-15)100000020.0%
Gemini 3.1 Flash Lite (Preview)100000020.0%
Gemma 4 26B100000020.0%
DeepSeek V3 (2024-12-26)100000020.0%
Z.AI GLM 4.7 Flash100000020.0%
GPT-4.1 Mini100000020.0%
Mistral Small 3.2 24B100000020.0%
Gemma 3 12B100000020.0%
Gemma 3 27B100000020.0%
Qwen 2.5 72B100000020.0%
Gemini 3 Flash (Preview, Reasoning)542500015.7%
Z.AI GLM 4.53400006.8%
Z.AI GLM 4.72500005.0%
Cohere Command R+ (Aug. 2024)2500005.0%
Inception Mercury 2000000.0%
Z.AI GLM 4.5 Air000000.0%
GPT-4o Mini (temp=0)000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Z.AI GLM 5 Turbo1001001001009999.7%
Claude Sonnet 5 (Reasoning)1001001001009799.4%
Claude Opus 4.6 (Reasoning)1001001001009699.3%
Z.AI GLM 5.2 (Reasoning, High)1001001001009699.1%
Kimi K3 (Reasoning, Low)1001001001009699.1%
GPT-5.5 (Reasoning, Medium)1001001001009598.9%
GPT-5.4 Mini (Reasoning, Low)1001001001009598.9%
Grok 4.5 (Reasoning, High)100100100979798.9%
GPT-5.51001001001009498.9%
GPT-5.41001001001009498.9%
Claude Opus 5 (Reasoning)1001001001008997.9%
Muse Spark 1.2 (Reasoning, Medium)1001001001008997.9%
DeepSeek V3 (2025-03-24)100100100979297.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001008897.6%
Aion 3.0100100100978997.3%
GPT-5.4 Mini (Reasoning)100100100998797.2%
GPT-5.6 Sol1001001001008697.1%
Claude Opus 4.8 (Reasoning)100100100968997.0%
GPT-5.4 (Reasoning, Low)1001001001008496.9%
Claude Sonnet 5.5 (Reasoning)1001001001008396.7%
Claude Haiku 5.5 (Reasoning, Medium)1001001001008396.7%
Claude Opus 5100100100998296.0%
Muse Spark 1.1 (Reasoning, Medium)100100100918895.7%
MiniMax M2.5100100100978195.6%
Qwen 3.5 27B1001001001007795.5%
Kimi K3 (Reasoning, High)1001001001007595.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100997594.7%
Z.AI GLM 5.11001001001007394.7%
Claude Opus 5.5 (Reasoning)10010093898793.7%
Claude Sonnet 4.5100100100858393.7%
Claude Opus 4.710010092928393.3%
Claude Sonnet 5 (Reasoning, Low)10010096878393.1%
Claude Opus 5 (Reasoning, Low)1001001001006593.0%
Xiaomi MIMO v2.6 Pro1001001001006392.5%
Claude Sonnet 4.6 (Reasoning)1001001001006092.0%
GPT-5.4 Mini100100100837191.0%
Qwen 3 235B A22B Instruct 250710010094837790.9%
Aion 3.5 (Reasoning, High)10010088887790.7%
DeepSeek V4.1 Flash (Reasoning, High)100100100836990.6%
Claude Haiku 4.5100100100896390.4%
Hy4 Preview (Reasoning, High)100100100856590.0%
Mistral Large 4.0 (Reasoning)100100100777289.9%
Grok 4.5 (Reasoning, Low)100100100777289.9%
Grok 4.20 (Reasoning)100100100995089.7%
Thinking Machines Inkling100100100895488.6%
MiniMax M2.7100100100786488.5%
GPT-5.1999689876887.8%
Z.AI GLM 5.3 (Reasoning, Max)10010088757587.6%
Grok 4.20100100100756087.0%
Grok 4.7 (Reasoning, High)10010088806586.5%
Claude Opus 4.7 (Reasoning)100100100834886.3%
Kimi K2.5100100100755485.7%
Claude Opus 4.510010095696485.7%
Grok 4.310010094775785.6%
Mistral Small 4 (Reasoning)10010087875485.3%
Claude Opus 4.8 (Reasoning, Low)100100100834285.0%
Gemini 3.1 Flash Lite (Preview)1001001001002585.0%
Qwen 3.5 9B1001001001002585.0%
Qwen 3.8 27B (Reasoning, XHigh)10010078776985.0%
Claude Haiku 5.5 (Adaptive)100100100893484.7%
GPT-5.4 Nano (Reasoning)10010080716983.9%
Aion 3.5 Mini (Reasoning, High)10010092834283.3%
Laguna S 2.11009285776383.3%
Mistral Small 41009689874583.3%
Gemini 3.8 Flash (Reasoning, Medium)1001001001001683.3%
Gemini 3.7 Flash (Reasoning, Medium)100100100575782.7%
MiniMax M310010094665482.7%
Grok 4.6 (Reasoning, High)1009277756982.7%
GPT-5.4 Nano (Reasoning, Low)1008577777282.2%
Qwen 3.7 Flash (Reasoning)100100100100781.5%
Mistral Large 4.01009278736381.1%
Xiaomi MIMO v2.6 Flash10010093922181.0%
Muse Spark 1.1 (Reasoning, Minimal)10010081804280.4%
Claude Sonnet 510010094832580.4%
Qwen 3.6 35B100100100100080.0%
Gemini 3.1 Flash Lite100100100100080.0%
Z.AI GLM 5100100100633779.9%
DeepSeek V4 Pro10010091772578.4%
DeepSeek V4 Flash 0731 (Reasoning, High)1001009683075.8%
Mistral Medium 3.1100959189074.9%
Qwen 3.6 27B1009969574874.6%
Writer: Palmyra X51009283772074.4%
Qwen 3.6 Flash100100100422573.3%
Qwen 3.5 35B100100100422573.3%
GPT-5978574555372.8%
GPT-5.2998266595872.7%
GPT-5 Mini1009573692572.5%
Qwen 3.5 Plus (2026-04-20)1001008775072.3%
DeepSeek V4 Flash100878383772.1%
Aion 3.0 Mini1008380603771.9%
Gemini 3.6 Flash (Reasoning, Minimal)827169676771.4%
Qwen 3.5 Flash10010096342570.9%
Claude Sonnet 410010065454470.9%
Qwen 3.5 122B10010069463770.5%
DeepSeek V4 Flash (Reasoning)100997269068.1%
Z.AI GLM 4.7858369633867.7%
o4 Mini948787541466.9%
Claude Opus 4100858260666.8%
Gemini 3.5 Flash Lite (Reasoning)10010072372065.8%
Muse Glimmer 30B (Reasoning, Medium)10010054451863.3%
GPT-5.4 Nano777163545062.8%
Gemini 3.1 Pro (Preview)10010010011062.3%
o4 Mini High1007766541462.2%
GPT-4.1966054543860.1%
Llama 3.1 70B1001001000060.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001006331058.8%
DeepSeek V4 Pro 0813 (Reasoning, High)10010050301158.2%
Xiaomi MIMO v2.5100100855058.0%
Gemini 3.6 Flash (Reasoning)826754512555.7%
GPT-4o, Aug. 6th (temp=1)975854343054.6%
ByteDance Seed 1.6 Flash100757522054.3%
DeepSeek V4 Pro (Reasoning)91756342053.9%
Claude Haiku 5.5 (Reasoning, Low)54 – – – – 53.6%
Grok 4.3 (Reasoning)100805425753.1%
Cydonia 24B V4.187645452351.8%
Thinking Machines Inkling Small (Reasoning, High)826057342551.6%
Qwen 3 32B100664842051.2%
Laguna XS 2.1100584825547.3%
Thinking Machines Inkling (Reasoning)9472660046.5%
Arcee AI: Trinity Mini8075750045.9%
Gemini 3 Flash (Preview)9687460045.6%
ByteDance Seed 2.0 Mini100832520045.6%
Ministral 3 3B100100250045.0%
Aion 2.075584544044.5%
Mistral Large 283585820043.9%
Z.AI GLM 4.7 Flash575447422043.7%
ByteDance Seed 2.0 Lite10075420043.3%
ByteDance Seed 1.68075500040.9%
Gemini 3.5 Flash (Reasoning)9957460040.4%
Mistral Large 310010000040.0%
DeepSeek-V2 Chat10010000040.0%
GPT-4.1 Nano10087100039.2%
Hermes 3 405B1009200038.3%
Mistral Medium 3.5968900037.0%
Mistral Small 3.2 24B1008300036.7%
Gemini 2.5 Flash Lite (Reasoning)10045340035.8%
GPT-5 Nano7160420034.7%
Gemma 4 31B63633414034.6%
DeepSeek V3 (2024-12-26)10057100033.3%
Ministral 8B69632014033.1%
Ministral 3 14B63423411029.9%
Ministral 3B1004800029.6%
Gemini 3 Flash (Preview, Reasoning)6954250029.6%
Gemini 3.5 Flash (Reasoning, Minimal)473629201128.5%
Qwen 3.5 Plus (2026-02-15)665800024.9%
Gemma 4 26B (Reasoning)5848180024.9%
Mistral Medium 3.5 (Reasoning)942500023.8%
WizardLM 2 8x22b1001600023.3%
Cohere Command R+ (Aug. 2024)6634140022.8%
Z.AI GLM 4.5574760022.1%
Z.AI GLM 4.5 Air693050021.0%
DeepSeek V3.25722160018.9%
DeepSeek V3.13432215018.5%
Nemotron 3 Nano463940017.9%
GPT-4.1 Mini80000015.9%
Gemini 2.5 Flash (Reasoning)3330160015.8%
Nemotron 3 Super651000014.9%
Gemma 4 26B482500014.6%
Ministral 3 8B581000013.6%
Gemma 4 31B (Reasoning)371070010.7%
GPT-4o Mini (temp=1)54000010.7%
GPT-OSS 120B3700007.4%
Gemma 3 27B11110004.5%
Hermes 3 70B1470004.2%
Gemma 3 12B1900003.8%
Gemini 2.5 Pro1060003.1%
GPT-4o, Aug. 6th (temp=0)600001.2%
Xiaomi MIMO v2.5 Pro400000.9%
Z.AI GLM 4.6000000.0%
Inception Mercury 2000000.0%
Gemini 2.5 Flash000000.0%
Gemini 2.5 Flash Lite000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Gemma 3 4B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-5.5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-6 Sol1001001001009999.7%
GPT-5.5 (Reasoning, Low)1001001001009799.4%
GPT-5.5 (Reasoning, Medium)1001001001009699.1%
Claude Opus 5 (Reasoning)1001001001009699.1%
GPT-5.6 Terra1001001001009699.1%
Aion 3.5 Mini (Reasoning, High)100100100979698.6%
Claude Opus 5100100100979498.2%
Kimi K3 (Reasoning, High)100100100969397.7%
Claude Sonnet 4.61001001001008797.3%
Claude Sonnet 51001001001008797.3%
Xiaomi MIMO v2.6 Pro100100100998296.0%
Grok 4.7 (Reasoning, High)1009796968995.5%
Claude Opus 4.61001001001007795.5%
Claude Opus 4.7 (Reasoning)100100100898795.2%
DeepSeek V4.1 Flash (Reasoning, High)1001001001007595.0%
Claude Opus 4.71001001001007595.0%
Claude Sonnet 5 (Reasoning, Low)100100100928094.2%
GPT-5.11001001001007194.1%
GPT-51001001001006993.9%
GPT-6 Luna1001001001006993.9%
GPT-5.4 Mini (Reasoning, Low)1001001001006993.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1009996968093.9%
MiniMax M3100100100898093.8%
Claude Opus 4.6 (Reasoning)1009797948093.5%
GPT-5.4 Mini (Reasoning)1001001001006693.2%
GPT-5.4 Mini1001001001006693.2%
Z.AI GLM 5 Turbo100100100897592.9%
Claude Sonnet 5.5 (Reasoning)10010094878392.7%
Claude Opus 4.5100100100926390.8%
Claude Opus 5.5 (Reasoning)1001001001005490.7%
GPT-5.4 (Reasoning)1001001001005490.7%
GPT-5.41001001001005490.7%
Qwen 3.8 27B (Reasoning, XHigh)10010094877390.7%
Grok 4.5 (Reasoning, Low)10010089838090.4%
Hy4 Preview (Reasoning, High)100100100945890.4%
Claude Opus 4.8 (Reasoning)10010092896990.1%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001005090.0%
Aion 3.010010092806988.1%
Z.AI GLM 5.2 (Reasoning, High)10010099835487.1%
DeepSeek V4 Pro 0813 (Reasoning, High)10010094895186.9%
Kimi K3 (Reasoning, Low)10010094875486.8%
Z.AI GLM 5.3 (Reasoning, Max)100100100666686.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010092924886.3%
Claude Opus 5 (Reasoning, Low)100100100725886.1%
Claude Sonnet 4.6 (Reasoning)10010094834684.6%
MiniMax M2.51009996656384.4%
Claude Opus 4.8 (Reasoning, Low)1009692755884.1%
Z.AI GLM 5.11009694755483.6%
Claude Opus 41009694893482.5%
Muse Spark 1.1 (Reasoning, Medium)1009689666082.2%
GPT-5.4 Nano (Reasoning, Low)10010075756082.1%
Claude Sonnet 4.51001001001001081.9%
Claude Haiku 5.5 (Reasoning, Medium)1008375756980.6%
GPT-5.4 Nano948786855180.3%
Muse Spark 1.1 (Reasoning, Minimal)979675755880.2%
o4 Mini10010080635880.1%
Qwen 3.5 397B A17B100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100080.0%
Grok 4.5 (Reasoning, High)1008983695479.1%
Mistral Small 4 (Reasoning)100100100544279.0%
Claude Haiku 4.51009287635478.9%
Grok 4.3100100100691877.5%
Muse Spark 1.2 (Reasoning, Medium)1008077725777.2%
Qwen 3.7 Max10010010083076.7%
Qwen 3 235B A22B Instruct 25071009687752576.4%
Muse Spark 1.3 (Reasoning, Medium)10010087662575.5%
Laguna S 2.1979280693474.4%
Gemini 3.8 Flash (Reasoning, Medium)100999672073.3%
GPT-5 Mini10010091383472.5%
Z.AI GLM 5100969263871.6%
Qwen 3.6 35B10010010054070.7%
MiniMax M2.71001009460070.7%
Claude Haiku 5.5 (Adaptive)1008975424269.5%
Claude Sonnet 5 (Reasoning)1008069583468.3%
Aion 3.0 Mini10010097301468.2%
Qwen 3 32B1001009642067.5%
Kimi K2.6948763483865.8%
GPT-4.1100876963765.2%
Mistral Small 4100876966064.4%
GPT-5.4 Nano (Reasoning)100817566064.4%
Mistral Large 21001008337064.0%
Muse Glimmer 30B (Reasoning, Medium)1001006346061.7%
GPT-5.2817569443961.7%
Grok 4.6 (Reasoning, High)96969225061.6%
Claude Sonnet 41008954372560.9%
Grok 4.2010010058311460.7%
Hermes 3 405B100877542060.6%
Qwen 3.5 Flash1001001000060.0%
Thinking Machines Inkling Small (Reasoning, High)100897534059.7%
Mistral Medium 3.11009663251459.4%
o4 Mini High89896354058.9%
Qwen 3.5 122B1001006025057.0%
Thinking Machines Inkling1006954421656.2%
Mistral Large 3100695454055.3%
Qwen 3.5 9B926650303053.5%
Mistral Large 4.087837518052.5%
DeepSeek V4 Flash1001003425051.8%
Thinking Machines Inkling (Reasoning)100664646051.7%
Gemini 3.6 Flash (Reasoning, Minimal)666649423451.5%
DeepSeek V3 (2025-03-24)1001004214051.1%
Mistral Large 4.0 (Reasoning)876350312551.1%
DeepSeek V4 Flash (Reasoning)100584842650.8%
Xiaomi MIMO v2.510099426650.5%
DeepSeek V4 Pro89754638049.7%
Grok 4.20 (Reasoning)10083630049.2%
Ministral 3 8B100100340046.8%
Qwen 3.7 Flash (Reasoning)10092420046.7%
Laguna XS 2.110083500046.7%
DeepSeek V4 Pro (Reasoning)10087340044.1%
Writer: Palmyra X583424242743.1%
Kimi K2.583585418042.6%
Qwen 3.5 35B100582525041.7%
Mistral Medium 3.58783340040.8%
Gemini 3.1 Pro (Preview)10010000040.0%
Grok 4.3 (Reasoning)10010000040.0%
Qwen 3.5 Plus (2026-04-20)10010000040.0%
Qwen 3.6 27B10010000040.0%
Gemini 3.7 Flash (Reasoning, Medium)100482525039.6%
ByteDance Seed 2.0 Mini80423431037.3%
ByteDance Seed 2.0 Lite1008300036.7%
Gemini 3.6 Flash (Reasoning)1008100036.2%
Xiaomi MIMO v2.5 Pro10037340034.2%
DeepSeek-V2 Chat7554420034.0%
GPT-5 Nano6864360033.6%
Mistral Medium 3.5 (Reasoning)8069140032.6%
Gemini 2.5 Pro875400028.0%
Gemini 3 Flash (Preview, Reasoning)50462519028.0%
Cydonia 24B V4.163381814026.5%
Z.AI GLM 4.742392817025.2%
Cohere Command R+ (Aug. 2024)1002500025.0%
ByteDance Seed 1.6 Flash685400024.3%
Qwen 3.5 27B1002000023.9%
DeepSeek V3 (2024-12-26)692570020.4%
Llama 3.1 70B100000020.0%
Z.AI GLM 4.528252516018.9%
GPT-4o Mini (temp=1)661800016.8%
ByteDance Seed 1.683000016.7%
Mistral NeMO80000015.9%
Gemini 2.5 Flash (Reasoning)542500015.7%
GPT-4.1 Mini422570014.8%
Hermes 3 70B63000012.5%
Gemini 3.5 Flash (Reasoning, Minimal)58000011.7%
Aion 2.0372000011.3%
Ministral 3 14B54000010.7%
Gemini 3.5 Flash (Reasoning)252500010.0%
Gemma 4 31B37100009.3%
WizardLM 2 8x22b4200008.3%
Ministral 3B4200008.3%
Ministral 8B25140007.8%
Gemini 2.5 Flash Lite (Reasoning)3400006.8%
Z.AI GLM 4.5 Air3400006.8%
Arcee AI: Trinity Mini3400006.8%
Gemini 2.5 Flash16107006.7%
Gemma 4 31B (Reasoning)2570006.5%
DeepSeek V3.23100006.3%
Z.AI GLM 4.7 Flash3000006.0%
Gemma 3 27B1870005.0%
Nemotron 3 Super2500005.0%
Qwen 2.5 72B2500005.0%
GPT-4.1 Nano2500005.0%
Inception Mercury 22000003.9%
Mistral Small 3.2 24B2000003.9%
Gemini 3 Flash (Preview)1800003.6%
GPT-4o, Aug. 6th (temp=1)1400002.8%
Gemma 4 26B (Reasoning)700001.5%
Z.AI GLM 4.6000000.0%
Qwen 3.5 Plus (2026-02-15)000000.0%
Gemma 4 26B000000.0%
GPT-OSS 120B000000.0%
DeepSeek V3.1000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Gemini 2.5 Flash Lite000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Nemotron 3 Nano000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.51001001001009999.9%
Aion 3.5 (Reasoning, High)1001001001009999.7%
GPT-6 Luna (Reasoning, Medium)1001001001009799.4%
Z.AI GLM 5.3 (Reasoning, Max)100100100999799.2%
Qwen 3.5 397B A17B1001001001009699.1%
Qwen 3.5 35B1001001001009699.1%
GPT-5.6 Luna100100100999698.9%
GPT-5.4 Mini (Reasoning, Low)100100100999698.9%
GPT-5.6 Terra (Reasoning, Medium)1001001001009398.5%
GPT-6.1 Sol (Reasoning, Medium)1001001001009298.3%
GPT-5.41001001001009298.3%
Claude Opus 4.8 (Reasoning, Low)100100100969698.2%
Kimi K3 (Reasoning, High)100100100969397.7%
Claude Opus 5 (Reasoning)1001001001008797.3%
GPT-5.6 Terra100100100968997.1%
Grok 4.7 (Reasoning, High)1001001001008597.0%
Claude Opus 4.7100100100948996.6%
DeepSeek V4.1 Flash (Reasoning, High)100100100968596.1%
GPT-5.5 (Reasoning, Low)1001001001008095.9%
Claude Sonnet 4.6100100100968295.4%
MiniMax M3100100100948295.1%
Aion 3.5 Mini (Reasoning, High)1001001001007294.5%
GPT-5.4 (Reasoning, Low)10010095898894.4%
DeepSeek V4 Flash 0731 (Reasoning, High)10010096918393.9%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100858393.7%
Claude Opus 4.6 (Reasoning)100100100967293.6%
Claude Opus 5 (Reasoning, Low)1001001001006593.0%
Claude Opus 4.8 (Reasoning)100100100927292.8%
Claude Sonnet 5 (Reasoning)1001001001006392.5%
GPT-5.4 (Reasoning)10010096917692.5%
Muse Spark 1.3 (Reasoning, Medium)100100100808091.8%
Claude Sonnet 4.6 (Reasoning)100100100808091.8%
Xiaomi MIMO v2.6 Flash10010096946991.8%
Grok 4.6 (Reasoning, High)100100100896691.1%
Z.AI GLM 510010099837391.1%
DeepSeek V4 Pro10010094857390.4%
Claude Haiku 5.5 (Reasoning, Medium)100100100945489.5%
Xiaomi MIMO v2.6 Pro100100100994889.4%
GPT-5.5 (Reasoning, Medium)100100100856089.1%
GPT-5 Mini100100100925489.0%
Aion 3.0 Mini100100100944888.4%
Z.AI GLM 5.1100100100875488.0%
Kimi K2.610010094806687.9%
Claude Opus 4.6100100100974287.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099875487.8%
DeepSeek V3 (2025-03-24)100100100756387.5%
Claude Sonnet 5100100100894687.1%
Muse Spark 1.1 (Reasoning, Medium)10010087776686.0%
Z.AI GLM 5.2 (Reasoning, High)10010092756385.8%
DeepSeek V4 Flash (Reasoning)1009692924885.4%
Mistral Large 4.010010083746985.4%
Muse Glimmer 30B (Reasoning, Medium)100100100715485.0%
Z.AI GLM 5 Turbo100100100804584.9%
GPT-5.4 Mini (Reasoning)10010082756784.8%
GPT-5.11009283767284.4%
Grok 4.5 (Reasoning, Low)100100100774283.8%
DeepSeek V4 Pro 0813 (Reasoning, High)10010082696683.4%
Aion 3.01009792636382.8%
MiniMax M2.5100100100693781.2%
Muse Spark 1.1 (Reasoning, Minimal)10010082735081.0%
MiniMax M2.71009885724880.7%
Qwen 3 235B A22B Instruct 25071008972716980.5%
Claude Haiku 5.5 (Adaptive)100100100584280.0%
Qwen 3.6 Flash100100100100080.0%
Qwen 3.7 Flash (Reasoning)100100100100080.0%
Qwen 3.6 35B100100100100080.0%
GPT-5100100100742579.8%
DeepSeek V4 Pro (Reasoning)1008575676778.9%
Claude Opus 4.7 (Reasoning)10010010092078.3%
GPT-5.4 Mini928080756578.2%
Xiaomi MIMO v2.510010010087077.3%
DeepSeek V4 Flash10010010075776.5%
Laguna S 2.11009973605076.3%
Claude Sonnet 41008580674876.0%
Grok 4.20978277635674.9%
Grok 4.20 (Reasoning)10010083603174.9%
Grok 4.5 (Reasoning, High)1008777574873.8%
Claude Opus 41008775644273.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100481672.9%
Claude Opus 4.51008977494872.8%
Hy4 Preview (Reasoning, High)1008780712572.5%
Muse Spark 1.2 (Reasoning, Medium)1008382752071.9%
Gemini 3.5 Flash Lite (Reasoning)1009966542568.7%
Thinking Machines Inkling (Reasoning)100948954067.3%
Claude Sonnet 5 (Reasoning, Low)929266463165.4%
ByteDance Seed 2.0 Lite1008363542564.9%
Claude Sonnet 4.51007367543064.8%
GPT-5.4 Nano1009054472963.9%
GPT-5.4 Nano (Reasoning)847665503963.0%
Kimi K2.5100896358062.0%
Grok 4.397898525660.5%
Gemini 3.1 Flash Lite (Preview)1001001000060.0%
Claude Haiku 4.5807572571159.0%
Mistral Small 4 (Reasoning)898054482258.4%
GPT-5.4 Nano (Reasoning, Low)99807633057.8%
Mistral Large 4.0 (Reasoning)99994842057.4%
Gemini 3.1 Pro (Preview)100100660053.2%
GPT-5.2805855343251.7%
Thinking Machines Inkling97924811650.9%
Qwen 3.5 Flash100664834049.7%
Mistral Small 475696925047.8%
Thinking Machines Inkling Small (Reasoning, High)88774225046.2%
Mistral Large 2877534201445.9%
Hermes 3 70B87664234045.7%
GPT-4.1806642311045.7%
Qwen 3.5 9B10069570045.3%
Qwen 3.7 Max100100250045.0%
Gemini 3.6 Flash (Reasoning)75664637044.8%
Cydonia 24B V4.18783540044.7%
Hermes 3 405B69695814743.7%
Qwen 3 32B87634218041.7%
Gemini 3.6 Flash (Reasoning, Minimal)80665110041.3%
Ministral 3 14B10080200039.9%
Qwen 3.5 27B10054250035.7%
GPT-5 Nano56544219535.1%
Xiaomi MIMO v2.5 Pro10050160033.3%
ByteDance Seed 1.610051140033.0%
Qwen 3.5 122B10046140032.0%
Laguna XS 2.18742300031.6%
ByteDance Seed 2.0 Mini10031250031.3%
Qwen 3.5 Plus (2026-04-20)66423410030.3%
Mistral Medium 3.17254180028.8%
Writer: Palmyra X566421814027.9%
Mistral Large 35448340027.1%
GPT-4o, Aug. 6th (temp=1)6942200026.2%
ByteDance Seed 1.6 Flash6336280025.2%
Z.AI GLM 4.75130298023.6%
DeepSeek V3 (2024-12-26)1001800023.6%
Mistral Medium 3.5873100023.6%
Gemini 3.8 Flash (Reasoning, Medium)45251814020.3%
o4 Mini544800020.3%
Grok 4.3 (Reasoning)662500018.2%
WizardLM 2 8x22b89000017.9%
Gemini 2.5 Flash Lite (Reasoning)483070017.0%
Gemma 3 27B543100017.0%
Gemma 4 31B75000015.0%
Gemini 3.5 Flash (Reasoning)502500015.0%
Gemini 2.5 Flash71000014.3%
Mistral Medium 3.5 (Reasoning)373200013.8%
Aion 2.0392900013.5%
Z.AI GLM 4.5511400013.1%
Z.AI GLM 4.7 Flash3216140012.5%
Llama 3.1 70B63000012.5%
DeepSeek V3.254700012.2%
Gemini 3.7 Flash (Reasoning, Medium)421450012.1%
Gemini 2.5 Pro4600009.2%
Gemma 4 26B (Reasoning)25180008.6%
Nemotron 3 Super4200008.3%
Gemini 3.5 Flash (Reasoning, Minimal)3700007.4%
GPT-4.1 Nano2500005.0%
Ministral 3B2500005.0%
o4 Mini High2000003.9%
DeepSeek V3.12000003.9%
GPT-4.1 Mini10100003.8%
Cohere Command R+ (Aug. 2024)1800003.6%
Gemini 2.5 Flash Lite1400002.8%
Gemini 3 Flash (Preview, Reasoning)1100002.3%
Qwen 3.6 27B1100002.3%
Gemma 4 31B (Reasoning)1000001.9%
Qwen 3.5 Plus (2026-02-15)600001.2%
Nemotron 3 Nano600001.2%
Z.AI GLM 4.6000000.0%
Gemini 3 Flash (Preview)000000.0%
Gemma 4 26B000000.0%
GPT-OSS 120B000000.0%
Gemini 2.5 Flash (Reasoning)000000.0%
DeepSeek-V2 Chat000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
Z.AI GLM 4.5 Air000000.0%
GPT-4o Mini (temp=1)000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Qwen 2.5 72B000000.0%
Ministral 3 8B000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Ministral 8B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Haiku 5.5 (Reasoning, Max)100 – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
GPT-5.5100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
GPT-5.5 (Reasoning, Low)1001001001009799.4%
GPT-5.6 Luna (Reasoning, Medium)1001001001008997.9%
GPT-5.6 Terra100100100948796.1%
Z.AI GLM 5.3 (Reasoning, Max)1001001001008095.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008095.9%
GPT-5.6 Sol1001001001006993.9%
Claude Sonnet 4.61001001001006993.9%
Claude Haiku 5.5 (Reasoning, Medium)1001001001006993.9%
GPT-5.4 (Reasoning, Low)100100100897592.9%
Kimi K3 (Reasoning, High)1001001001006392.5%
Grok 4.7 (Reasoning, High)1001001001006392.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001006392.5%
Claude Opus 410010094927592.1%
Claude Opus 5 (Reasoning, Low)1001001001005490.7%
Aion 3.5 (Reasoning, High)1001001001005490.7%
MiniMax M31001001001005490.7%
Qwen 3.6 27B1001001001005490.7%
Xiaomi MIMO v2.6 Pro1001001001004288.3%
Claude Sonnet 5 (Reasoning)1001001001004288.3%
Xiaomi MIMO v2.51001001001004288.3%
Muse Spark 1.1 (Reasoning, Minimal)100100100756387.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001003486.8%
Qwen 3.8 Max (Reasoning, XHigh)100100100834285.0%
Claude Sonnet 5 (Reasoning, Low)1001001001002585.0%
GPT-6 Luna1001001001002585.0%
Aion 3.5 Mini (Reasoning, High)100100100802580.9%
Claude Opus 4.6 (Reasoning)100100100100080.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100080.0%
Gemini 3.1 Pro (Preview)100100100100080.0%
Claude Sonnet 4.6 (Reasoning)100100100100080.0%
Kimi K2.6100100100100080.0%
Claude Opus 4.7 (Reasoning)100100100100080.0%
GPT-6 Luna (Reasoning, Medium)100100100100080.0%
Claude Opus 4.6100100100100080.0%
Grok 4.5 (Reasoning, Low)100100100752580.0%
Kimi K2.5100100100100080.0%
Thinking Machines Inkling (Reasoning)100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
Gemma 4 31B (Reasoning)100100100100080.0%
Gemma 4 26B (Reasoning)100100100100080.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100080.0%
Aion 3.0100100100100080.0%
Qwen 3.7 Flash (Reasoning)100100100100080.0%
Qwen 3.6 35B100100100100080.0%
Z.AI GLM 4.6100100100100080.0%
Claude Sonnet 4100100100100080.0%
Xiaomi MIMO v2.6 Flash100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100080.0%
Claude Haiku 4.5100100100100080.0%
DeepSeek V4 Pro100100100100080.0%
DeepSeek V3 (2025-03-24)100100100100080.0%
Thinking Machines Inkling100100100100080.0%
Z.AI GLM 4.5100100100662578.2%
Qwen 3.8 27B (Reasoning, XHigh)100100100632577.5%
Muse Spark 1.1 (Reasoning, Medium)10010010069073.9%
Mistral Large 4.010010080751473.7%
Aion 3.0 Mini10010010063072.5%
GPT-5.4 Mini10010094422572.1%
GPT-5.5 (Reasoning, Medium)1001009663071.6%
GPT-5 Nano10010063484671.3%
Qwen 3.6 Flash10010010054070.7%
Grok 4.310010010054070.7%
GPT-51009266583670.4%
Gemini 3.8 Flash (Reasoning, Medium)10010010048069.6%
GPT-5.4 (Reasoning)10010069542569.6%
o4 Mini High1008763544268.9%
Claude Opus 5.5 (Reasoning)10010010042068.3%
GPT-5.410010058424268.3%
GPT-5.4 Nano100898957067.1%
Cydonia 24B V4.110010069501166.2%
Grok 4.201001007554065.7%
Writer: Palmyra X5928380631065.3%
GPT-5.11001006742663.0%
Claude Sonnet 4.510010010014062.8%
GPT-5 Mini1001007534061.8%
GPT-4.11001008914060.6%
Grok 4.5 (Reasoning, High)1001001000060.0%
Mistral Large 4.0 (Reasoning)1001001000060.0%
Grok 4.3 (Reasoning)1001001000060.0%
Qwen 3.5 Plus (2026-04-20)1001001000060.0%
Z.AI GLM 51001001000060.0%
Claude Haiku 5.5 (Adaptive)1001001000060.0%
DeepSeek V4 Flash (Reasoning)1001001000060.0%
Qwen 3.5 Flash1001001000060.0%
Gemini 3.1 Flash Lite1001001000060.0%
Hermes 3 405B1001001000060.0%
Gemini 2.5 Flash Lite1001001000060.0%
Llama 3.1 70B1001001000060.0%
Mistral Small 41001007525060.0%
Ministral 3 14B1001001000060.0%
Nemotron 3 Super1001006325057.5%
Claude Opus 4.5100100870057.3%
Xiaomi MIMO v2.5 Pro100100800055.9%
DeepSeek V3 (2024-12-26)100100690053.9%
Muse Spark 1.2 (Reasoning, Medium)1001004225053.3%
GPT-4o, Aug. 6th (temp=1)1001004225053.3%
Qwen 3.5 9B100100580051.7%
Qwen 3 235B A22B Instruct 250780756934051.6%
Ministral 8B100100540050.7%
Qwen 3.8 Flash (Reasoning)1001002525050.0%
Mistral Small 4 (Reasoning)1001002525050.0%
MiniMax M2.710080690049.8%
GPT-5.210072630047.0%
Gemini 3.5 Flash (Reasoning)100100250045.0%
Gemini 3.1 Flash Lite (Preview)100100250045.0%
Aion 2.0100100100041.9%
o4 Mini63635425040.7%
Gemini 3.6 Flash (Reasoning)10010000040.0%
Claude Opus 4.8 (Reasoning)10010000040.0%
Claude Opus 4.710010000040.0%
Mistral Large 310010000040.0%
DeepSeek V3.110010000040.0%
DeepSeek V4 Flash10010000040.0%
GPT-4.1 Mini10010000040.0%
Gemma 3 27B10010000040.0%
GPT-4.1 Nano10010000040.0%
GPT-5.4 Mini (Reasoning, Low)10058250036.7%
ByteDance Seed 2.0 Mini10063140035.3%
ByteDance Seed 1.6 Flash9631310031.8%
Qwen 3.5 27B10042140031.1%
Gemini 3.6 Flash (Reasoning, Minimal)10025250030.0%
Nemotron 3 Nano10025250030.0%
GPT-5.4 Nano (Reasoning, Low)1004800029.6%
Grok 4.20 (Reasoning)806300028.4%
Gemini 3 Flash (Preview, Reasoning)1004200028.3%
Mistral Small 3.2 24B1004200028.3%
Cohere Command R+ (Aug. 2024)1004200028.3%
Qwen 3 32B6351140025.5%
Gemini 3.5 Flash (Reasoning, Minimal)1002500025.0%
DeepSeek V3.21002500025.0%
Mistral Large 21002500025.0%
GPT-5.4 Nano (Reasoning)48422510024.9%
DeepSeek V4 Pro (Reasoning)1001400022.8%
Laguna XS 2.15442140021.8%
Mistral Medium 3.1723400021.3%
Hy4 Preview (Reasoning, High)100000020.0%
Qwen 3.5 122B100000020.0%
ByteDance Seed 1.6100000020.0%
Qwen 3.5 Plus (2026-02-15)100000020.0%
Mistral Medium 3.5 (Reasoning)100000020.0%
Gemma 4 31B100000020.0%
DeepSeek-V2 Chat100000020.0%
GPT-4o, Aug. 6th (temp=0)100000020.0%
Ministral 3 8B100000020.0%
Ministral 3 3B100000020.0%
Ministral 3B100000020.0%
Gemini 3 Flash (Preview)871000019.2%
Mistral Medium 3.5544200019.0%
Laguna S 2.1582500016.7%
Z.AI GLM 4.7631000014.4%
Z.AI GLM 4.7 Flash66000013.2%
Hermes 3 70B63000012.5%
GPT-4o Mini (temp=1)2500005.0%
Mistral NeMO2500005.0%
Gemma 3 12B1400002.8%
Gemma 4 26B000000.0%
GPT-OSS 120B000000.0%
ByteDance Seed 2.0 Lite000000.0%
Inception Mercury 2000000.0%
Z.AI GLM 4.5 Air000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)1001001001009799.4%
Claude Opus 5 (Reasoning)1001001001009699.1%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
GPT-6 Sol1001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
Claude Opus 51001001001009298.3%
GPT-5.41001001001008997.9%
GPT-5.4 Mini1001001001008997.9%
Qwen 3.6 Max Preview1001001001008797.3%
Qwen 3.5 122B1001001001008396.7%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100968796.4%
ByteDance Seed 1.61001001001008095.9%
Qwen 3.5 Flash1001001001007795.5%
Muse Spark 1.1 (Reasoning, Minimal)1001001001007595.0%
GPT-5.1100100100928094.2%
Aion 3.5 (Reasoning, High)10010096898092.9%
GPT-5.5 (Reasoning, Medium)1001001001006392.5%
Gemini 3.5 Flash Lite (Reasoning)1001001001006392.5%
Grok 4.5 (Reasoning, High)1001001001005490.7%
Claude Opus 4.8 (Reasoning, Low)100100100925890.0%
GPT-5.4 Mini (Reasoning)10010096965889.9%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100965489.8%
Claude Sonnet 5.5 (Reasoning)1001001001004889.6%
GPT-5.4 Mini (Reasoning, Low)10010094945889.2%
Claude Sonnet 5 (Reasoning, Low)100100100806689.1%
Claude Haiku 4.510010089876989.1%
Kimi K3 (Reasoning, Low)1009997945488.6%
DeepSeek V4.1 Flash (Reasoning, High)10010097806688.6%
GPT-5.5100100100806388.4%
Gemini 3.6 Flash (Reasoning)100100100726988.4%
Muse Spark 1.1 (Reasoning, Medium)1001001001004288.3%
Claude Opus 4.610010092925888.3%
Claude Opus 4.8 (Reasoning)10010099874886.7%
Kimi K2.5100100100834886.3%
Claude Haiku 5.5 (Adaptive)10010087756986.2%
Claude Haiku 5.5 (Reasoning, Low)10010058 – – 86.1%
Claude Opus 5 (Reasoning, Low)100100100666385.7%
Claude Opus 5.5 (Reasoning)10010094894284.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100695484.6%
GPT-5.210010078776583.9%
GPT-510010087785082.9%
Claude Sonnet 4.6 (Reasoning)100100100872582.3%
MiniMax M2.51009775696681.6%
DeepSeek V4 Pro1009777696080.8%
Claude Haiku 5.5 (Reasoning, Medium)1008080756980.7%
GPT-5.6 Sol (Reasoning, Medium)100100100100080.0%
Hy4 Preview (Reasoning, High)100100100100080.0%
Qwen 3.5 Plus (2026-04-20)100100100100080.0%
Gemma 4 31B (Reasoning)100100100100080.0%
Qwen 3.7 Flash (Reasoning)100100100100080.0%
ByteDance Seed 2.0 Mini100100100100080.0%
Mistral Medium 3.110010087872579.6%
Z.AI GLM 5.3 (Reasoning, Max)10010075665478.9%
Grok 4.310010010092078.3%
Claude Sonnet 5 (Reasoning)10010010089077.9%
Claude Opus 4.7100100100543477.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100691877.5%
Gemini 3.7 Flash (Reasoning, Medium)10010010087077.3%
Qwen 3.7 Max10010010077776.9%
Claude Opus 4.6 (Reasoning)100100100503176.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001008989075.7%
o4 Mini High10010010075075.0%
Qwen 3.6 27B10010010075075.0%
Qwen 3 32B1009689801074.8%
GPT-5.4 Nano (Reasoning, Low)928775635073.1%
Claude Opus 4.7 (Reasoning)10010063583471.0%
Kimi K3 (Reasoning, High)1007263585068.6%
o4 Mini100100100251868.6%
Mistral Large 21001008354067.4%
GPT-5.4 Nano (Reasoning)1001007748566.1%
Z.AI GLM 5 Turbo10010063541065.1%
Mistral Medium 3.5 (Reasoning)10010010025065.0%
Claude Sonnet 51008363423464.3%
Mistral Small 41008775421864.2%
Aion 3.0 Mini1001008931064.1%
MiniMax M310010060342563.8%
GPT-5.4 Nano918785282162.2%
Mistral Small 4 (Reasoning)1008063422561.7%
Mistral Large 4.0 (Reasoning)10010069251461.7%
Aion 3.01001006642061.6%
Gemini 3.8 Flash (Reasoning, Medium)1001009710061.4%
Qwen 3 235B A22B Instruct 2507836966543461.3%
Grok 4.2010010063251861.1%
Writer: Palmyra X5896966542560.7%
GPT-5 Mini1009556381260.1%
Grok 4.6 (Reasoning, High)1001001000060.0%
Mistral Medium 3.51001001000060.0%
Mistral Large 31001001000060.0%
Thinking Machines Inkling Small (Reasoning, High)100978318059.7%
Thinking Machines Inkling (Reasoning)877575372559.7%
Claude Sonnet 4.6100806354059.1%
Mistral Large 4.0100807738059.0%
Thinking Machines Inkling10096870056.4%
Gemini 3 Flash (Preview, Reasoning)100100800055.9%
Aion 3.5 Mini (Reasoning, High)100835825053.3%
Claude Opus 4.599636342053.1%
Z.AI GLM 5.2 (Reasoning, High)100100630052.5%
Gemini 3.5 Flash (Reasoning)100100600052.0%
Gemini 3 Flash (Preview)1001004810051.5%
Ministral 8B100100540050.7%
Claude Sonnet 4.569665848749.9%
Gemini 3.5 Flash (Reasoning, Minimal)94875810049.6%
Z.AI GLM 5100695425049.6%
Claude Opus 496635425047.3%
Gemini 3.6 Flash (Reasoning, Minimal)10087480046.9%
Laguna XS 2.19269660045.5%
Llama 3.1 70B100100250045.0%
Z.AI GLM 5.110063560043.7%
Z.AI GLM 4.7 Flash545451382243.5%
DeepSeek V4 Pro (Reasoning)8075630043.4%
DeepSeek V4 Flash100832010042.5%
DeepSeek V4 Flash (Reasoning)10058480041.3%
Claude Sonnet 487832510040.9%
GPT-4.1 Nano10063420040.8%
DeepSeek V3 (2024-12-26)10010000040.0%
Ministral 3 3B10010000040.0%
Aion 2.0545434302539.2%
Cydonia 24B V4.18763420038.1%
ByteDance Seed 1.6 Flash8272256037.0%
Z.AI GLM 4.710038370035.0%
DeepSeek V3.21006900033.9%
Gemma 4 31B6363420033.3%
WizardLM 2 8x22b927200032.8%
Ministral 3 8B1005800031.7%
Xiaomi MIMO v2.510031140029.0%
MiniMax M2.76050250027.0%
GPT-5 Nano913500025.1%
Xiaomi MIMO v2.5 Pro695400024.6%
DeepSeek V3.11001800023.6%
GPT-4.1754200023.3%
Z.AI GLM 4.5754200023.3%
Nemotron 3 Super1001000021.9%
Gemini 2.5 Pro100000020.0%
Hermes 3 405B100000020.0%
Gemini 2.5 Flash100000020.0%
Ministral 3B100000020.0%
Z.AI GLM 4.5 Air821250019.7%
Hermes 3 70B92000018.3%
GPT-OSS 120B75000015.0%
GPT-4.1 Mini63000012.5%
Laguna S 2.163000012.5%
Nemotron 3 Nano63000012.5%
Ministral 3 14B54000010.7%
Z.AI GLM 4.64200008.3%
GPT-4o, Aug. 6th (temp=0)2500005.0%
GPT-4o, Aug. 6th (temp=1)1800003.6%
Gemma 3 12B700001.5%
Qwen 3.5 Plus (2026-02-15)000000.0%
Gemini 2.5 Flash (Reasoning)000000.0%
DeepSeek-V2 Chat000000.0%
Gemini 2.5 Flash Lite (Reasoning)000000.0%
Inception Mercury 2000000.0%
Gemini 2.5 Flash Lite000000.0%
GPT-4o Mini (temp=1)000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 27B000000.0%
Qwen 2.5 72B000000.0%
Arcee AI: Trinity Mini000000.0%
Cohere Command R+ (Aug. 2024)000000.0%
Gemma 3 4B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Grok 4.3100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Qwen 3.5 Flash1001001001009999.7%
Qwen 3.5 Plus (2026-04-20)1001001001008396.7%
Qwen 3.7 Flash (Reasoning)1001001001008095.9%
Qwen 3.8 Max (Reasoning, XHigh)1001001001007595.0%
GPT-5.6 Sol1001001001006993.9%
Kimi K3 (Reasoning, Low)1001001001005490.7%
MiniMax M2.51001001001005490.7%
Claude Sonnet 5.5 (Reasoning)100100100806989.8%
GPT-5.11001001001004889.6%
GPT-5.51001001001004889.6%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001004288.3%
Grok 4.20 (Reasoning)1001001001004288.3%
Claude Opus 4.71001001001004288.3%
Ministral 3B1001001001004288.3%
Xiaomi MIMO v2.6 Pro100100100756387.5%
GPT-510010096805485.7%
Kimi K3 (Reasoning, High)1001001001002585.0%
Claude Opus 4.61001001001002585.0%
Qwen 3.5 122B1001001001002585.0%
DeepSeek V4 Pro (Reasoning)1001001001002585.0%
Gemma 4 31B1001001001002585.0%
GPT-5.4100100100635483.2%
o4 Mini High1001001001001482.8%
Grok 4.2010010083636381.7%
Mistral Large 4.0 (Reasoning)100100100545481.4%
Claude Opus 4.6 (Reasoning)100100100100080.0%
Qwen 3.7 Max100100100100080.0%
Qwen 3.8 Flash (Reasoning)100100100100080.0%
Grok 4.5 (Reasoning, High)100100100100080.0%
Z.AI GLM 5.1100100100100080.0%
Kimi K2.6100100100100080.0%
Claude Opus 4.8 (Reasoning, Low)100100100100080.0%
Claude Sonnet 4.6100100100100080.0%
MiniMax M3100100100100080.0%
Claude Sonnet 5 (Reasoning)100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
Claude Opus 5100100100100080.0%
Claude Haiku 5.5 (Adaptive)100100100100080.0%
Gemma 4 26B (Reasoning)100100100100080.0%
DeepSeek V4 Flash (Reasoning)100100100100080.0%
Xiaomi MIMO v2.5 Pro100100100100080.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100080.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100080.0%
Xiaomi MIMO v2.5100100100100080.0%
Claude Haiku 4.5100100100100080.0%
DeepSeek V3.1100100100100080.0%
DeepSeek V3.2100100100100080.0%
Nemotron 3 Super100100100100080.0%
Mistral Large 2100100100100080.0%
Mistral Small 4 (Reasoning)100100100100080.0%
Mistral Medium 3.1100100100100080.0%
Laguna XS 2.1100100100100080.0%
GPT-5.4 Mini (Reasoning)100100100544279.0%
Claude Opus 5 (Reasoning, Low)100100100692578.9%
Aion 3.5 Mini (Reasoning, High)10010010080075.9%
DeepSeek V4 Pro10010010080075.9%
Cohere Command R+ (Aug. 2024)10010010069073.9%
Aion 3.0 Mini10010010063072.5%
Mistral Large 4.01001009463071.3%
GPT-6 Luna10010010054070.7%
GPT-5.4 Nano (Reasoning, Low)100948763068.6%
Gemini 3.6 Flash (Reasoning, Minimal)10010010042068.3%
Qwen 3 235B A22B Instruct 250710010010042068.3%
Cydonia 24B V4.11001008354067.4%
GPT-5.4 (Reasoning, Low)10010010025065.0%
Gemini 3 Flash (Preview, Reasoning)10010010025065.0%
DeepSeek V4 Flash10010010025065.0%
GPT-5 Mini1001006458064.5%
Mistral Small 410010010018063.6%
GPT-5.4 Nano (Reasoning)978363581463.1%
ByteDance Seed 1.610010042422561.7%
GPT-5.4 Mini (Reasoning, Low)10010042422561.7%
Claude Opus 4.7 (Reasoning)1001001000060.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001000060.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001000060.0%
Aion 2.01001001000060.0%
Gemini 3 Flash (Preview)1001001000060.0%
Gemini 3.1 Flash Lite (Preview)1001001000060.0%
Z.AI GLM 4.51001001000060.0%
Z.AI GLM 4.7 Flash1001001000060.0%
Hermes 3 405B1001001000060.0%
Mistral Small 3.2 24B1001001000060.0%
WizardLM 2 8x22b1001001000060.0%
Ministral 3 8B1001001000060.0%
Ministral 8B1001001000060.0%
GPT-5.4 Mini100806948059.4%
Claude Opus 4.8 (Reasoning)1001005442059.0%
Gemini 3.5 Flash (Reasoning)1001004234055.2%
Aion 3.5 (Reasoning, High)100100690053.9%
Ministral 3 14B100100690053.9%
Gemini 3.8 Flash (Reasoning, Medium)1001004225053.3%
Writer: Palmyra X51001004225053.3%
GPT-5 Nano91894542053.3%
GPT-5.4 Nano9287690049.5%
Claude Sonnet 4100100420048.3%
Qwen 3 32B10089420046.2%
Gemini 3.6 Flash (Reasoning)100752525045.0%
DeepSeek V3 (2024-12-26)100100250045.0%
Hermes 3 70B100100250045.0%
Z.AI GLM 5.3 (Reasoning, Max)10063540043.2%
o4 Mini1004225181840.5%
Z.AI GLM 4.710010000040.0%
Qwen 3.5 Plus (2026-02-15)10010000040.0%
ByteDance Seed 2.0 Mini10010000040.0%
Mistral Medium 3.510010000040.0%
DeepSeek-V2 Chat10010000040.0%
Gemini 2.5 Flash Lite (Reasoning)10010000040.0%
Gemini 2.5 Flash Lite10010000040.0%
Llama 3.1 70B10010000040.0%
Nemotron 3 Nano10010000040.0%
GPT-4.1 Nano10010000040.0%
Ministral 3 3B10010000040.0%
GPT-5.210054347039.0%
ByteDance Seed 1.6 Flash10066250038.2%
Z.AI GLM 4.5 Air69423725034.6%
Claude Opus 41007200034.5%
Laguna S 2.11006900033.9%
GPT-4.1 Mini1004200028.3%
GPT-4o, Aug. 6th (temp=1)10025140027.8%
Gemini 3.5 Flash (Reasoning, Minimal)100000020.0%
Mistral Medium 3.5 (Reasoning)100000020.0%
GPT-4o, Aug. 6th (temp=0)100000020.0%
Gemma 3 27B100000020.0%
Mistral NeMO100000020.0%
GPT-4.1542500015.7%
GPT-OSS 120B69000013.9%
GPT-4o Mini (temp=1)58000011.7%
Inception Mercury 2000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Qwen 2.5 72B000000.0%
Gemma 3 4B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-51001001001009999.8%
Claude Sonnet 4.61001001001009999.7%
Qwen 3.5 35B1001001001009799.4%
Kimi K3 (Reasoning, High)100100100999799.2%
Claude Opus 4.61001001001009699.1%
Qwen 3.5 Flash1001001001009498.8%
Kimi K3 (Reasoning, Low)1001001001009298.3%
GPT-5.4 (Reasoning, Low)1001001001009298.3%
Muse Glimmer 30B (Reasoning, Medium)1001001001009298.3%
Claude Haiku 4.51001001001009298.3%
Aion 3.5 (Reasoning, High)100100100979498.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100969497.9%
Mistral Small 4100100100969497.9%
GPT-6 Sol (Reasoning, Medium)1001001001008997.9%
Gemini 3.1 Pro (Preview)1001001001008997.9%
GPT-5.5 (Reasoning, Low)1001001001008997.9%
GPT-5.6 Luna (Reasoning, Medium)1001001001008997.9%
Grok 4.31001001001008997.9%
Grok 4.7 (Reasoning, High)1001001001008597.0%
GPT-5.5 (Reasoning, Medium)1001001001008396.7%
Grok 4.6 (Reasoning, High)100100100948996.6%
Xiaomi MIMO v2.6 Pro1001001001008095.9%
Claude Opus 5 (Reasoning)1001001001008095.9%
Qwen 3.5 122B1001001001007795.5%
MiniMax M3100100100997795.2%
GPT-5.4 Nano1009795929295.0%
Claude Sonnet 5.5 (Reasoning)1001001001007595.0%
GPT-6 Luna (Reasoning, Medium)1001001001007595.0%
Z.AI GLM 51001001001007595.0%
DeepSeek V4 Pro1001001001007595.0%
Claude Haiku 5.5 (Reasoning, Low)10010010080 – 94.9%
Claude Opus 4.8 (Reasoning)1001001001007294.5%
Z.AI GLM 5 Turbo10010097928394.4%
Claude Sonnet 4.6 (Reasoning)1001001001006993.9%
GPT-5 Mini1001001001006593.1%
Aion 3.0100100100966993.0%
GPT-5.6 Luna100100100966993.0%
Writer: Palmyra X5100100100976692.7%
Claude Opus 5 (Reasoning, Low)1001001001006392.5%
Aion 3.5 Mini (Reasoning, High)10010089898392.4%
Claude Opus 4.6 (Reasoning)10010097897291.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099966391.4%
Z.AI GLM 5.1100100100966091.1%
MiniMax M2.7100100100936090.6%
Claude Opus 410010089828290.5%
Claude Opus 4.7 (Reasoning)100100100945890.4%
Thinking Machines Inkling Small (Reasoning, High)10010097827290.2%
GPT-5.110010092827690.1%
Qwen 3 235B A22B Instruct 25071001001001005090.0%
Claude Opus 4.5100100100876389.8%
Claude Sonnet 5 (Reasoning, Low)1001001001004889.6%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100895889.5%
DeepSeek V3 (2025-03-24)100100100895488.6%
Mistral Small 4 (Reasoning)100100100726988.4%
Kimi K2.51001001001004288.3%
GPT-5.6 Sol1001001001004288.3%
DeepSeek V4 Flash (Reasoning)10010089806987.7%
GPT-5.4 Mini979796776987.4%
Qwen 3.5 Plus (2026-04-20)1001001001003486.8%
Claude Sonnet 4.5100100100666686.5%
Claude Opus 4.710010092875486.4%
Grok 4.5 (Reasoning, Low)100100100635483.2%
ByteDance Seed 2.0 Lite1001001001001482.8%
Mistral Large 2100100100872582.3%
o4 Mini10010094872581.1%
DeepSeek V4 Flash10010097693780.7%
Gemini 3.5 Flash Lite (Reasoning)100100100772580.5%
Gemma 4 31B (Reasoning)100100100100080.0%
Qwen 3.6 Flash100100100100080.0%
Gemma 4 26B (Reasoning)100100100100080.0%
Gemini 3.1 Flash Lite100100100100080.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100603879.6%
Gemini 3 Flash (Preview, Reasoning)10010010096079.1%
Claude Haiku 5.5 (Reasoning, Medium)1009783803478.8%
Mistral Large 4.0100100100514278.5%
GPT-5.510010075754278.3%
Grok 4.5 (Reasoning, High)10010075635478.2%
Laguna S 2.110010010085678.2%
Qwen 3.7 Max100100100751076.9%
Claude Sonnet 5 (Reasoning)100100100423875.9%
Qwen 3.7 Flash (Reasoning)10010010077075.3%
Thinking Machines Inkling (Reasoning)1001008987075.2%
GPT-5.21008174635875.1%
DeepSeek V4.1 Flash (Reasoning, High)1001009475073.8%
Qwen 3.6 27B1001008380072.6%
ByteDance Seed 2.0 Mini1001008380072.6%
Qwen 3 32B1009680632572.5%
GPT-5.4 Mini (Reasoning)1001009466072.0%
GPT-4.11008775722571.8%
Muse Spark 1.1 (Reasoning, Minimal)1001009663071.6%
Xiaomi MIMO v2.510010098421069.9%
Claude Opus 4.8 (Reasoning, Low)10010072542069.1%
Laguna XS 2.192928969068.4%
o4 Mini High100100100251467.8%
Z.AI GLM 4.610010063482567.1%
GPT-5.4 Mini (Reasoning, Low)1007769632566.9%
Gemini 3.6 Flash (Reasoning)10010089291466.4%
DeepSeek V4 Pro (Reasoning)1001006963066.4%
GPT-5 Nano10010010031066.3%
Claude Sonnet 41001007550065.0%
Gemma 4 31B10010010025065.0%
Mistral Large 4.0 (Reasoning)10010057372563.7%
Hy4 Preview (Reasoning, High)1006963483763.4%
Gemini 3.7 Flash (Reasoning, Medium)1009254422562.4%
Hermes 3 70B1001008725062.3%
Mistral Medium 3.510010072251462.3%
Z.AI GLM 4.510010069251662.1%
Grok 4.201006969541060.4%
WizardLM 2 8x22b10010057311260.0%
Gemma 4 26B1001001000060.0%
Mistral Medium 3.1997558422559.7%
Gemini 3.5 Flash (Reasoning, Minimal)99755850056.4%
Gemini 3.6 Flash (Reasoning, Minimal)1006960252155.0%
Hermes 3 405B100776334054.8%
Gemini 3.5 Flash (Reasoning)1001005418054.3%
Gemini 3.8 Flash (Reasoning, Medium)92755048052.9%
Z.AI GLM 4.7 Flash100945414052.2%
DeepSeek V3.285775737051.2%
Aion 2.010099560050.9%
ByteDance Seed 1.6 Flash918934212050.9%
Ministral 3 14B80635442047.5%
Mistral Large 310080540046.6%
Ministral 3 8B1004237342046.5%
Gemini 3.1 Flash Lite (Preview)100100310046.3%
GPT-4o, Aug. 6th (temp=1)10080420044.2%
Cydonia 24B V4.171664831043.4%
Gemini 3 Flash (Preview)10063540043.2%
Ministral 3B10010000040.0%
Xiaomi MIMO v2.5 Pro100543210039.1%
Cohere Command R+ (Aug. 2024)10080140038.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)80483125036.8%
Z.AI GLM 4.783542514035.2%
Mistral Medium 3.5 (Reasoning)10046250034.2%
Gemini 2.5 Pro897500032.9%
Ministral 3 3B1006300032.5%
Qwen 3.5 Plus (2026-02-15)777550031.5%
Gemma 3 27B6350280028.1%
DeepSeek-V2 Chat8331250027.9%
DeepSeek V3.163372014026.6%
Z.AI GLM 4.5 Air1002750026.5%
Gemini 2.5 Flash665400023.9%
Gemini 2.5 Flash Lite (Reasoning)575040022.2%
Nemotron 3 Super100000020.0%
GPT-4.1 Nano100000020.0%
Ministral 8B544200019.0%
Nemotron 3 Nano771100017.6%
Gemma 3 12B54000010.7%
Gemini 2.5 Flash (Reasoning)421000010.3%
Arcee AI: Trinity Mini4600009.2%
Mistral Small 3.2 24B4200008.3%
GPT-4o Mini (temp=1)1800003.6%
GPT-4.1 Mini770002.9%
Llama 3.1 70B1400002.8%
Gemini 2.5 Flash Lite1000001.9%
GPT-OSS 120B000000.0%
DeepSeek V3 (2024-12-26)000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Inception Mercury 2000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Gemma 3 4B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)1001001001009699.3%
GPT-5.6 Terra (Reasoning, Medium)1001001001009699.1%
GPT-5.4 Mini1001001001009699.1%
GPT-5.4 Nano (Reasoning)1001001001009699.1%
Qwen 3.5 27B1001001001009599.0%
Claude Opus 4.6 (Reasoning)1001001001009498.8%
Claude Opus 5 (Reasoning, Low)1001001001009498.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009498.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009298.3%
Xiaomi MIMO v2.6 Pro1001001001009298.3%
Z.AI GLM 5.3 (Reasoning, Max)100100100969698.2%
Z.AI GLM 5.1100100100979297.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010099969297.2%
Gemini 3.1 Pro (Preview)1001001001008396.7%
Grok 4.6 (Reasoning, High)1001001001008396.7%
GPT-5.4 Mini (Reasoning, Low)1001001001008396.7%
Kimi K2.6100100100928996.2%
Claude Sonnet 4.6 (Reasoning)1001001001007595.0%
Muse Spark 1.1 (Reasoning, Minimal)1001001001007595.0%
Qwen 3.8 Flash (Reasoning)1001001001006993.9%
MiniMax M31001001001006993.9%
Mistral Large 21001001001006993.9%
Claude Sonnet 4.6100100100927593.3%
Xiaomi MIMO v2.6 Flash100100100927593.3%
Claude Opus 4.61001001001006392.5%
Aion 3.5 (Reasoning, High)10010096946691.1%
Claude Opus 51001001001005490.7%
Qwen 3 235B A22B Instruct 25071009992926990.3%
Aion 3.5 Mini (Reasoning, High)10010096896690.2%
Claude Haiku 5.5 (Adaptive)100100100757590.0%
GPT-5 Mini969391868289.4%
Gemini 3.7 Flash (Reasoning, Medium)100100100806689.1%
Claude Sonnet 5 (Reasoning)100100100806689.1%
o4 Mini High10010096876388.9%
Qwen 3.8 Max (Reasoning, XHigh)1001001001004288.3%
Claude Haiku 5.5 (Reasoning, Medium)100100100974287.8%
Claude Opus 4.8 (Reasoning, Low)10010092836387.5%
Claude Opus 5 (Reasoning)100100100776087.4%
Aion 3.0100100100835487.4%
Claude Sonnet 5.5 (Reasoning)100100100726387.0%
Claude Sonnet 51001001001003486.8%
o4 Mini10010080807586.8%
DeepSeek V4 Flash 0731 (Reasoning, High)10010087776986.7%
GPT-5.5 (Reasoning, Low)1001001001002585.0%
Cohere Command R+ (Aug. 2024)1001001001002585.0%
GPT-5.4 Nano1009488736984.9%
Claude Haiku 5.5 (Reasoning, Low)10069 – – – 84.7%
Claude Opus 410010096893784.3%
Qwen 3.6 Flash1001001001002083.9%
DeepSeek V4 Flash (Reasoning)1009792834683.7%
Aion 3.0 Mini100100100922082.3%
GPT-5.4 Mini (Reasoning)10010094922582.1%
Mistral Large 4.0 (Reasoning)10010087695481.9%
DeepSeek V3 (2025-03-24)10010075755480.7%
Writer: Palmyra X51009287754880.3%
Qwen 3 32B10010094584880.0%
Gemma 4 26B (Reasoning)100100100100080.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100080.0%
ByteDance Seed 2.0 Mini100100100100080.0%
Grok 4.3100100100100080.0%
Claude Opus 4.7100100100544279.0%
DeepSeek V4 Pro10010087693778.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010075694878.5%
DeepSeek V4 Pro (Reasoning)10010092752578.3%
Hermes 3 70B100100100464277.5%
Qwen 3.5 Plus (2026-04-20)100100100632577.5%
Thinking Machines Inkling10010010075776.5%
Claude Sonnet 4.510010010080075.9%
Claude Sonnet 5 (Reasoning, Low)10010083484675.5%
Claude Opus 4.8 (Reasoning)10010089503474.7%
Llama 3.1 70B10010010063072.5%
Gemini 3.6 Flash (Reasoning)100968780072.3%
Xiaomi MIMO v2.51001009269072.2%
Claude Haiku 4.5100978380072.0%
GPT-5.11001009166071.4%
Gemini 3.5 Flash Lite (Reasoning)10010010054070.7%
Cydonia 24B V4.1100948366068.7%
Z.AI GLM 4.51001007566068.2%
Laguna S 2.110010066601468.0%
Claude Opus 4.5878380513466.9%
Claude Sonnet 410010075421466.1%
Mistral Medium 3.5 (Reasoning)10010066421865.1%
Gemma 4 31B (Reasoning)10010010025065.0%
Mistral Small 410010010025065.0%
Qwen 3.7 Max94886966664.7%
ByteDance Seed 1.6 Flash1009473292564.2%
Gemini 3.1 Flash Lite100100100101063.8%
GPT-4o, Aug. 6th (temp=1)10010010018063.6%
Gemma 4 31B87877569063.5%
Nemotron 3 Super10010010014062.8%
Kimi K2.51009769252162.5%
Gemini 3.1 Flash Lite (Reasoning)10010010010061.9%
Gemini 3.6 Flash (Reasoning, Minimal)100946550061.8%
Hermes 3 405B100927542061.7%
Z.AI GLM 5.2 (Reasoning, High)1001001000060.0%
Z.AI GLM 5 Turbo1001001000060.0%
Gemma 4 26B1001001000060.0%
Mistral Large 31001001000060.0%
GPT-4.11007554481458.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010042341457.9%
Gemini 2.5 Pro1001006325057.5%
Z.AI GLM 51001007214057.3%
Gemini 3.8 Flash (Reasoning, Medium)100996325057.2%
Thinking Machines Inkling (Reasoning)928763251856.7%
WizardLM 2 8x22b696554544256.7%
Aion 2.097725446053.8%
MiniMax M2.5100635742753.7%
MiniMax M2.7756967252552.4%
GPT-5.21009225251851.9%
Z.AI GLM 4.7756966341451.7%
GPT-4.1 Nano100636331051.2%
Mistral Large 4.0925449252148.1%
Mistral Medium 3.175694242045.6%
Gemini 3.5 Flash (Reasoning)8382580044.6%
DeepSeek V4 Flash10069420042.2%
Grok 4.2094423731040.7%
Gemini 3 Flash (Preview, Reasoning)10075250040.0%
Gemini 3.1 Flash Lite (Preview)10010000040.0%
Mistral Small 4 (Reasoning)10010000040.0%
Laguna XS 2.19287140038.4%
DeepSeek V3 (2024-12-26)10063250037.5%
Xiaomi MIMO v2.5 Pro10050140032.8%
Mistral Medium 3.51006300032.5%
Ministral 3 14B1006300032.5%
Z.AI GLM 4.610042180031.9%
Gemini 2.5 Flash (Reasoning)946500031.8%
GPT-4.1 Mini6969180031.3%
Z.AI GLM 4.5 Air6646200026.4%
DeepSeek V3.26354100025.1%
GPT-5 Nano100000020.0%
Nemotron 3 Nano100000020.0%
Ministral 3 8B100000020.0%
Ministral 3B100000020.0%
Ministral 8B752500020.0%
Z.AI GLM 4.7 Flash4725168019.3%
Gemma 3 27B662000017.2%
DeepSeek-V2 Chat83000016.7%
Qwen 3.5 Plus (2026-02-15)462880016.5%
Gemini 2.5 Flash Lite (Reasoning)542500015.7%
Gemini 2.5 Flash4814140015.2%
GPT-4o Mini (temp=1)482000013.6%
DeepSeek V3.1422500013.3%
Inception Mercury 265000013.0%
Gemma 3 12B303000011.9%
Gemini 2.5 Flash Lite58000011.7%
Gemini 3 Flash (Preview)30180009.5%
Gemini 3.5 Flash (Reasoning, Minimal)700001.5%
GPT-OSS 120B000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Mistral Small 3.2 24B000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Grok 4.6 (Reasoning, High)1001001001009999.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009799.4%
Claude Opus 5 (Reasoning)1001001001009799.4%
Xiaomi MIMO v2.51001001001009799.4%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009298.3%
Claude Sonnet 4.6 (Reasoning)1001001001009298.3%
Thinking Machines Inkling Small (Reasoning, High)1001001001009298.3%
GPT-5.41001001001009298.3%
Qwen 3.5 27B100100100979498.2%
DeepSeek V4 Pro1001001001008897.6%
GPT-6 Luna (Reasoning, Medium)1001001001008797.3%
Z.AI GLM 5.2 (Reasoning, High)1001001001008597.0%
Claude Opus 5100100100998596.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001008296.3%
Grok 4.5 (Reasoning, High)1001001001008095.9%
GPT-5.4 (Reasoning, Low)1001001001008095.9%
Claude Opus 4100100100978295.9%
Kimi K3 (Reasoning, Low)100100100978295.7%
Claude Sonnet 5 (Reasoning, Low)100100100948395.4%
GPT-5.6 Sol (Reasoning, Medium)1001001001007595.0%
Hy4 Preview (Reasoning, High)1001001001007595.0%
GPT-5 Mini1001001001007595.0%
Kimi K3 (Reasoning, High)10010097948394.9%
Aion 3.5 Mini (Reasoning, High)10010096898994.8%
Claude Opus 4.7 (Reasoning)100100100878794.6%
GPT-51001001001007294.5%
Thinking Machines Inkling (Reasoning)100100100967594.1%
Claude Opus 4.6100100100927593.3%
GPT-5.4 Mini (Reasoning)1001001001006693.2%
o4 Mini100100100878093.2%
DeepSeek V4 Flash100100100966993.0%
Z.AI GLM 5.1100100100877892.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001006392.5%
Claude Haiku 5.5 (Adaptive)100100100877592.3%
Claude Opus 5.5 (Reasoning)1001001001005891.7%
GPT-5.4 Mini100100100807590.9%
GPT-5.5 (Reasoning, Medium)100100100896390.4%
GPT-5.4 Mini (Reasoning, Low)1001001001005090.0%
Claude Haiku 4.51001001001005090.0%
Claude Sonnet 4.6100100100876389.8%
Qwen 3.7 Max100100100975189.6%
GPT-5.4 Nano (Reasoning)100100100747389.4%
Claude Sonnet 5 (Reasoning)10010094807289.1%
Z.AI GLM 5100100100994688.9%
GPT-5.4 Nano10010090856888.4%
GPT-5.4 (Reasoning)1001001001004288.3%
GPT-5.5 (Reasoning, Low)1001001001004288.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001004288.3%
GPT-5.4 Nano (Reasoning, Low)10010096836288.2%
DeepSeek V3 (2025-03-24)10010092806988.1%
Grok 4.7 (Reasoning, High)100100100736387.2%
Qwen 3 235B A22B Instruct 25071009994895487.1%
Claude Opus 4.6 (Reasoning)1009289895885.7%
Grok 4.2010010097963285.0%
Mistral Large 4.01008984816984.8%
Grok 4.5 (Reasoning, Low)10010080756984.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009794874684.7%
Mistral Small 4100100100893484.7%
Claude Sonnet 5.5 (Reasoning)10010089736084.5%
Claude Opus 4.8 (Reasoning)1009692726384.4%
Xiaomi MIMO v2.6 Flash100100100962584.1%
Aion 3.010010096635883.3%
Aion 3.0 Mini10010092665883.2%
Claude Sonnet 510010087874282.9%
Claude Opus 4.510010082805182.4%
MiniMax M2.710010093882981.9%
MiniMax M2.510010080676081.3%
Z.AI GLM 5 Turbo100100100634280.8%
Z.AI GLM 5.3 (Reasoning, Max)1008780756380.7%
Gemini 3.1 Pro (Preview)100100100100080.0%
MiniMax M310010083754280.0%
Claude Opus 4.7100100100100080.0%
Gemma 4 26B (Reasoning)100100100100080.0%
Gemini 3.1 Flash Lite100100100100080.0%
Claude Opus 4.8 (Reasoning, Low)1009682754278.8%
DeepSeek V4 Pro (Reasoning)10010077694678.6%
Hermes 3 70B1009789634278.1%
Claude Haiku 5.5 (Reasoning, Medium)1007575696977.8%
o4 Mini High100100100543177.0%
Aion 3.5 (Reasoning, High)1009287603775.0%
DeepSeek V4 Flash (Reasoning)10010083484274.6%
Kimi K2.610010010069073.9%
Qwen 3 32B10010010069073.9%
Grok 4.310010010069073.9%
GPT-5.2100989475073.3%
Mistral Small 4 (Reasoning)1008863635473.3%
Claude Haiku 5.5 (Reasoning, Low)10042 – – – 70.8%
Gemini 3.8 Flash (Reasoning, Medium)1001007769069.4%
DeepSeek V4 Flash 0731 (Reasoning, High)99948563068.0%
Claude Sonnet 4.51001009738067.1%
ByteDance Seed 2.0 Mini1001008054066.6%
Laguna XS 2.1100949246066.3%
Kimi K2.596898337562.0%
Mistral Medium 3.5 (Reasoning)100926354061.5%
Gemini 3 Flash (Preview, Reasoning)1001001000060.0%
Gemma 4 31B (Reasoning)1001001000060.0%
Gemma 4 31B1001001000060.0%
Gemma 4 26B1001001000060.0%
DeepSeek V3 (2024-12-26)1001001000060.0%
Claude Sonnet 41007548373458.8%
Thinking Machines Inkling100928310056.9%
Writer: Palmyra X5996654342555.5%
Laguna S 2.11008856181455.1%
Ministral 3 14B10010025252555.0%
GPT-5 Nano100100730054.7%
DeepSeek V3.292756342054.2%
Xiaomi MIMO v2.5 Pro100100690053.9%
Mistral Large 4.0 (Reasoning)100725838053.7%
Mistral Medium 3.187776925051.7%
Gemini 3.5 Flash Lite (Reasoning)100100580051.7%
Gemini 3.6 Flash (Reasoning)10094630051.2%
GPT-4.19283750050.0%
Z.AI GLM 4.6100100420048.3%
Mistral Large 28775690046.2%
Mistral Medium 3.5777542251045.7%
Qwen 3.6 27B100100280045.6%
Gemini 3.7 Flash (Reasoning, Medium)10075480044.6%
DeepSeek-V2 Chat10087180040.9%
ByteDance Seed 1.6 Flash10072310040.7%
Cydonia 24B V4.190453828040.3%
Z.AI GLM 4.5100691414039.4%
Mistral Large 310069250038.9%
Ministral 3B1008700037.3%
Z.AI GLM 4.76958540036.3%
Hermes 3 405B10069100035.8%
Gemini 2.5 Pro8748250031.9%
Gemini 2.5 Flash7565160031.3%
Nemotron 3 Super1005400030.7%
Llama 3.1 70B1005400030.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1004270029.8%
Aion 2.07734250027.3%
GPT-4o Mini (temp=1)7242180026.4%
Cohere Command R+ (Aug. 2024)943700026.1%
Gemini 3.5 Flash (Reasoning, Minimal)805000025.9%
Arcee AI: Trinity Mini694200022.2%
Ministral 3 3B545400021.4%
Qwen 3.5 Plus (2026-02-15)633900020.3%
Mistral Small 3.2 24B100000020.0%
Nemotron 3 Nano100000020.0%
Ministral 8B100000020.0%
Z.AI GLM 4.7 Flash5825140019.4%
Gemini 3.6 Flash (Reasoning, Minimal)543700018.1%
Gemini 2.5 Flash Lite (Reasoning)661470017.5%
GPT-4o, Aug. 6th (temp=1)87000017.3%
WizardLM 2 8x22b3731180017.2%
Gemini 2.5 Flash (Reasoning)57800013.0%
Inception Mercury 2391800011.4%
Gemini 2.5 Flash Lite302500011.0%
Gemma 3 27B4600009.2%
GPT-OSS 120B4200008.3%
GPT-4.1 Mini3400006.8%
DeepSeek V3.1700001.5%
Gemini 3.5 Flash (Reasoning)000000.0%
Gemini 3 Flash (Preview)000000.0%
GPT-4o, Aug. 6th (temp=0)000000.0%
Z.AI GLM 4.5 Air000000.0%
GPT-4o Mini (temp=0)000000.0%
Gemma 3 12B000000.0%
Qwen 2.5 72B000000.0%
Ministral 3 8B000000.0%
GPT-4.1 Nano000000.0%
Gemma 3 4B000000.0%
Mistral NeMO000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Qwen 3.5 35B100100100100100100.0%
Aion 2.0100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 Flash1001001001009298.3%
Aion 3.0 Mini1001001001009298.3%
Qwen 3.7 Max1001001001008797.3%
Qwen 3.5 27B1001001001008797.3%
Thinking Machines Inkling Small (Reasoning, High)1001001001008797.3%
MiniMax M2.51001001001008797.3%
Claude Opus 5 (Reasoning, Low)1001001001008396.7%
Z.AI GLM 4.71001001001008396.7%
Kimi K3 (Reasoning, High)1001001001008095.9%
Qwen 3.6 35B1001001001008095.9%
Claude Opus 51001001001006993.9%
GPT-6 Luna1001001001006993.9%
DeepSeek V4 Pro100100100927593.3%
Kimi K2.61001001001006392.5%
GPT-5 Mini100100100827791.9%
Claude Opus 5 (Reasoning)1001001001005891.7%
Kimi K3 (Reasoning, Low)1001001001005490.7%
Claude Opus 4.8 (Reasoning, Low)1001001001005490.7%
Claude Opus 41001001001005490.7%
GPT-510010087828089.6%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001004288.3%
GPT-6 Sol (Reasoning, Medium)1001001001004288.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001004288.3%
Gemini 3.1 Flash Lite1001001001004288.3%
GPT-5.4 (Reasoning)1001001001002585.0%
Claude Sonnet 41001001001002585.0%
Mistral Small 4 (Reasoning)1001001001002585.0%
Claude Opus 4.6 (Reasoning)1001001001001482.8%
Xiaomi MIMO v2.5 Pro1001001001001482.8%
GPT-5.4 Nano (Reasoning)1009891753880.3%
Gemini 3.6 Flash (Reasoning)100100100100080.0%
Hy4 Preview (Reasoning, High)100100100100080.0%
Claude Opus 4.8 (Reasoning)100100100100080.0%
Xiaomi MIMO v2.6 Pro100100100100080.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100080.0%
Claude Opus 4.7100100100100080.0%
Claude Sonnet 5100100100100080.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100080.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100080.0%
Gemini 2.5 Flash (Reasoning)100100100100080.0%
Z.AI GLM 4.510010010089077.9%
GPT-5.4 Mini (Reasoning, Low)10010080634276.7%
Writer: Palmyra X51008069696376.2%
Qwen 3.5 Plus (2026-04-20)100100100542575.7%
GPT-5.4 Nano (Reasoning, Low)10010078633675.3%
GPT-4.110010010075075.0%
GPT-5.11001008983074.5%
Mistral Large 4.010010083424273.3%
o4 Mini1001008380072.6%
Z.AI GLM 5.110010010063072.5%
Claude Sonnet 4.6 (Reasoning)10010010063072.5%
o4 Mini High10010010063072.5%
Claude Sonnet 4.510010010054070.7%
MiniMax M2.7100948772070.5%
Claude Opus 5.5 (Reasoning)10010054544269.8%
DeepSeek V3.110010010042068.3%
Gemini 2.5 Flash10010010042068.3%
Mistral Medium 3.110010010042068.3%
Mistral Small 410010010042068.3%
DeepSeek V4 Pro (Reasoning)10010010034066.8%
Claude Sonnet 5 (Reasoning)10010010025065.0%
Xiaomi MIMO v2.6 Flash10010010025065.0%
Gemma 4 31B10010010025065.0%
Claude Opus 4.51007269483464.8%
Z.AI GLM 4.7 Flash10010054422564.0%
Aion 3.5 (Reasoning, High)100806958061.5%
GPT-5.4 Mini10010048342561.4%
Gemini 3.5 Flash (Reasoning)1001001000060.0%
Claude Haiku 5.5 (Adaptive)1001001000060.0%
DeepSeek V4 Flash (Reasoning)1001001000060.0%
Z.AI GLM 4.61001001000060.0%
Mistral Medium 3.51001001000060.0%
Claude Haiku 4.51001001000060.0%
Mistral Large 21001001000060.0%
Gemini 2.5 Flash Lite1001001000060.0%
Mistral Small 3.2 24B100100970059.4%
GPT-5.4 Nano1008356292558.6%
Aion 3.5 Mini (Reasoning, High)100100750055.0%
DeepSeek V3.2100100690053.9%
WizardLM 2 8x22b100100690053.9%
Thinking Machines Inkling (Reasoning)1001004225053.3%
Laguna S 2.11009242211052.8%
GPT-5.2100725437052.5%
Qwen 3 32B1005854252552.4%
ByteDance Seed 2.0 Mini100100540050.7%
Hermes 3 405B100100540050.7%
DeepSeek V3 (2025-03-24)100100540050.7%
Qwen 3 235B A22B Instruct 2507636342424250.0%
Z.AI GLM 5100100420048.3%
Grok 4.3100100420048.3%
Thinking Machines Inkling100100420048.3%
Cydonia 24B V4.1100100420048.3%
GPT-4o, Aug. 6th (temp=1)1001001814046.3%
Gemini 3.6 Flash (Reasoning, Minimal)100634225045.8%
ByteDance Seed 1.6 Flash100634222045.1%
Claude Opus 4.7 (Reasoning)100100250045.0%
Hermes 3 70B10069540044.6%
DeepSeek V4 Flash100544225044.0%
Gemini 3 Flash (Preview, Reasoning)10010000040.0%
ByteDance Seed 1.610010000040.0%
Mistral Large 310010000040.0%
DeepSeek-V2 Chat10010000040.0%
Xiaomi MIMO v2.510010000040.0%
GPT-4o, Aug. 6th (temp=0)10010000040.0%
Ministral 3 14B10010000040.0%
Grok 4.2010050250035.0%
Claude Sonnet 5 (Reasoning, Low)1006900033.9%
GPT-5 Nano1004200028.3%
Gemma 3 27B696300026.4%
Gemini 3.8 Flash (Reasoning, Medium)1001400022.8%
Z.AI GLM 4.5 Air1001400022.8%
Mistral Medium 3.5 (Reasoning)100000020.0%
DeepSeek V3 (2024-12-26)100000020.0%
Nemotron 3 Super100000020.0%
Llama 3.1 70B100000020.0%
Laguna XS 2.1100000020.0%
Nemotron 3 Nano100000020.0%
Cohere Command R+ (Aug. 2024)100000020.0%
Ministral 3B100000020.0%
Gemma 3 12B75000015.0%
Gemini 3 Flash (Preview)66000013.2%
Gemini 3.5 Flash (Reasoning, Minimal)421400011.1%
Qwen 3.5 Plus (2026-02-15)3800007.6%
GPT-4o Mini (temp=1)3100006.3%
Ministral 8B2500005.0%
GPT-OSS 120B1000001.9%
Inception Mercury 2000000.0%
GPT-4.1 Mini000000.0%
GPT-4o Mini (temp=0)000000.0%
Qwen 2.5 72B000000.0%
Ministral 3 8B000000.0%
GPT-4.1 Nano000000.0%
Arcee AI: Trinity Mini000000.0%
Gemma 3 4B000000.0%
Ministral 3 3B000000.0%
Mistral NeMO000000.0%