Purple prose (modifier overload)

Test: Bad Writing Habits

Avg. Score
96.1%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Inception Mercury 298.9%$0.00327.0s95%
2ByteDance Seed 1.6 Flash99.1%$0.001327.3s95%
3GPT-4o Mini (temp=0)99.0%$0.001234.8s95%
4DeepSeek V4 Flash98.7%$0.000631.6s94%
5GPT-6 Luna98.7%$0.001332.6s94%
6Claude Haiku 5.5 (Reasoning, Low)98.1%$0.001515.4s93%
7Mistral NeMO97.8%$0.000510.1s93%
8Claude Haiku 5.5 (Adaptive)98.1%$0.001819.3s93%
9Nemotron 3 Nano98.9%$0.00101.1m95%
10Ministral 3B97.8%$0.00018.1s91%
11GPT-4o, Aug. 6th (temp=0)98.6%$0.02322.7s95%
12DeepSeek V4.1 Flash (Reasoning, High)98.3%$0.002935.4s93%
13Claude Haiku 5.5 (Reasoning, Medium)98.0%$0.001414.9s91%
14Qwen 2.5 72B98.0%$0.001036.7s92%
15Qwen 3.5 Flash98.3%$0.002547.5s93%
16GPT-5.6 Luna97.9%$0.01515.8s93%
17o4 Mini97.9%$0.01525.7s94%
18GPT-6 Luna (Reasoning, High)98.2%$0.002357.1s93%
19Grok 4.397.6%$0.006930.5s93%
20Z.AI GLM 5 Turbo97.8%$0.008133.2s93%
21Mistral Large 4.098.7%$0.00631.1m94%
22DeepSeek V4 Flash (Reasoning)98.1%$0.000731.1s91%
23GPT-OSS 120B99.0%$0.00151.8m95%
24Muse Spark 1.1 (Reasoning, Minimal)97.5%$0.01219.2s92%
25Nemotron 3 Super98.6%$0.00001.4m93%
26Qwen 3.6 Flash97.9%$0.01041.4s93%
27Laguna XS 2.196.7%$0.000314.4s91%
28Xiaomi MIMO v2.6 Flash98.8%$0.00081.8m95%
29GPT-6 Luna (Reasoning, Medium)97.7%$0.001643.0s91%
30Qwen 3.5 9B98.5%$0.00111.4m93%
31GPT-6 Sol (Reasoning, Medium)98.9%$0.0311.0m95%
32Mistral Medium 3.5 (Reasoning)97.7%$0.01818.0s92%
33GPT-5.6 Luna (Reasoning, Medium)97.4%$0.01718.0s92%
34Muse Spark 1.1 (Reasoning, Medium)97.3%$0.01523.9s92%
35GPT-5 Mini97.7%$0.010057.4s93%
36Aion 3.098.5%$0.0241.0m94%
37o4 Mini High98.2%$0.02547.2s94%
38GPT-4o Mini (temp=1)97.4%$0.001234.8s90%
39DeepSeek V3 (2025-03-24)97.3%$0.001439.4s90%
40Hermes 3 70B97.5%$0.00101.2m93%
41GPT-6 Sol98.4%$0.02751.4s93%
42Arcee AI: Trinity Mini96.3%$0.00039.2s90%
43Cohere Command R+ (Aug. 2024)98.0%$0.02052.5s93%
44Mistral Large 397.0%$0.003330.3s90%
45Qwen 3.5 Plus (2026-02-15)96.7%$0.006031.5s91%
46Claude Sonnet 5.5 (Reasoning)98.6%$0.04236.9s94%
47Mistral Medium 3.597.1%$0.01818.2s91%
48Z.AI GLM 5.2 (Reasoning, High)97.8%$0.0111.0m92%
49Qwen 3.6 35B97.4%$0.00831.0m92%
50Thinking Machines Inkling97.9%$0.00751.5m93%
51Qwen 3.5 35B98.0%$0.0181.0m92%
52Aion 3.0 Mini97.8%$0.00531.2m91%
53Xiaomi MIMO v2.6 Pro98.4%$0.00332.0m94%
54Z.AI GLM 5.3 Flash (Reasoning, Low)97.9%$0.00051.1m88%
55Mistral Large 296.7%$0.01329.4s90%
56Muse Glimmer 30B (Reasoning, Medium)96.6%$0.003843.4s90%
57Qwen 3 32B97.4%$0.001554.6s88%
58GPT-5.4 Nano (Reasoning, Low)96.3%$0.005520.6s89%
59Z.AI GLM 5.197.8%$0.0141.5m93%
60Ministral 8B95.6%$0.000410.4s88%
61Mistral Small 495.9%$0.001418.2s88%
62Qwen 3.5 122B97.7%$0.0251.1m92%
63Ministral 3 14B96.0%$0.000711.7s87%
64Aion 3.5 (Reasoning, High)98.2%$0.0221.3m91%
65Hermes 3 405B96.8%$0.003253.2s89%
66DeepSeek V4 Pro97.2%$0.00481.3m90%
67Muse Spark 1.2 (Reasoning, Medium)96.8%$0.01838.3s90%
68Z.AI GLM 4.5 Air96.6%$0.002958.2s89%
69Z.AI GLM 597.3%$0.00841.2m90%
70Xiaomi MIMO v2.596.2%$0.005431.8s88%
71Qwen 3.5 Plus (2026-04-20)98.1%$0.0171.8m93%
72Ministral 3 3B95.9%$0.000511.1s86%
73Ministral 3 8B95.6%$0.000819.6s87%
74Kimi K3 (Reasoning, Low)97.7%$0.0281.1m91%
75Aion 2.096.4%$0.00641.3m91%
76Mistral Medium 3.195.8%$0.004836.5s89%
77GPT-4.196.5%$0.01844.7s90%
78MiniMax M2.796.6%$0.00401.1m89%
79Grok 4.3 (Reasoning)98.6%$0.0212.3m94%
80GPT-4o, Aug. 6th (temp=1)96.6%$0.01824.4s87%
81DeepSeek V3 (2024-12-26)96.1%$0.002154.6s88%
82DeepSeek-V2 Chat95.8%$0.002153.3s88%
83Qwen 3 235B A22B Instruct 250796.0%$0.001159.2s88%
84DeepSeek V4 Flash 0731 (Reasoning, High)97.8%$0.00222.6m93%
85Writer: Palmyra X595.6%$0.01122.0s87%
86DeepSeek V4 Pro 0813 (Reasoning, High)98.0%$0.0251.8m92%
87GPT-5.6 Terra (Reasoning, Medium)97.2%$0.04435.2s91%
88WizardLM 2 8x22b96.9%$0.00261.8m90%
89Xiaomi MIMO v2.5 Pro96.0%$0.008553.5s89%
90Qwen 3.5 27B97.0%$0.0201.6m92%
91GPT-6.1 Sol (Reasoning, Medium)98.0%$0.0311.6m92%
92Claude Haiku 4.595.3%$0.01121.6s87%
93Z.AI GLM 4.7 Flash96.1%$0.00171.2m87%
94Qwen 3.7 Flash (Reasoning)96.4%$0.001055.2s85%
95Llama 3.1 70B96.2%$0.001529.4s83%
96Claude Opus 4.8 (Reasoning)98.0%$0.07141.7s93%
97MiniMax M2.596.0%$0.00341.3m88%
98MiniMax M398.1%$0.00603.1m94%
99GPT-5.4 Nano95.3%$0.005726.3s85%
100Aion 3.5 Mini (Reasoning, High)98.1%$0.0112.4m90%
101Qwen 3.8 Flash (Reasoning)98.2%$0.00643.1m93%
102GPT-5.6 Terra96.8%$0.04636.9s90%
103Thinking Machines Inkling Small (Reasoning, High)96.3%$0.00881.7m90%
104Muse Spark 1.3 (Reasoning, Medium)96.8%$0.0251.8m92%
105ByteDance Seed 2.0 Lite97.2%$0.0122.2m91%
106GPT-5.4 Nano (Reasoning)95.0%$0.006124.5s85%
107GPT-5.4 Mini (Reasoning)95.6%$0.02228.1s87%
108Claude Sonnet 4.596.0%$0.03538.1s89%
109Claude Opus 4.7 (Reasoning)97.6%$0.07632.0s92%
110GPT-5 Nano95.7%$0.00421.4m88%
111Qwen 3.5 397B A17B97.7%$0.0143.0m94%
112ByteDance Seed 1.697.4%$0.0132.5m91%
113 Kimi K3 (Reasoning, High)97.9%$0.0441.8m92%
114Claude Opus 5.5 (Reasoning)98.5%$0.09256.0s94%
115Grok 4.2095.2%$0.009345.7s86%
116Claude Sonnet 495.9%$0.03243.7s88%
117GPT-5.4 Mini94.8%$0.01516.8s85%
118Kimi K2.598.3%$0.0193.2m93%
119Claude Opus 4.797.1%$0.06930.4s91%
120Laguna S 2.194.1%$0.000522.1s84%
121Claude Opus 4.8 (Reasoning, Low)97.6%$0.07141.9s90%
122Gemma 4 31B96.0%$0.00101.6m86%
123Mistral Small 4 (Reasoning)94.5%$0.002230.2s83%
124Grok 4.20 (Reasoning)96.2%$0.0181.5m87%
125Z.AI GLM 4.796.0%$0.0101.4m86%
126Z.AI GLM 4.694.9%$0.006551.5s85%
127Mistral Large 4.0 (Reasoning)98.3%$0.0233.4m94%
128Grok 4.6 (Reasoning, High)98.0%$0.0422.5m93%
129GPT-5.4 Mini (Reasoning, Low)94.6%$0.01516.8s83%
130DeepSeek V4 Pro (Reasoning)97.3%$0.0153.1m92%
131GPT-4.1 Mini93.7%$0.002719.0s83%
132Z.AI GLM 4.594.7%$0.005142.1s83%
133Grok 4.5 (Reasoning, Low)95.3%$0.0181.1m86%
134Claude Opus 597.4%$0.08250.1s91%
135Gemini 3.1 Flash Lite (Reasoning)93.7%$0.003011.9s82%
136Gemini 3.5 Flash Lite (Reasoning, Minimal)93.2%$0.00356.3s82%
137Claude Opus 5 (Reasoning, Low)98.1%$0.0971.0m93%
138Claude Opus 4.697.3%$0.0781.2m92%
139Gemini 3 Flash (Preview)94.1%$0.007819.6s81%
140GPT-5.296.7%$0.0561.5m91%
141Gemini 3.1 Flash Lite (Preview)93.5%$0.00308.4s81%
142Gemini 2.5 Flash Lite93.4%$0.00099.5s80%
143Gemma 4 26B93.5%$0.000955.1s83%
144Gemini 3.1 Flash Lite92.8%$0.003012.1s81%
145DeepSeek V3.295.2%$0.00141.9m83%
146Qwen 3.8 27B (Reasoning, XHigh)99.1%$0.0404.7m96%
147Claude Sonnet 4.694.2%$0.03139.3s83%
148Claude Opus 4.6 (Reasoning)96.9%$0.0881.4m91%
149GPT-597.7%$0.0652.8m93%
150Gemini 2.5 Pro94.6%$0.03636.2s83%
151Gemma 4 31B (Reasoning)94.9%$0.00142.2m84%
152Gemini 3.5 Flash Lite (Reasoning)92.0%$0.00356.6s80%
153Claude Opus 5 (Reasoning)96.9%$0.0981.0m91%
154Grok 4.5 (Reasoning, High)95.2%$0.0301.6m84%
155Gemma 3 12B92.9%$0.000441.3s79%
156Gemini 2.5 Flash91.5%$0.005210.6s80%
157GPT-5.495.3%$0.0491.4m86%
158Gemini 3.7 Flash (Reasoning, Medium)92.4%$0.01218.2s80%
159Gemini 3.8 Flash (Reasoning, Medium)91.8%$0.01418.0s81%
160GPT-5.6 Sol (Reasoning, Medium)96.8%$0.1081.2m90%
161Qwen 3.6 27B96.2%$0.0252.3m82%
162Grok 4.7 (Reasoning, High)98.6%$0.0743.9m94%
163Gemma 4 26B (Reasoning)93.3%$0.00132.0m82%
164Z.AI GLM 5.3 Flash (Reasoning, Max)98.7%$0.00316.5m94%
165DeepSeek V3.193.3%$0.00201.8m81%
166Claude Opus 4.594.8%$0.07053.4s85%
167GPT-5.6 Sol96.6%$0.1051.2m88%
168Gemini 2.5 Flash Lite (Reasoning)90.9%$0.002830.8s79%
169GPT-5.195.1%$0.0541.8m85%
170Qwen 3.6 Max Preview96.9%$0.0503.5m89%
171Claude Sonnet 4.6 (Reasoning)94.4%$0.0601.2m83%
172Gemini 3.6 Flash (Reasoning, Minimal)91.2%$0.01714.3s78%
173Claude Sonnet 5 (Reasoning, Low)92.4%$0.03138.4s80%
174Claude Sonnet 5 (Reasoning)92.0%$0.03038.9s80%
175Gemma 3 27B91.7%$0.000652.6s75%
176Claude Sonnet 591.7%$0.02733.5s77%
177GPT-5.4 (Reasoning, Low)93.9%$0.0551.4m82%
178Hy4 Preview (Reasoning, High)96.2%$0.0404.4m90%
179Thinking Machines Inkling (Reasoning)96.4%$0.0255.1m91%
180ByteDance Seed 2.0 Mini95.9%$0.00454.9m86%
181Gemini 3.5 Flash (Reasoning, Minimal)89.5%$0.01812.0s77%
182GPT-5.5 (Reasoning, Low)96.7%$0.1391.8m91%
183Gemini 3 Flash (Preview, Reasoning)90.0%$0.01230.1s74%
184Gemini 3.6 Flash (Reasoning)91.1%$0.04432.5s78%
185Gemma 3 4B88.7%$0.000220.0s71%
186GPT-5.5 (Reasoning, Medium)96.0%$0.1421.8m88%
187GPT-4.1 Nano87.6%$0.000713.3s73%
188Qwen 3.8 Max (Reasoning, XHigh)98.2%$0.0835.9m93%
189Z.AI GLM 5.3 (Reasoning, Max)99.0%$0.0667.3m95%
190Mistral Small 3.2 24B95.3%$0.00685.6m83%
191Gemini 2.5 Flash (Reasoning)88.2%$0.01121.5s72%
192GPT-5.595.6%$0.1391.7m86%
193Qwen 3.7 Max92.4%$0.0682.3m82%
194Kimi K2.697.7%$0.0586.5m90%
195GPT-5.4 (Reasoning)94.4%$0.0892.6m82%
196Claude Haiku 5.5 (Reasoning, Max)91.8%$0.0314.7m88%
197Claude Opus 496.9%$0.2091.4m91%
198Gemini 3.5 Flash (Reasoning)87.7%$0.07137.6s71%
199Gemini 3.1 Pro (Preview)86.8%$0.1071.8m73%
200Cydonia 24B V4.183.8%$0.001444.8s53%
96.12%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Qwen 3 32B100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
DeepSeek V4 Flash1001001001009799.4%
Grok 4.3 (Reasoning)1001001001009799.4%
Grok 4.6 (Reasoning, High)100100100999899.4%
Z.AI GLM 4.510010099989798.9%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Grok 4.7 (Reasoning, High)1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
Aion 3.01001001001009498.8%
o4 Mini High1001001001009498.8%
GPT-5.6 Terra1001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
DeepSeek-V2 Chat1001001001009498.8%
GPT-6 Luna1001001001009498.8%
Inception Mercury 21001001001009498.8%
GPT-4o, Aug. 6th (temp=1)1001001001009498.8%
GPT-5.4 Nano (Reasoning, Low)1001001001009498.8%
Mistral Small 3.2 24B1001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
GPT-5.4 Nano1001001001009498.8%
Ministral 3 14B1001001001009498.8%
Mistral NeMO1001001001009498.8%
Grok 4.5 (Reasoning, Low)100100100999498.6%
Mistral Medium 3.1100100100999498.6%
Claude Opus 4100100100989498.5%
GPT-5.4 Mini (Reasoning, Low)100100100989498.4%
Z.AI GLM 5 Turbo100100100979498.2%
Claude Opus 5 (Reasoning, Low)10010097979698.0%
Claude Haiku 5.5 (Reasoning, Low)10010094 – – 98.0%
Z.AI GLM 5.2 (Reasoning, High)100100100969498.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100969498.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100969497.9%
Grok 4.3100100100959497.9%
Ministral 8B1001001001008997.9%
Ministral 3B100100100999097.8%
Mistral Large 3100100100949497.7%
DeepSeek V4 Pro (Reasoning)100100100949497.6%
GPT-5.4 (Reasoning)100100100949497.6%
Kimi K3 (Reasoning, High)100100100949497.6%
GPT-6 Sol (Reasoning, Medium)100100100949497.6%
GPT-6 Luna (Reasoning, Medium)100100100949497.6%
Aion 3.5 Mini (Reasoning, High)100100100949497.6%
Claude Opus 4.6100100100949497.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
Xiaomi MIMO v2.6 Pro1001001001008897.6%
GPT-5100100100949497.6%
GPT-5 Mini100100100949497.6%
Kimi K2.51001001001008897.6%
GPT-6 Sol100100100949497.6%
Qwen 3.5 Plus (2026-04-20)100100100949497.6%
Qwen 3.6 27B1001001001008897.6%
GPT-OSS 120B1001001001008897.6%
Mistral Large 4.0100100100949497.6%
Mistral Medium 3.5100100100949497.6%
DeepSeek V3 (2024-12-26)1001001001008897.6%
Thinking Machines Inkling100100100949497.6%
Cohere Command R+ (Aug. 2024)100100100949497.6%
MiniMax M3100100100949497.5%
Mistral Small 41009997979497.5%
ByteDance Seed 2.0 Mini100100100998897.3%
MiniMax M2.7100100100959297.3%
Grok 4.20 (Reasoning)10010098949497.2%
Qwen 3 235B A22B Instruct 250710010098949497.1%
Xiaomi MIMO v2.5 Pro100100100978897.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100949197.1%
Claude Haiku 5.5 (Reasoning, Medium)100100100969097.0%
Hermes 3 70B100100100949096.8%
GPT-5.4 Mini10010096949496.8%
Claude Haiku 5.5 (Adaptive)10010097949296.6%
Muse Spark 1.2 (Reasoning, Medium)100100100948896.4%
Claude Sonnet 5.5 (Reasoning)100100100948896.4%
GPT-5.6 Terra (Reasoning, Medium)10010094949496.4%
ByteDance Seed 1.610010094949496.4%
GPT-5.210010094949496.4%
GPT-5.5100100100948896.4%
Gemma 4 26B (Reasoning)10010094949496.4%
DeepSeek V4 Flash (Reasoning)10010094949496.4%
Z.AI GLM 4.7100100100948896.4%
Qwen 3.6 35B10010094949496.4%
Xiaomi MIMO v2.6 Flash100100100948896.4%
Qwen 3.5 35B100100100948896.4%
o4 Mini10010094949496.4%
Qwen 3.5 Flash10010094949496.4%
Gemma 4 26B10010094949496.4%
ByteDance Seed 2.0 Lite100100100948896.4%
Aion 3.0 Mini100100100948896.4%
DeepSeek V3 (2025-03-24)10010094949496.4%
ByteDance Seed 1.6 Flash100100100948896.4%
GPT-4.110010096949296.3%
DeepSeek V4 Flash 0731 (Reasoning, High)10010094949396.2%
Mistral Small 4 (Reasoning)10010099948896.2%
Ministral 3 8B100100100948796.2%
Claude Opus 5.5 (Reasoning)10010099948896.1%
Laguna XS 2.11009894949496.0%
Hermes 3 405B1001001001008096.0%
Mistral Medium 3.5 (Reasoning)10010097948895.8%
Laguna S 2.11009998929095.8%
Muse Spark 1.1 (Reasoning, Minimal)10010094949195.7%
Claude Sonnet 4.6 (Reasoning)10010094929195.6%
Writer: Palmyra X5100100100948395.5%
Gemma 3 12B1009594949495.4%
GPT-6.1 Sol (Reasoning, Medium)100100100948295.2%
GPT-5.6 Sol (Reasoning, Medium)10010094948895.2%
Hy4 Preview (Reasoning, High)10010094948895.2%
Muse Spark 1.3 (Reasoning, Medium)1009494949495.2%
Muse Spark 1.1 (Reasoning, Medium)10010094948895.2%
Qwen 3.6 Max Preview10010094948895.2%
Aion 3.5 (Reasoning, High)100100100948295.2%
Thinking Machines Inkling (Reasoning)10010094948895.2%
Qwen 3.7 Flash (Reasoning)10010094948895.2%
Qwen 3.5 Plus (2026-02-15)1009494949495.2%
GPT-5.410010094948895.2%
Qwen 3.5 9B100100100948295.2%
Z.AI GLM 4.7 Flash1009494949495.2%
Mistral Large 21009494949495.2%
GPT-5.4 Nano (Reasoning)10010094948895.2%
Claude Sonnet 4.5999797948895.0%
Claude Opus 4.6 (Reasoning)10010099948295.0%
Gemma 3 27B100100100888795.0%
Grok 4.5 (Reasoning, High)10010098948294.8%
Claude Sonnet 4.610010098888894.8%
DeepSeek V4 Pro 0813 (Reasoning, High)10010094918894.5%
Claude Sonnet 410010094938594.4%
Claude Opus 4.71009896948294.0%
GPT-5.5 (Reasoning, Low)10010094888894.0%
Qwen 3.5 397B A17B1009494948894.0%
GPT-5.4 Mini (Reasoning)1009494948894.0%
Qwen 2.5 72B10010094888894.0%
GPT-5.4 (Reasoning, Low)949494949494.0%
Gemini 2.5 Flash Lite1009894908893.9%
Claude Opus 4.8 (Reasoning)10010093888893.8%
Claude Opus 5 (Reasoning)10010094888693.6%
Claude Haiku 4.51009594918793.4%
Gemini 2.5 Flash1009493928893.4%
GPT-4.1 Nano1009493918993.4%
GPT-4.1 Mini949494949093.1%
Xiaomi MIMO v2.510010094888393.1%
Kimi K3 (Reasoning, Low)100100100838292.9%
MiniMax M2.51009897927792.9%
GPT-5.6 Sol1001001001006492.8%
DeepSeek V3.2100100100828292.8%
Gemini 3.8 Flash (Reasoning, Medium)949494948892.8%
Kimi K2.61009494888892.8%
GPT-5.6 Luna (Reasoning, Medium)10010094947692.8%
Gemini 3.1 Flash Lite (Reasoning)949494948892.8%
Gemini 3.1 Flash Lite (Preview)1009494888892.8%
Gemma 4 31B1009494888892.8%
Claude Sonnet 5979593908892.6%
Claude Opus 4.8 (Reasoning, Low)1009794947892.5%
Claude Opus 4.7 (Reasoning)1009491888892.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)979494888792.1%
Claude Opus 4.51009694927892.0%
Llama 3.1 70B1001001001006092.0%
WizardLM 2 8x22b949494908791.7%
Claude Sonnet 5 (Reasoning, Low)999891888291.6%
Gemini 3.5 Flash (Reasoning)949494888891.6%
Z.AI GLM 4.610010088888291.6%
Z.AI GLM 51009897966691.5%
Aion 2.01009488888791.4%
GPT-5 Nano10010099827691.4%
Thinking Machines Inkling Small (Reasoning, High)949491888891.0%
Gemini 3.7 Flash (Reasoning, Medium)10010094887090.4%
GPT-5.5 (Reasoning, Medium)1009488888290.4%
Gemma 4 31B (Reasoning)1009488888290.4%
Gemini 3.6 Flash (Reasoning, Minimal)10010094827690.4%
Ministral 3 3B10010094887090.4%
Claude Opus 510010094827690.3%
Muse Glimmer 30B (Reasoning, Medium)999488888290.2%
Qwen 3.7 Max10010088827689.2%
GPT-5.11009488887689.2%
Gemini 2.5 Pro1008888888289.2%
Gemini 3 Flash (Preview)1009488827688.0%
Gemini 2.5 Flash (Reasoning)949087868287.8%
Gemini 2.5 Flash Lite (Reasoning)1008887867887.8%
Claude Sonnet 5 (Reasoning)969486867887.8%
Gemini 3 Flash (Preview, Reasoning)949488827686.8%
DeepSeek V3.11008888887086.8%
Gemini 3.1 Pro (Preview)949482827685.6%
Gemini 3.5 Flash Lite (Reasoning)1008882827685.6%
Gemma 3 4B929286837485.4%
Gemini 3.6 Flash (Reasoning)1009476767083.2%
Cydonia 24B V4.110010096932382.4%
Gemini 3.1 Flash Lite948882767082.0%
Gemini 3.5 Flash (Reasoning, Minimal)888282767079.6%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Hermes 3 405B100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009999.8%
Thinking Machines Inkling1001001001009999.7%
Arcee AI: Trinity Mini1001001001009899.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009799.5%
Grok 4.3 (Reasoning)100100100999799.2%
Ministral 3 8B1001001001009699.1%
GPT-6 Sol (Reasoning, Medium)1001001001009599.0%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009498.8%
Z.AI GLM 5.11001001001009498.8%
Qwen 3.6 Max Preview1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
Claude Sonnet 5.5 (Reasoning)1001001001009498.8%
Grok 4.7 (Reasoning, High)1001001001009498.8%
GPT-5.5 (Reasoning, Low)1001001001009498.8%
Claude Opus 4.61001001001009498.8%
GPT-5.6 Sol1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
Qwen 3.6 27B1001001001009498.8%
Xiaomi MIMO v2.6 Flash1001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009498.8%
Nemotron 3 Super1001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001009498.8%
GPT-6 Sol100100100999498.5%
Aion 3.0100100100989498.5%
Claude Haiku 5.5 (Adaptive)1001001001009298.5%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100989498.4%
Z.AI GLM 5 Turbo1001001001009198.2%
GPT-5.4 Nano1009999969698.2%
MiniMax M3100100100979498.1%
Ministral 3 14B100100100989197.9%
DeepSeek V4 Flash100100100959497.8%
ByteDance Seed 1.6100100100959497.8%
GPT-4o, Aug. 6th (temp=1)100100100969397.7%
Mistral Medium 3.5 (Reasoning)100100100959397.6%
GPT-6.1 Sol (Reasoning, Medium)100100100949497.6%
GPT-6 Luna (Reasoning, High)100100100949497.6%
Kimi K3 (Reasoning, High)100100100949497.6%
GPT-5.6 Terra (Reasoning, Medium)1001001001008897.6%
Aion 3.5 Mini (Reasoning, High)100100100949497.6%
Claude Opus 5 (Reasoning, Low)100100100949497.6%
Xiaomi MIMO v2.6 Pro1001001001008897.6%
GPT-5100100100949497.6%
Qwen 3.5 397B A17B100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
Qwen 3.5 Plus (2026-04-20)1001001001008897.6%
Z.AI GLM 4.7100100100949497.6%
o4 Mini100100100949497.6%
Qwen 3.5 Plus (2026-02-15)100100100949497.6%
Qwen 3.5 Flash100100100949497.6%
GPT-4o, Aug. 6th (temp=0)100100100949497.6%
DeepSeek V4 Pro100100100949497.6%
Qwen 3 32B100100100949497.6%
Cohere Command R+ (Aug. 2024)1001001001008897.6%
GPT-5.4 Nano (Reasoning)10010099989297.5%
GPT-5.5100100100949397.5%
Mistral Medium 3.1100100100949397.5%
GPT-5.4 Mini10010096969597.4%
Hermes 3 70B10010099949497.3%
Qwen 3 235B A22B Instruct 250710010096969497.3%
Claude Opus 410010099988997.2%
Claude Sonnet 4.6 (Reasoning)100100100988797.1%
Claude Haiku 5.5 (Reasoning, Low)1009695 – – 97.1%
DeepSeek V4 Pro (Reasoning)10010099949196.8%
Aion 3.0 Mini100100100949096.7%
Claude Opus 4.7 (Reasoning)100100100949096.7%
Kimi K3 (Reasoning, Low)1001001001008496.7%
Grok 4.20 (Reasoning)100100100958896.6%
DeepSeek V3.1100100100948996.6%
Claude Opus 4.8 (Reasoning)100100100958896.6%
Claude Opus 4.8 (Reasoning, Low)10010094949496.5%
Claude Opus 5.5 (Reasoning)10010094949496.4%
GPT-5.6 Sol (Reasoning, Medium)100100100948896.4%
Claude Opus 4.6 (Reasoning)10010094949496.4%
Muse Spark 1.2 (Reasoning, Medium)100100100948896.4%
Qwen 3.8 Flash (Reasoning)100100100948896.4%
Muse Spark 1.3 (Reasoning, Medium)10010094949496.4%
Kimi K2.5100100100948896.4%
Qwen 3.6 Flash100100100948896.4%
Muse Glimmer 30B (Reasoning, Medium)100100100948896.4%
Qwen 3.6 35B10010094949496.4%
Aion 2.010010094949496.4%
Xiaomi MIMO v2.5 Pro100100100948896.4%
GPT-5.6 Luna10010094949496.4%
Z.AI GLM 4.7 Flash100100100948896.4%
Inception Mercury 210010094949496.4%
Llama 3.1 70B1001001001008296.4%
Qwen 2.5 72B100100100948896.4%
Xiaomi MIMO v2.510010094949496.4%
ByteDance Seed 2.0 Mini1001001001008196.3%
Claude Sonnet 410010097949196.3%
Mistral Small 3.2 24B100100100948796.2%
Mistral Medium 3.5100100100998296.2%
Mistral NeMO1001001001008196.2%
DeepSeek V4.1 Flash (Reasoning, High)1001001001008096.1%
GPT-5.4 (Reasoning)1009894949496.0%
GPT-5.4 Mini (Reasoning)1009595959495.9%
GPT-4o Mini (temp=1)1009995949195.9%
Qwen 3.7 Flash (Reasoning)100100100948595.8%
Claude Opus 4.51009896949195.8%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100908895.8%
Grok 4.5 (Reasoning, Low)10010094949195.7%
Mistral Large 210010095948995.6%
GPT-5.110010094949095.6%
Z.AI GLM 5100100100988095.6%
Laguna XS 2.110010096929095.5%
Claude Opus 4.710010095948895.5%
Grok 4.310010096938795.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010094948895.2%
Mistral Large 4.0 (Reasoning)10010094948895.2%
Aion 3.5 (Reasoning, High)10010094948895.2%
Claude Opus 5 (Reasoning)10010094948895.2%
Qwen 3.5 27B1009494949495.2%
Claude Opus 51009494949495.2%
o4 Mini High10010094948895.2%
GPT-5.6 Terra10010094948895.2%
Gemini 3.5 Flash (Reasoning, Minimal)10010094948895.2%
Z.AI GLM 4.5 Air10010094948895.2%
Grok 4.2010010094929095.1%
Mistral Large 4.0100100100938295.1%
Writer: Palmyra X5100100100948195.0%
DeepSeek V4 Flash (Reasoning)100100100888795.0%
WizardLM 2 8x22b1009795948894.7%
DeepSeek V3 (2025-03-24)1001001001007394.5%
MiniMax M2.510010094938594.2%
Claude Haiku 4.510010092908994.2%
DeepSeek V3 (2024-12-26)10010097908494.1%
Muse Spark 1.1 (Reasoning, Minimal)1009594928994.0%
Gemini 3.8 Flash (Reasoning, Medium)10010094888894.0%
DeepSeek V3.210010094948294.0%
GPT-5.4 (Reasoning, Low)1009493929093.9%
GPT-5.4 Nano (Reasoning, Low)10010094938293.9%
GPT-5.5 (Reasoning, Medium)10010099888293.8%
GPT-5.4989594948693.6%
Thinking Machines Inkling Small (Reasoning, High)10010094918293.5%
Mistral Small 410010094918293.5%
Z.AI GLM 4.61009493928893.4%
Grok 4.5 (Reasoning, High)1009494948493.2%
Claude Sonnet 4.51009995868693.2%
Claude Sonnet 4.610010095947793.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949494948892.9%
Gemini 2.5 Flash Lite (Reasoning)1009993898392.8%
Gemini 2.5 Pro1009494888792.6%
Laguna S 2.11009392898892.5%
GPT-5.4 Mini (Reasoning, Low)969595928592.5%
Gemini 3 Flash (Preview)949494928892.5%
Gemini 3.5 Flash Lite (Reasoning)1009494928292.4%
GPT-5.21009494888391.8%
Qwen 3.7 Max949494888891.6%
Thinking Machines Inkling (Reasoning)1009794858291.6%
Mistral Small 4 (Reasoning)999594888291.5%
MiniMax M2.7989492918191.2%
Hy4 Preview (Reasoning, High)1009794887691.2%
Gemini 2.5 Flash Lite10010096897091.1%
GPT-4.1 Nano949493928191.0%
Mistral Large 3959392898490.7%
GPT-4.11009494917490.6%
GPT-4.1 Mini969494868290.4%
Gemini 3.6 Flash (Reasoning, Minimal)1009494937090.3%
Z.AI GLM 4.5959493878390.2%
Gemma 3 4B1009896807689.9%
Gemini 3.6 Flash (Reasoning)10010084828289.7%
Claude Sonnet 5 (Reasoning)1009090848289.2%
Gemma 4 26B (Reasoning)10010088827689.2%
Gemini 3.1 Flash Lite (Preview)949488887688.0%
Gemini 3.1 Flash Lite949488828288.0%
Gemini 3.5 Flash (Reasoning)949494827688.0%
Gemini 3.1 Flash Lite (Reasoning)1009494827088.0%
Gemma 4 26B1008888887688.0%
DeepSeek-V2 Chat948988848187.1%
Gemma 3 12B1009694766486.2%
Gemma 3 27B1009190757185.6%
Gemini 3.7 Flash (Reasoning, Medium)1008882827685.6%
Ministral 3 3B1009982786885.5%
Claude Sonnet 51009290885785.5%
Gemini 2.5 Flash918986817784.6%
Gemini 3.1 Pro (Preview)1008882827084.4%
Gemma 4 31B (Reasoning)948888827084.4%
Claude Sonnet 5 (Reasoning, Low)1008685846584.0%
Gemini 2.5 Flash (Reasoning)888886727281.2%
Gemini 3 Flash (Preview, Reasoning)949476706078.8%
Cydonia 24B V4.1838281583467.6%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Aion 2.0100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Claude Opus 4.6 (Reasoning)10010010010010099.9%
DeepSeek-V2 Chat10010010010010099.9%
Qwen 3.7 Flash (Reasoning)10010010010010099.9%
Kimi K3 (Reasoning, High)10010010010010099.9%
Claude Opus 5 (Reasoning)1001001001009999.9%
Grok 4.31001001001009999.9%
Mistral Large 21001001001009999.8%
DeepSeek V4 Flash1001001001009999.7%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009999.7%
Aion 3.5 (Reasoning, High)1001001001009899.6%
Claude Opus 4.8 (Reasoning, Low)1001001001009899.5%
Claude Opus 4.8 (Reasoning)1001001001009799.5%
Cohere Command R+ (Aug. 2024)1001001001009799.3%
MiniMax M31001001001009799.3%
Z.AI GLM 5.11001001001009699.3%
Mistral Large 3100100100999799.2%
DeepSeek V3 (2025-03-24)1001001001009699.2%
Grok 4.6 (Reasoning, High)100100100989798.9%
Z.AI GLM 51001001001009498.9%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
GPT-5.4 (Reasoning)1001001001009498.8%
Qwen 3.6 Max Preview1001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
GPT-51001001001009498.8%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009498.8%
GPT-5 Mini1001001001009498.8%
Qwen 3.5 397B A17B1001001001009498.8%
GPT-5.4 (Reasoning, Low)1001001001009498.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Xiaomi MIMO v2.51001001001009498.8%
GPT-6 Luna1001001001009498.8%
DeepSeek V3 (2024-12-26)1001001001009498.8%
Z.AI GLM 4.7 Flash1001001001009498.8%
DeepSeek V4 Pro1001001001009498.8%
Inception Mercury 21001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
Thinking Machines Inkling1001001001009498.8%
Arcee AI: Trinity Mini1001001001009498.8%
Mistral NeMO1001001001009498.8%
WizardLM 2 8x22b100100100999498.7%
Claude Opus 5 (Reasoning, Low)100100100999498.6%
Claude Sonnet 4.5100100100999498.5%
GPT-5.4 Mini (Reasoning, Low)10010099989598.5%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100989498.5%
Claude Sonnet 5 (Reasoning)1001001001009298.5%
Ministral 3B1001001001009298.5%
Grok 4.20 (Reasoning)1001001001009298.4%
GPT-5.4 Nano (Reasoning, Low)100100100989498.4%
GPT-5.4100100100989498.3%
GPT-5.4 Mini (Reasoning)100100100969698.3%
Ministral 8B1001001001009198.2%
GPT-5 Nano10010099979598.2%
DeepSeek V4.1 Flash (Reasoning, High)10010099989498.1%
Aion 3.0 Mini100100100979498.1%
MiniMax M2.7100100100969498.1%
Z.AI GLM 4.5 Air10010099989398.0%
Grok 4.20100100100969497.9%
Claude Sonnet 4.610010098989397.9%
Claude Sonnet 5100100100959497.8%
Ministral 3 3B1001001001008997.7%
Muse Spark 1.2 (Reasoning, Medium)100100100949497.6%
Grok 4.5 (Reasoning, High)100100100949497.6%
GPT-6 Sol (Reasoning, Medium)100100100949497.6%
Kimi K2.6100100100949497.6%
GPT-5.5 (Reasoning, Low)1001001001008897.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
Kimi K2.5100100100949497.6%
GPT-5.6 Sol100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
GPT-6 Sol100100100949497.6%
Gemma 4 31B (Reasoning)1001001001008897.6%
ByteDance Seed 1.61001001001008897.6%
GPT-5.2100100100949497.6%
Qwen 3.6 Flash100100100949497.6%
GPT-4.1100100100949497.6%
o4 Mini100100100949497.6%
Gemini 3.1 Flash Lite (Reasoning)1001001001008897.6%
ByteDance Seed 2.0 Mini100100100949497.6%
GPT-5.6 Luna100100100949497.6%
ByteDance Seed 2.0 Lite100100100949497.6%
Gemini 2.5 Flash100100100999097.6%
Mistral Medium 3.5 (Reasoning)100100100998897.4%
Qwen 3.5 Plus (2026-02-15)10010099949497.4%
GPT-5.4 Mini100100100989097.4%
GPT-5.4 Nano (Reasoning)1009998979297.4%
Z.AI GLM 4.510010099949497.4%
Mistral Medium 3.1100100100949397.3%
Hermes 3 405B100100100949397.3%
DeepSeek V4 Pro (Reasoning)100100100949297.3%
GPT-4.1 Mini100100100949397.2%
Mistral Large 4.0100100100949297.2%
Thinking Machines Inkling (Reasoning)10010098949497.0%
Claude Sonnet 4.6 (Reasoning)10010097959397.0%
Z.AI GLM 4.710010097949497.0%
Grok 4.5 (Reasoning, Low)10010095949496.7%
Qwen 3 235B A22B Instruct 250710010099929196.5%
o4 Mini High10010094949496.4%
Z.AI GLM 5.2 (Reasoning, High)100100100948896.4%
Gemini 3.7 Flash (Reasoning, Medium)100100100948896.4%
Muse Spark 1.3 (Reasoning, Medium)10010094949496.4%
GPT-5.5 (Reasoning, Medium)10010094949496.4%
Grok 4.7 (Reasoning, High)10010094949496.4%
Claude Opus 4.610010094949496.4%
GPT-5.110010094949496.4%
Qwen 3.5 122B10010094949496.4%
Qwen 3.5 27B10010094949496.4%
Qwen 3.6 27B10010094949496.4%
GPT-5.6 Terra100100100948896.4%
GPT-4o, Aug. 6th (temp=0)10010094949496.4%
Qwen 2.5 72B100100100948896.4%
Gemini 3.6 Flash (Reasoning, Minimal)100100100948896.3%
Claude Sonnet 4100100100948796.2%
Mistral Medium 3.51009897949296.2%
Claude Sonnet 5 (Reasoning, Low)10010097939196.1%
Mistral Small 4 (Reasoning)10010095949296.1%
Hermes 3 70B1009894949496.0%
Thinking Machines Inkling Small (Reasoning, High)1009794949495.8%
Claude Opus 410010096929095.7%
Writer: Palmyra X51009594949495.4%
Z.AI GLM 4.61009494949495.2%
DeepSeek V3.2100100100948295.2%
Llama 3.1 70B100100100888694.7%
Gemma 3 12B10010098918594.6%
Laguna XS 2.110010093909094.6%
Mistral Small 4999794948894.5%
Qwen 3.5 35B10010094908894.4%
Hy4 Preview (Reasoning, High)10010094888894.0%
GPT-5.51009494948894.0%
Ministral 3 8B999594948793.9%
Gemini 2.5 Flash Lite1009594938893.9%
Laguna S 2.11009795948393.8%
Gemma 4 26B1009494908893.2%
Ministral 3 14B1009996937793.1%
MiniMax M2.5989592909093.1%
DeepSeek V3.11009494898893.0%
Qwen 3.7 Max949494948892.8%
Gemini 3 Flash (Preview)100100100887692.8%
Gemma 4 31B1009494888892.8%
Gemini 3.1 Flash Lite10010094888292.8%
GPT-5.4 Nano959494938792.4%
Aion 3.5 Mini (Reasoning, High)100100100946591.8%
Gemini 3.6 Flash (Reasoning)10010088888291.6%
GPT-4o, Aug. 6th (temp=1)10010098827490.8%
Claude Opus 4.5989292907990.5%
Gemini 2.5 Pro10010094827690.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949488888890.4%
Gemini 3.5 Flash Lite (Reasoning)949494888290.4%
Gemini 3.8 Flash (Reasoning, Medium)949494828289.2%
Gemma 4 26B (Reasoning)949488888289.2%
Muse Glimmer 30B (Reasoning, Medium)949488888289.2%
Gemini 3.5 Flash (Reasoning, Minimal)949494828289.2%
GPT-4o Mini (temp=1)1009494847288.8%
Gemini 2.5 Flash Lite (Reasoning)1009685857888.8%
Gemini 3.1 Flash Lite (Preview)1009488827688.0%
Claude Haiku 4.5999586827888.0%
Gemini 3.5 Flash (Reasoning)948888828286.8%
Gemini 3 Flash (Preview, Reasoning)1009482827085.6%
Gemini 2.5 Flash (Reasoning)1009490766785.4%
GPT-4.1 Nano919085817584.3%
Gemini 3.1 Pro (Preview)888882827683.2%
Gemma 3 27B939283785480.0%
Gemma 3 4B928482795077.4%
Mistral Small 3.2 24B1008266625973.7%
Cydonia 24B V4.1878374554769.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
o4 Mini100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 3B100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)1001001001009999.9%
GPT-4o, Aug. 6th (temp=0)1001001001009999.9%
GPT-5.4 Mini (Reasoning, Low)1001001001009999.8%
Qwen 3 235B A22B Instruct 25071001001001009999.8%
Gemini 3.5 Flash Lite (Reasoning)1001001001009899.7%
Claude Sonnet 5 (Reasoning)1001001001009899.6%
Qwen 3.6 35B1001001001009899.6%
Z.AI GLM 4.5100100100999999.6%
MiniMax M2.71001001001009899.5%
GPT-4o Mini (temp=1)1001001001009799.5%
Grok 4.31001001001009799.5%
Claude Haiku 4.5100100100999899.3%
Claude Opus 41001001001009498.9%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
GPT-6.1 Sol (Reasoning, Medium)1001001001009498.8%
GPT-5.6 Sol (Reasoning, Medium)1001001001009498.8%
Qwen 3.8 Flash (Reasoning)1001001001009498.8%
Claude Sonnet 5.5 (Reasoning)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)1001001001009498.8%
Kimi K2.61001001001009498.8%
Aion 3.5 Mini (Reasoning, High)1001001001009498.8%
Claude Opus 4.8 (Reasoning)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
Claude Opus 4.8 (Reasoning, Low)1001001001009498.8%
GPT-51001001001009498.8%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009498.8%
GPT-5 Mini1001001001009498.8%
Claude Opus 5 (Reasoning)1001001001009498.8%
Thinking Machines Inkling (Reasoning)1001001001009498.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009498.8%
MiniMax M31001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
o4 Mini High1001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009498.8%
Gemini 2.5 Pro1001001001009498.8%
DeepSeek V4 Flash (Reasoning)1001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009498.8%
GPT-5.41001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
DeepSeek V4 Pro1001001001009498.8%
Inception Mercury 21001001001009498.8%
Qwen 3 32B1001001001009498.8%
Llama 3.1 70B1001001001009498.8%
Mistral Small 3.2 24B1001001001009498.8%
Thinking Machines Inkling1001001001009498.8%
Qwen 2.5 72B1001001001009498.8%
Laguna S 2.11001001001009398.7%
Hermes 3 70B100100100999498.6%
Aion 3.01001001001009398.6%
GPT-5.4 Mini1001001001009298.5%
Mistral Large 3100100100989498.3%
Grok 4.20 (Reasoning)100100100979498.2%
MiniMax M2.51001001001009198.1%
Z.AI GLM 5.2 (Reasoning, High)100100100969498.0%
Ministral 3 3B100100100959497.8%
Mistral Small 41001001001008997.8%
Claude Sonnet 4.6100100100959497.7%
Gemini 2.5 Flash Lite1001001001008997.7%
Hy4 Preview (Reasoning, High)100100100949497.6%
Muse Spark 1.2 (Reasoning, Medium)100100100949497.6%
DeepSeek V4.1 Flash (Reasoning, High)100100100949497.6%
GPT-5.4 (Reasoning)100100100949497.6%
Muse Spark 1.1 (Reasoning, Medium)100100100949497.6%
Z.AI GLM 5.1100100100949497.6%
GPT-5.5 (Reasoning, Low)100100100949497.6%
Mistral Large 4.0 (Reasoning)1001001001008897.6%
Kimi K3 (Reasoning, Low)100100100949497.6%
Claude Opus 5 (Reasoning, Low)100100100949497.6%
Qwen 3.5 397B A17B100100100949497.6%
GPT-5.4 (Reasoning, Low)100100100949497.6%
GPT-5.1100100100949497.6%
GPT-5.4 Mini (Reasoning)100100100949497.6%
Gemma 4 31B (Reasoning)100100100949497.6%
GPT-5.5100100100949497.6%
Xiaomi MIMO v2.6 Flash100100100949497.6%
Aion 2.0100100100949497.6%
Qwen 3.5 Plus (2026-02-15)100100100949497.6%
Xiaomi MIMO v2.5 Pro100100100949497.6%
ByteDance Seed 2.0 Lite1001001001008897.6%
GPT-6 Luna100100100949497.6%
Grok 4.20100100100949497.6%
WizardLM 2 8x22b100100100949497.6%
Cohere Command R+ (Aug. 2024)100100100979197.6%
Writer: Palmyra X510010098969497.5%
DeepSeek V4 Pro (Reasoning)100100100949497.5%
Claude Opus 4.5100100100949497.5%
Mistral Large 2100100100949397.5%
Claude Sonnet 4.6 (Reasoning)100100100949397.5%
Claude Sonnet 4.5100100100969197.5%
GPT-5.4 Nano (Reasoning)10010099969297.3%
GPT-5.4 Nano (Reasoning, Low)10010099949497.3%
Mistral Medium 3.110010099959196.9%
Ministral 8B10010097949296.8%
DeepSeek V3 (2024-12-26)1009999949096.4%
Qwen 3.8 Max (Reasoning, XHigh)100100100948896.4%
Gemini 3.7 Flash (Reasoning, Medium)10010094949496.4%
Kimi K3 (Reasoning, High)1001001001008296.4%
Xiaomi MIMO v2.6 Pro100100100948896.4%
Grok 4.5 (Reasoning, Low)100100100948896.4%
ByteDance Seed 1.610010094949496.4%
Z.AI GLM 4.710010094949496.4%
Xiaomi MIMO v2.5100100100948896.4%
DeepSeek V3.110010094949496.4%
GPT-5 Nano10010094949496.4%
Arcee AI: Trinity Mini100100100948896.4%
Gemini 3.6 Flash (Reasoning, Minimal)100100100948896.4%
Claude Sonnet 5 (Reasoning, Low)100100100998296.3%
Ministral 3 14B10010098929196.3%
Claude Sonnet 510010094939195.6%
Claude Sonnet 410010096938895.5%
Mistral Small 4 (Reasoning)100100100948395.4%
Qwen 3.7 Max1009494949495.2%
Grok 4.5 (Reasoning, High)10010094948895.2%
Muse Glimmer 30B (Reasoning, Medium)10010094948895.2%
Qwen 3.6 27B100100100888895.2%
Z.AI GLM 4.610010094948895.2%
GPT-4.110010094948895.2%
Gemini 3.1 Flash Lite (Reasoning)10010094948895.2%
ByteDance Seed 2.0 Mini1009494949495.2%
Gemma 4 26B1009494949495.2%
DeepSeek V3.210010094948895.2%
Gemma 3 12B10010099928395.0%
Aion 3.0 Mini10010095908894.6%
DeepSeek V3 (2025-03-24)1009894938894.6%
Z.AI GLM 4.7 Flash1009794948794.5%
Hermes 3 405B10010099957894.3%
Gemma 4 26B (Reasoning)100100100888294.0%
Gemini 3.8 Flash (Reasoning, Medium)10010094948294.0%
Grok 4.7 (Reasoning, High)949494949494.0%
GPT-5.6 Sol1009494948894.0%
Gemma 4 31B1009494948894.0%
GPT-5.4 Nano10010094888793.8%
Ministral 3 8B10010094888793.7%
GPT-4.1 Mini1009794888793.2%
Gemini 2.5 Flash10010093898593.1%
Gemini 3.1 Flash Lite1009494948292.8%
GPT-5.5 (Reasoning, Medium)949494948892.8%
Gemma 3 27B10010096858192.4%
Gemini 3.1 Flash Lite (Preview)100100100887091.6%
Gemini 3.5 Flash (Reasoning, Minimal)10010094828291.6%
GPT-4.1 Nano939391888289.3%
Gemini 3.5 Flash (Reasoning)1009494827689.2%
Gemini 3 Flash (Preview)1009494827689.2%
Qwen 3.7 Flash (Reasoning)1001001001003887.6%
Gemini 3.6 Flash (Reasoning)1009488767686.8%
Cydonia 24B V4.1999690845985.7%
Gemini 2.5 Flash (Reasoning)948684817984.7%
Gemini 3.1 Pro (Preview)948882826482.0%
Gemma 3 4B929084756981.9%
Gemini 2.5 Flash Lite (Reasoning)848383817681.3%
Gemini 3 Flash (Preview, Reasoning)948882706078.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Grok 4.3100100100100100100.0%
Claude Opus 4.710010010010010099.9%
Grok 4.7 (Reasoning, High)10010010010010099.9%
DeepSeek V4 Flash (Reasoning)10010010010010099.9%
DeepSeek-V2 Chat1001001001009999.9%
Mistral Medium 3.5 (Reasoning)1001001001009899.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009899.7%
Claude Opus 4.8 (Reasoning, Low)1001001001009899.6%
ByteDance Seed 1.6 Flash1001001001009899.6%
Mistral Small 41001001001009899.5%
MiniMax M2.51001001001009899.5%
Kimi K3 (Reasoning, High)1001001001009899.5%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009799.4%
Aion 3.0 Mini1001001001009799.4%
GPT-5.41001001001009699.3%
GPT-OSS 120B1001001001009699.2%
Claude Opus 4.8 (Reasoning)100100100999698.9%
Aion 3.01001001001009498.9%
Claude Sonnet 5.5 (Reasoning)1001001001009498.8%
GPT-6.1 Sol (Reasoning, Medium)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Qwen 3.6 Max Preview1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
Grok 4.6 (Reasoning, High)1001001001009498.8%
Kimi K2.61001001001009498.8%
Claude Opus 4.7 (Reasoning)1001001001009498.8%
Claude Opus 5 (Reasoning, Low)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
GPT-51001001001009498.8%
GPT-5.6 Sol1001001001009498.8%
Z.AI GLM 51001001001009498.8%
GPT-5.51001001001009498.8%
Qwen 3.6 Flash1001001001009498.8%
o4 Mini High1001001001009498.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009498.8%
Qwen 3.6 35B1001001001009498.8%
o4 Mini1001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
Mistral Large 4.01001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
GPT-6 Luna1001001001009498.8%
Nemotron 3 Nano1001001001009498.8%
Thinking Machines Inkling1001001001009498.8%
Cohere Command R+ (Aug. 2024)1001001001009498.8%
GPT-4o, Aug. 6th (temp=0)1001001001009398.6%
Grok 4.5 (Reasoning, Low)100100100989598.6%
ByteDance Seed 2.0 Lite1001001001009398.5%
Z.AI GLM 5.11001001001009398.5%
Claude Opus 51001001001009398.5%
GPT-4o Mini (temp=1)100100100969698.4%
Hermes 3 70B1001001001009198.3%
Claude Opus 4.6100100100979498.2%
Laguna XS 2.1100100100969498.0%
Ministral 3 14B100100100969497.9%
GPT-5.4 Mini10010099999397.9%
Ministral 3B100100100969497.9%
Xiaomi MIMO v2.6 Pro1001001001008997.9%
Claude Haiku 5.5 (Adaptive)10010098979497.9%
Grok 4.2010010099989297.9%
Claude Opus 5 (Reasoning)1001001001008897.7%
DeepSeek V4 Flash100100100949497.6%
GPT-5.4 Mini (Reasoning, Low)1009998969597.6%
GPT-5.6 Sol (Reasoning, Medium)100100100949497.6%
Claude Opus 4.6 (Reasoning)100100100949497.6%
Hy4 Preview (Reasoning, High)100100100949497.6%
Muse Spark 1.1 (Reasoning, Medium)100100100949497.6%
GPT-5.5 (Reasoning, Medium)100100100949497.6%
Aion 3.5 Mini (Reasoning, High)100100100949497.6%
Muse Spark 1.1 (Reasoning, Minimal)100100100949497.6%
GPT-5.4 (Reasoning, Low)100100100949497.6%
GPT-5.1100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
ByteDance Seed 1.61001001001008897.6%
DeepSeek V4 Pro (Reasoning)100100100949497.6%
Qwen 3.7 Flash (Reasoning)1001001001008897.6%
GPT-5.6 Terra1001001001008897.6%
Qwen 3.5 35B100100100949497.6%
Aion 2.0100100100949497.6%
Mistral Medium 3.5100100100949497.6%
Xiaomi MIMO v2.5100100100949497.6%
DeepSeek V3.21001001001008897.6%
Z.AI GLM 4.7 Flash100100100949497.6%
Qwen 3 235B A22B Instruct 2507100100100949397.5%
Mistral NeMO10010099949497.5%
DeepSeek V3 (2024-12-26)10010099949497.3%
GPT-5.4 Mini (Reasoning)100100100949397.3%
DeepSeek V4 Pro1001001001008697.3%
Claude Opus 410010099939397.0%
DeepSeek V3 (2025-03-24)100100100978896.9%
Z.AI GLM 5 Turbo100100100949196.9%
Claude Sonnet 4100100100949096.8%
GPT-5 Nano10010098949296.8%
MiniMax M3100100100949096.8%
GPT-5.4 Nano (Reasoning, Low)999797979496.6%
GPT-4.1100100100958896.5%
Claude Haiku 5.5 (Reasoning, Medium)100100100938996.4%
Gemini 3.8 Flash (Reasoning, Medium)100100100948896.4%
GPT-5.4 (Reasoning)100100100948896.4%
GPT-5.6 Terra (Reasoning, Medium)10010094949496.4%
Qwen 3.5 27B10010094949496.4%
Z.AI GLM 4.710010094949496.4%
Thinking Machines Inkling Small (Reasoning, High)100100100948896.4%
Claude Sonnet 4.5100100100948896.3%
Grok 4.20 (Reasoning)100100100988496.3%
Writer: Palmyra X5100100100948595.9%
GPT-5 Mini10010098948895.9%
Claude Sonnet 4.6 (Reasoning)989896959295.8%
Mistral Large 310010095949095.7%
GPT-4o, Aug. 6th (temp=1)100100100948495.7%
Gemma 4 31B (Reasoning)10010094949095.6%
GPT-5.4 Nano1009595949495.6%
Hermes 3 405B10010096948895.5%
Grok 4.5 (Reasoning, High)10010094948895.2%
GPT-5.210010094948895.2%
Gemini 2.5 Pro10010094948895.2%
Qwen 3.6 27B1009494949495.2%
Z.AI GLM 4.61009494949495.2%
Mistral Small 3.2 24B1009494949495.2%
Arcee AI: Trinity Mini10010094948895.2%
Gemini 3 Flash (Preview)100100100888895.1%
GPT-5.4 Nano (Reasoning)1009895919094.9%
DeepSeek V3.11009494949294.7%
Gemini 2.5 Flash Lite (Reasoning)999896948694.6%
Mistral Large 2100100100908294.5%
WizardLM 2 8x22b10010096898894.4%
Ministral 3 8B10010094948494.4%
Z.AI GLM 4.5 Air10010095888894.2%
Qwen 3 32B100100100947694.2%
Gemini 3.7 Flash (Reasoning, Medium)949494949494.0%
Mistral Small 4 (Reasoning)989693919193.9%
Claude Sonnet 5 (Reasoning)1009695918593.4%
Thinking Machines Inkling (Reasoning)949494949093.1%
GPT-4.1 Mini10010094878593.1%
Mistral Medium 3.1979695928593.0%
Gemini 2.5 Flash Lite10010094858592.8%
GPT-5.5 (Reasoning, Low)10010094888292.8%
Qwen 3.7 Max1009494888892.8%
Gemma 4 26B (Reasoning)1009494888892.8%
Gemma 4 31B949494948892.8%
Gemini 3.1 Flash Lite (Reasoning)1009493888892.7%
Claude Opus 4.5999693888792.6%
Claude Sonnet 4.6999792888792.6%
Gemini 3.5 Flash Lite (Reasoning)1009494888692.5%
Laguna S 2.1989694888592.2%
Gemini 3.5 Flash (Reasoning, Minimal)10010097828292.2%
Gemini 3.1 Flash Lite (Preview)10010088888291.6%
Ministral 3 3B100100100906791.4%
Llama 3.1 70B1009390908391.0%
Gemini 2.5 Flash969490888590.8%
Claude Haiku 5.5 (Reasoning, Low)91 – – – – 90.7%
Muse Glimmer 30B (Reasoning, Medium)1009488888290.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949488888890.4%
Gemma 3 27B1009393858090.2%
MiniMax M2.710010091916790.0%
Claude Sonnet 51009491877990.0%
Claude Haiku 4.5969190908089.4%
Gemini 3.1 Flash Lite949494828289.2%
Gemini 3.6 Flash (Reasoning)949488888289.2%
Gemini 3.6 Flash (Reasoning, Minimal)1009494887089.1%
Gemma 3 12B1009492817989.0%
Ministral 8B1009987867388.9%
Gemini 2.5 Flash (Reasoning)929189898388.8%
GPT-4.1 Nano998786868388.3%
Gemma 4 26B949288828287.6%
Claude Sonnet 5 (Reasoning, Low)908886858486.8%
Z.AI GLM 4.5949391886786.7%
Gemini 3.1 Pro (Preview)948883828285.7%
Gemini 3 Flash (Preview, Reasoning)949482767684.4%
Gemini 3.5 Flash (Reasoning)1009482826083.6%
Gemma 3 4B777371665869.1%
Cydonia 24B V4.198837237058.1%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
MiniMax M3100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
GPT-5.4100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 3B100100100100100100.0%
DeepSeek V3 (2024-12-26)10010010010010099.9%
Claude Haiku 4.51001001001009999.8%
Claude Opus 4.51001001001009999.8%
Mistral Large 4.01001001001009899.5%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009598.9%
Hy4 Preview (Reasoning, High)1001001001009498.8%
Qwen 3.8 Flash (Reasoning)1001001001009498.8%
Muse Spark 1.3 (Reasoning, Medium)1001001001009498.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001009498.8%
Z.AI GLM 5.11001001001009498.8%
Qwen 3.6 Max Preview1001001001009498.8%
Z.AI GLM 5 Turbo1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
Claude Sonnet 5.5 (Reasoning)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)1001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
Mistral Large 4.0 (Reasoning)1001001001009498.8%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009498.8%
Claude Opus 5 (Reasoning)1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
Claude Sonnet 5 (Reasoning, Low)1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
Claude Opus 51001001001009498.8%
Claude Opus 4.71001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Z.AI GLM 51001001001009498.8%
GPT-5.6 Terra1001001001009498.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009498.8%
Claude Sonnet 41001001001009498.8%
GPT-4.11001001001009498.8%
MiniMax M2.71001001001009498.8%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009498.8%
GPT-6 Luna1001001001009498.8%
GPT-5.4 Mini (Reasoning, Low)1001001001009498.8%
Inception Mercury 21001001001009498.8%
Mistral Large 21001001001009498.8%
GPT-4o, Aug. 6th (temp=1)1001001001009498.8%
Qwen 3 32B1001001001009498.8%
Llama 3.1 70B1001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
Nemotron 3 Nano1001001001009498.8%
Thinking Machines Inkling1001001001009498.8%
Ministral 3 14B1001001001009498.8%
Ministral 3 8B1001001001009498.8%
Hermes 3 70B1001001001009498.8%
Arcee AI: Trinity Mini1001001001009498.8%
Mistral NeMO1001001001009498.8%
Laguna XS 2.11001001001009498.8%
Cohere Command R+ (Aug. 2024)1001001001009498.8%
Mistral Small 41001001001009498.7%
Z.AI GLM 4.51001001001009398.7%
Mistral Small 4 (Reasoning)1001001001009398.6%
Mistral Medium 3.5100100100979498.3%
Grok 4.3100100100979498.1%
Gemini 2.5 Flash (Reasoning)1001001001009198.1%
DeepSeek-V2 Chat100100100969498.0%
Mistral Large 3100100100969497.9%
Claude Sonnet 5 (Reasoning)1001001001008897.7%
Grok 4.5 (Reasoning, High)100100100949497.6%
Claude Sonnet 4.6 (Reasoning)100100100949497.6%
Grok 4.7 (Reasoning, High)100100100949497.6%
GPT-5.5 (Reasoning, Low)1001001001008897.6%
Claude Opus 4.6100100100949497.6%
Claude Opus 5 (Reasoning, Low)100100100949497.6%
Qwen 3.5 397B A17B100100100949497.6%
Grok 4.3 (Reasoning)1001001001008897.6%
Thinking Machines Inkling (Reasoning)1001001001008897.6%
GPT-6 Sol100100100949497.6%
Qwen 3.6 Flash100100100949497.6%
Qwen 3.7 Flash (Reasoning)100100100949497.6%
Z.AI GLM 4.71001001001008897.6%
Qwen 3.6 35B100100100949497.6%
o4 Mini1001001001008897.6%
Mistral Medium 3.5 (Reasoning)1001001001008897.6%
Gemma 4 31B100100100949497.6%
ByteDance Seed 2.0 Lite1001001001008897.6%
DeepSeek V3.2100100100949497.6%
Z.AI GLM 4.5 Air100100100949497.6%
GPT-5.4 Mini1001001001008897.6%
GPT-5.4 Nano (Reasoning)100100100949497.6%
GPT-5.4 Nano (Reasoning, Low)100100100949497.6%
ByteDance Seed 1.6 Flash100100100949497.6%
Laguna S 2.1100100100998897.4%
o4 Mini High10010099949497.4%
Thinking Machines Inkling Small (Reasoning, High)10010098949497.1%
GPT-4.1 Nano100100100978896.9%
Aion 3.010010094949496.5%
Claude Opus 5.5 (Reasoning)100100100948896.4%
GPT-6.1 Sol (Reasoning, Medium)1001001001008296.4%
GPT-5.6 Sol (Reasoning, Medium)10010094949496.4%
Claude Opus 4.6 (Reasoning)10010094949496.4%
Gemini 3.6 Flash (Reasoning)100100100948896.4%
GPT-5.4 (Reasoning)100100100948896.4%
GPT-6 Luna (Reasoning, Medium)100100100948896.4%
Grok 4.5 (Reasoning, Low)10010094949496.4%
GPT-5.1100100100948896.4%
GPT-5.6 Luna (Reasoning, Medium)100100100948896.4%
ByteDance Seed 1.6100100100948896.4%
GPT-5.210010094949496.4%
Gemini 2.5 Pro100100100948896.4%
Z.AI GLM 4.6100100100948896.4%
Aion 2.010010094949496.4%
Qwen 3.5 Plus (2026-02-15)10010094949496.4%
GPT-4.1 Mini100100100948896.4%
GPT-5 Nano100100100948896.4%
Ministral 8B10010094949496.4%
Writer: Palmyra X510010094949396.2%
Grok 4.201009994949496.2%
Hermes 3 405B10010094949396.2%
Gemini 2.5 Flash Lite100100100998195.9%
GPT-4o Mini (temp=1)100100100948595.9%
Gemini 3.5 Flash Lite (Reasoning)100100100918895.8%
Gemma 3 4B10010096948895.6%
GPT-510010094948895.2%
Grok 4.20 (Reasoning)10010094948895.2%
Kimi K2.51009494949495.2%
MiniMax M2.510010094948895.2%
Gemini 3.6 Flash (Reasoning, Minimal)10010094948895.2%
Gemini 3 Flash (Preview)10010094948895.2%
Z.AI GLM 4.7 Flash10010094948895.2%
Qwen 3 235B A22B Instruct 2507100100100888895.1%
GPT-5.4 Nano10010096888894.4%
GPT-5.4 (Reasoning, Low)10010094948294.0%
Gemini 3.1 Flash Lite (Preview)10010094948294.0%
Gemma 4 26B100100100888294.0%
Qwen 3.8 Max (Reasoning, XHigh)1009494948894.0%
Gemini 3.8 Flash (Reasoning, Medium)1009494948894.0%
Gemini 3.7 Flash (Reasoning, Medium)10010094948294.0%
Qwen 3.7 Max10010094948294.0%
GPT-5.510010094888894.0%
Muse Glimmer 30B (Reasoning, Medium)1009494948894.0%
Xiaomi MIMO v2.5 Pro1009494948894.0%
Gemma 3 12B100100100967393.9%
Gemma 3 27B1001001001006993.7%
Claude Sonnet 51009791918893.5%
Gemma 4 26B (Reasoning)1009494948292.8%
Z.AI GLM 5.2 (Reasoning, High)10010088888892.8%
GPT-5.6 Sol1009494888892.8%
Xiaomi MIMO v2.51009494888892.8%
DeepSeek V3.1949494948892.8%
Mistral Medium 3.110010094888192.6%
GPT-5.5 (Reasoning, Medium)10010094947091.6%
Gemma 4 31B (Reasoning)1009488888891.6%
Gemini 3.1 Flash Lite (Reasoning)1009488888891.6%
Gemini 3.1 Flash Lite949494948291.6%
Gemini 2.5 Flash1009694848291.1%
Gemini 3.5 Flash (Reasoning, Minimal)100100100827090.4%
Gemini 2.5 Flash Lite (Reasoning)10010094826287.5%
Cydonia 24B V4.110010093914685.9%
Qwen 3.6 27B1001001001002284.4%
Gemini 3.5 Flash (Reasoning)948882827684.4%
Gemini 3.1 Pro (Preview)948888707082.0%
Gemini 3 Flash (Preview, Reasoning)1009482646080.0%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-OSS 120B100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
MiniMax M31001001001009999.9%
Hermes 3 405B1001001001009999.9%
DeepSeek V3 (2025-03-24)1001001001009999.8%
Laguna XS 2.11001001001009999.8%
Claude Opus 4.61001001001009799.4%
GPT-4o Mini (temp=1)1001001001009699.3%
Ministral 3B1001001001009699.2%
Mistral Large 31001001001009599.0%
GPT-5.5 (Reasoning, Medium)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
DeepSeek V4 Pro1001001001009498.8%
DeepSeek V4 Flash1001001001009498.8%
Inception Mercury 21001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
WizardLM 2 8x22b1001001001009498.8%
Cohere Command R+ (Aug. 2024)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)100100100999498.7%
GPT-4o, Aug. 6th (temp=1)100100100999498.7%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100999498.6%
Llama 3.1 70B100100100999398.5%
Ministral 3 3B100100100979498.3%
GPT-4.1 Mini100100100979498.3%
Mistral Small 4100100100979498.3%
Claude Opus 5.5 (Reasoning)10010099979698.3%
Hermes 3 70B100100100979498.1%
Claude Opus 5 (Reasoning, Low)100100100979498.1%
Qwen 3.8 27B (Reasoning, XHigh)100100100949497.6%
Grok 4.7 (Reasoning, High)1001001001008897.6%
Mistral Large 4.0 (Reasoning)1001001001008897.6%
GPT-5100100100949497.6%
Kimi K2.5100100100949497.6%
Muse Glimmer 30B (Reasoning, Medium)100100100949497.6%
DeepSeek V4 Flash (Reasoning)100100100949497.6%
Xiaomi MIMO v2.6 Flash100100100949497.6%
ByteDance Seed 2.0 Mini1001001001008897.6%
Qwen 3.5 Flash100100100949497.6%
GPT-5.6 Luna100100100949497.6%
Mistral Large 4.01001001001008897.6%
ByteDance Seed 2.0 Lite100100100949497.6%
Qwen 3.5 9B1001001001008897.6%
GPT-4o, Aug. 6th (temp=0)100100100949497.6%
GPT-5 Nano100100100949497.6%
Qwen 3 32B100100100949497.6%
ByteDance Seed 1.6 Flash100100100949497.6%
Mistral NeMO1001001001008897.6%
Z.AI GLM 5.2 (Reasoning, High)100100100979197.6%
Z.AI GLM 4.7 Flash100100100949397.5%
Z.AI GLM 4.710010098949397.1%
Mistral Medium 3.5 (Reasoning)10010096959497.1%
Z.AI GLM 5.1100100100978897.0%
Z.AI GLM 5100100100949096.8%
Claude Opus 410010099949096.7%
Ministral 3 8B100100100949096.7%
Qwen 3 235B A22B Instruct 250710010096949496.7%
Kimi K3 (Reasoning, High)10010099988696.6%
Mistral Large 2100100100958896.6%
Grok 4.2010010099948996.5%
Claude Sonnet 5.5 (Reasoning)10010098968896.4%
Gemma 3 4B10010098949096.4%
Hy4 Preview (Reasoning, High)10010094949496.4%
Kimi K2.6100100100948896.4%
GPT-6 Luna (Reasoning, Medium)10010094949496.4%
Qwen 3.5 397B A17B10010094949496.4%
GPT-5.6 Luna (Reasoning, Medium)100100100948896.4%
ByteDance Seed 1.610010094949496.4%
Qwen 3.6 Flash10010094949496.4%
DeepSeek V4 Pro (Reasoning)10010094949496.4%
o4 Mini High100100100948896.4%
GPT-5.6 Terra100100100948896.4%
Thinking Machines Inkling Small (Reasoning, High)10010094949496.4%
Qwen 2.5 72B100100100948896.4%
Arcee AI: Trinity Mini10010094949496.4%
Ministral 8B100100100988496.3%
Gemma 3 27B1009998949196.3%
Muse Spark 1.1 (Reasoning, Minimal)10010096949096.2%
Xiaomi MIMO v2.6 Pro10010094949396.1%
Claude Opus 4.8 (Reasoning)1009896949396.1%
Writer: Palmyra X51009896949296.0%
Claude Opus 4.51009797949396.0%
Z.AI GLM 4.6100100100948695.9%
Claude Sonnet 41009897968995.9%
Grok 4.3 (Reasoning)100100100918895.9%
Claude Haiku 5.5 (Reasoning, Medium)100100100908995.8%
GPT-5.4 Nano (Reasoning, Low)1009997948895.5%
GPT-5.2100100100968295.5%
Xiaomi MIMO v2.510010094929095.4%
Gemma 3 12B10010095938895.3%
GPT-6 Luna (Reasoning, High)1009494949495.2%
GPT-5 Mini10010094948895.2%
Qwen 3.5 122B100100100948295.2%
Qwen 3.6 35B10010094948895.2%
Aion 2.01009494949495.2%
o4 Mini10010094948895.2%
Qwen 3.5 Plus (2026-02-15)1009494949495.2%
DeepSeek V3.210010094948895.2%
Grok 4.31009494949495.2%
Z.AI GLM 5.3 (Reasoning, Max)10010094948895.1%
GPT-6 Luna1009494949495.1%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010098948495.1%
Claude Opus 5 (Reasoning)10010097908895.0%
Grok 4.20 (Reasoning)1009994948894.9%
Qwen 3.8 Flash (Reasoning)1009995948594.7%
Xiaomi MIMO v2.5 Pro10010097948294.6%
Kimi K3 (Reasoning, Low)969595949394.6%
Gemma 4 26B10010093918894.5%
Claude Opus 510010094908994.5%
Thinking Machines Inkling1009494949094.4%
Gemini 2.5 Flash Lite (Reasoning)1009694919194.3%
GPT-5.5 (Reasoning, Low)1009494948994.3%
Claude Haiku 4.510010094938494.2%
GPT-5.51009493929294.2%
MiniMax M2.710010094908794.1%
DeepSeek V3 (2024-12-26)1009993938694.1%
Mistral Medium 3.510010095888894.1%
GPT-6.1 Sol (Reasoning, Medium)10010094948294.0%
Gemma 4 31B (Reasoning)1009494948894.0%
GPT-6 Sol10010094888894.0%
DeepSeek V4.1 Flash (Reasoning, High)10010094938494.0%
Claude Opus 4.6 (Reasoning)1009494948793.9%
Ministral 3 14B989895958393.8%
Aion 3.01009494948793.7%
Laguna S 2.1969594939193.7%
Aion 3.5 Mini (Reasoning, High)1009695948393.6%
Z.AI GLM 5 Turbo1009493928993.5%
Claude Opus 4.7 (Reasoning)10010094938093.3%
Claude Haiku 5.5 (Reasoning, Low)959491 – – 93.3%
Muse Spark 1.3 (Reasoning, Medium)1009695888693.1%
Z.AI GLM 4.5 Air1009693888792.9%
Qwen 3.8 Max (Reasoning, XHigh)10010094888292.8%
Thinking Machines Inkling (Reasoning)1009494888892.8%
GPT-5.6 Sol10010094947692.8%
Qwen 3.5 27B1009494888892.8%
Qwen 3.7 Flash (Reasoning)1009494888892.8%
Gemini 3.1 Flash Lite (Reasoning)10010094888292.8%
GPT-5.4 Nano10010099946992.4%
GPT-5.4 Mini (Reasoning)949493938792.4%
GPT-4.11009493938292.4%
Cydonia 24B V4.110010094888092.3%
GPT-5.4 Nano (Reasoning)969493908792.1%
Muse Spark 1.1 (Reasoning, Medium)10010088868591.9%
Mistral Small 4 (Reasoning)949494918691.7%
Qwen 3.5 Plus (2026-04-20)1009489888891.7%
Claude Haiku 5.5 (Adaptive)1009392898491.7%
Qwen 3.6 27B1009494888291.6%
Gemini 3 Flash (Preview)100100100827691.6%
Gemini 3.1 Flash Lite (Preview)1009488888891.6%
Gemma 4 31B949494888891.6%
Mistral Medium 3.110010094887691.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)959493918591.4%
Aion 3.0 Mini100100100886891.3%
Grok 4.6 (Reasoning, High)949494938291.3%
Z.AI GLM 4.51009290888691.3%
Grok 4.5 (Reasoning, Low)979392888591.0%
Claude Sonnet 4.51009393878191.0%
DeepSeek-V2 Chat1009189888791.0%
Claude Opus 4.8 (Reasoning, Low)1009594917490.7%
Claude Opus 4.71009492877990.5%
GPT-5.4 (Reasoning)999795837890.4%
Grok 4.5 (Reasoning, High)969491888390.4%
DeepSeek V4 Pro 0813 (Reasoning, High)10010090857690.2%
Gemini 2.5 Pro949492888289.9%
GPT-5.4 Mini (Reasoning, Low)979188888489.4%
Gemma 4 26B (Reasoning)1009494827689.2%
Gemini 3.6 Flash (Reasoning)1009494887089.2%
Claude Sonnet 5929290898288.9%
GPT-5.6 Terra (Reasoning, Medium)949393887688.8%
Claude Sonnet 5 (Reasoning, Low)929189858488.2%
GPT-5.6 Sol (Reasoning, Medium)1009488827688.0%
Gemini 3 Flash (Preview, Reasoning)948888888288.0%
Muse Spark 1.2 (Reasoning, Medium)938888878488.0%
GPT-5.4959586847987.9%
GPT-4.1 Nano939289858087.8%
Gemini 2.5 Flash898888878787.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949288877687.5%
MiniMax M2.5979487837587.2%
GPT-5.1938887858287.2%
GPT-5.4 Mini969291847287.0%
Gemini 3.8 Flash (Reasoning, Medium)949488827686.8%
Qwen 3.7 Max948888887686.8%
Claude Sonnet 4.6949286807886.0%
Gemini 3.1 Flash Lite948882828285.6%
Gemini 2.5 Flash Lite888887867885.3%
Claude Sonnet 4.6 (Reasoning)949184817484.9%
Gemini 3.7 Flash (Reasoning, Medium)1008888767084.4%
Qwen 3.6 Max Preview1008882767684.4%
DeepSeek V3.1948888827084.4%
GPT-5.4 (Reasoning, Low)878585847983.8%
Claude Sonnet 5 (Reasoning)919083797383.2%
Gemini 3.5 Flash Lite (Reasoning)888882827683.2%
Gemini 3.5 Flash (Reasoning, Minimal)948882766480.8%
Gemini 2.5 Flash (Reasoning)948782706679.5%
Gemini 3.1 Pro (Preview)948681746279.5%
Gemini 3.6 Flash (Reasoning, Minimal)828276767678.4%
Gemini 3.5 Flash (Reasoning)888276766076.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
GPT-4o Mini (temp=0)10010010010010099.9%
Mistral Medium 3.51001001001009999.9%
GPT-4o, Aug. 6th (temp=1)1001001001009999.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009899.5%
Thinking Machines Inkling Small (Reasoning, High)100100100989899.2%
Llama 3.1 70B100100100989899.2%
Claude Sonnet 5.5 (Reasoning)100100100989799.0%
GPT-6 Sol1001001001009498.8%
ByteDance Seed 1.61001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
GPT-OSS 120B1001001001009498.8%
DeepSeek V4 Flash1001001001009498.8%
ByteDance Seed 1.6 Flash1001001001009498.8%
Hermes 3 70B1001001001009498.8%
Mistral NeMO1001001001009498.8%
Aion 3.01001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009398.7%
Z.AI GLM 5.3 (Reasoning, Max)100100100999498.6%
Z.AI GLM 5.1100100100999498.5%
Mistral Large 4.0100100100999498.5%
GPT-6 Sol (Reasoning, Medium)100100100989498.4%
Ministral 3 3B100100100999298.3%
Ministral 3B10010099979598.2%
Claude Opus 5.5 (Reasoning)1001001001009198.1%
ByteDance Seed 2.0 Lite100100100989198.0%
GPT-5.5 (Reasoning, Low)10010098979497.9%
Xiaomi MIMO v2.6 Pro100100100959497.8%
Mistral Medium 3.5 (Reasoning)100100100959497.7%
Qwen 3.8 Max (Reasoning, XHigh)100100100949497.6%
Qwen 3.6 Max Preview100100100949497.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
Thinking Machines Inkling (Reasoning)100100100949497.6%
o4 Mini100100100949497.6%
GPT-4o, Aug. 6th (temp=0)1001001001008897.6%
Inception Mercury 2100100100949497.6%
MiniMax M3100100100949497.6%
Hermes 3 405B100100100998997.5%
ByteDance Seed 2.0 Mini1001001001008797.4%
Z.AI GLM 4.5 Air10010099949497.4%
GPT-5.5 (Reasoning, Medium)100100100949397.4%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100949397.4%
Mistral Large 310010099988997.2%
MiniMax M2.51009997959597.2%
Grok 4.6 (Reasoning, High)10010097959497.2%
Qwen 3.6 Flash100100100949297.2%
Gemini 3 Flash (Preview)10010098949497.1%
Claude Opus 4.6 (Reasoning)10010097959497.1%
Claude Opus 4.710010096959497.0%
GPT-5.2100100100949197.0%
GPT-5.6 Sol (Reasoning, Medium)100100100949196.9%
Gemini 3.1 Flash Lite100100100949096.8%
Muse Glimmer 30B (Reasoning, Medium)1001001001008496.8%
Gemini 2.5 Flash Lite1009996969496.7%
GPT-4.11009997949496.7%
Ministral 3 14B10010098949296.7%
Qwen 3.5 Plus (2026-04-20)10010095949496.6%
GPT-4o Mini (temp=1)10010097949296.5%
GPT-5100100100948896.4%
GPT-5 Mini100100100948896.4%
Qwen 3.5 397B A17B10010094949496.4%
GPT-5.6 Luna (Reasoning, Medium)100100100948896.4%
o4 Mini High100100100948896.4%
Qwen 3.5 35B10010094949496.4%
Aion 2.0100100100948896.4%
Gemini 3.1 Flash Lite (Preview)100100100948896.4%
Qwen 3.5 9B100100100948896.4%
Qwen 3 32B10010094949496.4%
Xiaomi MIMO v2.6 Flash10010094949396.1%
Z.AI GLM 510010097978796.1%
Claude Haiku 5.5 (Adaptive)1009795949396.0%
Qwen 3.8 Flash (Reasoning)10010095949095.9%
Muse Spark 1.2 (Reasoning, Medium)1009795949395.9%
Claude Opus 4.7 (Reasoning)1009997949095.8%
Mistral Small 41009695949495.8%
Z.AI GLM 5.2 (Reasoning, High)100100100948495.6%
GPT-5.6 Luna10010097948695.3%
Thinking Machines Inkling1009494949495.3%
Kimi K3 (Reasoning, High)10010094938995.2%
Cohere Command R+ (Aug. 2024)10010094948895.2%
Gemini 3.8 Flash (Reasoning, Medium)100100100888895.2%
Qwen 3.6 27B10010094948895.2%
DeepSeek V3.210010094948895.2%
Mistral Small 3.2 24B1009494949495.2%
Qwen 3.5 122B1009494949495.1%
Arcee AI: Trinity Mini1009895948895.1%
GPT-6 Luna (Reasoning, High)1009594939395.1%
Claude Opus 4.8 (Reasoning)10010096918895.0%
Claude Haiku 4.510010093919094.8%
GPT-5.6 Terra10010099938294.8%
MiniMax M2.710010095938694.7%
Claude Haiku 5.5 (Reasoning, Low)1009886 – – 94.7%
GPT-6 Luna10010094948594.7%
Gemma 4 31B10010094928694.5%
Aion 3.5 Mini (Reasoning, High)10010097938394.5%
Muse Spark 1.1 (Reasoning, Medium)10010094908794.3%
Muse Spark 1.1 (Reasoning, Minimal)10010094938594.3%
Qwen 3.5 Plus (2026-02-15)10010095948294.2%
GPT-5.6 Terra (Reasoning, Medium)1009995938494.2%
DeepSeek V3 (2025-03-24)10010093918794.1%
Writer: Palmyra X51009996898694.1%
Qwen 3.6 35B10010093888893.8%
Qwen 3.5 27B1009994888893.8%
Gemini 2.5 Flash Lite (Reasoning)1009595948493.6%
Laguna XS 2.11009797948093.6%
Xiaomi MIMO v2.510010097888293.5%
Claude Opus 51009894888793.4%
Ministral 3 8B1009593908993.4%
Kimi K3 (Reasoning, Low)989896948193.4%
GPT-6.1 Sol (Reasoning, Medium)1009494948593.3%
Claude Opus 5 (Reasoning, Low)1009891908893.3%
Claude Opus 4.61009692918893.2%
Z.AI GLM 5 Turbo1009292929093.2%
Gemma 3 4B1009493898993.1%
Ministral 8B1009593898993.1%
Muse Spark 1.3 (Reasoning, Medium)1009494918793.1%
Claude Sonnet 4.6 (Reasoning)1009891888893.1%
Claude Opus 410010094917992.9%
Laguna S 2.11009694888692.8%
DeepSeek V4 Pro (Reasoning)10010094888292.8%
Z.AI GLM 4.7949494948892.8%
DeepSeek V4 Flash (Reasoning)100100100996592.7%
Mistral Small 4 (Reasoning)979493928892.7%
Claude Haiku 5.5 (Reasoning, Medium)100100100927192.6%
GPT-5.4 Nano1009494938292.6%
Mistral Large 2989594908692.6%
Mistral Medium 3.11009491898792.3%
Grok 4.5 (Reasoning, Low)10010088878692.1%
GPT-5.6 Sol10010093858292.0%
Claude Opus 4.8 (Reasoning, Low)10010094858192.0%
Claude Opus 4.5979494888792.0%
Grok 4.5 (Reasoning, High)999491908691.9%
GPT-5.11009890868591.9%
Z.AI GLM 4.61009594888291.8%
Gemini 3.6 Flash (Reasoning)10010089888291.7%
Z.AI GLM 4.7 Flash10010094828291.7%
Gemini 3 Flash (Preview, Reasoning)10010094887691.6%
Gemma 4 26B10010088888291.6%
Claude Sonnet 4.51009988868591.6%
Claude Sonnet 5 (Reasoning, Low)999894917691.6%
GPT-5.4 Nano (Reasoning, Low)989695848391.5%
Hy4 Preview (Reasoning, High)1009494888191.4%
GPT-5.51009591888291.3%
DeepSeek V4 Pro949492888791.1%
GPT-5 Nano1009488888591.0%
Grok 4.3949291908890.9%
Claude Sonnet 5 (Reasoning)999290888590.9%
Claude Haiku 5.5 (Reasoning, Max)9487 – – – 90.7%
Kimi K2.6100100100886590.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009493828290.2%
Qwen 3.7 Flash (Reasoning)10010088828190.1%
Xiaomi MIMO v2.5 Pro969494917489.9%
Qwen 3 235B A22B Instruct 2507979493907689.9%
Aion 3.5 (Reasoning, High)1009893896889.7%
Gemma 4 31B (Reasoning)989488878189.7%
Cydonia 24B V4.110010091867289.6%
Claude Sonnet 4939190898589.5%
GPT-4.1 Mini959290907989.4%
Z.AI GLM 4.5969493897489.4%
DeepSeek V4 Flash 0731 (Reasoning, High)949489888289.3%
Gemini 2.5 Pro1009488828289.2%
Claude Opus 5 (Reasoning)1009386858289.2%
GPT-5.4 Mini (Reasoning, Low)969389897588.5%
DeepSeek V3 (2024-12-26)959493867388.1%
Gemini 3.5 Flash Lite (Reasoning)1009488887087.9%
GPT-5.4 Mini (Reasoning)949088868287.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010094925387.9%
Gemini 3.7 Flash (Reasoning, Medium)938888888287.8%
Gemma 4 26B (Reasoning)949488827887.2%
Claude Sonnet 4.6929088847986.7%
Gemini 3.5 Flash (Reasoning, Minimal)1009382827686.7%
GPT-5.4 (Reasoning, Low)1008686837986.6%
Gemini 2.5 Flash1009483817486.2%
GPT-6 Luna (Reasoning, Medium)949488827386.0%
GPT-5.4 Mini1009088757585.8%
DeepSeek-V2 Chat958989857085.5%
Gemma 3 12B978887837285.3%
Claude Sonnet 51009289796785.3%
Qwen 3.7 Max1008585827384.9%
Gemma 3 27B1008986846584.8%
Gemini 3.1 Pro (Preview)1009481767284.5%
Gemini 3.1 Flash Lite (Reasoning)948882827684.4%
DeepSeek V3.11008882817084.1%
GPT-5.4 Nano (Reasoning)998988756883.8%
Grok 4.20948686827083.7%
Grok 4.20 (Reasoning)949478767383.3%
Gemini 3.6 Flash (Reasoning, Minimal)888782827682.9%
GPT-5.4918582817582.9%
Gemini 3.5 Flash (Reasoning)1008276707079.6%
GPT-4.1 Nano888786746279.4%
GPT-5.4 (Reasoning)888278767379.3%
Gemini 2.5 Flash (Reasoning)1008976725778.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009999.8%
Kimi K2.51001001001009999.8%
Nemotron 3 Super1001001001009899.6%
Claude Opus 5 (Reasoning, Low)1001001001009899.6%
DeepSeek V4 Flash1001001001009899.6%
GPT-5.6 Luna (Reasoning, Medium)1001001001009799.4%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009699.3%
Kimi K3 (Reasoning, Low)1001001001009599.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001009598.9%
Aion 3.5 Mini (Reasoning, High)1001001001009598.9%
GPT-6.1 Sol (Reasoning, Medium)1001001001009498.8%
Claude Opus 4.6 (Reasoning)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Claude Opus 5 (Reasoning)1001001001009498.8%
GPT-6 Sol1001001001009498.8%
Claude Sonnet 41001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
Aion 3.0 Mini1001001001009498.8%
Inception Mercury 21001001001009498.8%
Mistral Large 210010099989698.8%
Claude Opus 4.8 (Reasoning, Low)1001001001009398.5%
Nemotron 3 Nano100100100989498.5%
Grok 4.20 (Reasoning)100100100979598.4%
Mistral Large 4.0 (Reasoning)100100100989498.4%
Qwen 2.5 72B1001001001009298.4%
Claude Opus 5100100100989498.3%
Grok 4.7 (Reasoning, High)1001001001009198.2%
MiniMax M31001001001009198.2%
Qwen 3 32B1001001001009098.0%
Grok 4.3 (Reasoning)100100100959497.9%
ByteDance Seed 1.61001001001008997.9%
Mistral Large 3100100100989197.8%
Aion 2.0100100100959497.7%
Qwen 3.8 Max (Reasoning, XHigh)10010099959497.7%
Kimi K2.6100100100949497.6%
GPT-6 Luna (Reasoning, Medium)100100100949497.6%
Xiaomi MIMO v2.6 Pro100100100949497.6%
Qwen 3.5 397B A17B100100100949497.6%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100949497.6%
Qwen 3.6 Flash100100100949497.6%
Muse Glimmer 30B (Reasoning, Medium)100100100949497.6%
o4 Mini High100100100949497.6%
o4 Mini100100100949497.6%
ByteDance Seed 2.0 Mini100100100949497.6%
GPT-5.6 Terra (Reasoning, Medium)10010097979497.5%
Qwen 3.5 Plus (2026-04-20)100100100949497.5%
GPT-4.11001001001008897.5%
Claude Opus 4.6100100100959197.3%
Aion 3.01001001001008797.3%
GPT-5100100100998897.3%
DeepSeek V3 (2024-12-26)10010099949397.3%
Kimi K3 (Reasoning, High)100100100988897.3%
Qwen 3.6 Max Preview100100100949297.3%
Arcee AI: Trinity Mini100100100949297.2%
Thinking Machines Inkling (Reasoning)10010099969197.1%
MiniMax M2.7100100100949297.1%
DeepSeek V4 Flash (Reasoning)100100100949297.1%
Claude Opus 4.8 (Reasoning)10010098969297.1%
ByteDance Seed 1.6 Flash10010097949497.0%
GPT-5.6 Sol10010098949296.9%
DeepSeek V4 Pro (Reasoning)100100100978896.9%
Ministral 3 14B10010098959196.8%
Claude Opus 4.7 (Reasoning)1009997949496.7%
Claude Opus 4.7100100100929296.7%
Claude Sonnet 4.5100100100929196.6%
Z.AI GLM 5 Turbo100100100988596.5%
Mistral Medium 3.110010096959296.5%
Grok 4.310010098959096.4%
Cohere Command R+ (Aug. 2024)1009896949496.4%
GPT-5 Mini10010094949496.4%
Gemma 4 31B (Reasoning)10010094949496.4%
ByteDance Seed 2.0 Lite100100100948896.4%
Qwen 3.5 9B100100100948896.4%
GPT-6 Luna100100100948896.4%
GPT-4o Mini (temp=1)100100100948896.4%
Z.AI GLM 5.1100100100938896.3%
GPT-5.6 Sol (Reasoning, Medium)10010099948896.2%
Muse Spark 1.3 (Reasoning, Medium)10010094949396.2%
DeepSeek-V2 Chat100100100909096.0%
Z.AI GLM 510010098948896.0%
GPT-OSS 120B100100100948595.9%
DeepSeek V4 Pro10010096948995.8%
Qwen 3.6 35B1009994949295.8%
Mistral Small 3.2 24B10010094949195.8%
GPT-5.4 Nano (Reasoning, Low)1009897929295.8%
Qwen 3.8 Flash (Reasoning)10010095948995.6%
DeepSeek V3 (2025-03-24)100100100898895.4%
Laguna XS 2.1100100100948395.3%
GPT-5.6 Terra1009794949295.3%
Qwen 3.8 27B (Reasoning, XHigh)10010094948895.2%
Qwen 3.5 27B1009494949495.2%
Gemini 3 Flash (Preview)1009494949495.2%
Gemini 3.1 Flash Lite (Preview)10010094948895.2%
Xiaomi MIMO v2.5100100100948295.2%
GPT-4o, Aug. 6th (temp=0)1009494949495.2%
Mistral NeMO1009494949495.2%
Grok 4.6 (Reasoning, High)1009696949095.2%
Qwen 3.7 Flash (Reasoning)1009694949195.1%
Qwen 3.5 35B100100100948295.1%
MiniMax M2.51009894949095.0%
Ministral 3 3B1009998938594.8%
Xiaomi MIMO v2.5 Pro1009494949294.8%
Claude Opus 410010097898894.8%
Mistral Medium 3.51009897928794.7%
Gemini 3.1 Flash Lite1009494949194.7%
Grok 4.2010010095938594.6%
Z.AI GLM 4.5 Air100100100957794.4%
Mistral Small 4 (Reasoning)1009997948294.4%
Ministral 8B10010099957794.3%
GPT-5.5 (Reasoning, Medium)10010093918794.3%
Muse Spark 1.1 (Reasoning, Medium)1009493929294.2%
Claude Haiku 4.510010096878794.1%
Gemma 4 26B (Reasoning)949494949494.0%
Qwen 3.5 Plus (2026-02-15)1009494948894.0%
GPT-4o Mini (temp=0)949494949494.0%
Claude Sonnet 5.5 (Reasoning)10010092918693.8%
Z.AI GLM 4.710010093888893.8%
Z.AI GLM 4.51009592929193.8%
DeepSeek V3.210010094888693.6%
GPT-5.2999896948093.5%
Claude Opus 4.51009494918993.5%
Gemini 2.5 Pro10010094898593.4%
Ministral 3B10010090898893.3%
GPT-5.4999692918893.2%
Muse Spark 1.1 (Reasoning, Minimal)989794888793.0%
Gemma 3 27B1009794938192.9%
Qwen 3 235B A22B Instruct 25071009493898892.9%
GPT-5.51009695898492.9%
Gemini 3.8 Flash (Reasoning, Medium)1009494888892.8%
Qwen 3.7 Max1009494888892.8%
Gemini 3 Flash (Preview, Reasoning)949494948892.8%
Z.AI GLM 4.7 Flash949494948892.8%
Hermes 3 70B1009894888492.8%
WizardLM 2 8x22b10010094947592.7%
Qwen 3.6 27B10010094878292.7%
DeepSeek V3.11009994888292.6%
Muse Spark 1.2 (Reasoning, Medium)1009391918992.6%
Claude Sonnet 5 (Reasoning, Low)989695908492.5%
Gemini 3.6 Flash (Reasoning)999494888892.5%
Ministral 3 8B1009795947692.4%
GPT-5 Nano10010094927692.3%
GPT-5.4 Nano10010095907692.3%
Writer: Palmyra X51009693918192.3%
Thinking Machines Inkling1009493938092.2%
Mistral Small 4999592918492.2%
GPT-5.4 (Reasoning, Low)969492908992.1%
Gemini 2.5 Flash Lite (Reasoning)1009794887991.9%
GPT-5.4 Nano (Reasoning)10010092887891.7%
Qwen 3.5 122B949494888891.6%
Gemini 3.1 Flash Lite (Reasoning)949494888891.6%
Gemini 3.5 Flash (Reasoning, Minimal)949494888891.6%
Gemma 4 26B949494888891.6%
GPT-4o, Aug. 6th (temp=1)100100100797891.5%
Gemma 4 31B949493888891.5%
GPT-4.1 Mini949493908691.5%
Gemma 3 12B989491888791.5%
GPT-5.4 Mini (Reasoning)989793868491.4%
Thinking Machines Inkling Small (Reasoning, High)1009494878291.4%
Z.AI GLM 4.6949492888891.2%
Grok 4.5 (Reasoning, High)959493898491.0%
Claude Sonnet 4.6969592868490.6%
Hermes 3 405B10010094926690.5%
Mistral Medium 3.5 (Reasoning)969488888690.4%
GPT-5.5 (Reasoning, Low)989488878590.3%
Claude Sonnet 4.6 (Reasoning)1009991877590.3%
GPT-5.11009391877990.1%
Gemini 2.5 Flash (Reasoning)1009789838190.0%
Claude Sonnet 51009190848489.9%
Gemma 3 4B999692827989.5%
Gemini 3.5 Flash (Reasoning)1008888868288.7%
Claude Sonnet 5 (Reasoning)979690867488.7%
GPT-5.4 (Reasoning)989290877488.3%
Grok 4.5 (Reasoning, Low)959489847787.8%
Gemini 3.6 Flash (Reasoning, Minimal)948888878287.7%
Gemini 2.5 Flash959384848287.6%
Gemini 3.1 Pro (Preview)999491846787.1%
Gemini 2.5 Flash Lite1009893786586.7%
Gemini 3.7 Flash (Reasoning, Medium)1008882827685.6%
Gemini 3.5 Flash Lite (Reasoning)948888837084.5%
Laguna S 2.1968782807784.3%
Llama 3.1 70B1009794883783.1%
GPT-5.4 Mini888482807581.8%
Cydonia 24B V4.1888281807781.5%
Gemini 3.5 Flash Lite (Reasoning, Minimal)888282767680.8%
GPT-5.4 Mini (Reasoning, Low)888777756878.9%
GPT-4.1 Nano977575676675.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Kimi K2.5100100100100100100.0%
MiniMax M3100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Mistral Large 3100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.6 Pro10010010010010099.9%
Grok 4.3 (Reasoning)10010010010010099.9%
GPT-4o, Aug. 6th (temp=0)10010010010010099.9%
Thinking Machines Inkling1001001001009999.8%
Z.AI GLM 51001001001009999.8%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009999.7%
Grok 4.20 (Reasoning)1001001001009999.7%
Claude Opus 4.8 (Reasoning, Low)1001001001009899.7%
Ministral 3B1001001001009899.6%
DeepSeek V4 Pro1001001001009799.5%
Muse Spark 1.2 (Reasoning, Medium)1001001001009799.4%
DeepSeek V3 (2024-12-26)1001001001009699.2%
Qwen 3.7 Flash (Reasoning)1001001001009599.1%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009498.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001009498.8%
Z.AI GLM 5.11001001001009498.8%
Kimi K3 (Reasoning, High)1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
Grok 4.6 (Reasoning, High)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)1001001001009498.8%
Grok 4.7 (Reasoning, High)1001001001009498.8%
GPT-5.5 (Reasoning, Low)1001001001009498.8%
Claude Opus 4.8 (Reasoning)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
Qwen 3.5 397B A17B1001001001009498.8%
Thinking Machines Inkling (Reasoning)1001001001009498.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
Claude Haiku 5.5 (Adaptive)1001001001009498.8%
Qwen 3.6 Flash1001001001009498.8%
Muse Glimmer 30B (Reasoning, Medium)1001001001009498.8%
Qwen 3.6 27B1001001001009498.8%
GPT-5.6 Terra1001001001009498.8%
DeepSeek V4 Flash (Reasoning)1001001001009498.8%
Z.AI GLM 4.61001001001009498.8%
Xiaomi MIMO v2.5 Pro1001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
ByteDance Seed 2.0 Lite1001001001009498.8%
DeepSeek V3.11001001001009498.8%
Hermes 3 405B1001001001009498.8%
DeepSeek V3 (2025-03-24)1001001001009498.8%
Llama 3.1 70B1001001001009498.8%
Nemotron 3 Nano1001001001009498.8%
Arcee AI: Trinity Mini1001001001009498.8%
MiniMax M2.7100100100999498.7%
Qwen 3 235B A22B Instruct 250710010099999598.6%
Z.AI GLM 4.51001001001009398.6%
GPT-5.4 Nano (Reasoning, Low)100100100999498.5%
Kimi K2.6100100100989498.5%
Claude Sonnet 5.5 (Reasoning)100100100989498.4%
GPT-5100100100989498.3%
GPT-5.4 Mini (Reasoning)100100100989398.3%
Mistral Large 2100100100989498.3%
Gemma 3 27B1001001001009198.3%
GPT-5.410010099979498.2%
Z.AI GLM 5 Turbo100100100989398.2%
Writer: Palmyra X5100100100989298.0%
Mistral Small 4100100100969397.8%
Z.AI GLM 4.5 Air100100100959497.8%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100959497.7%
Claude Sonnet 4.5100100100949497.7%
Claude Opus 4.7 (Reasoning)100100100949497.7%
Z.AI GLM 5.3 (Reasoning, Max)100100100949497.6%
Qwen 3.7 Max100100100949497.6%
Z.AI GLM 5.2 (Reasoning, High)1001001001008897.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
Kimi K3 (Reasoning, Low)100100100949497.6%
Claude Opus 5 (Reasoning, Low)1001001001008897.6%
Claude Opus 5 (Reasoning)100100100949497.6%
GPT-5.6 Sol100100100949497.6%
Gemini 3 Flash (Preview, Reasoning)100100100949497.6%
Claude Opus 4.5100100100949497.6%
ByteDance Seed 1.6100100100949497.6%
DeepSeek V4 Pro (Reasoning)100100100949497.6%
Gemma 4 26B (Reasoning)100100100949497.6%
Qwen 3.6 35B100100100949497.6%
Xiaomi MIMO v2.6 Flash100100100949497.6%
Qwen 3.5 35B100100100949497.6%
o4 Mini100100100949497.6%
Gemini 3.1 Flash Lite1001001001008897.6%
GPT-5.6 Luna100100100949497.6%
Xiaomi MIMO v2.5100100100949497.6%
Aion 3.0 Mini100100100949497.6%
DeepSeek V4 Flash100100100949497.6%
GPT-5 Nano100100100949497.6%
Hermes 3 70B100100100949497.6%
Mistral NeMO100100100949497.6%
Cohere Command R+ (Aug. 2024)1001001001008797.4%
DeepSeek-V2 Chat100100100949397.3%
Claude Sonnet 4.610010099998897.2%
Qwen 3.5 Plus (2026-02-15)100100100988897.2%
Grok 4.3100100100949297.2%
Ministral 3 3B100100100949197.0%
GPT-5.4 Mini (Reasoning, Low)10010098949296.9%
Gemini 2.5 Flash10010099949296.9%
Gemini 2.5 Flash Lite100100100949096.8%
Cydonia 24B V4.110010098949296.7%
Claude Opus 41009796959496.5%
GPT-6.1 Sol (Reasoning, Medium)100100100948896.4%
Hy4 Preview (Reasoning, High)10010094949496.4%
Muse Spark 1.3 (Reasoning, Medium)10010094949496.4%
GPT-6 Luna (Reasoning, High)100100100948896.4%
Gemini 3.5 Flash (Reasoning)10010094949496.4%
GPT-5 Mini10010094949496.4%
Claude Opus 5100100100948896.4%
Gemini 2.5 Pro100100100948896.4%
Thinking Machines Inkling Small (Reasoning, High)100100100948896.4%
GPT-4.110010094949496.4%
Gemini 3.1 Flash Lite (Preview)10010094949496.4%
Gemma 4 31B10010094949496.4%
Gemma 4 26B100100100948896.4%
Gemini 3.5 Flash Lite (Reasoning)100100100948896.4%
DeepSeek V3.2100100100948896.4%
Nemotron 3 Super100100100948896.4%
GPT-4o Mini (temp=1)1009994949496.3%
Grok 4.5 (Reasoning, Low)10010097949096.2%
Laguna S 2.110010099968696.2%
GPT-5.4 Mini100100100938896.2%
Laguna XS 2.11009695959495.9%
Qwen 3 32B100100100948595.8%
Mistral Medium 3.1100100100908895.5%
GPT-5.4 Nano100100100898895.3%
Qwen 3.6 Max Preview10010094948895.2%
GPT-5.510010094948895.2%
Aion 2.0100100100888895.2%
Gemini 3.5 Flash (Reasoning, Minimal)10010094948895.2%
Z.AI GLM 4.7 Flash1009494949495.2%
GPT-5.210010094948895.1%
Ministral 3 14B989896948995.0%
Grok 4.5 (Reasoning, High)1009494949194.6%
Claude Haiku 4.51009994908894.3%
GPT-5.6 Sol (Reasoning, Medium)10010094948294.0%
GPT-5.6 Terra (Reasoning, Medium)10010094888894.0%
Claude Opus 4.61009494948894.0%
GPT-6 Sol10010094948294.0%
Z.AI GLM 4.710010094888894.0%
Gemini 3.6 Flash (Reasoning, Minimal)1009494948894.0%
GPT-5.5 (Reasoning, Medium)100100100888293.9%
GPT-4o, Aug. 6th (temp=1)10010093918593.9%
Gemini 3.7 Flash (Reasoning, Medium)1009994948293.8%
Gemini 3.6 Flash (Reasoning)10010094948193.7%
GPT-5.4 Nano (Reasoning)1009494919093.6%
GPT-5.4 (Reasoning)1009694908893.6%
Claude Opus 4.6 (Reasoning)979494948893.5%
Mistral Small 4 (Reasoning)1009494909093.5%
Claude Sonnet 5 (Reasoning, Low)1009790908993.4%
Ministral 8B1009693898893.2%
Claude Sonnet 41009494948292.9%
Gemini 3.1 Flash Lite (Reasoning)10010094888292.8%
Gemini 3 Flash (Preview)1009494888892.8%
Mistral Medium 3.51009994888292.6%
Claude Sonnet 4.6 (Reasoning)1009694878692.5%
Claude Sonnet 51009493888592.0%
Grok 4.201009594888291.9%
GPT-5.1989491888891.8%
Gemini 2.5 Flash (Reasoning)979491888791.2%
Claude Sonnet 5 (Reasoning)1009688878491.1%
Ministral 3 8B1009493897990.9%
Gemini 3.1 Pro (Preview)989491888090.1%
GPT-5.4 (Reasoning, Low)1009288888290.0%
Gemma 3 12B1009794797889.7%
Gemini 2.5 Flash Lite (Reasoning)1009488838189.1%
GPT-4.1 Mini979088878088.5%
Gemini 3.8 Flash (Reasoning, Medium)949488848288.4%
ByteDance Seed 2.0 Mini1009488887088.0%
Gemma 3 4B959489827186.1%
GPT-4.1 Nano948584817583.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Aion 3.5 (Reasoning, High)100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-4o Mini (temp=0)10010010010010099.9%
Grok 4.7 (Reasoning, High)1001001001009999.8%
Claude Sonnet 5.5 (Reasoning)100100100999999.7%
GPT-6 Sol1001001001009899.7%
GPT-5.6 Sol1001001001009899.6%
ByteDance Seed 2.0 Lite1001001001009899.6%
Mistral Large 4.01001001001009799.5%
GPT-6 Luna1001001001009799.4%
Claude Opus 5 (Reasoning, Low)1001001001009699.3%
Qwen 3 32B1001001001009598.9%
Aion 3.5 Mini (Reasoning, High)100100100999698.9%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)1001001001009498.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
ByteDance Seed 1.61001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
o4 Mini1001001001009498.8%
Llama 3.1 70B1001001001009498.8%
GPT-6.1 Sol (Reasoning, Medium)1001001001009498.8%
Kimi K2.51001001001009498.8%
Mistral Medium 3.11001001001009498.7%
GPT-5.210010099999698.7%
Qwen 3.8 27B (Reasoning, XHigh)10010098989798.7%
Claude Opus 4.8 (Reasoning, Low)1001001001009398.6%
Ministral 8B1001001001009398.6%
Xiaomi MIMO v2.6 Pro100100100979598.6%
Mistral Large 2100100100979698.5%
Muse Glimmer 30B (Reasoning, Medium)100100100989498.5%
Claude Opus 5.5 (Reasoning)100100100989398.1%
Aion 3.0100100100989398.1%
Qwen 3.5 Plus (2026-02-15)1009999989498.1%
Ministral 3B100100100979398.0%
Thinking Machines Inkling100100100989297.9%
Mistral Medium 3.5 (Reasoning)100100100969497.9%
Mistral Medium 3.5100100100969397.9%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001008997.9%
DeepSeek V4.1 Flash (Reasoning, High)100100100959497.8%
Mistral Large 4.0 (Reasoning)100100100989197.7%
Z.AI GLM 510010097979497.7%
MiniMax M3100100100959497.7%
Hermes 3 70B100100100989097.7%
Qwen 3.5 397B A17B100100100949497.6%
GPT-OSS 120B100100100949497.6%
Inception Mercury 2100100100949497.6%
Qwen 2.5 72B100100100949497.6%
ByteDance Seed 1.6 Flash100100100949497.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010098979397.6%
Claude Opus 5100100100979097.5%
Claude Opus 4100100100969197.5%
o4 Mini High100100100998897.4%
Mistral NeMO10010099949497.4%
GPT-5.6 Sol (Reasoning, Medium)10010098949497.2%
GPT-5.5 (Reasoning, Medium)10010098949497.1%
MiniMax M2.71009796969597.0%
Z.AI GLM 5 Turbo1009896959596.9%
GPT-4.110010096959496.9%
Claude Opus 4.6 (Reasoning)10010099988796.8%
Claude Opus 4.61001001001008496.8%
Claude Haiku 5.5 (Reasoning, Medium)100100100978696.8%
DeepSeek V4 Flash100100100949096.8%
DeepSeek-V2 Chat10010096949496.7%
Grok 4.3 (Reasoning)1009999949296.7%
Kimi K2.610010095949496.6%
Qwen 3.5 Flash100100100948896.4%
GPT-4o, Aug. 6th (temp=0)10010094949496.4%
WizardLM 2 8x22b10010094949496.4%
DeepSeek V4 Flash 0731 (Reasoning, High)10010094949496.4%
Ministral 3 8B100100100998396.3%
Laguna S 2.110010095949296.3%
GPT-6 Luna (Reasoning, High)10010098948996.3%
Z.AI GLM 4.710010094949396.2%
Qwen 3.5 27B10010094949396.2%
Kimi K3 (Reasoning, High)1009996949296.0%
Xiaomi MIMO v2.5 Pro1009994949396.0%
GPT-5.5 (Reasoning, Low)100100100938796.0%
Claude Opus 5 (Reasoning)10010099928995.9%
DeepSeek V3 (2025-03-24)1001001001008095.9%
Grok 4.31009994939395.9%
GPT-510010097948895.8%
Kimi K3 (Reasoning, Low)10010099948695.8%
Claude Opus 4.8 (Reasoning)1009896949095.8%
GPT-5.6 Luna10010099908995.7%
Qwen 3.6 35B10010094949095.5%
Laguna XS 2.110010094939095.4%
Claude Opus 4.7 (Reasoning)10010098908895.3%
DeepSeek V4 Pro (Reasoning)1009896948995.2%
Qwen 3.8 Flash (Reasoning)100100100888895.2%
Gemma 4 31B1009494949495.2%
Qwen 3.5 9B100100100888895.2%
GPT-5 Nano1009896948995.2%
Qwen 3.7 Flash (Reasoning)10010094948895.1%
GPT-6 Luna (Reasoning, Medium)999895929195.0%
Claude Sonnet 4.61009795919194.9%
GPT-5 Mini10010094928894.8%
Claude Haiku 4.5100100100898594.8%
Muse Spark 1.1 (Reasoning, Medium)10010094938694.6%
GPT-5.6 Terra1009998948394.6%
Qwen 3.6 Max Preview1009494949094.5%
Qwen 3 235B A22B Instruct 250710010094908894.5%
Mistral Large 310010098948094.4%
GPT-4o Mini (temp=1)100100100987394.2%
Qwen 3.5 Plus (2026-04-20)10010094918694.1%
Z.AI GLM 4.610010094888894.0%
Aion 2.010010094948294.0%
Z.AI GLM 4.7 Flash10010094888894.0%
Hermes 3 405B1009794928593.8%
Qwen 3.6 Flash1009494938893.7%
Thinking Machines Inkling Small (Reasoning, High)100100100888193.7%
DeepSeek V4 Pro 0813 (Reasoning, High)969595948993.7%
Gemini 2.5 Pro10010094918393.7%
Muse Spark 1.1 (Reasoning, Minimal)1009694908793.4%
GPT-5.6 Terra (Reasoning, Medium)1009994898593.4%
Mistral Small 41009694908593.0%
GPT-5.4 Nano (Reasoning, Low)10010093898493.0%
MiniMax M2.510010092878592.9%
DeepSeek V3.21009494898892.9%
Z.AI GLM 5.2 (Reasoning, High)10010090888792.9%
Gemini 3.8 Flash (Reasoning, Medium)10010094888292.8%
Claude Opus 4.71009993868692.7%
Claude Haiku 5.5 (Adaptive)1009898848492.7%
Muse Spark 1.3 (Reasoning, Medium)959494938892.7%
Mistral Small 3.2 24B1009994937792.7%
Thinking Machines Inkling (Reasoning)10010092878492.6%
Claude Sonnet 5 (Reasoning, Low)100100100897392.5%
Ministral 3 14B989494928492.5%
Claude Sonnet 5 (Reasoning)1009898858292.5%
Xiaomi MIMO v2.5100100100847892.5%
Gemini 3 Flash (Preview)1009494888692.4%
Writer: Palmyra X51009995937592.4%
Claude Sonnet 4.51009693888492.2%
Claude Sonnet 41009890888592.2%
Qwen 3.6 27B10010088888592.1%
GPT-4o, Aug. 6th (temp=1)10010094917592.0%
GPT-5.51009491888792.0%
Gemma 4 26B (Reasoning)1009494888492.0%
Grok 4.5 (Reasoning, High)1009494878591.9%
DeepSeek V4 Pro10010094917491.6%
Gemma 4 31B (Reasoning)1009494888291.6%
Gemini 3.6 Flash (Reasoning, Minimal)10010088888291.6%
Z.AI GLM 5.1969491898891.6%
GPT-5.4 Nano1009290898691.4%
Mistral Small 4 (Reasoning)969390908791.2%
Ministral 3 3B999490908391.1%
Hy4 Preview (Reasoning, High)1009692888091.0%
GPT-5.4 Nano (Reasoning)949191908891.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009488868690.8%
Gemini 3.1 Flash Lite1009188888690.6%
Gemma 3 12B1009888848390.6%
Grok 4.6 (Reasoning, High)949493878590.5%
Gemma 4 26B949488888890.4%
GPT-5.1969594917690.4%
Claude Opus 4.510010094857390.3%
Gemini 2.5 Flash1009490857989.7%
DeepSeek V3 (2024-12-26)10010087817989.3%
Gemini 3.1 Flash Lite (Reasoning)1008888888289.2%
Cydonia 24B V4.11009592827789.1%
Arcee AI: Trinity Mini959492887789.1%
Z.AI GLM 4.5 Air959491887688.8%
GPT-4.1 Mini999287838288.6%
Z.AI GLM 4.5949389887888.5%
Gemini 3.5 Flash (Reasoning)949188888188.3%
Grok 4.20 (Reasoning)1008986858188.1%
Gemini 3 Flash (Preview, Reasoning)949488828288.0%
DeepSeek V3.1949388828287.7%
Qwen 3.7 Max949287828287.3%
Grok 4.5 (Reasoning, Low)928986858487.0%
Claude Sonnet 4.6 (Reasoning)939387847786.9%
Gemini 3.1 Flash Lite (Preview)1008888887086.8%
Claude Sonnet 5978786857886.8%
GPT-5.4908987858286.7%
GPT-5.4 (Reasoning)929185858086.6%
Gemini 3.5 Flash (Reasoning, Minimal)888888878286.6%
Gemini 3.7 Flash (Reasoning, Medium)948888857686.2%
Grok 4.20948986867686.1%
Gemini 2.5 Flash Lite (Reasoning)1009786737385.8%
Gemini 3.1 Pro (Preview)939390777685.7%
GPT-5.4 Mini (Reasoning)908986838085.6%
Gemini 2.5 Flash Lite949486847085.6%
GPT-5.4 Mini898989818085.5%
Muse Spark 1.2 (Reasoning, Medium)958882828085.3%
GPT-5.4 Mini (Reasoning, Low)908887847484.6%
Gemini 3.6 Flash (Reasoning)1009088737084.1%
Gemini 3.5 Flash Lite (Reasoning)928584827784.0%
Gemini 2.5 Flash (Reasoning)918684817182.7%
Gemma 3 27B928886786782.2%
GPT-5.4 (Reasoning, Low)878584797481.7%
Gemma 3 4B939188814078.6%
GPT-4.1 Nano898981755978.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Large 3100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Hermes 3 405B100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Claude Opus 410010010010010099.9%
DeepSeek V3 (2025-03-24)1001001001009999.9%
Grok 4.6 (Reasoning, High)1001001001009999.9%
Grok 4.31001001001009899.6%
WizardLM 2 8x22b1001001001009699.1%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
GPT-5.6 Sol (Reasoning, Medium)1001001001009498.8%
Muse Spark 1.2 (Reasoning, Medium)1001001001009498.8%
Muse Spark 1.3 (Reasoning, Medium)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Z.AI GLM 5.2 (Reasoning, High)1001001001009498.8%
Z.AI GLM 5 Turbo1001001001009498.8%
Claude Opus 4.7 (Reasoning)1001001001009498.8%
GPT-5.5 (Reasoning, Low)1001001001009498.8%
Kimi K3 (Reasoning, Low)1001001001009498.8%
Qwen 3.5 397B A17B1001001001009498.8%
GPT-5.11001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009498.8%
Gemini 3 Flash (Preview, Reasoning)1001001001009498.8%
Claude Opus 4.71001001001009498.8%
GPT-5.4 Mini (Reasoning)1001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Aion 3.01001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
Qwen 3.6 27B1001001001009498.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009498.8%
MiniMax M2.51001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
Mistral Medium 3.5 (Reasoning)1001001001009498.8%
Gemma 4 31B1001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
GPT-4.1 Mini1001001001009498.8%
Qwen 2.5 72B1001001001009498.8%
Cohere Command R+ (Aug. 2024)1001001001009498.8%
Ministral 3B1001001001009498.8%
Thinking Machines Inkling100100100999498.7%
Ministral 3 8B1001001001009398.7%
Claude Opus 4.8 (Reasoning, Low)100100100999498.5%
Gemma 3 12B100100100989498.5%
Ministral 3 14B100100100979498.1%
GPT-5.4 Nano (Reasoning, Low)100100100969498.1%
Claude Opus 5 (Reasoning, Low)100100100969498.0%
Writer: Palmyra X5100100100949497.6%
Claude Sonnet 5 (Reasoning, Low)100100100989097.6%
Claude Opus 5.5 (Reasoning)100100100949497.6%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001008897.6%
Qwen 3.8 Flash (Reasoning)1001001001008897.6%
Qwen 3.6 Max Preview100100100949497.6%
Aion 3.5 Mini (Reasoning, High)100100100949497.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
Aion 3.5 (Reasoning, High)100100100949497.6%
GPT-5100100100949497.6%
GPT-5 Mini100100100949497.6%
Claude Opus 5 (Reasoning)100100100949497.6%
Grok 4.3 (Reasoning)1001001001008897.6%
Thinking Machines Inkling (Reasoning)1001001001008897.6%
GPT-5.6 Sol100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
Gemma 4 31B (Reasoning)100100100949497.6%
Z.AI GLM 5100100100949497.6%
ByteDance Seed 1.6100100100949497.6%
Gemma 4 26B (Reasoning)100100100949497.6%
Gemini 2.5 Pro100100100949497.6%
GPT-5.6 Terra100100100949497.6%
Claude Sonnet 4.5100100100949497.6%
Aion 2.0100100100949497.6%
o4 Mini100100100949497.6%
Qwen 3.5 Plus (2026-02-15)1001001001008897.6%
Xiaomi MIMO v2.5 Pro1001001001008897.6%
Z.AI GLM 4.5100100100949497.6%
Mistral Medium 3.5100100100949497.6%
GPT-5.4100100100949497.6%
GPT-4o, Aug. 6th (temp=0)100100100949497.6%
DeepSeek V4 Flash100100100949497.6%
Grok 4.20100100100949497.6%
Z.AI GLM 4.5 Air100100100949497.6%
Qwen 3 32B100100100949497.6%
Qwen 3 235B A22B Instruct 2507100100100949497.6%
Llama 3.1 70B1001001001008897.6%
Laguna XS 2.1100100100949497.6%
Mistral Small 4 (Reasoning)10010099949497.5%
Claude Sonnet 4.6 (Reasoning)10010099949296.9%
Laguna S 2.1100100100968896.8%
Claude Sonnet 510010097949396.8%
Gemma 3 4B1009999968996.5%
Claude Haiku 4.510010099939196.5%
GPT-4.1 Nano10010096949296.4%
Claude Sonnet 4.610010096949296.4%
Hy4 Preview (Reasoning, High)100100100948896.4%
Grok 4.5 (Reasoning, High)100100100948896.4%
Z.AI GLM 5.1100100100948896.4%
Kimi K2.6100100100948896.4%
Xiaomi MIMO v2.6 Pro10010094949496.4%
MiniMax M3100100100948896.4%
Qwen 3.6 35B100100100948896.4%
MiniMax M2.710010094949496.4%
GPT-OSS 120B10010094949496.4%
ByteDance Seed 2.0 Lite100100100948896.4%
DeepSeek V3.1100100100948896.4%
DeepSeek V4 Pro100100100948896.4%
Mistral Large 2100100100948896.4%
GPT-4o, Aug. 6th (temp=1)100100100948896.4%
Mistral Small 3.2 24B10010094949496.4%
Mistral Medium 3.1100100100948896.4%
Nemotron 3 Nano10010094949496.4%
Gemini 2.5 Flash Lite100100100948896.3%
GPT-4.110010094949296.0%
GPT-5.4 Nano (Reasoning)1009996948895.5%
Gemini 2.5 Flash989694949495.3%
Thinking Machines Inkling Small (Reasoning, High)10010094948995.3%
Gemini 2.5 Flash (Reasoning)10010094948895.3%
Claude Opus 4.6 (Reasoning)100100100948295.2%
Gemini 3.7 Flash (Reasoning, Medium)10010094948895.2%
GPT-5.4 (Reasoning)10010094948895.2%
Kimi K2.510010094948895.2%
Qwen 3.5 27B10010094948895.2%
DeepSeek V4 Pro (Reasoning)10010094948895.2%
Z.AI GLM 4.710010094948895.2%
Z.AI GLM 4.61009494949495.2%
ByteDance Seed 2.0 Mini10010094948895.2%
Gemini 3.1 Flash Lite (Preview)10010094948895.2%
DeepSeek V3.21001001001007695.2%
Nemotron 3 Super10010094948895.2%
Arcee AI: Trinity Mini10010094948895.2%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100948295.2%
GPT-5.4 Nano10010094929095.2%
Gemini 3.5 Flash Lite (Reasoning)100100100928294.9%
Mistral NeMO10010098898894.8%
GPT-5.4 Mini (Reasoning, Low)1009994928894.6%
Gemma 3 27B1009694948894.4%
Gemini 2.5 Flash Lite (Reasoning)10010094908894.4%
Cydonia 24B V4.110010094948394.2%
Kimi K3 (Reasoning, High)1009594948894.2%
GPT-5.4 (Reasoning, Low)10010096948194.2%
Claude Haiku 5.5 (Reasoning, Max)94 – – – – 94.0%
Gemini 3.1 Flash Lite (Reasoning)10010094948294.0%
GPT-5.210010094948293.9%
Claude Sonnet 5 (Reasoning)1009494898893.0%
Mistral Small 4100100100828292.8%
Qwen 3.7 Max10010094888292.8%
GPT-5.5 (Reasoning, Medium)1009494888291.6%
Grok 4.20 (Reasoning)10010094887691.6%
GPT-5.51009494888291.6%
Gemini 3.5 Flash (Reasoning, Minimal)1009494888291.6%
Gemini 3.1 Pro (Preview)959494888290.5%
Gemini 3.8 Flash (Reasoning, Medium)10010094887090.4%
Grok 4.5 (Reasoning, Low)949494947690.4%
Gemini 3.1 Flash Lite10010088887690.4%
Gemma 4 26B949494888290.4%
GPT-5 Nano1008888888890.4%
Gemini 3.6 Flash (Reasoning)10010094827089.2%
Gemini 3.6 Flash (Reasoning, Minimal)949494887689.2%
Gemini 3.5 Flash (Reasoning)948888767083.2%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Mistral NeMO100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)1001001001009999.7%
Grok 4.3 (Reasoning)1001001001009899.5%
Llama 3.1 70B1001001001009699.3%
Z.AI GLM 4.5 Air1001001001009699.1%
GPT-4o Mini (temp=1)1001001001009699.1%
Ministral 3 8B1001001001009599.1%
Claude Opus 4.8 (Reasoning, Low)1001001001009599.0%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009498.8%
Muse Spark 1.2 (Reasoning, Medium)1001001001009498.8%
Qwen 3.8 Flash (Reasoning)1001001001009498.8%
Muse Spark 1.1 (Reasoning, Medium)1001001001009498.8%
Z.AI GLM 5 Turbo1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
Kimi K2.61001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
Aion 3.5 Mini (Reasoning, High)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
ByteDance Seed 1.61001001001009498.8%
Aion 3.01001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
Qwen 3.6 35B1001001001009498.8%
GPT-4.11001001001009498.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001009498.8%
Gemma 4 31B1001001001009498.8%
GPT-6 Luna1001001001009498.8%
GPT-5.4 Mini1001001001009498.8%
Ministral 3 3B1001001001009498.8%
Claude Opus 51001001001009498.7%
Claude Opus 5 (Reasoning, Low)100100100999498.7%
Claude Opus 4.7 (Reasoning)1001001001009398.7%
Claude Opus 4100100100979598.5%
Claude Sonnet 4100100100989498.4%
Claude Haiku 5.5 (Adaptive)1001001001009298.4%
Mistral Large 3100100100989498.4%
Writer: Palmyra X5100100100989398.3%
Mistral Small 4100100100999398.3%
DeepSeek V4 Pro100100100969498.1%
Mistral Medium 3.11001001001009098.1%
Z.AI GLM 5.1100100100969497.9%
GPT-5.4 Nano (Reasoning)10010098979497.8%
Qwen 3.8 Max (Reasoning, XHigh)100100100949497.6%
GPT-6.1 Sol (Reasoning, Medium)100100100949497.6%
Z.AI GLM 5.2 (Reasoning, High)100100100949497.6%
GPT-6 Sol (Reasoning, Medium)1001001001008897.6%
Mistral Large 4.0 (Reasoning)100100100949497.6%
GPT-5100100100949497.6%
GPT-5.6 Sol100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100949497.6%
Qwen 3.5 Plus (2026-04-20)1001001001008897.6%
Gemma 4 31B (Reasoning)100100100949497.6%
GPT-5.51001001001008897.6%
Z.AI GLM 4.7100100100949497.6%
Qwen 3.5 35B100100100949497.6%
ByteDance Seed 2.0 Mini1001001001008897.6%
Qwen 3.5 Flash100100100949497.6%
Claude Haiku 5.5 (Reasoning, Medium)1001001001008897.6%
GPT-5.4 Mini (Reasoning, Low)100100100949497.6%
Z.AI GLM 4.7 Flash100100100949497.6%
Nemotron 3 Super1001001001008897.6%
GPT-5.4 Nano (Reasoning, Low)1001001001008897.6%
Laguna XS 2.11001001001008897.6%
WizardLM 2 8x22b100100100949497.6%
Ministral 3B100100100949497.6%
Mistral Small 3.2 24B1001001001008897.5%
Aion 3.0 Mini10010099949497.4%
Gemma 3 27B100100100998897.4%
GPT-5.110010099949497.3%
Kimi K3 (Reasoning, Low)100100100949297.3%
DeepSeek V3 (2025-03-24)10010098949497.2%
Qwen 3 235B A22B Instruct 2507100100100939297.1%
Claude Sonnet 4.510010099949397.1%
MiniMax M2.7100100100978897.0%
Mistral Large 2100100100978897.0%
Gemma 3 4B10010096949496.9%
Grok 4.31009898979196.9%
Laguna S 2.110010099949296.9%
Gemini 2.5 Flash Lite100100100939096.7%
Thinking Machines Inkling (Reasoning)1001001001008296.4%
GPT-5.6 Sol (Reasoning, Medium)10010094949496.4%
Gemini 3.7 Flash (Reasoning, Medium)100100100948896.4%
DeepSeek V4.1 Flash (Reasoning, High)100100100948896.4%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010094949496.4%
Grok 4.6 (Reasoning, High)10010094949496.4%
Grok 4.7 (Reasoning, High)100100100948896.4%
GPT-5.5 (Reasoning, Low)10010094949496.4%
GPT-5 Mini10010094949496.4%
Grok 4.5 (Reasoning, Low)1001001001008296.4%
GPT-5.4 (Reasoning, Low)10010094949496.4%
Kimi K2.5100100100948896.4%
GPT-5.210010094949496.4%
DeepSeek V4 Pro (Reasoning)100100100948896.4%
DeepSeek V4 Flash (Reasoning)100100100948896.4%
DeepSeek V4 Flash 0731 (Reasoning, High)10010094949496.4%
Xiaomi MIMO v2.6 Flash10010094949496.4%
o4 Mini10010094949496.4%
Qwen 3.5 Plus (2026-02-15)100100100948896.4%
Gemini 3.1 Flash Lite (Preview)10010094949496.4%
Grok 4.20100100100948896.4%
Hermes 3 405B100100100948896.4%
Qwen 3 32B10010094949496.4%
Qwen 2.5 72B100100100948896.4%
GPT-5.4 Nano10010094949496.4%
GPT-4o, Aug. 6th (temp=1)10010094949496.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100998296.3%
MiniMax M310010099948896.3%
Gemma 3 12B10010094949496.2%
Claude Sonnet 5.5 (Reasoning)1009994949496.2%
MiniMax M2.510010099919196.2%
Cydonia 24B V4.110010097968996.2%
Claude Sonnet 4.6 (Reasoning)10010094949195.7%
GPT-4.1 Mini10010095948795.3%
Hy4 Preview (Reasoning, High)10010094948895.2%
Grok 4.5 (Reasoning, High)100100100948295.2%
Qwen 3.6 Max Preview100100100888895.2%
GPT-6 Luna (Reasoning, Medium)10010094948895.2%
Qwen 3.5 397B A17B10010094948895.2%
GPT-5.4 Mini (Reasoning)10010094948895.2%
Qwen 3.6 27B10010094948895.2%
Z.AI GLM 4.610010094948895.2%
Thinking Machines Inkling Small (Reasoning, High)1009494949495.2%
Gemma 4 26B10010094948895.2%
ByteDance Seed 2.0 Lite100100100888895.2%
DeepSeek V3.21009494949495.2%
GPT-5.410010094948895.1%
Gemini 3.5 Flash Lite (Reasoning)10010094938895.0%
Claude Opus 5 (Reasoning)1009994948895.0%
Z.AI GLM 4.510010094938894.9%
DeepSeek V3.11009894948894.9%
DeepSeek V3 (2024-12-26)1009994928994.8%
Claude Haiku 4.510010096918594.5%
Mistral Small 4 (Reasoning)100100100997294.2%
DeepSeek-V2 Chat10010097918394.0%
Ministral 8B1009494929094.0%
Muse Spark 1.3 (Reasoning, Medium)1009494948894.0%
Gemma 4 26B (Reasoning)949494949494.0%
Aion 2.01009494948894.0%
Gemini 3.1 Flash Lite10010094888894.0%
Claude Opus 4.7959494949393.9%
GPT-5 Nano10010094888793.8%
GPT-5.4 (Reasoning)969494948893.3%
Ministral 3 14B1009995898393.0%
Gemini 2.5 Pro1009494948292.8%
Claude Opus 4.6 (Reasoning)1009494948292.8%
Xiaomi MIMO v2.5100100100947092.8%
Claude Sonnet 4.610010094858492.5%
Claude Opus 4.510010094888192.5%
Hermes 3 70B949493898891.7%
Qwen 3.7 Max949494948291.6%
Qwen 3.6 Flash1009488888891.6%
GPT-5.6 Luna949494948291.6%
Gemini 2.5 Flash1009494888291.6%
Z.AI GLM 5959491898891.5%
GPT-4.1 Nano959494898190.6%
Gemini 3.6 Flash (Reasoning)949488888890.4%
Gemini 3 Flash (Preview, Reasoning)1009494887690.4%
Gemini 3 Flash (Preview)10010094827690.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949488888890.4%
Arcee AI: Trinity Mini1009488888290.4%
Claude Opus 4.6949392888490.3%
Claude Sonnet 5 (Reasoning, Low)949189898790.1%
Claude Sonnet 510010087877389.4%
Gemini 2.5 Flash Lite (Reasoning)1009288877989.1%
GPT-5.6 Terra949494827688.0%
Gemini 3.8 Flash (Reasoning, Medium)1008888887688.0%
Gemini 3.6 Flash (Reasoning, Minimal)10010088767086.8%
Claude Sonnet 5 (Reasoning)979682807986.8%
Xiaomi MIMO v2.5 Pro949488827085.6%
Gemini 2.5 Flash (Reasoning)948882828285.6%
Gemini 3.5 Flash (Reasoning, Minimal)1009476707082.0%
Gemini 3.5 Flash (Reasoning)948882826081.2%
Gemini 3.1 Pro (Preview)948276767680.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Mistral Small 3.2 24B100100100100 – 100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
GPT-5.210010010010010099.9%
ByteDance Seed 1.6 Flash1001001001009999.9%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009999.8%
Xiaomi MIMO v2.6 Flash1001001001009999.8%
GPT-5.41001001001009899.6%
GPT-5.4 (Reasoning, Low)10010099999899.2%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
GPT-6.1 Sol (Reasoning, Medium)1001001001009498.8%
Kimi K2.61001001001009498.8%
GPT-5.5 (Reasoning, Low)1001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
GPT-51001001001009498.8%
GPT-5 Mini1001001001009498.8%
Grok 4.3 (Reasoning)1001001001009498.8%
GPT-5.6 Sol1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Qwen 3.6 Flash1001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
Qwen 3.6 35B1001001001009498.8%
Aion 2.01001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
GPT-OSS 120B1001001001009498.8%
Mistral Large 4.01001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
Inception Mercury 21001001001009498.8%
Qwen 3 32B1001001001009498.8%
Hermes 3 70B1001001001009498.8%
Mistral NeMO100100100999498.7%
Aion 3.0100100100999498.6%
Llama 3.1 70B100100100999498.6%
Z.AI GLM 4.7 Flash1001001001009298.5%
Mistral Medium 3.1100100100989498.3%
Hermes 3 405B100100100989498.3%
Grok 4.5 (Reasoning, Low)1001001001009298.3%
GPT-4.110010099989398.1%
Grok 4.3100100100969498.1%
Z.AI GLM 4.510010098989498.0%
Claude Haiku 5.5 (Adaptive)10010099989498.0%
Claude Opus 5100100100999097.9%
GPT-4o, Aug. 6th (temp=1)1001001001008997.9%
Kimi K3 (Reasoning, Low)100100100959497.8%
Grok 4.5 (Reasoning, High)10010099999097.8%
GPT-5.6 Sol (Reasoning, Medium)100100100949497.6%
Hy4 Preview (Reasoning, High)1001001001008897.6%
Qwen 3.6 Max Preview1001001001008897.6%
GPT-6 Luna (Reasoning, Medium)100100100949497.6%
Claude Opus 4.6100100100949497.6%
Kimi K2.5100100100949497.6%
GPT-5.1100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
ByteDance Seed 1.6100100100949497.6%
DeepSeek V4 Pro (Reasoning)100100100949497.6%
o4 Mini High100100100949497.6%
GPT-5.6 Terra100100100949497.6%
Qwen 3.5 Flash100100100949497.6%
Z.AI GLM 4.5 Air1001001001008897.6%
Gemini 2.5 Flash Lite100100100959297.3%
Z.AI GLM 5.110010099949497.3%
GPT-5.4 (Reasoning)100100100949397.3%
Claude Opus 4.8 (Reasoning)100100100949297.3%
Grok 4.20 (Reasoning)1001001001008697.3%
Xiaomi MIMO v2.5 Pro100100100988897.2%
Cohere Command R+ (Aug. 2024)1001001001008697.2%
Thinking Machines Inkling Small (Reasoning, High)100100100988897.2%
Grok 4.2010010099988896.9%
Ministral 3 14B10010099949296.9%
MiniMax M2.510010097949396.8%
MiniMax M2.7100100100958996.8%
DeepSeek V4 Flash (Reasoning)100100100929196.6%
Claude Opus 4.6 (Reasoning)10010098949196.6%
MiniMax M310010095949496.6%
GPT-5.4 Nano10010096939396.5%
Gemini 3.7 Flash (Reasoning, Medium)100100100948896.4%
DeepSeek V4.1 Flash (Reasoning, High)100100100948896.4%
Gemini 3.5 Flash (Reasoning)100100100948896.4%
Qwen 3.5 122B10010094949496.4%
Gemma 4 31B (Reasoning)100100100948896.4%
GPT-5.5100100100948896.4%
Gemini 3.1 Flash Lite (Reasoning)100100100948896.4%
Gemini 3 Flash (Preview)10010094949496.4%
Gemma 4 31B100100100948896.4%
Gemini 3.1 Flash Lite100100100948896.4%
Claude Haiku 5.5 (Reasoning, Medium)100100100948896.4%
Aion 3.0 Mini10010094949496.4%
Nemotron 3 Nano10010094949496.4%
Claude Opus 4.7 (Reasoning)1009897949296.4%
GPT-5.4 Mini (Reasoning)10010097949196.3%
Xiaomi MIMO v2.5100100100948896.3%
DeepSeek V3 (2025-03-24)1009997949196.2%
Z.AI GLM 5 Turbo999896949496.2%
DeepSeek V4 Flash100100100948796.2%
Qwen 2.5 72B10010099948896.1%
Thinking Machines Inkling100100100919096.1%
Gemma 4 26B (Reasoning)1009894949496.1%
GPT-5.4 Mini (Reasoning, Low)1009997978695.9%
Gemma 3 4B10010096938895.5%
Claude Opus 4.8 (Reasoning, Low)10010095948895.4%
GPT-5.4 Nano (Reasoning)1009994939195.3%
Claude Sonnet 4.5999796949095.3%
Muse Spark 1.1 (Reasoning, Medium)10010094948895.2%
Qwen 3.5 397B A17B1009494949495.2%
ByteDance Seed 2.0 Lite100100100948295.2%
GPT-5.5 (Reasoning, Medium)1001001001007695.1%
Mistral Medium 3.5 (Reasoning)10010095948795.1%
GPT-6 Luna (Reasoning, High)100100100948195.1%
Gemini 3 Flash (Preview, Reasoning)100100100997695.1%
GPT-4o Mini (temp=1)10010095948695.0%
Ministral 3B10010095928895.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010094938894.9%
GPT-5 Nano100100100948194.9%
Claude Opus 4.51009894948894.8%
Ministral 3 3B1009797918894.8%
Arcee AI: Trinity Mini999494949394.7%
Claude Sonnet 4.6 (Reasoning)999998928594.6%
Gemini 2.5 Flash Lite (Reasoning)10010094948594.5%
Mistral Medium 3.510010097898694.3%
DeepSeek-V2 Chat1009996898894.3%
GPT-5.4 Mini1009794928894.2%
Kimi K3 (Reasoning, High)10010094888894.0%
Gemini 2.5 Pro1009494948894.0%
Z.AI GLM 4.71009494948894.0%
GPT-4.1 Mini1009493929194.0%
Claude Haiku 4.510010093898893.8%
Gemma 3 12B10010097927993.7%
Laguna XS 2.11009995908493.5%
Writer: Palmyra X510010092908593.5%
GPT-5.4 Nano (Reasoning, Low)10010094947993.4%
Claude Opus 4.710010094868693.3%
DeepSeek V4 Pro100100100877993.1%
Qwen 3.5 Plus (2026-02-15)100100100828292.8%
Gemini 3.6 Flash (Reasoning)1009494888892.8%
Claude Opus 5 (Reasoning, Low)10010088888892.8%
Claude Opus 5 (Reasoning)1009494888892.8%
Gemini 3.6 Flash (Reasoning, Minimal)1009494948292.8%
Nemotron 3 Super1009494888892.8%
Claude Sonnet 4.61009393908892.7%
Mistral Small 4 (Reasoning)1009493898692.6%
DeepSeek V3.110010088888792.4%
Gemma 4 26B10010094887992.2%
DeepSeek V3 (2024-12-26)1009494938092.2%
Mistral Small 41009794888392.2%
Z.AI GLM 4.61009788888792.0%
Qwen 3.7 Max1009494888291.6%
Gemini 3.1 Flash Lite (Preview)1009494888291.6%
WizardLM 2 8x22b1009494887991.0%
Claude Sonnet 41009694887690.7%
Cydonia 24B V4.1969491878390.5%
Gemini 3.8 Flash (Reasoning, Medium)949494888290.4%
Gemini 3.5 Flash (Reasoning, Minimal)949494888290.4%
Gemini 3.5 Flash Lite (Reasoning)1009488888290.4%
DeepSeek V3.2949494888290.4%
Claude Opus 41009492877890.2%
GPT-4.1 Nano959389878289.5%
Laguna S 2.11009491877288.9%
Claude Sonnet 51009789877188.8%
Qwen 3 235B A22B Instruct 25071009692787488.2%
Claude Sonnet 5 (Reasoning)1009185838288.1%
Gemini 3.1 Pro (Preview)948888888288.0%
Ministral 8B978885858487.9%
Ministral 3 8B1009589856586.8%
Mistral Large 2949490797786.8%
Gemini 2.5 Flash1008888836985.6%
Mistral Large 3948887817685.3%
Gemini 2.5 Flash (Reasoning)1009486757185.2%
Gemma 3 27B1009392815984.9%
Claude Sonnet 5 (Reasoning, Low)918885807884.4%
ByteDance Seed 2.0 Mini998875707080.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
o4 Mini100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)10010010010010099.9%
Claude Haiku 5.5 (Adaptive)1001001001009999.9%
Claude Opus 4.61001001001009999.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)1001001001009999.8%
DeepSeek V4 Flash (Reasoning)1001001001009899.6%
Xiaomi MIMO v2.6 Pro1001001001009899.6%
Claude Opus 5 (Reasoning)1001001001009699.3%
MiniMax M2.7100100100989899.2%
GPT-5.4 Mini1001001001009699.1%
GPT-5.6 Sol (Reasoning, Medium)1001001001009498.8%
Claude Opus 4.6 (Reasoning)1001001001009498.8%
Gemini 3.7 Flash (Reasoning, Medium)1001001001009498.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009498.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009498.8%
Grok 4.5 (Reasoning, High)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
GPT-5.5 (Reasoning, Medium)1001001001009498.8%
Z.AI GLM 5.2 (Reasoning, High)1001001001009498.8%
Grok 4.6 (Reasoning, High)1001001001009498.8%
Kimi K2.61001001001009498.8%
Mistral Large 4.0 (Reasoning)1001001001009498.8%
GPT-5 Mini1001001001009498.8%
Grok 4.3 (Reasoning)1001001001009498.8%
GPT-5.4 (Reasoning, Low)1001001001009498.8%
Grok 4.20 (Reasoning)1001001001009498.8%
GPT-5.6 Sol1001001001009498.8%
Qwen 3.5 122B1001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Gemma 4 31B (Reasoning)1001001001009498.8%
ByteDance Seed 1.61001001001009498.8%
GPT-5.21001001001009498.8%
GPT-5.51001001001009498.8%
DeepSeek V4 Pro (Reasoning)1001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
GPT-5.6 Terra1001001001009498.8%
Qwen 3.6 35B1001001001009498.8%
Thinking Machines Inkling Small (Reasoning, High)1001001001009498.8%
Xiaomi MIMO v2.6 Flash1001001001009498.8%
Qwen 3.5 Flash1001001001009498.8%
Gemini 3.1 Flash Lite (Preview)1001001001009498.8%
GPT-5.41001001001009498.8%
ByteDance Seed 2.0 Lite1001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
DeepSeek V3.11001001001009498.8%
DeepSeek V4 Pro1001001001009498.8%
Grok 4.31001001001009498.8%
GPT-4o Mini (temp=1)1001001001009498.8%
Nemotron 3 Nano1001001001009498.8%
Qwen 2.5 72B1001001001009498.8%
Claude Opus 4.710010099979798.8%
Claude Opus 4.7 (Reasoning)1001001001009498.8%
GPT-5 Nano100100100999498.7%
DeepSeek-V2 Chat1001001001009398.6%
GPT-5.4 Nano (Reasoning)100100100999498.5%
Qwen 3 235B A22B Instruct 2507100100100989498.5%
Mistral Large 210010099989598.5%
Claude Haiku 5.5 (Reasoning, Low)10010010094 – 98.5%
GPT-4.1100100100989498.4%
Claude Opus 4.8 (Reasoning)100100100989498.4%
Claude Sonnet 4.51001001001009298.4%
DeepSeek V3 (2025-03-24)100100100979498.3%
MiniMax M3100100100979498.1%
Hermes 3 70B100100100969598.1%
Claude Opus 5100100100959397.8%
Gemma 3 27B10010099959497.7%
Qwen 3.8 Flash (Reasoning)100100100949497.6%
Z.AI GLM 5.1100100100949497.6%
GPT-6 Sol (Reasoning, Medium)100100100949497.6%
Qwen 3.5 397B A17B100100100949497.6%
Kimi K2.51001001001008897.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
GPT-6 Sol100100100949497.6%
Gemini 2.5 Pro1001001001008897.6%
GPT-5.6 Luna100100100949497.6%
Gemma 4 26B100100100949497.6%
Mistral Large 4.01001001001008897.6%
Aion 3.0 Mini1001001001008897.6%
DeepSeek V3.2100100100949497.6%
DeepSeek V4 Flash1001001001008897.6%
Thinking Machines Inkling100100100949497.6%
Gemini 3 Flash (Preview)100100100949497.6%
Claude Haiku 4.5100100100979197.5%
DeepSeek V3 (2024-12-26)100100100998897.4%
Arcee AI: Trinity Mini10010098969197.1%
Mistral Large 3100100100949197.1%
Gemma 3 12B10010099949197.0%
Cohere Command R+ (Aug. 2024)100100100968896.9%
Ministral 3 8B10010098978996.9%
Ministral 3 3B100100100948996.5%
GPT-4o, Aug. 6th (temp=1)100100100988596.5%
Mistral Small 410010098949196.5%
Z.AI GLM 510010099968796.4%
Qwen 3.7 Max10010094949496.4%
Muse Spark 1.1 (Reasoning, Medium)10010094949496.4%
GPT-5.5 (Reasoning, Low)100100100948896.4%
Gemini 3 Flash (Preview, Reasoning)10010094949496.4%
Muse Glimmer 30B (Reasoning, Medium)10010094949496.4%
Gemini 3.6 Flash (Reasoning, Minimal)10010094949496.4%
Xiaomi MIMO v2.5 Pro10010094949496.4%
Gemini 3.1 Flash Lite (Reasoning)100100100948896.4%
Gemini 3.1 Flash Lite10010094949496.4%
Z.AI GLM 4.7 Flash10010094949496.4%
WizardLM 2 8x22b10010094949496.4%
GPT-5.4 Nano (Reasoning, Low)1009797949496.3%
Mistral Medium 3.5 (Reasoning)1001001001008196.3%
GPT-5.4 Mini (Reasoning, Low)999896949496.1%
Laguna XS 2.110010099938896.1%
GPT-5.4 Nano1009897939396.1%
Z.AI GLM 4.61009894949496.0%
Claude Opus 410010094949195.8%
Qwen 3 32B1001001001007995.8%
Mistral Medium 3.5100100100918895.8%
Mistral NeMO1009794949495.8%
Z.AI GLM 4.5100100100908895.6%
Mistral Medium 3.1100100100908995.6%
Z.AI GLM 4.5 Air1001001001007895.5%
Grok 4.201001001001007895.5%
Writer: Palmyra X51009795949095.2%
Gemini 3.8 Flash (Reasoning, Medium)10010094948895.2%
Gemini 3.6 Flash (Reasoning)10010094948895.2%
Hy4 Preview (Reasoning, High)1009494949495.2%
Muse Spark 1.3 (Reasoning, Medium)10010094948895.2%
Thinking Machines Inkling (Reasoning)1009494949495.2%
Qwen 3.5 27B10010094948895.2%
Qwen 3.5 35B100100100948295.2%
Qwen 3.5 Plus (2026-02-15)1009494949495.2%
ByteDance Seed 2.0 Mini10010094948895.2%
Mistral Small 3.2 24B1009494949495.2%
Claude Opus 4.510010098948495.1%
GPT-4o Mini (temp=0)1009494949395.0%
Claude Sonnet 4.6 (Reasoning)10010096908894.8%
Claude Sonnet 410010096918694.6%
Hermes 3 405B1009894919094.6%
Claude Sonnet 5 (Reasoning)10010094938594.5%
MiniMax M2.51009999888694.3%
Gemini 3.5 Flash (Reasoning, Minimal)100100100888294.0%
Gemini 3.1 Pro (Preview)1009494948894.0%
Gemini 3.5 Flash (Reasoning)1009494948894.0%
Z.AI GLM 4.71009494948894.0%
Claude Sonnet 5 (Reasoning, Low)1009998868693.9%
Aion 2.010010094938293.8%
Ministral 8B10010091898993.8%
Llama 3.1 70B1009494928893.6%
Ministral 3B100100100878093.5%
Mistral Small 4 (Reasoning)10010098947392.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949494948892.8%
Gemini 2.5 Flash (Reasoning)1009994868392.5%
Gemini 2.5 Flash1009494908091.6%
Gemini 3.5 Flash Lite (Reasoning)949494948291.6%
Claude Sonnet 4.6959390898890.9%
Gemma 3 4B1009493867990.7%
Gemini 2.5 Flash Lite (Reasoning)949290908690.3%
Cydonia 24B V4.1989492838389.8%
Claude Sonnet 51009290897789.7%
Ministral 3 14B10010097866589.5%
GPT-4.1 Mini1009090867788.7%
Laguna S 2.1999086848388.5%
Gemma 4 26B (Reasoning)949488828288.0%
Gemini 2.5 Flash Lite1009894786987.7%
GPT-4.1 Nano918980787081.6%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
MiniMax M3100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Qwen 3 32B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3B100100100100100100.0%
Claude Opus 4.7 (Reasoning)10010010010010099.9%
MiniMax M2.71001001001009999.9%
GPT-5.4 Mini1001001001009999.8%
GPT-4o Mini (temp=1)1001001001009999.8%
Writer: Palmyra X51001001001009999.8%
Ministral 3 3B1001001001009999.8%
Ministral 3 14B1001001001009799.4%
Hermes 3 405B1001001001009699.3%
Ministral 8B100100100999698.9%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
Qwen 3.8 Flash (Reasoning)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Z.AI GLM 5.11001001001009498.8%
GPT-5.5 (Reasoning, Medium)1001001001009498.8%
Claude Sonnet 4.6 (Reasoning)1001001001009498.8%
Z.AI GLM 5 Turbo1001001001009498.8%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009498.8%
GPT-6 Sol (Reasoning, Medium)1001001001009498.8%
Grok 4.7 (Reasoning, High)1001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
Claude Opus 4.8 (Reasoning)1001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
Claude Opus 4.8 (Reasoning, Low)1001001001009498.8%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
GPT-51001001001009498.8%
GPT-5 Mini1001001001009498.8%
Grok 4.5 (Reasoning, Low)1001001001009498.8%
Grok 4.20 (Reasoning)1001001001009498.8%
Qwen 3.5 27B1001001001009498.8%
Claude Opus 4.71001001001009498.8%
GPT-5.4 Mini (Reasoning)1001001001009498.8%
Qwen 3.5 Plus (2026-04-20)1001001001009498.8%
Z.AI GLM 51001001001009498.8%
Claude Haiku 5.5 (Adaptive)1001001001009498.8%
GPT-5.51001001001009498.8%
Qwen 3.6 Flash1001001001009498.8%
Gemma 4 26B (Reasoning)1001001001009498.8%
Muse Glimmer 30B (Reasoning, Medium)1001001001009498.8%
o4 Mini High1001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
DeepSeek V4 Flash (Reasoning)1001001001009498.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009498.8%
Claude Opus 41001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
GPT-4.11001001001009498.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
GPT-OSS 120B1001001001009498.8%
Mistral Large 31001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
GPT-6 Luna1001001001009498.8%
GPT-4o, Aug. 6th (temp=0)1001001001009498.8%
Nemotron 3 Super1001001001009498.8%
GPT-4o, Aug. 6th (temp=1)1001001001009498.8%
Z.AI GLM 4.5 Air1001001001009498.8%
GPT-5 Nano1001001001009498.8%
o4 Mini100100100999498.7%
Claude Opus 5100100100999498.6%
Qwen 2.5 72B100100100999498.6%
Mistral Medium 3.5100100100999498.6%
Mistral NeMO1001001001009398.6%
Claude Sonnet 5 (Reasoning, Low)100100100989498.4%
Ministral 3 8B100100100979498.2%
Claude Sonnet 5100100100989398.2%
Claude Sonnet 410010098989498.1%
Mistral Small 4 (Reasoning)100100100969598.1%
Z.AI GLM 4.61001001001009098.1%
Z.AI GLM 4.51001001001009098.0%
Qwen 3 235B A22B Instruct 250710010099979498.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100949497.6%
Muse Spark 1.2 (Reasoning, Medium)100100100949497.6%
Muse Spark 1.3 (Reasoning, Medium)100100100949497.6%
GPT-5.5 (Reasoning, Low)1001001001008897.6%
GPT-5.4 (Reasoning, Low)100100100949497.6%
Thinking Machines Inkling (Reasoning)100100100949497.6%
GPT-5.6 Luna (Reasoning, Medium)100100100949497.6%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100949497.6%
GPT-6 Sol100100100949497.6%
Claude Opus 4.5100100100949497.6%
GPT-5.2100100100949497.6%
Qwen 3.6 35B100100100949497.6%
Thinking Machines Inkling Small (Reasoning, High)1001001001008897.6%
Qwen 3.5 Plus (2026-02-15)100100100949497.6%
Xiaomi MIMO v2.5 Pro1001001001008897.6%
Gemini 3 Flash (Preview)100100100949497.6%
Gemma 4 31B100100100949497.6%
Gemma 4 26B100100100949497.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100949497.6%
DeepSeek V3.1100100100949497.6%
DeepSeek V4 Pro100100100949497.6%
Inception Mercury 2100100100949497.6%
Mistral Large 2100100100949497.6%
Grok 4.3100100100949497.6%
Thinking Machines Inkling100100100949497.6%
Cohere Command R+ (Aug. 2024)100100100949497.6%
GPT-5.4 Mini (Reasoning, Low)100100100949497.5%
GPT-5.4 Nano (Reasoning, Low)10010098959497.4%
Claude Haiku 4.5100100100949397.4%
Claude Haiku 5.5 (Reasoning, Medium)100100100949297.3%
GPT-5.4 Nano (Reasoning)100100100988897.2%
Hermes 3 70B100100100949197.1%
Laguna XS 2.1100100100939196.9%
Laguna S 2.110010098969096.9%
Llama 3.1 70B100100100949096.8%
Claude Sonnet 4.5100100100948996.6%
Z.AI GLM 5.3 (Reasoning, Max)10010094949496.4%
Grok 4.5 (Reasoning, High)100100100948896.4%
Claude Opus 4.610010094949496.4%
GPT-5.1100100100948896.4%
Gemma 4 31B (Reasoning)1001001001008296.4%
GPT-5.6 Terra10010094949496.4%
Z.AI GLM 4.7100100100948896.4%
Aion 2.010010094949496.4%
ByteDance Seed 2.0 Mini10010094949496.4%
Gemini 3.1 Flash Lite (Preview)100100100948896.4%
Gemini 3.1 Flash Lite10010094949496.4%
GPT-5.4100100100948896.4%
ByteDance Seed 2.0 Lite100100100948896.4%
Z.AI GLM 4.7 Flash100100100948896.4%
Grok 4.20100100100948896.4%
GPT-4.1 Mini10010095949396.4%
GPT-5.4 Nano10010094949396.1%
DeepSeek V3 (2024-12-26)1009994949496.1%
Gemini 2.5 Flash Lite10010097948995.9%
Gemini 2.5 Flash Lite (Reasoning)10010099948695.8%
DeepSeek V3 (2025-03-24)10010094939195.6%
Gemma 3 27B10010095958895.6%
Arcee AI: Trinity Mini1009894949095.3%
GPT-5.6 Sol (Reasoning, Medium)10010094948895.2%
Gemini 3.6 Flash (Reasoning)10010094948895.2%
Qwen 3.7 Max10010094948895.2%
Gemini 3.5 Flash (Reasoning)10010094948895.2%
GPT-5.6 Sol10010094948895.2%
Gemini 3 Flash (Preview, Reasoning)100100100888895.2%
Gemini 3.6 Flash (Reasoning, Minimal)100100100948295.2%
Mistral Medium 3.110010094938995.1%
Claude Sonnet 5 (Reasoning)10010099898795.0%
DeepSeek-V2 Chat999694948894.2%
Gemini 3.1 Pro (Preview)1009494948894.0%
DeepSeek V3.210010094888894.0%
Mistral Small 410010092918693.6%
Gemini 2.5 Flash (Reasoning)10010094918293.4%
ByteDance Seed 1.6100100100887692.8%
Gemini 2.5 Flash1009491918892.7%
GPT-4.1 Nano1009790888692.0%
Gemma 3 4B979594878291.2%
Cydonia 24B V4.1949494898290.5%
Gemma 3 12B10010094797689.8%
Gemini 3.5 Flash (Reasoning, Minimal)1009488887689.2%
Mistral Small 3.2 24B10010088885987.0%
Gemini 3.8 Flash (Reasoning, Medium)888882827683.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.1100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Mistral Large 3100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)1001001001009999.9%
Kimi K3 (Reasoning, Low)1001001001009999.9%
Mistral Large 21001001001009999.8%
GPT-4o Mini (temp=1)1001001001009999.7%
Claude Opus 4.71001001001009899.6%
Kimi K3 (Reasoning, High)1001001001009899.6%
DeepSeek V3 (2024-12-26)1001001001009899.5%
Claude Opus 5 (Reasoning, Low)1001001001009899.5%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009899.5%
DeepSeek V4 Pro (Reasoning)1001001001009799.5%
Claude Sonnet 4100100100999899.5%
Claude Opus 4.8 (Reasoning, Low)1001001001009799.4%
Qwen 3.6 Flash1001001001009799.3%
Z.AI GLM 5 Turbo1001001001009799.3%
Claude Haiku 4.5100100100999899.3%
GPT-5.4 Nano1001001001009699.3%
Grok 4.20 (Reasoning)1001001001009699.2%
Claude Opus 5100100100999799.1%
Z.AI GLM 51001001001009599.1%
Grok 4.5 (Reasoning, Low)100100100989799.1%
Claude Opus 5 (Reasoning)1001001001009498.9%
Hermes 3 70B100100100989698.9%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
Gemini 3.6 Flash (Reasoning)1001001001009498.8%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009498.8%
Muse Spark 1.3 (Reasoning, Medium)1001001001009498.8%
GPT-5.5 (Reasoning, Medium)1001001001009498.8%
Z.AI GLM 5.2 (Reasoning, High)1001001001009498.8%
Claude Sonnet 5.5 (Reasoning)1001001001009498.8%
Kimi K2.61001001001009498.8%
Aion 3.5 (Reasoning, High)1001001001009498.8%
GPT-5.6 Sol1001001001009498.8%
GPT-5.51001001001009498.8%
Aion 3.01001001001009498.8%
Gemini 2.5 Pro1001001001009498.8%
Qwen 3.5 35B1001001001009498.8%
o4 Mini1001001001009498.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001009498.8%
GPT-5.6 Luna1001001001009498.8%
GPT-OSS 120B1001001001009498.8%
DeepSeek V4 Flash1001001001009498.8%
Nemotron 3 Super1001001001009498.8%
WizardLM 2 8x22b1001001001009498.8%
Hy4 Preview (Reasoning, High)1001001001009498.8%
Mistral Medium 3.51001001001009498.8%
Grok 4.6 (Reasoning, High)1001001001009498.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009498.7%
GPT-5.2100100100999598.7%
Gemma 4 31B (Reasoning)100100100999498.7%
Claude Opus 4.8 (Reasoning)1001001001009398.6%
Claude Haiku 5.5 (Adaptive)1001001001009398.5%
Cohere Command R+ (Aug. 2024)1001001001009298.5%
DeepSeek V3 (2025-03-24)1001001001009298.3%
MiniMax M31001001001009198.1%
GPT-5.4 Nano (Reasoning)1009898989698.1%
Arcee AI: Trinity Mini100100100999298.1%
Claude Opus 4.7 (Reasoning)100100100969498.0%
MiniMax M2.510010098979598.0%
Gemini 3.1 Flash Lite100100100969497.9%
Claude Opus 4.6100100100959497.9%
Mistral Medium 3.5 (Reasoning)1001001001008997.8%
Thinking Machines Inkling Small (Reasoning, High)1001001001008997.8%
Qwen 2.5 72B1001001001008897.7%
Gemini 3.8 Flash (Reasoning, Medium)100100100949497.6%
Claude Opus 4.6 (Reasoning)100100100949497.6%
Qwen 3.7 Max100100100949497.6%
Grok 4.5 (Reasoning, High)100100100949497.6%
Qwen 3.6 Max Preview1001001001008897.6%
GPT-5.6 Terra (Reasoning, Medium)100100100949497.6%
GPT-6 Luna (Reasoning, Medium)100100100949497.6%
Muse Spark 1.1 (Reasoning, Minimal)1001001001008897.6%
Thinking Machines Inkling (Reasoning)100100100949497.6%
GPT-5.6 Terra1001001001008897.6%
DeepSeek V4 Flash (Reasoning)100100100949497.6%
Aion 2.0100100100949497.6%
Gemini 3 Flash (Preview)1001001001008897.6%
Nemotron 3 Nano1001001001008897.6%
ByteDance Seed 2.0 Lite100100100949497.5%
GPT-5.4 Mini (Reasoning, Low)10010099959197.1%
GPT-5.4 (Reasoning)10010097949497.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100939296.8%
Z.AI GLM 5.110010097959296.7%
GPT-5.41009997949496.7%
GPT-5.4 (Reasoning, Low)10010098959096.5%
Ministral 3 14B10010099948996.5%
Grok 4.201009896949496.4%
Grok 4.3 (Reasoning)100100100948896.4%
GPT-5.6 Luna (Reasoning, Medium)10010094949496.4%
Gemini 3 Flash (Preview, Reasoning)100100100948896.4%
Qwen 3.7 Flash (Reasoning)10010094949496.4%
Z.AI GLM 4.7100100100948896.4%
Xiaomi MIMO v2.5 Pro100100100948896.4%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010094949496.4%
Xiaomi MIMO v2.510010094949496.4%
Mistral NeMO10010094949496.4%
GPT-5.4 Mini (Reasoning)10010098929196.2%
Laguna XS 2.110010094949296.1%
Mistral Large 4.010010096939196.1%
Ministral 3 8B10010094939396.0%
Claude Opus 410010095949196.0%
Claude Sonnet 4.5100100100948595.7%
Hermes 3 405B100100100948595.7%
GPT-4o, Aug. 6th (temp=1)1001001001007895.7%
Llama 3.1 70B10010094949095.6%
Gemini 2.5 Flash10010094929295.6%
GPT-5.4 Mini1009896958895.5%
Qwen 3 235B A22B Instruct 250710010097948595.3%
Gemini 3.1 Flash Lite (Preview)10010094948895.2%
Gemma 4 26B1009494949495.2%
Z.AI GLM 4.7 Flash10010094948895.2%
Mistral Small 41009897948695.0%
Mistral Small 4 (Reasoning)10010093928994.9%
GPT-5.4 Nano (Reasoning, Low)999898948594.8%
Mistral Small 3.2 24B959594949494.5%
MiniMax M2.710010098987694.5%
DeepSeek-V2 Chat10010094938594.4%
Z.AI GLM 4.5 Air1009794948694.4%
GPT-5 Nano10010094928694.3%
Laguna S 2.11009894928894.1%
Mistral Medium 3.110010097918394.1%
Gemini 3.1 Pro (Preview)1009494948894.0%
Gemma 4 26B (Reasoning)1009494948894.0%
Gemini 3.5 Flash Lite (Reasoning)1009494948894.0%
GPT-4.1 Mini10010099868493.8%
Claude Sonnet 4.610010096937993.6%
Ministral 3 3B1009695948393.5%
Claude Opus 4.51009794908693.5%
Z.AI GLM 4.610010094918293.4%
Ministral 8B1009494938593.2%
Ministral 3B100100100887793.1%
DeepSeek V3.1989494928793.0%
Gemini 2.5 Flash Lite1009494888892.7%
GPT-4.11009494948092.5%
Gemma 3 12B989795947792.4%
Claude Sonnet 4.6 (Reasoning)949393919092.2%
Claude Sonnet 5 (Reasoning, Low)1009992878191.7%
Gemini 3.6 Flash (Reasoning, Minimal)10010094887691.6%
Writer: Palmyra X510010089887991.2%
Gemini 2.5 Flash Lite (Reasoning)1009490878190.3%
Claude Sonnet 5989786858590.1%
Z.AI GLM 4.5949488888690.0%
Gemma 3 27B989494907389.8%
Gemini 3.5 Flash (Reasoning, Minimal)1009794827689.8%
Gemini 2.5 Flash (Reasoning)949191888589.8%
Gemini 3.7 Flash (Reasoning, Medium)1009488828289.2%
Claude Sonnet 5 (Reasoning)979587848289.0%
Qwen 3 32B10010090866287.7%
Gemini 3.5 Flash (Reasoning)949488887086.8%
Gemma 3 4B1009976726883.1%
GPT-4.1 Nano977978777581.2%
Cydonia 24B V4.179776634051.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Mistral Small 41001001001009999.8%
Claude Haiku 4.51001001001009899.6%
Hermes 3 70B1001001001009799.5%
Claude Sonnet 51001001001009799.4%
Claude Sonnet 4.6 (Reasoning)1001001001009599.1%
Claude Opus 5.5 (Reasoning)1001001001009498.8%
Qwen 3.8 Max (Reasoning, XHigh)1001001001009498.8%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009498.8%
GPT-5.6 Sol (Reasoning, Medium)1001001001009498.8%
Hy4 Preview (Reasoning, High)1001001001009498.8%
Muse Spark 1.2 (Reasoning, Medium)1001001001009498.8%
GPT-6 Luna (Reasoning, High)1001001001009498.8%
Z.AI GLM 5.2 (Reasoning, High)1001001001009498.8%
Kimi K3 (Reasoning, High)1001001001009498.8%
Grok 4.7 (Reasoning, High)1001001001009498.8%
Kimi K2.61001001001009498.8%
GPT-5.6 Terra (Reasoning, Medium)1001001001009498.8%
Mistral Large 4.0 (Reasoning)1001001001009498.8%
Xiaomi MIMO v2.6 Pro1001001001009498.8%
Qwen 3.5 397B A17B1001001001009498.8%
Kimi K2.51001001001009498.8%
Thinking Machines Inkling (Reasoning)1001001001009498.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009498.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009498.8%
Claude Opus 4.71001001001009498.8%
GPT-5.21001001001009498.8%
Qwen 3.6 Flash1001001001009498.8%
DeepSeek V4 Pro (Reasoning)1001001001009498.8%
Muse Glimmer 30B (Reasoning, Medium)1001001001009498.8%
Aion 3.01001001001009498.8%
o4 Mini High1001001001009498.8%
Qwen 3.7 Flash (Reasoning)1001001001009498.8%
Z.AI GLM 4.71001001001009498.8%
Z.AI GLM 4.61001001001009498.8%
Xiaomi MIMO v2.6 Flash1001001001009498.8%
Claude Opus 41001001001009498.8%
GPT-4.11001001001009498.8%
MiniMax M2.51001001001009498.8%
Aion 2.01001001001009498.8%
MiniMax M2.71001001001009498.8%
Qwen 3.5 Plus (2026-02-15)1001001001009498.8%
Xiaomi MIMO v2.5 Pro1001001001009498.8%
Mistral Medium 3.5 (Reasoning)1001001001009498.8%
Mistral Large 31001001001009498.8%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009498.8%
DeepSeek-V2 Chat1001001001009498.8%
Qwen 3.5 9B1001001001009498.8%
DeepSeek V3.11001001001009498.8%
Inception Mercury 21001001001009498.8%
Mistral Large 21001001001009498.8%
Z.AI GLM 4.5 Air1001001001009498.8%
GPT-5 Nano1001001001009498.8%
Gemini 2.5 Flash Lite1001001001009498.8%
Grok 4.31001001001009498.8%
GPT-4o Mini (temp=1)1001001001009498.8%
Mistral Small 3.2 24B1001001001009498.8%
GPT-4o Mini (temp=0)1001001001009498.8%
Gemma 3 27B1001001001009498.8%
Qwen 2.5 72B1001001001009498.8%
GPT-5.4 Nano1001001001009498.8%
ByteDance Seed 1.6 Flash1001001001009498.8%
Mistral NeMO1001001001009498.8%
GPT-5.4 Nano (Reasoning, Low)1001001001009498.8%
Gemma 3 12B1001001001009498.7%
Claude Opus 51001001001009398.6%
Hermes 3 405B1001001001009398.5%
Cohere Command R+ (Aug. 2024)1001001001009298.5%
Laguna S 2.110010099989498.2%
Claude Sonnet 4.6100100100989197.9%
Claude Opus 4.6 (Reasoning)100100100949497.6%
Grok 4.5 (Reasoning, High)100100100949497.6%
Z.AI GLM 5 Turbo100100100949497.6%
Kimi K3 (Reasoning, Low)1001001001008897.6%
Muse Spark 1.1 (Reasoning, Minimal)100100100949497.6%
GPT-5 Mini100100100949497.6%
Grok 4.3 (Reasoning)100100100949497.6%
GPT-5.4 (Reasoning, Low)100100100949497.6%
GPT-5.6 Sol1001001001008897.6%
GPT-5.1100100100949497.6%
Qwen 3.5 27B1001001001008897.6%
Z.AI GLM 5100100100949497.6%
Gemini 2.5 Pro100100100949497.6%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100949497.6%
Claude Sonnet 4100100100949497.6%
Claude Sonnet 4.5100100100949497.6%
Gemma 4 31B100100100949497.6%
Z.AI GLM 4.5100100100949497.6%
Mistral Medium 3.5100100100949497.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100949497.6%
Gemini 3.5 Flash Lite (Reasoning)100100100949497.6%
Gemini 2.5 Flash (Reasoning)100100100949497.6%
DeepSeek V3 (2024-12-26)100100100949497.6%
Z.AI GLM 4.7 Flash100100100949497.6%
GPT-5.4 Mini100100100949497.6%
Writer: Palmyra X5100100100949497.6%
Qwen 3 235B A22B Instruct 2507100100100949497.6%
Arcee AI: Trinity Mini100100100949497.6%
Claude Sonnet 5 (Reasoning)10010097979397.4%
Cydonia 24B V4.11001001001008697.2%
Ministral 3 14B1001001001008697.2%
GPT-4.1 Nano10010099978696.5%
Qwen 3.6 Max Preview100100100948896.4%
GPT-5.5 (Reasoning, Low)100100100948896.4%
MiniMax M310010094949496.4%
GPT-5.4 Mini (Reasoning)100100100948896.4%
Gemma 4 26B (Reasoning)100100100948896.4%
Gemini 3.6 Flash (Reasoning, Minimal)100100100948896.4%
o4 Mini100100100948896.4%
Gemini 3.1 Flash Lite (Preview)100100100948896.4%
Gemini 3.1 Flash Lite10010094949496.4%
GPT-5.410010094949496.4%
Xiaomi MIMO v2.5100100100948896.4%
Aion 3.0 Mini10010094949496.4%
DeepSeek V4 Pro100100100948896.4%
Nemotron 3 Super100100100948896.4%
Grok 4.2010010094949496.4%
Gemini 2.5 Flash10010094949496.4%
Mistral Small 4 (Reasoning)100100100948896.4%
Nemotron 3 Nano100100100948896.4%
WizardLM 2 8x22b100100100948896.4%
Mistral Medium 3.110010094949296.0%
Claude Opus 4.510010098948896.0%
Gemini 3.7 Flash (Reasoning, Medium)10010094948895.2%
GPT-5.4 (Reasoning)10010094948895.2%
Grok 4.5 (Reasoning, Low)10010094948895.2%
Gemini 3 Flash (Preview, Reasoning)100100100948295.2%
ByteDance Seed 1.6100100100888895.2%
GPT-5.51009494949495.2%
Qwen 3.6 35B100100100888895.2%
Gemini 3.5 Flash (Reasoning, Minimal)1009494949495.2%
Gemma 4 26B10010094948895.2%
DeepSeek V3.21009494949495.2%
GPT-5.4 Nano (Reasoning)1009494949495.2%
Claude Sonnet 5 (Reasoning, Low)1009996948494.6%
GPT-5949494949494.0%
Qwen 3.5 122B10010094888894.0%
Gemma 4 31B (Reasoning)100100100947694.0%
Gemini 3.1 Flash Lite (Reasoning)10010094888894.0%
ByteDance Seed 2.0 Mini1009494948894.0%
Gemini 2.5 Flash Lite (Reasoning)1009494948894.0%
Qwen 3.5 Flash10010094947692.8%
ByteDance Seed 2.0 Lite10010094888292.8%
Qwen 3.7 Max1009494948292.8%
Gemini 3 Flash (Preview)1009494888892.8%
Gemini 3.8 Flash (Reasoning, Medium)1009494888291.6%
Gemini 3.1 Pro (Preview)1009494888291.6%
Gemini 3.6 Flash (Reasoning)10010094887090.4%
Gemini 3.5 Flash (Reasoning)949494827688.0%