Passive voice overuse

Test: Bad Writing Habits

Avg. Score
96.7%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Qwen 3.7 Flash (Reasoning)99.6%$0.001055.2s98%
2o4 Mini99.5%$0.01525.7s97%
3o4 Mini High99.8%$0.02547.2s99%
4GPT-4o Mini (temp=1)99.0%$0.001234.8s96%
5Qwen 3 235B A22B Instruct 250799.0%$0.001159.2s96%
6Writer: Palmyra X598.8%$0.01122.0s96%
7Mistral Small 4 (Reasoning)98.7%$0.002230.2s95%
8DeepSeek V3 (2025-03-24)98.8%$0.001439.4s94%
9GPT-4.199.3%$0.01844.7s95%
10GPT-5.6 Luna98.8%$0.01515.8s94%
11Mistral Small 498.2%$0.001418.2s93%
12Grok 4.5 (Reasoning, Low)99.4%$0.0181.1m95%
13GPT-6.1 Sol (Reasoning, Medium)99.6%$0.0311.6m98%
14Grok 4.398.6%$0.006930.5s92%
15Gemini 2.5 Flash (Reasoning)98.1%$0.01121.5s93%
16GPT-6 Luna (Reasoning, Medium)98.6%$0.001643.0s92%
17Gemini 3.5 Flash Lite (Reasoning, Minimal)97.9%$0.00356.3s91%
18GPT-6 Luna (Reasoning, High)98.9%$0.002357.1s92%
19GPT-4.1 Mini98.1%$0.002719.0s91%
20GPT-6 Luna98.3%$0.001332.6s92%
21GPT-5.6 Luna (Reasoning, Medium)98.6%$0.01718.0s92%
22GPT-6 Sol99.1%$0.02751.4s94%
23GPT-5.4 Nano (Reasoning, Low)97.7%$0.005520.6s92%
24Grok 4.2098.5%$0.009345.7s92%
25GPT-6 Sol (Reasoning, Medium)99.1%$0.0311.0m95%
26GPT-5.4 Nano (Reasoning)98.0%$0.006124.5s91%
27GPT-5.4 Mini (Reasoning, Low)97.9%$0.01516.8s92%
28GPT-5.6 Terra99.0%$0.04636.9s95%
29Hermes 3 405B97.9%$0.003253.2s93%
30Grok 4.5 (Reasoning, High)99.2%$0.0301.6m96%
31GPT-5.4 Mini97.8%$0.01516.8s91%
32Ministral 3 3B97.3%$0.000511.1s90%
33DeepSeek V3 (2024-12-26)97.8%$0.002154.6s92%
34Qwen 3.6 Flash98.3%$0.01041.4s91%
35Qwen 3 32B97.6%$0.001554.6s92%
36GPT-4o Mini (temp=0)97.4%$0.001234.8s91%
37GPT-5.4 Nano97.3%$0.005726.3s91%
38Qwen 3.5 Flash97.5%$0.002547.5s91%
39Gemini 3.5 Flash Lite (Reasoning)97.2%$0.00356.6s89%
40GPT-4.1 Nano97.0%$0.000713.3s90%
41Qwen 3.5 Plus (2026-02-15)97.6%$0.006031.5s90%
42Mistral Medium 3.197.5%$0.004836.5s91%
43DeepSeek-V2 Chat97.5%$0.002153.3s91%
44Gemini 2.5 Flash97.3%$0.005210.6s89%
45Gemma 3 27B97.2%$0.000652.6s91%
46Mistral Medium 3.597.2%$0.01818.2s92%
47Gemma 3 12B97.1%$0.000441.3s91%
48Gemma 3 4B96.7%$0.000220.0s90%
49Qwen 3.5 9B97.9%$0.00111.4m92%
50Qwen 3.6 35B98.2%$0.00831.0m91%
51Qwen 3.5 122B98.1%$0.0251.1m93%
52GPT-4o, Aug. 6th (temp=1)97.9%$0.01824.4s90%
53Muse Spark 1.1 (Reasoning, Minimal)97.3%$0.01219.2s90%
54Thinking Machines Inkling98.0%$0.00751.5m92%
55Claude Sonnet 4.598.1%$0.03538.1s92%
56GPT-5.199.5%$0.0541.8m96%
57GPT-5.6 Terra (Reasoning, Medium)98.5%$0.04435.2s92%
58Ministral 3B96.5%$0.00018.1s89%
59Gemini 3.6 Flash (Reasoning, Minimal)97.1%$0.01714.3s90%
60ByteDance Seed 1.6 Flash96.6%$0.001327.3s90%
61Ministral 3 14B96.5%$0.000711.7s89%
62Ministral 3 8B96.3%$0.000819.6s90%
63Claude Haiku 4.596.9%$0.01121.6s90%
64Muse Spark 1.1 (Reasoning, Medium)97.1%$0.01523.9s90%
65GPT-5.498.8%$0.0491.4m95%
66Mistral Medium 3.5 (Reasoning)96.8%$0.01818.0s90%
67Inception Mercury 296.8%$0.00327.0s87%
68Z.AI GLM 4.597.0%$0.005142.1s90%
69DeepSeek V4 Flash (Reasoning)96.6%$0.000731.1s89%
70Z.AI GLM 5 Turbo97.0%$0.008133.2s89%
71Gemini 3.8 Flash (Reasoning, Medium)96.8%$0.01418.0s89%
72Qwen 3.5 Plus (2026-04-20)98.3%$0.0171.8m92%
73Z.AI GLM 597.1%$0.00841.2m91%
74Grok 4.20 (Reasoning)98.4%$0.0181.5m90%
75Muse Spark 1.2 (Reasoning, Medium)97.0%$0.01838.3s90%
76Qwen 3.5 27B97.8%$0.0201.6m92%
77Mistral NeMO95.9%$0.000510.1s88%
78GPT-5.4 Mini (Reasoning)97.5%$0.02228.1s89%
79GPT-5.298.7%$0.0561.5m94%
80Muse Glimmer 30B (Reasoning, Medium)97.2%$0.003843.4s87%
81Gemini 2.5 Flash Lite (Reasoning)96.2%$0.002830.8s89%
82Muse Spark 1.3 (Reasoning, Medium)98.4%$0.0251.8m92%
83MiniMax M2.596.5%$0.00341.3m91%
84GPT-5.6 Sol99.6%$0.1051.2m97%
85GPT-5 Nano96.7%$0.00421.4m91%
86MiniMax M2.796.7%$0.00401.1m90%
87Gemini 3.6 Flash (Reasoning)97.5%$0.04432.5s91%
88DeepSeek V4 Flash96.0%$0.000631.6s88%
89Z.AI GLM 5.197.3%$0.0141.5m91%
90Gemini 3.5 Flash (Reasoning, Minimal)96.1%$0.01812.0s88%
91GPT-5.6 Sol (Reasoning, Medium)99.6%$0.1081.2m96%
92Gemini 3.7 Flash (Reasoning, Medium)96.7%$0.01218.2s87%
93GPT-5.4 (Reasoning, Low)98.4%$0.0551.4m93%
94Gemini 2.5 Flash Lite95.4%$0.00099.5s87%
95Ministral 8B95.6%$0.000410.4s86%
96Z.AI GLM 4.5 Air96.2%$0.002958.2s88%
97DeepSeek V4.1 Flash (Reasoning, High)96.0%$0.002935.4s87%
98Claude Sonnet 5.5 (Reasoning)97.0%$0.04236.9s90%
99Aion 3.0 Mini96.4%$0.00531.2m88%
100GPT-OSS 120B97.0%$0.00151.8m88%
101Aion 3.096.7%$0.0241.0m89%
102Mistral Large 395.5%$0.003330.3s87%
103Kimi K3 (Reasoning, Low)96.8%$0.0281.1m89%
104Claude Sonnet 496.6%$0.03243.7s89%
105Mistral Large 296.2%$0.01329.4s86%
106DeepSeek V4 Pro96.7%$0.00481.3m87%
107Arcee AI: Trinity Mini95.3%$0.00039.2s85%
108Xiaomi MIMO v2.5 Pro95.8%$0.008553.5s87%
109Gemini 3.1 Flash Lite (Reasoning)95.0%$0.003011.9s86%
110Laguna S 2.195.0%$0.000522.1s86%
111Qwen 3.5 397B A17B98.2%$0.0143.0m91%
112Aion 3.5 (Reasoning, High)96.3%$0.0221.3m89%
113Z.AI GLM 5.2 (Reasoning, High)95.8%$0.0111.0m87%
114Z.AI GLM 4.796.0%$0.0101.4m88%
115Cydonia 24B V4.195.3%$0.001444.8s86%
116GPT-598.8%$0.0652.8m95%
117Grok 4.3 (Reasoning)98.0%$0.0212.3m88%
118Qwen 3.6 Max Preview99.1%$0.0503.5m94%
119Qwen 3.6 27B97.6%$0.0252.3m89%
120Hermes 3 70B95.5%$0.00101.2m86%
121Gemini 3.1 Flash Lite (Preview)94.5%$0.00308.4s84%
122Gemini 3.1 Flash Lite94.6%$0.003012.1s84%
123Claude Opus 5.5 (Reasoning)97.6%$0.09256.0s93%
124Laguna XS 2.194.6%$0.000314.4s84%
125 Kimi K3 (Reasoning, High)97.2%$0.0441.8m90%
126GPT-5 Mini95.3%$0.010057.4s86%
127GPT-4o, Aug. 6th (temp=0)95.6%$0.02322.7s85%
128Xiaomi MIMO v2.594.7%$0.005431.8s85%
129Claude Opus 4.597.1%$0.07053.4s90%
130GPT-5.5 (Reasoning, Medium)99.6%$0.1421.8m97%
131GPT-5.4 (Reasoning)98.9%$0.0892.6m95%
132Cohere Command R+ (Aug. 2024)95.5%$0.02052.5s86%
133Mistral Large 4.095.8%$0.00631.1m84%
134Gemini 3.5 Flash (Reasoning)96.7%$0.07137.6s89%
135Claude Opus 4.8 (Reasoning)96.5%$0.07141.7s90%
136Kimi K2.597.9%$0.0193.2m89%
137Qwen 3.5 35B96.1%$0.0181.0m84%
138Gemini 3 Flash (Preview)94.1%$0.007819.6s85%
139Gemma 4 26B94.9%$0.000955.1s84%
140GPT-5.5 (Reasoning, Low)99.3%$0.1391.8m96%
141DeepSeek V3.295.3%$0.00141.9m86%
142Claude Opus 4.8 (Reasoning, Low)96.7%$0.07141.9s88%
143Grok 4.6 (Reasoning, High)97.4%$0.0422.5m90%
144Z.AI GLM 4.7 Flash94.5%$0.00171.2m85%
145GPT-5.599.2%$0.1391.7m95%
146Gemma 4 31B (Reasoning)95.5%$0.00142.2m87%
147Xiaomi MIMO v2.6 Pro95.4%$0.00332.0m86%
148Gemini 3 Flash (Preview, Reasoning)94.4%$0.01230.1s83%
149Nemotron 3 Super95.2%$0.00001.4m83%
150Gemma 4 31B94.9%$0.00101.6m85%
151Mistral Large 4.0 (Reasoning)97.5%$0.0233.4m89%
152Gemma 4 26B (Reasoning)95.0%$0.00132.0m85%
153Z.AI GLM 5.3 Flash (Reasoning, Low)94.2%$0.00051.1m84%
154Gemini 3.1 Pro (Preview)98.3%$0.1071.8m91%
155Aion 3.5 Mini (Reasoning, High)95.5%$0.0112.4m87%
156DeepSeek V4 Pro 0813 (Reasoning, High)95.8%$0.0251.8m85%
157Aion 2.094.3%$0.00641.3m84%
158Claude Opus 4.696.4%$0.0781.2m88%
159DeepSeek V4 Pro (Reasoning)96.1%$0.0153.1m87%
160Z.AI GLM 4.693.7%$0.006551.5s83%
161Claude Haiku 5.5 (Reasoning, Low)93.2%$0.001515.4s81%
162Qwen 3.7 Max96.6%$0.0682.3m90%
163Qwen 2.5 72B93.3%$0.001036.7s81%
164Gemini 2.5 Pro94.1%$0.03636.2s84%
165DeepSeek V4 Flash 0731 (Reasoning, High)95.2%$0.00222.6m85%
166Nemotron 3 Nano94.4%$0.00101.1m80%
167Claude Sonnet 5 (Reasoning)94.4%$0.03038.9s82%
168Claude Opus 4.6 (Reasoning)96.2%$0.0881.4m88%
169Claude Sonnet 4.693.7%$0.03139.3s83%
170Hy4 Preview (Reasoning, High)97.4%$0.0404.4m90%
171Claude Haiku 5.5 (Adaptive)92.6%$0.001819.3s80%
172Xiaomi MIMO v2.6 Flash94.0%$0.00081.8m82%
173Grok 4.7 (Reasoning, High)97.8%$0.0743.9m91%
174WizardLM 2 8x22b94.8%$0.00261.8m80%
175Thinking Machines Inkling (Reasoning)97.4%$0.0255.1m90%
176Claude Opus 5 (Reasoning, Low)95.6%$0.0971.0m87%
177MiniMax M394.8%$0.00603.1m85%
178Qwen 3.8 Flash (Reasoning)95.1%$0.00643.1m84%
179Claude Opus 4.7 (Reasoning)94.4%$0.07632.0s85%
180Claude Sonnet 4.6 (Reasoning)94.6%$0.0601.2m84%
181Claude Sonnet 593.4%$0.02733.5s80%
182Llama 3.1 70B92.5%$0.001529.4s78%
183DeepSeek V3.193.2%$0.00201.8m81%
184Claude Haiku 5.5 (Reasoning, Medium)92.1%$0.001414.9s77%
185Thinking Machines Inkling Small (Reasoning, High)93.7%$0.00881.7m80%
186Claude Opus 4.793.8%$0.06930.4s83%
187Claude Sonnet 5 (Reasoning, Low)92.9%$0.03138.4s80%
188Claude Opus 5 (Reasoning)94.9%$0.0981.0m85%
189Claude Opus 498.5%$0.2091.4m94%
190Claude Opus 594.1%$0.08250.1s83%
191Kimi K2.698.5%$0.0586.5m92%
192Z.AI GLM 5.3 Flash (Reasoning, Max)96.5%$0.00316.5m89%
193Qwen 3.8 27B (Reasoning, XHigh)96.3%$0.0404.7m86%
194Mistral Small 3.2 24B95.8%$0.00695.7m84%
195Qwen 3.8 Max (Reasoning, XHigh)97.6%$0.0835.9m88%
196ByteDance Seed 1.692.1%$0.0132.5m76%
197Z.AI GLM 5.3 (Reasoning, Max)96.5%$0.0667.3m90%
198Claude Haiku 5.5 (Reasoning, Max)90.2%$0.0314.7m88%
199ByteDance Seed 2.0 Lite89.5%$0.0122.2m71%
200ByteDance Seed 2.0 Mini87.5%$0.00454.9m70%
96.65%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
GPT-4o Mini (temp=0)10010010010010099.9%
Claude Haiku 5.5 (Adaptive)10010010010010099.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010010010010099.9%
Writer: Palmyra X51001001001009999.9%
GPT-4.1 Nano1001001001009999.9%
Grok 4.3 (Reasoning)1001001001009999.9%
GPT-5.4 (Reasoning, Low)1001001001009999.9%
Qwen 3.6 Flash1001001001009999.9%
Qwen 3.5 27B1001001001009999.8%
GPT-5.41001001001009999.8%
Grok 4.20 (Reasoning)1001001001009999.8%
Kimi K3 (Reasoning, High)1001001001009999.8%
Thinking Machines Inkling (Reasoning)1001001001009999.7%
Claude Haiku 5.5 (Reasoning, Medium)1001001001009999.7%
Muse Glimmer 30B (Reasoning, Medium)100100100999999.7%
Claude Sonnet 4.51001001001009999.7%
Grok 4.6 (Reasoning, High)1001001001009899.7%
Inception Mercury 21001001001009999.7%
Claude Opus 4.61001001001009899.7%
Qwen 3.7 Max1001001001009899.6%
Qwen 3.5 Plus (2026-02-15)1001001001009899.6%
Mistral Medium 3.5100100100999999.6%
GPT-5.4 Nano1001001001009899.6%
Claude Sonnet 4100100100999999.6%
Claude Haiku 4.51001001001009899.5%
Gemini 2.5 Flash1001001001009799.5%
Z.AI GLM 5.2 (Reasoning, High)1001001001009799.5%
Claude Sonnet 5.5 (Reasoning)1001001001009799.5%
Arcee AI: Trinity Mini100100100999899.5%
Aion 3.01001001001009799.5%
Gemini 3.6 Flash (Reasoning, Minimal)100100100999899.4%
Claude Opus 4.8 (Reasoning, Low)1001001001009799.4%
Cydonia 24B V4.11001001001009799.4%
Mistral Large 4.0100100100999899.4%
Gemini 3.5 Flash Lite (Reasoning)1001001001009799.4%
Xiaomi MIMO v2.5 Pro100100100999899.4%
Z.AI GLM 4.7100100100999899.4%
Claude Opus 4.6 (Reasoning)100100100999899.4%
Aion 3.0 Mini1001001001009799.4%
Claude Haiku 5.5 (Reasoning, Low)1009999 – – 99.4%
Qwen 3.5 Plus (2026-04-20)1001001001009799.4%
GPT-5.4 Mini (Reasoning)1001001001009799.3%
Mistral Small 41001001001009799.3%
Claude Sonnet 51001001001009699.3%
Mistral Medium 3.11001001001009699.3%
Laguna XS 2.1100100100999799.3%
Thinking Machines Inkling Small (Reasoning, High)100100100999899.3%
Claude Sonnet 4.6 (Reasoning)100100100989899.3%
Qwen 3.5 35B1001001001009699.3%
Qwen 3.5 397B A17B100100100989899.3%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009699.3%
Claude Opus 4.71001001001009699.2%
GPT-5.4 Nano (Reasoning)1001001001009699.2%
Aion 3.5 Mini (Reasoning, High)1001001001009699.2%
Kimi K2.51001001001009699.2%
Claude Sonnet 5 (Reasoning)1001001001009699.2%
DeepSeek V4 Pro (Reasoning)1001001001009699.1%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100989899.1%
Xiaomi MIMO v2.6 Flash1001001001009599.1%
GPT-4.1 Mini1001001001009599.1%
Muse Spark 1.1 (Reasoning, Medium)1001001001009599.1%
GPT-5 Nano100100100999699.0%
Gemini 2.5 Flash (Reasoning)100100100989799.0%
Ministral 8B1001001001009599.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100989799.0%
Thinking Machines Inkling1001001001009699.0%
Ministral 3 14B100100100999699.0%
Qwen 3.5 Flash1001001001009598.9%
Claude Opus 51001001001009598.9%
Z.AI GLM 51001001001009498.8%
Gemma 3 27B1001001001009498.7%
Gemini 3.5 Flash (Reasoning)100100100979698.7%
Qwen 3 32B100100100999498.7%
Gemini 2.5 Flash Lite (Reasoning)1001001001009398.6%
Nemotron 3 Super100100100989598.6%
GPT-5 Mini10010099999598.6%
MiniMax M3100100100979698.6%
Gemma 3 4B100100100969698.5%
Hy4 Preview (Reasoning, High)1001001001009298.5%
Gemma 4 31B10010099979698.5%
Gemini 3.6 Flash (Reasoning)1001001001009298.4%
Claude Opus 4.7 (Reasoning)100100100979598.4%
Claude Sonnet 5 (Reasoning, Low)100100100989498.4%
Aion 2.0999998989898.3%
Hermes 3 405B100100100989398.3%
Xiaomi MIMO v2.510010098989598.3%
Ministral 3B100100100969598.2%
GPT-4o, Aug. 6th (temp=0)100100100999298.2%
Muse Spark 1.1 (Reasoning, Minimal)1001001001009098.1%
Ministral 3 8B100100100969498.1%
WizardLM 2 8x22b100100100989298.0%
Claude Opus 5 (Reasoning)10010098979598.0%
Gemma 4 26B (Reasoning)100100100969498.0%
Claude Opus 5 (Reasoning, Low)100100100979398.0%
GPT-5.4 Nano (Reasoning, Low)10010099989297.8%
Gemini 3 Flash (Preview, Reasoning)100100100989197.7%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100959397.7%
Gemini 3.8 Flash (Reasoning, Medium)10010097969597.6%
MiniMax M2.5100100100959397.6%
ByteDance Seed 1.6100100100989097.5%
Gemma 3 12B100100100949397.5%
Gemini 3.1 Flash Lite (Preview)100100100979097.4%
DeepSeek V3.21009998979397.4%
DeepSeek V4 Flash (Reasoning)10010098979297.3%
Gemma 4 31B (Reasoning)100100100949297.1%
Mistral Large 31009996959396.8%
Mistral Medium 3.5 (Reasoning)10010096959396.7%
Aion 3.5 (Reasoning, High)10010096949396.6%
Gemini 3.1 Flash Lite10010097969196.6%
Claude Opus 41009796959596.6%
Nemotron 3 Nano10010096959296.5%
Gemini 2.5 Pro10010096949396.5%
ByteDance Seed 1.6 Flash1009896959396.4%
Gemini 3 Flash (Preview)10010098959096.4%
Hermes 3 70B10010095949196.1%
Gemini 3.1 Flash Lite (Reasoning)100100100978396.0%
Ministral 3 3B100100100968496.0%
Gemma 4 26B999797949195.7%
Mistral Large 21009996968895.6%
DeepSeek V3.11009696959195.6%
Z.AI GLM 4.610010096938895.6%
Claude Sonnet 4.610010096948494.9%
Cohere Command R+ (Aug. 2024)100100100888494.4%
Gemini 2.5 Flash Lite1009693918994.0%
Mistral NeMO1009998957893.9%
Z.AI GLM 4.7 Flash10010092918493.5%
Qwen 2.5 72B10010099967193.1%
Mistral Small 3.2 24B1009792898792.8%
Laguna S 2.110010093868592.7%
ByteDance Seed 2.0 Mini10010099877892.7%
Llama 3.1 70B1009796837089.2%
ByteDance Seed 2.0 Lite989679737283.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.4100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
Mistral Small 4100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Qwen 3.7 Max10010010010010099.9%
Writer: Palmyra X510010010010010099.9%
Grok 4.2010010010010010099.9%
MiniMax M2.710010010010010099.9%
GPT-5.4 Nano (Reasoning)10010010010010099.9%
Muse Spark 1.2 (Reasoning, Medium)1001001001009999.9%
Aion 3.01001001001009999.9%
Qwen 3.5 397B A17B1001001001009999.8%
Z.AI GLM 51001001001009999.8%
Grok 4.3 (Reasoning)1001001001009999.8%
Claude Sonnet 4.51001001001009999.8%
GPT-5.4 (Reasoning)1001001001009999.8%
DeepSeek V3 (2025-03-24)1001001001009999.8%
Ministral 3 3B1001001001009999.8%
Qwen 3.5 122B1001001001009999.8%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001009999.8%
Mistral Small 4 (Reasoning)1001001001009999.7%
Z.AI GLM 5.2 (Reasoning, High)100100100999999.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001009999.7%
GPT-5.4 Mini (Reasoning, Low)1001001001009899.7%
Qwen 3 235B A22B Instruct 2507100100100999999.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009899.6%
Mistral Large 31001001001009899.6%
GPT-5 Mini1001001001009999.6%
Qwen 3.5 35B1001001001009899.6%
Qwen 3.5 Flash1001001001009899.6%
MiniMax M2.51001001001009999.6%
Mistral Large 21001001001009899.6%
Z.AI GLM 5.11001001001009899.6%
Claude Opus 4.61001001001009899.6%
DeepSeek V4 Pro1001001001009899.5%
Gemini 3.6 Flash (Reasoning)1001001001009899.5%
Muse Spark 1.1 (Reasoning, Medium)1001001001009899.5%
Grok 4.6 (Reasoning, High)1001001001009799.5%
Thinking Machines Inkling Small (Reasoning, High)1001001001009799.5%
Z.AI GLM 5.3 (Reasoning, Max)100100100999899.5%
GPT-4.1 Mini1001001001009799.4%
Qwen 3.5 9B1001001001009799.4%
DeepSeek V4 Pro (Reasoning)10010099999899.4%
Aion 3.5 (Reasoning, High)1001001001009799.4%
Claude Opus 4.5100100100989899.3%
Thinking Machines Inkling100100100999799.3%
Nemotron 3 Super1001001001009699.3%
Qwen 3.5 27B1001001001009699.3%
Qwen 3.8 27B (Reasoning, XHigh)1001001001009699.3%
Gemini 2.5 Flash (Reasoning)1001001001009699.3%
Aion 3.5 Mini (Reasoning, High)1001001001009699.2%
GPT-5.4 Nano (Reasoning, Low)1001001001009699.2%
Mistral Medium 3.5 (Reasoning)100100100989899.2%
Hermes 3 405B1001001001009699.2%
Mistral Medium 3.5100100100999799.2%
Xiaomi MIMO v2.6 Pro1001001001009699.1%
Muse Spark 1.1 (Reasoning, Minimal)100100100999699.1%
Gemini 2.5 Flash100100100989799.1%
Grok 4.7 (Reasoning, High)1001001001009599.0%
Gemini 3.5 Flash Lite (Reasoning)1001001001009599.0%
Claude Opus 4.8 (Reasoning, Low)10010098989898.9%
Gemma 3 12B10010099999698.9%
MiniMax M31001001001009498.7%
Claude Haiku 4.5100100100979698.7%
GPT-4o Mini (temp=1)1001001001009398.7%
Claude Sonnet 5 (Reasoning)100100100979698.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010099979698.6%
DeepSeek V4 Flash 0731 (Reasoning, High)10010099979798.5%
Gemma 4 26B (Reasoning)10010098989798.5%
Claude Haiku 5.5 (Adaptive)1001001001009298.4%
Thinking Machines Inkling (Reasoning)1001001001009298.4%
Claude Opus 4.6 (Reasoning)10010099979698.3%
Gemma 3 27B1009999979698.3%
Gemini 3.8 Flash (Reasoning, Medium)100100100989398.2%
Gemini 3.7 Flash (Reasoning, Medium)100100100989398.2%
DeepSeek V3 (2024-12-26)100100100959598.1%
DeepSeek V3.210010099979598.0%
Qwen 3 32B10010099969498.0%
Claude Haiku 5.5 (Reasoning, Low)10010094 – – 98.0%
Claude Opus 510010099979498.0%
Arcee AI: Trinity Mini1001001001009097.9%
Mistral Medium 3.110010099989397.9%
Gemini 3.5 Flash (Reasoning)100100100989297.9%
GPT-4o Mini (temp=0)1001001001008997.7%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100969297.6%
Claude Sonnet 4.6 (Reasoning)1009998959597.5%
DeepSeek V4 Flash (Reasoning)100100100969297.5%
Inception Mercury 210010099979297.5%
DeepSeek-V2 Chat1001001001008897.5%
Gemini 3.1 Flash Lite10010097979397.5%
Claude Opus 5 (Reasoning, Low)100100100988997.5%
Gemini 3.1 Flash Lite (Reasoning)100100100988997.4%
Gemini 2.5 Flash Lite (Reasoning)100100100949397.3%
DeepSeek V4 Flash100100100949397.3%
WizardLM 2 8x22b1009797969597.3%
Laguna S 2.110010099979097.2%
Aion 2.010010098949397.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100959097.0%
DeepSeek V4.1 Flash (Reasoning, High)10010099988897.0%
Gemma 4 31B (Reasoning)100100100949096.9%
Gemini 3 Flash (Preview, Reasoning)1001001001008596.9%
Z.AI GLM 4.510010096959296.7%
Cohere Command R+ (Aug. 2024)10010096939396.5%
GPT-OSS 120B1001001001008296.5%
Claude Haiku 5.5 (Reasoning, Medium)1009996969196.4%
Gemini 2.5 Pro1009796969396.3%
Mistral Large 4.010010096939396.3%
Xiaomi MIMO v2.6 Flash10010095959096.2%
Z.AI GLM 4.5 Air100100100958696.2%
Z.AI GLM 4.71009998968796.1%
Claude Opus 5 (Reasoning)10010097929196.1%
GPT-5 Nano1009998949096.1%
Ministral 3 8B10010095939296.0%
Llama 3.1 70B10010096939095.9%
ByteDance Seed 1.6 Flash1009895939295.8%
Gemma 4 31B10010094939295.8%
Z.AI GLM 4.7 Flash1009997938995.6%
Claude Opus 4.71009999938895.6%
Gemini 3 Flash (Preview)10010096938995.6%
Ministral 3B1001001001007895.5%
Nemotron 3 Nano10010098918995.4%
Gemini 3.1 Flash Lite (Preview)10010098968295.4%
Ministral 8B1009997958695.1%
Gemma 3 4B1009897919095.1%
Claude Opus 4.8 (Reasoning)989595949395.0%
Gemma 4 26B1009797968394.6%
Claude Sonnet 4.61009594949094.3%
Claude Opus 4.7 (Reasoning)1009994938594.2%
Hermes 3 70B1001001001007094.0%
GPT-4o, Aug. 6th (temp=0)10010096908393.9%
GPT-4.1 Nano10010097977593.9%
Mistral NeMO1009993898893.9%
Qwen 2.5 72B10010093908693.8%
Z.AI GLM 4.6979695938693.4%
DeepSeek V3.110010098977293.3%
Xiaomi MIMO v2.51009795938393.3%
ByteDance Seed 1.610010094908092.6%
Gemini 2.5 Flash Lite1009891917991.8%
Cydonia 24B V4.110010090888091.5%
ByteDance Seed 2.0 Lite989795867991.1%
ByteDance Seed 2.0 Mini1009489878190.1%
Laguna XS 2.11008684847986.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)10010010010010099.9%
Mistral Medium 3.510010010010010099.9%
Thinking Machines Inkling (Reasoning)10010010010010099.9%
Mistral NeMO10010010010010099.9%
GPT-5.41001001001009999.9%
Gemini 3.8 Flash (Reasoning, Medium)1001001001009999.9%
Gemini 3.6 Flash (Reasoning)1001001001009999.9%
Kimi K3 (Reasoning, High)1001001001009999.9%
Grok 4.3 (Reasoning)1001001001009999.8%
GPT-4o, Aug. 6th (temp=1)1001001001009999.8%
Mistral Small 41001001001009999.8%
Qwen 3 32B1001001001009999.8%
GPT-5.6 Terra1001001001009999.8%
Muse Spark 1.2 (Reasoning, Medium)1001001001009999.8%
GPT-6 Luna (Reasoning, Medium)1001001001009999.8%
GPT-4o, Aug. 6th (temp=0)1001001001009999.8%
Thinking Machines Inkling1001001001009999.8%
GPT-5.4 Nano100100100999999.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009999.7%
DeepSeek-V2 Chat1001001001009899.6%
Writer: Palmyra X51001001001009899.6%
Z.AI GLM 4.7100100100999999.6%
Mistral Large 21001001001009899.6%
Claude Sonnet 5.5 (Reasoning)1001001001009899.6%
Gemini 2.5 Flash (Reasoning)1001001001009899.6%
Z.AI GLM 5100100100999999.6%
Gemini 2.5 Flash1001001001009899.5%
Kimi K3 (Reasoning, Low)100100100999999.5%
Qwen 3.5 Flash1001001001009899.5%
Muse Spark 1.3 (Reasoning, Medium)100100100999999.5%
Gemma 4 31B (Reasoning)1001001001009899.5%
DeepSeek V4 Flash (Reasoning)1001001001009899.4%
GPT-5.4 Nano (Reasoning)1001001001009799.4%
Gemini 3.7 Flash (Reasoning, Medium)100100100999899.4%
DeepSeek V3.21009999999999.4%
Grok 4.5 (Reasoning, High)1001001001009799.3%
GPT-5.4 Nano (Reasoning, Low)100100100989899.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009799.3%
Qwen 3.5 Plus (2026-02-15)100100100989899.3%
GPT-5.4 Mini1001001001009699.2%
Qwen 3.6 27B1001001001009699.2%
Ministral 3 14B1001001001009699.1%
Claude Opus 4.51001001001009699.1%
Z.AI GLM 5 Turbo1001001001009699.1%
GPT-4.1 Mini100100100989899.1%
GPT-5.21001001001009599.1%
GPT-4o Mini (temp=1)1001001001009699.1%
Kimi K2.51001001001009599.0%
Mistral Large 4.0 (Reasoning)100100100999699.0%
Nemotron 3 Super100100100999699.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100989899.0%
Gemma 4 31B1001001001009599.0%
Nemotron 3 Nano1001001001009599.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099989899.0%
Ministral 3 3B10010099989798.9%
DeepSeek V3 (2024-12-26)100100100999598.9%
MiniMax M2.51001001001009498.9%
GPT-4.1 Nano100100100999598.9%
Grok 4.31001001001009498.9%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001009498.8%
DeepSeek V4 Pro (Reasoning)100100100989698.8%
Claude Opus 5 (Reasoning, Low)1001001001009498.8%
Laguna S 2.11001001001009498.7%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009398.7%
Xiaomi MIMO v2.6 Pro100100100979798.7%
Aion 2.01001001001009398.6%
Cydonia 24B V4.1100100100999598.6%
Z.AI GLM 5.3 (Reasoning, Max)10010099989698.6%
Aion 3.5 (Reasoning, High)10010099999598.6%
DeepSeek V3 (2025-03-24)100100100989598.6%
Z.AI GLM 4.5 Air1001001001009398.5%
MiniMax M2.7100100100979698.5%
Muse Spark 1.1 (Reasoning, Minimal)100100100989598.5%
Z.AI GLM 5.11001001001009398.5%
Gemma 3 27B100100100989498.5%
WizardLM 2 8x22b100100100999398.5%
Z.AI GLM 5.2 (Reasoning, High)100100100989598.5%
ByteDance Seed 1.6 Flash10010098989698.4%
Hermes 3 405B1001001001009298.4%
Aion 3.010010099989498.3%
Grok 4.6 (Reasoning, High)100100100979498.3%
Claude Sonnet 4.5100100100969598.2%
GPT-5 Mini100100100969498.0%
Gemini 3 Flash (Preview, Reasoning)1001001001009098.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009097.9%
Gemini 2.5 Flash Lite100100100969397.9%
Ministral 3 8B10010099969497.9%
Qwen 2.5 72B1001001001009097.9%
Gemini 3.5 Flash Lite (Reasoning)100100100979297.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001008997.8%
Qwen 3.8 Flash (Reasoning)100100100998997.8%
Claude Sonnet 4100100100969397.7%
Ministral 8B100100100959497.7%
Arcee AI: Trinity Mini1001001001008997.7%
Hermes 3 70B100100100969397.7%
Claude Opus 4.61009997979597.6%
Claude Opus 4.8 (Reasoning, Low)10010099969397.6%
Aion 3.0 Mini1009998969497.6%
Claude Sonnet 5 (Reasoning, Low)999998979697.6%
GPT-5 Nano100100100979097.5%
Qwen 3.5 9B10010099969297.4%
Xiaomi MIMO v2.5 Pro1001001001008797.4%
Gemini 3.1 Flash Lite10010099949497.4%
Gemini 3.1 Flash Lite (Preview)100100100949397.4%
DeepSeek V4 Flash100100100998797.3%
Gemini 2.5 Flash Lite (Reasoning)1009998969397.2%
Claude Haiku 4.510010098949497.2%
DeepSeek V4 Pro100100100939397.1%
Claude Opus 4.8 (Reasoning)100100100949197.0%
Thinking Machines Inkling Small (Reasoning, High)10010098978996.9%
Gemini 2.5 Pro100100100978796.8%
Gemini 3.1 Flash Lite (Reasoning)1001001001008396.6%
Z.AI GLM 4.7 Flash1009997959296.6%
Mistral Medium 3.11001001001008396.6%
ByteDance Seed 1.610010096969196.5%
Aion 3.5 Mini (Reasoning, High)1001001001008296.4%
Gemma 4 26B (Reasoning)10010099939096.4%
Xiaomi MIMO v2.510010099968796.3%
MiniMax M31009997959196.3%
Gemma 4 26B10010096929296.0%
Claude Sonnet 5 (Reasoning)10010098948896.0%
ByteDance Seed 2.0 Lite10010096968795.9%
Qwen 3.7 Max100100100918895.7%
Mistral Large 3100100100908895.7%
Claude Opus 510010094948995.6%
Mistral Large 4.010010097958695.5%
ByteDance Seed 2.0 Mini1009998918995.3%
Mistral Small 3.2 24B1001001001007695.2%
Laguna XS 2.110010094938995.2%
Cohere Command R+ (Aug. 2024)10010096938695.1%
Gemma 3 12B1009796919094.9%
Xiaomi MIMO v2.6 Flash10010095928894.9%
Z.AI GLM 4.610010093929094.8%
Claude Sonnet 4.6 (Reasoning)979494939394.4%
Claude Opus 4.7100100100918094.2%
Claude Haiku 5.5 (Reasoning, Low)10010082 – – 94.0%
Claude Haiku 5.5 (Adaptive)979696968393.7%
Claude Sonnet 51009898888493.6%
Claude Opus 4.7 (Reasoning)10010099917893.5%
Claude Opus 5 (Reasoning)1009692909093.4%
DeepSeek V3.11009996868593.3%
Gemma 3 4B1009592918793.1%
Ministral 3B10010088888692.5%
Gemini 3 Flash (Preview)1009994858291.9%
Claude Sonnet 4.6979391908891.9%
Claude Haiku 5.5 (Reasoning, Medium)969696838190.3%
Llama 3.1 70B1008988806283.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)10010010010010099.9%
GPT-4.1 Mini10010010010010099.9%
Inception Mercury 21001001001009999.9%
Kimi K3 (Reasoning, High)1001001001009999.9%
Grok 4.201001001001009999.8%
Claude Opus 5.5 (Reasoning)1001001001009999.8%
GPT-5.5 (Reasoning, Low)1001001001009999.8%
o4 Mini High1001001001009899.7%
GPT-5.6 Luna (Reasoning, Medium)1001001001009999.7%
Qwen 3.6 27B1001001001009899.6%
Qwen 3.5 397B A17B100100100999899.6%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009899.5%
GPT-5.4 Mini (Reasoning)100100100999999.5%
GPT-5.4 Mini100100100999899.4%
Writer: Palmyra X51001001001009799.4%
GPT-5.6 Terra100100100999799.3%
Claude Sonnet 5 (Reasoning, Low)10010099999899.3%
Qwen 3.5 27B100100100999799.2%
GPT-5.4 Nano (Reasoning)100100100999799.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100999799.2%
Kimi K2.51001001001009699.2%
Hy4 Preview (Reasoning, High)1001001001009699.2%
Claude Opus 4.8 (Reasoning, Low)100100100989899.2%
MiniMax M2.71001001001009699.1%
GPT-OSS 120B100100100989799.1%
Gemini 3.6 Flash (Reasoning)1001001001009599.1%
Thinking Machines Inkling1001001001009599.0%
DeepSeek-V2 Chat100100100989798.9%
Qwen 3.5 Plus (2026-02-15)1001001001009598.9%
GPT-6 Luna100100100989698.9%
Claude Sonnet 5.5 (Reasoning)100100100989698.8%
Grok 4.6 (Reasoning, High)100100100999698.8%
Grok 4.20 (Reasoning)100100100999598.8%
GPT-5100100100979798.8%
Claude Opus 41001001001009498.8%
Z.AI GLM 510010099989698.7%
Nemotron 3 Super1009999999798.7%
GPT-5.4 (Reasoning, Low)100100100989598.6%
Grok 4.3 (Reasoning)100100100989498.5%
Gemini 3.5 Flash Lite (Reasoning)10010099989598.4%
Claude Sonnet 5 (Reasoning)1001001001009298.4%
GPT-5.210010097979798.4%
Claude Sonnet 4.510010098979698.3%
Kimi K3 (Reasoning, Low)100100100989498.2%
Xiaomi MIMO v2.6 Pro100100100999298.2%
Hermes 3 405B100100100989398.2%
DeepSeek V3 (2025-03-24)10010097979698.1%
Gemini 3.5 Flash (Reasoning)100100100969498.1%
Gemini 2.5 Flash (Reasoning)10010099989398.1%
GPT-5.4 Nano (Reasoning, Low)10010098969598.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100969498.0%
Gemini 2.5 Flash1009897979797.9%
GPT-4o Mini (temp=1)100100100999197.9%
Hermes 3 70B10010097969697.9%
GPT-4o Mini (temp=0)10010099969497.7%
Claude Opus 4.8 (Reasoning)100100100949497.6%
DeepSeek V4 Flash10010099998997.5%
DeepSeek V4 Pro (Reasoning)10010097969497.4%
Qwen 3.5 9B1001001001008697.2%
Claude Opus 4.6 (Reasoning)10010097959397.1%
GPT-5.4999998969497.0%
Aion 3.0 Mini1009897959497.0%
Claude Haiku 4.51009997969397.0%
Thinking Machines Inkling (Reasoning)100100100998596.9%
Muse Spark 1.2 (Reasoning, Medium)100100100998596.9%
Qwen 3 32B100100100929296.8%
Muse Glimmer 30B (Reasoning, Medium)1009897979296.8%
Claude Sonnet 41009896969396.6%
DeepSeek V3 (2024-12-26)1001001001008396.6%
GPT-5.4 Mini (Reasoning, Low)1009896969396.6%
Ministral 3B100100100998496.5%
Xiaomi MIMO v2.5 Pro10010097959096.4%
Nemotron 3 Nano100100100988496.4%
Gemini 3.6 Flash (Reasoning, Minimal)100100100978596.2%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009997959096.1%
Qwen 3.5 122B100100100918996.1%
DeepSeek V4 Flash (Reasoning)1009996969096.1%
Claude Opus 4.5100100100938796.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100988195.9%
Muse Spark 1.1 (Reasoning, Medium)10010098958695.8%
Qwen 3.8 Flash (Reasoning)100100100908995.7%
Z.AI GLM 5.2 (Reasoning, High)1009797968995.7%
Muse Spark 1.1 (Reasoning, Minimal)999896959095.7%
ByteDance Seed 1.6 Flash1009994939295.6%
Mistral Large 4.0999897948995.5%
Z.AI GLM 5.110010097918995.4%
GPT-5.4 Nano1009997919095.4%
Thinking Machines Inkling Small (Reasoning, High)999999928995.4%
Gemma 4 31B (Reasoning)10010096928895.2%
Ministral 3 3B10010098948495.1%
Qwen 3.5 Flash10010096968495.1%
Aion 3.5 (Reasoning, High)1009896938995.1%
Gemini 3.5 Flash (Reasoning, Minimal)100100100958195.1%
Mistral NeMO100100100898695.1%
Mistral Small 4 (Reasoning)1009795938995.0%
Qwen 3.5 35B989696949195.0%
MiniMax M310010097928594.9%
GPT-5 Nano989894929294.9%
Gemma 4 26B (Reasoning)1009695929094.8%
Aion 3.5 Mini (Reasoning, High)10010097928594.7%
Gemma 3 27B10010094938694.6%
GPT-5 Mini1009898968194.6%
Mistral Small 410010097928494.6%
Mistral Medium 3.5 (Reasoning)10010096888794.4%
Gemma 3 12B1009695948794.4%
Qwen 3.7 Max10010097898694.4%
Claude Opus 4.61009796908994.4%
Claude Sonnet 4.6 (Reasoning)1009894928794.3%
Mistral Small 3.2 24B100100100977494.3%
Aion 3.0989896918894.2%
Xiaomi MIMO v2.510010099908194.1%
Mistral Large 4.0 (Reasoning)10010097947994.0%
Gemini 3.1 Flash Lite (Reasoning)1009692919094.0%
Mistral Medium 3.51009991909093.9%
Z.AI GLM 4.7 Flash1009896948293.9%
Ministral 8B999796918793.8%
Z.AI GLM 4.5 Air1009897898493.7%
Aion 2.01009994888893.6%
Cohere Command R+ (Aug. 2024)100100100987093.6%
Gemma 4 31B10010095878693.5%
GPT-4.1 Nano1009790909093.3%
Laguna XS 2.11009996957693.3%
Claude Sonnet 5989797918293.2%
Claude Haiku 5.5 (Reasoning, Low)9888 – – – 93.1%
Laguna S 2.1100100100858193.0%
Claude Haiku 5.5 (Adaptive)979694928593.0%
Z.AI GLM 4.510010090908593.0%
Ministral 3 8B1009892888792.8%
Claude Opus 5 (Reasoning, Low)979794928492.8%
Arcee AI: Trinity Mini10010092888492.8%
Z.AI GLM 5 Turbo10010094947592.7%
GPT-4o, Aug. 6th (temp=0)1009695918292.6%
DeepSeek V4 Flash 0731 (Reasoning, High)1009493928592.6%
Cydonia 24B V4.11009996888092.4%
Z.AI GLM 4.71009595868592.3%
Xiaomi MIMO v2.6 Flash999995947492.1%
Mistral Medium 3.1969594888691.9%
Gemma 3 4B1009691908291.7%
DeepSeek V3.2989590898391.1%
Claude Opus 51009891868191.0%
MiniMax M2.5969593888290.9%
ByteDance Seed 1.61009089898790.9%
DeepSeek V4.1 Flash (Reasoning, High)1009892897690.9%
Ministral 3 14B969493908190.8%
DeepSeek V4 Pro 0813 (Reasoning, High)1009589868390.6%
Gemini 3.1 Flash Lite1009994817890.4%
Gemini 3.1 Flash Lite (Preview)979391868490.3%
Claude Opus 5 (Reasoning)1009894827790.2%
Llama 3.1 70B1009996946189.9%
WizardLM 2 8x22b959492848489.8%
Gemini 3 Flash (Preview, Reasoning)1009292848189.6%
Gemini 2.5 Pro1009592897289.5%
DeepSeek V4 Pro10010091906689.4%
Claude Haiku 5.5 (Reasoning, Medium)1009391847889.3%
Claude Opus 4.7 (Reasoning)1009087848389.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009589857488.8%
Mistral Large 21009998836588.8%
Gemini 2.5 Flash Lite989791817688.7%
Mistral Large 3969188877888.0%
DeepSeek V3.1999288867588.0%
Claude Opus 4.71008886838287.9%
Gemini 2.5 Flash Lite (Reasoning)969087838387.6%
Claude Sonnet 4.61009588787487.2%
ByteDance Seed 2.0 Mini979691886487.0%
Z.AI GLM 4.61009683817587.0%
Gemini 3 Flash (Preview)958985857986.5%
Gemma 4 26B969285807986.1%
Qwen 2.5 72B968985796983.5%
ByteDance Seed 2.0 Lite1007877745777.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)10010010010010099.9%
GPT-4o Mini (temp=1)10010010010010099.9%
GPT-5.4 (Reasoning, Low)10010010010010099.9%
GPT-5.410010010010010099.9%
Claude Opus 510010010010010099.9%
Z.AI GLM 4.5 Air10010010010010099.9%
Gemma 4 26B (Reasoning)10010010010010099.9%
Thinking Machines Inkling1001001001009999.9%
Aion 3.5 (Reasoning, High)1001001001009999.9%
Claude Sonnet 41001001001009999.9%
Mistral Small 3.2 24B1001001001009999.9%
Hermes 3 405B1001001001009999.8%
DeepSeek V4 Pro1001001001009999.8%
Claude Opus 4.6 (Reasoning)1001001001009999.8%
Z.AI GLM 4.51001001001009999.8%
GPT-5.4 (Reasoning)1001001001009999.8%
DeepSeek-V2 Chat1001001001009999.8%
Qwen 3 32B1001001001009999.8%
Aion 3.01001001001009999.8%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001009999.7%
Grok 4.6 (Reasoning, High)1001001001009999.7%
Claude Opus 4.51001001001009999.7%
Thinking Machines Inkling (Reasoning)1001001001009999.7%
GPT-5.4 Nano (Reasoning, Low)1001001001009999.7%
Gemini 3.1 Flash Lite1001001001009999.7%
Aion 3.0 Mini1001001001009899.7%
DeepSeek V3 (2025-03-24)1001001001009899.6%
Mistral NeMO1001001001009899.6%
Qwen 3 235B A22B Instruct 25071001001001009899.6%
Qwen 3.5 397B A17B1001001001009899.6%
DeepSeek V4 Pro (Reasoning)1001001001009899.6%
Arcee AI: Trinity Mini100100100999999.6%
Gemini 3.7 Flash (Reasoning, Medium)100100100999899.6%
Claude Sonnet 5.5 (Reasoning)1001001001009899.5%
GPT-5.6 Luna (Reasoning, Medium)1001001001009799.5%
Gemini 2.5 Flash1001001001009799.5%
Gemma 4 31B (Reasoning)100100100999899.5%
Qwen 3.5 27B1001001001009799.5%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009799.5%
Xiaomi MIMO v2.6 Pro1001001001009799.4%
Muse Spark 1.1 (Reasoning, Medium)100100100999899.4%
Gemini 3.5 Flash (Reasoning)100100100999899.4%
Mistral Medium 3.5100100100999899.3%
Mistral Large 21001001001009699.3%
Claude Opus 5.5 (Reasoning)1001001001009699.3%
Z.AI GLM 4.71001001001009699.2%
Qwen 3.5 Flash1001001001009699.2%
Mistral Medium 3.5 (Reasoning)100100100999799.2%
Qwen 3.5 122B1001001001009699.2%
Mistral Medium 3.110010099999899.2%
GPT-5 Mini100100100999799.2%
Gemini 3.5 Flash Lite (Reasoning)1001001001009699.2%
GPT-4.1 Mini1001001001009699.1%
Gemini 2.5 Flash (Reasoning)1001001001009699.1%
Z.AI GLM 4.61001001001009699.1%
Gemini 3 Flash (Preview)100100100999699.1%
Mistral Small 4 (Reasoning)1001001001009599.1%
Claude Opus 5 (Reasoning)1001001001009699.0%
Z.AI GLM 4.7 Flash10010099989899.0%
ByteDance Seed 1.6 Flash1001001001009599.0%
Mistral Small 41001001001009599.0%
Xiaomi MIMO v2.5 Pro100100100999698.9%
Gemma 3 12B100100100989698.9%
Hy4 Preview (Reasoning, High)100100100999598.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009498.9%
Gemma 3 4B1001001001009498.8%
Xiaomi MIMO v2.6 Flash100100100999598.8%
GPT-4.1 Nano100100100999598.7%
Gemma 4 31B1001001001009498.7%
MiniMax M310010099989698.7%
Inception Mercury 21001001001009398.7%
Laguna S 2.11001001001009498.6%
Claude Haiku 4.5100100100979698.6%
Ministral 3B100100100989598.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100989498.4%
DeepSeek V4 Flash 0731 (Reasoning, High)10010098989698.3%
Kimi K3 (Reasoning, High)100100100999298.3%
Gemini 2.5 Flash Lite1009999989698.3%
Mistral Large 31001001001009198.3%
GPT-5 Nano10010099969698.2%
Gemini 2.5 Flash Lite (Reasoning)100100100979398.2%
GPT-4o Mini (temp=0)10010099999398.1%
DeepSeek V4 Flash100100100969498.1%
Claude Sonnet 510010097969698.0%
Kimi K3 (Reasoning, Low)1001001001009097.9%
Z.AI GLM 5.3 (Reasoning, Max)1001001001008997.9%
Claude Sonnet 5 (Reasoning)1001001001008897.6%
Gemini 3.1 Flash Lite (Reasoning)10010099989297.6%
Qwen 2.5 72B100100100959397.6%
Claude Opus 4.7100100100969297.5%
DeepSeek V3.2999898979697.5%
Laguna XS 2.110010099959397.5%
Xiaomi MIMO v2.510010099979197.4%
Ministral 3 3B10010096959597.4%
ByteDance Seed 1.610010099979197.3%
Cydonia 24B V4.11001001001008697.2%
Ministral 3 8B1001001001008697.2%
GPT-4o, Aug. 6th (temp=0)1001001001008597.1%
Cohere Command R+ (Aug. 2024)1001001001008596.9%
Gemini 3.1 Flash Lite (Preview)1009898959496.8%
Gemma 3 27B10010096959396.7%
Gemma 4 26B10010098939296.7%
Ministral 8B1009898949296.5%
Nemotron 3 Nano100100100968696.4%
Thinking Machines Inkling Small (Reasoning, High)100100100928896.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099998296.0%
GPT-4o, Aug. 6th (temp=1)100100100997995.7%
Aion 3.5 Mini (Reasoning, High)100100100958295.3%
ByteDance Seed 2.0 Mini1009997928895.3%
Claude Sonnet 4.6 (Reasoning)10010098938394.9%
Claude Opus 4.7 (Reasoning)1009995919094.9%
Claude Haiku 5.5 (Reasoning, Medium)100100100878794.8%
Llama 3.1 70B10010096928694.8%
Claude Sonnet 4.610010096948294.2%
Claude Haiku 5.5 (Adaptive)10010098868493.7%
Gemini 2.5 Pro1009692909093.7%
Hermes 3 70B100100100977093.5%
Qwen 3.5 35B1001001001003987.8%
ByteDance Seed 2.0 Lite10010097525079.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-6 Luna100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.310010010010010099.9%
Qwen 3.5 122B10010010010010099.9%
GPT-5.410010010010010099.9%
GPT-4.1 Nano10010010010010099.9%
Claude Sonnet 5.5 (Reasoning)1001001001009999.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009999.8%
Claude Opus 41001001001009999.8%
Qwen 3.5 397B A17B1001001001009999.8%
Muse Spark 1.1 (Reasoning, Minimal)100100100999999.8%
Qwen 3.5 Plus (2026-02-15)1001001001009999.8%
Qwen 3.6 35B1001001001009999.7%
Grok 4.6 (Reasoning, High)1001001001009999.7%
Claude Sonnet 5 (Reasoning, Low)1001001001009999.7%
Inception Mercury 21001001001009999.7%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009999.7%
Mistral Large 4.01001001001009999.7%
Gemini 3.5 Flash (Reasoning)1001001001009899.7%
DeepSeek V3 (2024-12-26)1001001001009899.6%
Claude Sonnet 41001001001009899.6%
Mistral Small 4 (Reasoning)100100100999999.6%
Qwen 3.6 27B1001001001009899.6%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009799.5%
Aion 3.01001001001009799.5%
Muse Spark 1.1 (Reasoning, Medium)1001001001009799.4%
GPT-5.21001001001009799.3%
GPT-OSS 120B100100100999899.3%
Gemini 2.5 Flash1001001001009799.3%
Mistral Small 3.2 24B1001001001009699.3%
Qwen 3.5 27B100100100999899.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009699.3%
Gemini 3.1 Flash Lite (Preview)1001001001009699.3%
Mistral Large 4.0 (Reasoning)1001001001009699.3%
DeepSeek-V2 Chat1001001001009699.3%
Qwen 3 32B100100100999799.2%
Claude Opus 4.8 (Reasoning, Low)1001001001009699.2%
Gemini 2.5 Flash (Reasoning)1001001001009799.2%
Claude Opus 4.6100100100999799.1%
Claude Opus 4.5100100100989799.1%
Thinking Machines Inkling (Reasoning)100100100999799.1%
Gemma 4 26B10010099999799.1%
Z.AI GLM 5.11001001001009599.0%
Nemotron 3 Super1001001001009599.0%
MiniMax M2.7100100100999699.0%
Qwen 3.5 9B100100100989799.0%
Grok 4.3 (Reasoning)100100100999699.0%
GPT-5.4 Nano (Reasoning, Low)10010099999699.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009599.0%
GPT-5.4 Mini (Reasoning, Low)1001001001009599.0%
GPT-4o Mini (temp=1)1001001001009598.9%
Muse Glimmer 30B (Reasoning, Medium)100100100999598.9%
Aion 3.5 Mini (Reasoning, High)1001001001009498.9%
DeepSeek V3 (2025-03-24)1001001001009498.8%
Z.AI GLM 5.2 (Reasoning, High)100100100989698.8%
Gemma 4 31B (Reasoning)1001001001009498.8%
Xiaomi MIMO v2.6 Flash10010099999798.7%
Qwen 3.8 Flash (Reasoning)100100100989598.6%
Kimi K3 (Reasoning, Low)100100100979698.5%
Ministral 3 14B100100100989598.5%
Thinking Machines Inkling Small (Reasoning, High)10010099989598.4%
MiniMax M31001001001009298.4%
DeepSeek V3.210010099979698.4%
Aion 3.0 Mini1001001001009298.4%
Aion 3.5 (Reasoning, High)1009898989798.4%
Z.AI GLM 4.71009998979798.4%
MiniMax M2.5100100100979598.3%
GPT-5.4 Nano10010098989598.3%
GPT-5.4 Nano (Reasoning)100100100999298.2%
Claude Opus 4.6 (Reasoning)1001001001009198.2%
Z.AI GLM 4.5 Air100100100999298.2%
Claude Sonnet 5 (Reasoning)100100100969598.2%
WizardLM 2 8x22b100100100999298.2%
Claude Opus 5 (Reasoning, Low)100100100969598.2%
Z.AI GLM 5 Turbo1009998989598.1%
Gemma 4 26B (Reasoning)10010099989498.1%
Claude Sonnet 4.6 (Reasoning)10010097979698.1%
Mistral Medium 3.5 (Reasoning)10010098969698.1%
Claude Opus 4.7 (Reasoning)100100100999298.1%
Gemini 3 Flash (Preview, Reasoning)10010099989398.1%
Mistral Medium 3.11001001001009097.9%
GPT-5 Mini10010099979497.9%
Z.AI GLM 4.510010099989397.9%
Llama 3.1 70B100100100999197.8%
DeepSeek V4 Flash (Reasoning)1001001001008997.8%
Ministral 3 3B1001001001008997.8%
Z.AI GLM 5.3 (Reasoning, Max)100100100969397.8%
Gemma 3 12B1009999989397.8%
Xiaomi MIMO v2.510010099969397.7%
ByteDance Seed 1.6 Flash100100100979297.7%
Thinking Machines Inkling1001001001008997.7%
GPT-4o Mini (temp=0)100100100979197.6%
Gemini 3.5 Flash Lite (Reasoning)1001001001008897.6%
Cohere Command R+ (Aug. 2024)10010099998997.5%
Qwen 3.5 35B10010097969397.4%
Gemma 3 4B10010097969397.3%
DeepSeek V4 Flash1009897969597.3%
GPT-5 Nano10010099969197.2%
DeepSeek V4 Pro 0813 (Reasoning, High)10010099949397.2%
Cydonia 24B V4.1100100100969097.2%
Claude Sonnet 4.610010098979097.1%
Xiaomi MIMO v2.5 Pro10010097959397.1%
Mistral Small 410010098979197.1%
Ministral 3B10010099969097.0%
Claude Haiku 4.5100100100988797.0%
Claude Opus 4.8 (Reasoning)100100100958996.8%
Z.AI GLM 4.7 Flash10010096949496.8%
Claude Haiku 5.5 (Reasoning, Medium)10010097969096.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009797979296.6%
Kimi K3 (Reasoning, High)100100100948996.5%
Hermes 3 70B100100100998396.4%
Gemma 4 31B1009998949196.2%
ByteDance Seed 1.61009895959396.2%
Laguna S 2.1100100100948596.0%
Aion 2.010010099928995.9%
Arcee AI: Trinity Mini100100100928895.9%
Z.AI GLM 510010095949095.7%
DeepSeek V4 Pro (Reasoning)100100100988095.6%
DeepSeek V4.1 Flash (Reasoning, High)1009998958595.5%
Claude Opus 4.710010094939095.3%
Gemini 3.5 Flash (Reasoning, Minimal)10010093929195.3%
DeepSeek V3.11009795948995.2%
ByteDance Seed 2.0 Lite1009996968595.0%
Gemini 3.1 Flash Lite969696959295.0%
Gemini 3.1 Flash Lite (Reasoning)1009796958794.9%
Mistral Large 3999895948994.9%
Gemini 2.5 Pro10010097918794.8%
Gemini 2.5 Flash Lite (Reasoning)10010099898594.6%
Mistral Medium 3.5979796939094.5%
Ministral 3 8B999796948694.4%
Qwen 2.5 72B989694929194.3%
Gemma 3 27B10010093928594.1%
Ministral 8B1009795928694.0%
Mistral Large 21009393929093.7%
Claude Haiku 5.5 (Adaptive)100100100888093.6%
Nemotron 3 Nano100100100977093.4%
Gemini 3 Flash (Preview)999994888693.2%
Claude Opus 51009593908893.1%
Z.AI GLM 4.61009994868693.1%
Laguna XS 2.1979695948292.8%
GPT-4o, Aug. 6th (temp=0)100100100897392.5%
Claude Opus 5 (Reasoning)1009988878792.2%
Claude Sonnet 5969591908791.6%
Gemini 2.5 Flash Lite949392898791.0%
Mistral NeMO989385857887.9%
ByteDance Seed 2.0 Mini948969676677.0%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Claude Opus 4100100100100100100.0%
o4 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)10010010010010099.9%
GPT-6 Luna10010010010010099.9%
GPT-4.1 Mini10010010010010099.9%
Mistral Small 410010010010010099.9%
Mistral Small 4 (Reasoning)1001001001009999.9%
GPT-4.1 Nano1001001001009999.9%
GPT-6 Luna (Reasoning, High)1001001001009999.8%
Writer: Palmyra X51001001001009999.8%
Mistral Medium 3.51001001001009999.8%
Grok 4.201001001001009999.8%
Qwen 3.5 Plus (2026-04-20)100100100999999.7%
GPT-4o, Aug. 6th (temp=0)100100100999999.6%
Grok 4.3 (Reasoning)1001001001009899.6%
Qwen 3.7 Flash (Reasoning)1001001001009899.6%
Gemma 4 31B10010099999999.5%
Qwen 3.5 122B1001001001009899.5%
o4 Mini High1001001001009899.5%
GPT-5.6 Luna (Reasoning, Medium)100100100999899.4%
GPT-6 Sol1001001001009799.4%
Qwen 3.6 Max Preview1001001001009799.3%
GPT-5.41001001001009699.3%
GPT-4o, Aug. 6th (temp=1)100100100999899.3%
GPT-6 Luna (Reasoning, Medium)100100100999799.2%
GPT-5.6 Sol1001001001009699.2%
Grok 4.3100100100989899.2%
GPT-5.5 (Reasoning, Low)1001001001009699.2%
Qwen 3.5 27B100100100989899.1%
Mistral Large 31001001001009599.1%
GPT-5.6 Luna100100100999699.1%
GPT-5.4 (Reasoning, Low)100100100989799.0%
GPT-4o Mini (temp=0)1001001001009699.0%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009599.0%
MiniMax M2.51001001001009599.0%
Z.AI GLM 4.7100100100999699.0%
GPT-5.5100100100989799.0%
GPT-6.1 Sol (Reasoning, Medium)100100100999698.9%
GPT-5.4 (Reasoning)10010099989798.9%
Grok 4.20 (Reasoning)10010099989898.9%
GPT-6 Sol (Reasoning, Medium)100100100999598.8%
Qwen 3.5 Plus (2026-02-15)100100100979798.8%
Z.AI GLM 5100100100979698.7%
Grok 4.7 (Reasoning, High)10010099979798.6%
GPT-5.110010099979798.6%
Mistral Large 2100100100979698.6%
Ministral 3B10010098979798.6%
Qwen 3 32B100100100989598.6%
Kimi K2.6100100100979698.6%
Gemini 2.5 Flash Lite (Reasoning)10010099999598.6%
Gemma 3 27B1001001001009398.5%
Thinking Machines Inkling1001001001009298.4%
Gemini 3.6 Flash (Reasoning)100100100979598.4%
Claude Opus 4.61009999999498.3%
ByteDance Seed 1.6 Flash100100100999398.3%
Claude Sonnet 4100100100999398.3%
Aion 3.0100100100999398.3%
GPT-OSS 120B1009999989698.3%
Qwen 3.6 Flash100100100979498.1%
Claude Opus 4.5100100100979398.1%
Qwen 3.5 397B A17B1001001001009098.1%
GPT-4.11001001001009098.1%
Z.AI GLM 4.5 Air1001001001009098.1%
Muse Spark 1.3 (Reasoning, Medium)10010098989498.1%
Muse Spark 1.1 (Reasoning, Minimal)100100100979398.1%
Nemotron 3 Nano10010098989498.1%
DeepSeek V4 Flash (Reasoning)100100100979398.0%
Claude Sonnet 4.51001001001009098.0%
GPT-5.21009999969698.0%
Claude Opus 4.8 (Reasoning, Low)100100100959598.0%
Z.AI GLM 5.1100100100979397.9%
GPT-5100100100979397.9%
Kimi K2.5100100100959497.9%
Mistral Large 4.0 (Reasoning)10010097969697.7%
Arcee AI: Trinity Mini1001001001008997.7%
Claude Haiku 5.5 (Reasoning, Low)1009994 – – 97.7%
DeepSeek-V2 Chat100100100959497.7%
Cydonia 24B V4.1100100100989097.7%
Mistral NeMO100100100989097.7%
Gemini 3.5 Flash (Reasoning)10010098979397.6%
ByteDance Seed 1.6100100100969197.5%
Aion 3.5 Mini (Reasoning, High)100100100949397.4%
Gemini 2.5 Flash10010099969297.3%
Claude Opus 4.6 (Reasoning)100100100988997.3%
Qwen 3.5 9B100100100969097.2%
Gemini 3.7 Flash (Reasoning, Medium)100100100949397.1%
Aion 3.5 (Reasoning, High)10010097979197.1%
Claude Haiku 5.5 (Reasoning, Medium)10010099988897.0%
GPT-5.4 Nano (Reasoning, Low)1009999959197.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1009996959496.9%
DeepSeek V4 Pro10010098949396.9%
Gemma 3 4B999999949396.9%
Aion 3.0 Mini100100100958996.9%
Nemotron 3 Super10010098939396.8%
Gemini 2.5 Flash Lite10010098949296.8%
Grok 4.6 (Reasoning, High)1009997969196.8%
DeepSeek V4 Flash10010096969296.7%
Thinking Machines Inkling (Reasoning)100100100939096.7%
Gemini 3.8 Flash (Reasoning, Medium)100100100958996.7%
Hermes 3 70B10010098939396.6%
Mistral Medium 3.1100100100948996.6%
Cohere Command R+ (Aug. 2024)10010099939296.6%
Qwen 3.8 Max (Reasoning, XHigh)1009998959096.6%
GPT-5.4 Mini10010098939196.5%
Muse Spark 1.1 (Reasoning, Medium)10010098939296.5%
Qwen 3.6 35B100100100948996.5%
Z.AI GLM 5 Turbo100100100978596.4%
GPT-5 Nano1009997959196.4%
Claude Opus 4.8 (Reasoning)10010099958896.4%
Gemini 3.1 Pro (Preview)10010097958996.3%
GPT-5.6 Terra (Reasoning, Medium)999897959396.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1009999939096.3%
Z.AI GLM 4.7 Flash10010098948996.3%
Laguna S 2.11009997939296.2%
Ministral 3 3B100100100938896.1%
Z.AI GLM 4.5100100100968496.1%
MiniMax M31009897968996.0%
Qwen 3.5 Flash1009897958995.8%
GPT-5.4 Nano (Reasoning)10010096938995.6%
Claude Sonnet 4.6 (Reasoning)100100100928695.6%
Mistral Large 4.010010095929095.6%
Ministral 3 8B10010097918995.4%
GPT-5.4 Nano10010094939095.4%
Xiaomi MIMO v2.5 Pro999998958695.4%
DeepSeek V3.21009997958695.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010097958595.3%
Hermes 3 405B1009995929095.2%
DeepSeek V4 Pro (Reasoning)1009795949095.1%
DeepSeek V4 Flash 0731 (Reasoning, High)1009998938595.1%
Ministral 3 14B989695949295.1%
Claude Opus 5 (Reasoning, Low)10010097938595.0%
Gemma 4 26B1001001001007594.9%
Mistral Medium 3.5 (Reasoning)1009594949294.9%
Ministral 8B989894939294.7%
GPT-5.4 Mini (Reasoning, Low)989794949194.7%
Gemini 2.5 Pro1009893929094.7%
Qwen 3.6 27B1009593939294.6%
Kimi K3 (Reasoning, High)10010098938294.6%
Z.AI GLM 5.2 (Reasoning, High)10010097938294.2%
Z.AI GLM 5.3 (Reasoning, Max)1009696898994.1%
Claude Haiku 5.5 (Adaptive)10010095958194.0%
Claude Sonnet 5 (Reasoning)1009898928294.0%
Gemini 3.5 Flash Lite (Reasoning)1009896948193.9%
DeepSeek V3 (2024-12-26)100100100888193.9%
Laguna XS 2.1999896948293.8%
Kimi K3 (Reasoning, Low)10010097888493.8%
Inception Mercury 2969694938993.7%
Gemini 3 Flash (Preview)979796908993.7%
Muse Spark 1.2 (Reasoning, Medium)999494928993.5%
Gemini 3.5 Flash (Reasoning, Minimal)1009993938393.5%
Gemini 3.1 Flash Lite1009593918793.3%
Claude Opus 5.5 (Reasoning)1009792918693.1%
Hy4 Preview (Reasoning, High)1009996858492.9%
Z.AI GLM 4.6969493919192.9%
Claude Opus 5 (Reasoning)999793898692.7%
Gemma 4 31B (Reasoning)1009792908592.7%
Claude Sonnet 5.5 (Reasoning)989493908792.5%
Aion 2.0989392898992.2%
Mistral Small 3.2 24B100100100827992.2%
GPT-5 Mini1009693898392.2%
Xiaomi MIMO v2.6 Flash10010093897992.1%
Claude Opus 4.71009690898591.9%
Z.AI GLM 5.3 Flash (Reasoning, Max)999898847991.6%
Claude Sonnet 5 (Reasoning, Low)1009889898191.5%
Claude Sonnet 4.6989591888691.4%
GPT-5.4 Mini (Reasoning)999591898391.4%
Qwen 3.8 27B (Reasoning, XHigh)1009792897991.4%
DeepSeek V4.1 Flash (Reasoning, High)1009893887991.3%
Qwen 3.7 Max999789878591.3%
Thinking Machines Inkling Small (Reasoning, High)1009593877991.0%
Claude Opus 51009592887990.6%
MiniMax M2.71009489897990.3%
Gemini 3.1 Flash Lite (Reasoning)1009393887790.3%
Gemma 3 12B939292918389.9%
Qwen 3.8 Flash (Reasoning)989594847789.8%
Gemini 3.1 Flash Lite (Preview)969290898289.8%
Xiaomi MIMO v2.51009786837889.0%
Xiaomi MIMO v2.6 Pro10010089807488.6%
Muse Glimmer 30B (Reasoning, Medium)10010097955088.4%
Qwen 3.5 35B969191857888.3%
DeepSeek V3.1949490907287.8%
ByteDance Seed 2.0 Lite989188847587.0%
Gemini 3 Flash (Preview, Reasoning)1009292846887.0%
Qwen 2.5 72B949084828086.0%
WizardLM 2 8x22b1009997736086.0%
Gemma 4 26B (Reasoning)928585847884.8%
Claude Sonnet 5999890815584.5%
Llama 3.1 70B968583787483.1%
ByteDance Seed 2.0 Mini918885836682.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.5100100100100100100.0%
o4 Mini High100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
GPT-5.4 (Reasoning, Low)1001001001009999.9%
GPT-5.6 Sol1001001001009999.8%
Qwen 3.7 Flash (Reasoning)1001001001009799.5%
Qwen 3.6 Max Preview1001001001009899.5%
Ministral 3 3B1001001001009799.5%
GPT-5.5 (Reasoning, Low)1001001001009899.5%
DeepSeek V4 Pro1001001001009799.4%
GPT-6.1 Sol (Reasoning, Medium)1001001001009799.4%
GPT-6 Luna1001001001009799.4%
Claude Opus 4.5100100100989899.4%
GPT-5.4 Mini (Reasoning)10010099999999.4%
GPT-5.6 Luna (Reasoning, Medium)1001001001009799.4%
Grok 4.20 (Reasoning)100100100999799.3%
Claude Opus 41001001001009699.3%
GPT-5.6 Luna100100100999799.2%
GPT-6 Sol100100100999799.2%
Claude Haiku 4.510010099999899.2%
GPT-4o Mini (temp=1)1001001001009599.1%
GPT-4o, Aug. 6th (temp=1)1001001001009599.0%
Gemma 3 27B10010099999799.0%
Qwen 3.6 27B100100100989799.0%
Aion 3.01001001001009599.0%
Qwen 3.5 Plus (2026-04-20)100100100999799.0%
Grok 4.5 (Reasoning, High)100100100999699.0%
GPT-5.4100100100989798.9%
Grok 4.3100100100999698.9%
GPT-5.6 Terra1001001001009598.9%
DeepSeek V3 (2024-12-26)10010099989898.9%
GPT-5.110010099989798.8%
Xiaomi MIMO v2.5 Pro10010099999698.8%
GPT-6 Luna (Reasoning, Medium)1001001001009498.8%
Claude Sonnet 51001001001009498.8%
Cohere Command R+ (Aug. 2024)100100100999498.6%
Mistral Small 4 (Reasoning)100100100979698.6%
Writer: Palmyra X510010099989598.4%
GPT-4.1100100100969598.3%
GPT-6 Sol (Reasoning, Medium)1001001001009198.3%
Qwen 3.6 35B10010099979598.3%
GPT-5.6 Terra (Reasoning, Medium)1009999979698.2%
Qwen 3 235B A22B Instruct 2507100100100969598.2%
Qwen 3.5 397B A17B10010099989498.1%
GPT-51009897979798.0%
Mistral Medium 3.5100100100989197.9%
Kimi K2.510010099969497.8%
Qwen 3.5 35B10010098979497.8%
Claude Opus 4.610010097969697.8%
GPT-5.4 Nano (Reasoning)1009997979697.8%
Mistral Small 410010099989197.8%
Mistral Large 4.01009898979597.7%
Ministral 3 8B10010099989197.7%
Z.AI GLM 5 Turbo100100100959397.6%
Gemini 3.5 Flash (Reasoning, Minimal)1009999959597.5%
Mistral Medium 3.1100100100998897.4%
DeepSeek V3 (2025-03-24)100100100949397.4%
Grok 4.2010010097979397.4%
GPT-5.210010097959597.4%
Ministral 3B10010099949397.2%
o4 Mini10010099988897.2%
Claude Sonnet 4.6999997969497.1%
DeepSeek-V2 Chat100100100959097.0%
GPT-5.4 Mini (Reasoning, Low)100100100978897.0%
Z.AI GLM 5.110010099949196.9%
Mistral Small 3.2 24B100100100959096.9%
DeepSeek V4 Flash (Reasoning)1009896959596.8%
Gemini 3.5 Flash Lite (Reasoning)1009998949396.8%
Gemini 2.5 Flash100100100968996.8%
DeepSeek V4 Pro (Reasoning)10010098959096.7%
Claude Opus 4.6 (Reasoning)10010099939296.7%
Gemini 3.7 Flash (Reasoning, Medium)10010097949296.6%
DeepSeek V3.21009995949496.6%
Claude Opus 4.8 (Reasoning)10010097959196.6%
Cydonia 24B V4.110010098939296.5%
Gemma 3 12B10010095959396.5%
Claude Opus 5.5 (Reasoning)10010096949396.5%
Qwen 3.8 Max (Reasoning, XHigh)1009796959396.4%
Qwen 3.5 Plus (2026-02-15)1009797959396.4%
Hermes 3 405B1009998978896.4%
Aion 2.01009896959396.4%
Qwen 3.8 Flash (Reasoning)999896969396.3%
GPT-4.1 Nano10010096959096.3%
Kimi K2.61009796959496.3%
Aion 3.5 (Reasoning, High)989897959396.3%
Gemini 2.5 Flash Lite (Reasoning)1009797969196.1%
GPT-4.1 Mini10010095949296.1%
Gemini 2.5 Flash (Reasoning)1009796959296.1%
Kimi K3 (Reasoning, High)1009897968896.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010099958696.0%
Grok 4.6 (Reasoning, High)1009896949295.9%
GPT-4o, Aug. 6th (temp=0)100100100948595.8%
GPT-5.4 Mini1009896949195.7%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100998095.7%
GPT-4o Mini (temp=0)10010096929095.7%
Z.AI GLM 5.2 (Reasoning, High)10010097978495.5%
Claude Sonnet 4.6 (Reasoning)1009796958895.4%
Claude Opus 5 (Reasoning, Low)1009999948595.4%
Claude Opus 4.8 (Reasoning, Low)100100100918695.3%
Arcee AI: Trinity Mini999996929095.3%
MiniMax M2.510010096948795.3%
Gemini 3.6 Flash (Reasoning)1009694949195.1%
Qwen 3.5 Flash1009997918895.1%
Claude Opus 4.71009797919095.0%
Claude Opus 5 (Reasoning)10010095948695.0%
Mistral Large 2999895939095.0%
Qwen 3.5 27B1009895929095.0%
Hy4 Preview (Reasoning, High)999795949095.0%
Z.AI GLM 4.7999994929194.9%
Muse Spark 1.1 (Reasoning, Minimal)1009993929194.8%
Claude Sonnet 5.5 (Reasoning)1009894938894.8%
Claude Sonnet 41009694939194.8%
Qwen 3.6 Flash1009595949094.7%
Mistral Medium 3.5 (Reasoning)10010097918594.7%
Qwen 3.8 27B (Reasoning, XHigh)989896958694.6%
Mistral Large 3100100100987494.5%
GPT-5.4 Nano (Reasoning, Low)1009595948994.4%
Llama 3.1 70B1009998928394.4%
WizardLM 2 8x22b10010099878694.4%
Xiaomi MIMO v2.5999595919194.4%
Ministral 8B1009494939094.3%
Gemini 3.1 Pro (Preview)1009893909094.3%
Gemma 4 26B999696958594.1%
Hermes 3 70B1009895928694.1%
Claude Sonnet 5 (Reasoning)10010099937994.1%
ByteDance Seed 1.6 Flash10010092898994.0%
Claude Opus 4.7 (Reasoning)1009593938894.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)1009996928494.0%
Qwen 3.7 Max969695929194.0%
Ministral 3 14B10010097878694.0%
Muse Spark 1.1 (Reasoning, Medium)999795918794.0%
Qwen 3 32B989895958393.9%
Aion 3.5 Mini (Reasoning, High)999796918693.9%
Kimi K3 (Reasoning, Low)989793938793.8%
Mistral Large 4.0 (Reasoning)1009996957993.8%
Z.AI GLM 5999794928793.7%
Muse Glimmer 30B (Reasoning, Medium)989796938493.5%
DeepSeek V4.1 Flash (Reasoning, High)1009894918593.5%
Muse Spark 1.3 (Reasoning, Medium)1009696948193.5%
Gemini 3.6 Flash (Reasoning, Minimal)969594939093.5%
Laguna XS 2.11009793908793.4%
Thinking Machines Inkling (Reasoning)10010093918393.3%
Gemma 4 31B989794938493.2%
DeepSeek V4 Flash 0731 (Reasoning, High)1009794888893.2%
Thinking Machines Inkling949493929293.0%
Gemma 3 4B1009892898592.9%
Muse Spark 1.2 (Reasoning, Medium)989593928792.8%
Claude Haiku 5.5 (Adaptive)10010093918092.8%
DeepSeek V4 Flash979593908992.7%
MiniMax M2.71009392908992.7%
Gemma 4 31B (Reasoning)989691908892.6%
Mistral NeMO1009292918992.6%
GPT-5.4 Nano1009592918592.6%
Xiaomi MIMO v2.6 Pro999897927692.5%
Z.AI GLM 4.5 Air949392919092.2%
ByteDance Seed 2.0 Lite10010088878692.2%
DeepSeek V3.1989492898892.2%
Z.AI GLM 4.51009595937892.2%
Inception Mercury 2989892878692.2%
DeepSeek V4 Pro 0813 (Reasoning, High)1009392898792.2%
Gemini 3.5 Flash (Reasoning)999593918292.1%
Gemini 3.8 Flash (Reasoning, Medium)959593918792.1%
Gemini 2.5 Flash Lite949391919192.0%
Claude Sonnet 5 (Reasoning, Low)1009993858391.9%
Z.AI GLM 5.3 (Reasoning, Max)989493878791.9%
Qwen 2.5 72B10010091888191.9%
Gemini 3.1 Flash Lite999594908191.8%
GPT-5 Mini989893927891.7%
Gemma 4 26B (Reasoning)989595868391.5%
Xiaomi MIMO v2.6 Flash1009893907591.3%
Z.AI GLM 4.61009490878491.0%
Gemini 2.5 Pro979793868291.0%
Qwen 3.5 9B979693907990.9%
Qwen 3.5 122B979589898590.9%
MiniMax M31009289878690.9%
GPT-5 Nano999191888490.8%
Grok 4.7 (Reasoning, High)1009288888490.3%
Claude Haiku 5.5 (Reasoning, Max)9289 – – – 90.2%
Claude Opus 5959589868489.8%
Gemini 3 Flash (Preview)969491888089.8%
Z.AI GLM 4.7 Flash959388878489.6%
Nemotron 3 Super988989887988.7%
Gemini 3.1 Flash Lite (Preview)929089888388.7%
Claude Haiku 5.5 (Reasoning, Low)1008579 – – 88.2%
Laguna S 2.1969187838388.0%
Gemini 3.1 Flash Lite (Reasoning)979189847787.5%
Nemotron 3 Nano969695787287.2%
Aion 3.0 Mini10010084777587.2%
Thinking Machines Inkling Small (Reasoning, High)989190886987.0%
Gemini 3 Flash (Preview, Reasoning)999086807886.6%
GPT-OSS 120B898984838385.6%
Claude Haiku 5.5 (Reasoning, Medium)928778727180.2%
ByteDance Seed 2.0 Mini858177686575.3%
ByteDance Seed 1.6918970704172.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.1100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
GPT-5.5100100100100100100.0%
Mistral NeMO10010010010010099.9%
GPT-6 Sol (Reasoning, Medium)1001001001009999.9%
Mistral Medium 3.11001001001009999.8%
GPT-6 Luna (Reasoning, Medium)1001001001009999.8%
GPT-5.4 (Reasoning)1001001001009999.7%
GPT-5.41001001001009999.6%
Muse Spark 1.3 (Reasoning, Medium)100100100999999.6%
Gemini 2.5 Flash1001001001009899.6%
GPT-5.6 Sol100100100999999.6%
Mistral Large 2100100100999999.6%
GPT-6 Sol1001001001009899.6%
Grok 4.5 (Reasoning, Low)100100100999899.5%
Claude Sonnet 4.51001001001009799.4%
Mistral Large 4.0 (Reasoning)100100100999899.4%
GPT-5.5 (Reasoning, Medium)1001001001009799.3%
GPT-6.1 Sol (Reasoning, Medium)1009999999999.3%
DeepSeek V3 (2025-03-24)100100100999799.2%
Qwen 3 235B A22B Instruct 25071001001001009699.2%
Gemma 3 4B1001001001009699.2%
Grok 4.31001001001009699.2%
GPT-4.1100100100989899.2%
Qwen 3.7 Flash (Reasoning)1001001001009699.2%
GPT-6 Luna (Reasoning, High)100100100989799.1%
Mistral Small 3.2 24B1001001001009599.0%
Mistral Medium 3.5100100100989799.0%
Z.AI GLM 5.110010099989898.9%
GPT-5.4 Nano100100100989798.9%
GPT-4o Mini (temp=1)1001001001009598.9%
Mistral Small 4 (Reasoning)10010099999698.9%
GPT-5.6 Luna1001001001009598.8%
GPT-5.5 (Reasoning, Low)10010098989898.8%
DeepSeek-V2 Chat1001001001009498.8%
Aion 3.0 Mini100100100989698.8%
Mistral Medium 3.5 (Reasoning)100100100999598.8%
Qwen 2.5 72B1001001001009498.7%
GPT-6 Luna100100100999598.7%
Mistral Small 4100100100999598.7%
GPT-5.4 Mini (Reasoning, Low)100100100979798.7%
GPT-5.21009999989898.6%
Gemini 2.5 Flash (Reasoning)100100100989598.6%
Qwen 3 32B1001001001009398.6%
Hermes 3 405B100100100979598.5%
GPT-5.6 Terra1009999999598.5%
Qwen 3.7 Max100100100979598.5%
GPT-5.6 Luna (Reasoning, Medium)1001001001009398.5%
Qwen 3.5 9B10010099989598.5%
Ministral 8B10010099989598.4%
Laguna XS 2.1100100100969698.4%
Writer: Palmyra X51001001001009298.3%
Claude Opus 41001001001009198.2%
GPT-5.6 Terra (Reasoning, Medium)10010099969698.2%
o4 Mini100100100999298.2%
GPT-5.6 Sol (Reasoning, Medium)100100100989398.1%
DeepSeek V3 (2024-12-26)100100100979498.1%
Llama 3.1 70B10010099969698.1%
Grok 4.20 (Reasoning)100100100999198.1%
Laguna S 2.1100100100969598.0%
Muse Glimmer 30B (Reasoning, Medium)1009999989598.0%
GPT-5 Nano100100100979397.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010099989297.8%
Z.AI GLM 4.6100100100959497.7%
Gemini 3.6 Flash (Reasoning)100100100969397.7%
Hermes 3 70B100100100969297.7%
Qwen 3.6 Max Preview1009999989397.7%
Grok 4.2010010097979597.6%
ByteDance Seed 1.6 Flash1001001001008897.6%
DeepSeek V4 Pro100100100969297.6%
Claude Haiku 5.5 (Reasoning, Medium)10010099979297.5%
Gemini 2.5 Flash Lite10010097969497.5%
DeepSeek V4.1 Flash (Reasoning, High)10010098959497.5%
Qwen 3.6 Flash1009998979397.4%
Gemini 2.5 Flash Lite (Reasoning)1001001001008897.4%
GPT-5.4 Nano (Reasoning, Low)100100100969197.4%
Claude Haiku 4.51001001001008797.4%
Ministral 3 14B10010098959497.4%
Gemini 3.7 Flash (Reasoning, Medium)10010098969397.3%
Grok 4.3 (Reasoning)10010099979197.3%
Gemini 3.1 Flash Lite (Preview)10010098959497.3%
Qwen 3.5 Plus (2026-04-20)100100100959297.3%
Claude Sonnet 4.6 (Reasoning)100100100939397.2%
Xiaomi MIMO v2.5 Pro989797979697.1%
Qwen 3.5 Flash100100100949197.1%
Mistral Large 4.010010098988997.0%
Z.AI GLM 4.7 Flash10010096969397.0%
DeepSeek V3.21009998959297.0%
MiniMax M2.71009996959597.0%
Gemini 3.1 Pro (Preview)10010097969296.9%
Z.AI GLM 4.51001001001008596.9%
Xiaomi MIMO v2.510010098949296.8%
Ministral 3B10010098969096.8%
DeepSeek V3.11009999978996.7%
Inception Mercury 21009999968996.7%
Gemini 3.8 Flash (Reasoning, Medium)10010098978896.7%
Muse Spark 1.1 (Reasoning, Minimal)1009998969196.7%
GPT-5.4 (Reasoning, Low)1009897959496.7%
GPT-5.4 Mini10010098978896.6%
Z.AI GLM 4.5 Air10010097949396.6%
Qwen 3.5 122B10010096949396.5%
DeepSeek V4 Flash (Reasoning)10010098968896.5%
Claude Opus 4.8 (Reasoning, Low)1009898959296.5%
Grok 4.5 (Reasoning, High)10010095949396.5%
Hy4 Preview (Reasoning, High)10010096959196.4%
Cohere Command R+ (Aug. 2024)10010099998596.4%
DeepSeek V4 Pro 0813 (Reasoning, High)1009896949496.4%
Qwen 3.5 397B A17B10010097968996.3%
Cydonia 24B V4.1100100100988496.3%
Z.AI GLM 4.71009896959296.1%
Qwen 3.8 Max (Reasoning, XHigh)100100100948796.1%
Kimi K2.6100100100938896.1%
Mistral Large 310010095939296.0%
Claude Sonnet 5 (Reasoning)1009896969096.0%
Gemini 3.1 Flash Lite100100100938796.0%
DeepSeek V4 Pro (Reasoning)1009997929296.0%
Kimi K3 (Reasoning, Low)10010094949296.0%
GPT-5.4 Nano (Reasoning)10010098968596.0%
Thinking Machines Inkling100100100958495.9%
Gemini 2.5 Pro1009896949295.9%
MiniMax M2.510010098948695.6%
Aion 3.5 (Reasoning, High)1009696959195.6%
Claude Opus 4.6 (Reasoning)1009795939395.5%
Claude Opus 4.610010097958695.5%
GPT-OSS 120B10010096929095.5%
Ministral 3 8B10010099908995.5%
Z.AI GLM 5.2 (Reasoning, High)10010095939095.5%
Gemma 3 12B10010097918995.4%
Claude Opus 5 (Reasoning)10010095919095.2%
GPT-4.1 Nano1009999918795.2%
Z.AI GLM 5 Turbo10010097958395.1%
Kimi K2.510010099948295.1%
Gemini 3 Flash (Preview)1009897938795.1%
Thinking Machines Inkling (Reasoning)100100100918495.1%
GPT-5 Mini1009997928795.0%
Qwen 3.5 27B10010094928895.0%
GPT-51009694939194.9%
Gemini 3.6 Flash (Reasoning, Minimal)1009996948594.9%
Gemini 3 Flash (Preview, Reasoning)1009694939294.8%
Z.AI GLM 510010097898894.7%
Gemini 3.1 Flash Lite (Reasoning)1009895938794.5%
GPT-5.4 Mini (Reasoning)1009995918894.5%
Qwen 3.8 Flash (Reasoning)1009997938394.4%
Gemini 3.5 Flash Lite (Reasoning)10010097908494.3%
Muse Spark 1.2 (Reasoning, Medium)1009795938694.2%
Gemini 3.5 Flash (Reasoning)1009694948794.2%
Claude Opus 5.5 (Reasoning)1009893918994.1%
ByteDance Seed 2.0 Mini999797908794.1%
Grok 4.6 (Reasoning, High)1009792928994.0%
DeepSeek V4 Flash10010094918493.8%
ByteDance Seed 1.610010092918593.7%
Gemma 4 31B (Reasoning)1009892918693.6%
Claude Opus 4.5969595948993.6%
Thinking Machines Inkling Small (Reasoning, High)1009392919193.5%
Claude Opus 4.7 (Reasoning)10010095878493.3%
Nemotron 3 Nano1009594928593.2%
Qwen 3.5 35B1009793918493.2%
Muse Spark 1.1 (Reasoning, Medium)1009691908893.2%
Kimi K3 (Reasoning, High)1009695898693.1%
Grok 4.7 (Reasoning, High)1009793918493.0%
Claude Sonnet 410010092908292.9%
Qwen 3.5 Plus (2026-02-15)10010096907892.6%
Claude Haiku 5.5 (Reasoning, Low)93 – – – – 92.5%
Gemma 3 27B999897858492.5%
Gemma 4 26B1009795898192.4%
GPT-4o, Aug. 6th (temp=1)100100100887492.4%
GPT-4.1 Mini1009998917392.3%
DeepSeek V4 Flash 0731 (Reasoning, High)999796908092.2%
Aion 2.0979593908692.2%
Ministral 3 3B100100100877392.2%
Z.AI GLM 5.3 (Reasoning, Max)1009690878691.8%
ByteDance Seed 2.0 Lite10010092878091.8%
Claude Sonnet 5989895888091.8%
Qwen 3.6 27B1009996838191.8%
Claude Sonnet 4.6989292898791.7%
Claude Sonnet 5.5 (Reasoning)979696878391.6%
Claude Haiku 5.5 (Adaptive)1009993838291.5%
Gemini 3.5 Flash (Reasoning, Minimal)1009792858391.4%
Qwen 3.8 27B (Reasoning, XHigh)969391908791.3%
Qwen 3.6 35B1009998877391.3%
Aion 3.0969593888491.1%
Aion 3.5 Mini (Reasoning, High)10010091867891.0%
Xiaomi MIMO v2.6 Pro989688888390.6%
Claude Opus 4.8 (Reasoning)1009492897289.5%
Claude Opus 5 (Reasoning, Low)979493867789.5%
Claude Opus 5959089878689.4%
Z.AI GLM 5.3 Flash (Reasoning, Max)929291878389.2%
MiniMax M31008988868389.2%
Xiaomi MIMO v2.6 Flash10010089837188.6%
Nemotron 3 Super1008987828187.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)948988888087.7%
Claude Opus 4.71009585777787.0%
Arcee AI: Trinity Mini1009191817186.9%
WizardLM 2 8x22b1001001001003286.4%
Gemma 4 26B (Reasoning)969392757385.7%
Gemma 4 31B938984828185.6%
Claude Sonnet 5 (Reasoning, Low)968180786980.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Hermes 3 405B1001001001009699.3%
DeepSeek V3 (2025-03-24)10010099989798.7%
o4 Mini High100100100989598.4%
GPT-6.1 Sol (Reasoning, Medium)100100100959598.0%
o4 Mini1009898979597.8%
GPT-4o Mini (temp=1)10010099949497.3%
Qwen 3 235B A22B Instruct 25071009998969497.3%
Gemma 3 12B100100100939196.8%
Mistral Small 410010099958796.3%
Qwen 3.7 Flash (Reasoning)1009895949496.2%
Writer: Palmyra X51009696959396.0%
Grok 4.5 (Reasoning, High)999998978695.8%
Gemma 3 4B100100100958295.4%
GPT-5.5 (Reasoning, Medium)989796939395.3%
GPT-5.6 Sol (Reasoning, Medium)10010096938795.1%
GPT-5 Nano1009895948995.0%
Claude Opus 5.5 (Reasoning)1009995948795.0%
GPT-4.110010098948394.9%
Claude Opus 41009898928694.8%
Claude Sonnet 4.5989795949094.7%
Gemini 2.5 Flash Lite10010099987694.6%
Hermes 3 70B10010099888594.3%
GPT-5.6 Sol999594929194.3%
GPT-5.11009797908794.2%
Llama 3.1 70B1009897908593.9%
Qwen 3.5 9B1009797918493.8%
Qwen 3.5 122B969694948993.8%
GPT-5.5 (Reasoning, Low)1009592919093.7%
Z.AI GLM 5999797908593.7%
Kimi K3 (Reasoning, High)999793928693.4%
Ministral 3 3B10010094898493.3%
GPT-51009595938393.2%
GPT-4.1 Mini1009995908293.2%
Z.AI GLM 4.5 Air989791918792.9%
Mistral Small 4 (Reasoning)1009695908492.9%
Grok 4.5 (Reasoning, Low)1009791908692.8%
Gemma 3 27B989894888592.7%
GPT-5.6 Terra979393928992.6%
Qwen 3.7 Max959593908992.5%
DeepSeek V3.1969492919092.5%
Thinking Machines Inkling10010091878592.5%
Z.AI GLM 4.71009391898892.2%
DeepSeek V3 (2024-12-26)969594918592.1%
GPT-5.41009392898692.1%
Claude Sonnet 4100100100857491.8%
GPT-6 Sol (Reasoning, Medium)969592888891.7%
Gemini 2.5 Flash1009593858491.6%
DeepSeek V4 Flash (Reasoning)959491908791.5%
Thinking Machines Inkling (Reasoning)1009989858591.5%
GPT-4o, Aug. 6th (temp=1)10010092858091.2%
GPT-5.5969190908991.2%
GPT-5.4 (Reasoning)929292908991.1%
Muse Glimmer 30B (Reasoning, Medium)969493888491.1%
Gemini 3.5 Flash (Reasoning)10010095946691.1%
Claude Opus 5 (Reasoning, Low)1009795848091.0%
MiniMax M2.5959390898791.0%
Mistral NeMO979592878390.9%
Ministral 3 8B1009291908190.9%
Z.AI GLM 4.5959491898590.9%
Qwen 3 32B999791877990.8%
GPT-4.1 Nano1009794857890.8%
DeepSeek V4 Flash 0731 (Reasoning, High)1009392888090.7%
Mistral Medium 3.11009897827690.6%
Mistral Medium 3.5939291898890.6%
Claude Opus 4.71009291917890.5%
Ministral 3B1009491868290.5%
GPT-5.2999088878790.3%
Gemini 3.1 Flash Lite (Reasoning)979494868090.2%
Z.AI GLM 5.3 (Reasoning, Max)989392848390.1%
Gemini 2.5 Pro969695877690.1%
Gemini 3 Flash (Preview, Reasoning)979290868590.0%
Z.AI GLM 5.2 (Reasoning, High)969492848389.9%
Qwen 3.5 Flash979189898389.9%
Laguna XS 2.1999089878589.9%
Gemini 2.5 Flash Lite (Reasoning)989291848489.8%
Kimi K2.61009391887789.8%
Grok 4.20 (Reasoning)979289878389.8%
ByteDance Seed 1.6 Flash999592877589.6%
Aion 3.0949488868589.5%
Gemma 4 26B (Reasoning)969392897789.3%
Qwen 3.5 35B969590848289.3%
Qwen 3.5 27B949390898289.3%
Qwen 3.6 Max Preview969388868489.3%
DeepSeek-V2 Chat999389848189.3%
Z.AI GLM 5.1959387868589.2%
Aion 3.0 Mini979088868489.2%
Qwen 3.5 Plus (2026-04-20)979290878089.1%
Qwen 3.6 35B959492848089.0%
Gemma 4 31B (Reasoning)979690857788.9%
GPT-5.6 Luna929288878588.9%
Claude Opus 4.8 (Reasoning)959087878588.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)979189887888.7%
GPT-4o Mini (temp=0)928989878688.7%
Gemini 2.5 Flash (Reasoning)969088858488.6%
Claude Sonnet 4.6919089878588.6%
Grok 4.7 (Reasoning, High)919189878488.5%
DeepSeek V4 Flash999386838288.5%
Mistral Large 3929188888388.5%
Muse Spark 1.3 (Reasoning, Medium)1008987878088.4%
WizardLM 2 8x22b959490887688.4%
Cohere Command R+ (Aug. 2024)1009684818088.0%
Claude Sonnet 4.6 (Reasoning)999590807788.0%
GPT-6 Sol908888878787.9%
Claude Opus 4.8 (Reasoning, Low)1009290896887.8%
Gemini 3.1 Pro (Preview)989889777687.8%
GPT-5.4 Nano (Reasoning, Low)929089848487.6%
DeepSeek V4 Pro (Reasoning)989289847587.5%
Hy4 Preview (Reasoning, High)999390807587.5%
Gemini 3.1 Flash Lite (Preview)959286848187.5%
Z.AI GLM 5 Turbo929190887587.3%
Aion 3.5 (Reasoning, High)938988858187.3%
Z.AI GLM 4.6939389867587.2%
Qwen 3.5 Plus (2026-02-15)1008685848187.2%
Claude Opus 51009088817887.1%
Claude Opus 4.5989791787287.1%
Xiaomi MIMO v2.5 Pro999488817387.1%
Z.AI GLM 4.7 Flash959088837987.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)949288827987.0%
Gemini 3.5 Flash (Reasoning, Minimal)1009085827786.8%
Gemini 3 Flash (Preview)928787868286.7%
Gemini 3.5 Flash Lite (Reasoning)1008984827886.7%
Arcee AI: Trinity Mini1009895786386.7%
Gemini 3.6 Flash (Reasoning, Minimal)1008886847586.7%
Kimi K3 (Reasoning, Low)999289866786.7%
Claude Haiku 4.51009881797686.7%
Kimi K2.5969392837186.7%
Grok 4.31008785857786.6%
GPT-5.6 Luna (Reasoning, Medium)998989797686.2%
GPT-5.4 Nano908986858186.2%
Mistral Small 3.2 24B1009282797986.1%
Ministral 3 14B939393836986.0%
DeepSeek V4 Pro1009983787086.0%
GPT-5.4 Mini (Reasoning, Low)918785858186.0%
Cydonia 24B V4.11009787747185.9%
GPT-5.4 (Reasoning, Low)968785837985.9%
MiniMax M2.7938986847685.7%
DeepSeek V4.1 Flash (Reasoning, High)939184847585.7%
Claude Opus 5 (Reasoning)1009387787085.6%
Gemma 4 26B1009784846485.6%
GPT-5.4 Nano (Reasoning)938986867385.5%
Grok 4.20939185827685.5%
ByteDance Seed 2.0 Lite988786827485.5%
DeepSeek V3.21009382807185.4%
GPT-6 Luna (Reasoning, High)1008987777485.4%
Xiaomi MIMO v2.5949384837285.3%
Gemini 3.6 Flash (Reasoning)909089797885.3%
Claude Opus 4.7 (Reasoning)928986827785.2%
Muse Spark 1.2 (Reasoning, Medium)919087807885.2%
Mistral Medium 3.5 (Reasoning)928787837885.2%
GPT-OSS 120B939392846385.1%
Gemini 3.1 Flash Lite988782827785.1%
Aion 2.0918887817884.9%
Claude Opus 4.6968984787684.9%
Grok 4.6 (Reasoning, High)999687826184.8%
Mistral Large 4.0 (Reasoning)969381787684.8%
GPT-5.6 Terra (Reasoning, Medium)888685848084.7%
GPT-6 Luna (Reasoning, Medium)928786827584.4%
GPT-4o, Aug. 6th (temp=0)909088866784.4%
Qwen 3.6 Flash969582767284.3%
Qwen 2.5 72B898985857284.2%
GPT-5 Mini949183787484.1%
Qwen 3.5 397B A17B959484767084.0%
Qwen 3.6 27B928989856584.0%
Muse Spark 1.1 (Reasoning, Minimal)949281807283.8%
Mistral Large 2969284836383.6%
GPT-6 Luna908786787683.5%
Gemini 3.8 Flash (Reasoning, Medium)939379777683.4%
Claude Sonnet 5 (Reasoning, Low)1009189726583.4%
Aion 3.5 Mini (Reasoning, High)948880797683.3%
Laguna S 2.1968582787683.3%
GPT-5.4 Mini858584828083.0%
ByteDance Seed 1.610010078726482.8%
Claude Opus 4.6 (Reasoning)898783817382.7%
Claude Sonnet 5.5 (Reasoning)878784817582.7%
Muse Spark 1.1 (Reasoning, Medium)929181787182.6%
Claude Sonnet 5 (Reasoning)979786785482.3%
Claude Haiku 5.5 (Adaptive)988380767482.1%
Xiaomi MIMO v2.6 Flash908582807382.1%
DeepSeek V4 Pro 0813 (Reasoning, High)929187815981.8%
Ministral 8B978484776781.8%
Claude Haiku 5.5 (Reasoning, Medium)928877777481.5%
Xiaomi MIMO v2.6 Pro898281817481.4%
Claude Sonnet 5959380696981.1%
GPT-5.4 Mini (Reasoning)968579737180.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)888479787380.2%
Gemma 4 31B938576757179.9%
Grok 4.3 (Reasoning)848379767378.9%
Inception Mercury 2938580775978.8%
MiniMax M3848181747378.6%
Qwen 3.8 Flash (Reasoning)847977747477.5%
Qwen 3.8 Max (Reasoning, XHigh)897776746977.0%
Nemotron 3 Nano988580724676.1%
Gemini 3.7 Flash (Reasoning, Medium)817978726574.9%
Qwen 3.8 27B (Reasoning, XHigh)897672686774.4%
Mistral Large 4.0777368676670.1%
Nemotron 3 Super867171675570.0%
Thinking Machines Inkling Small (Reasoning, High)736968656167.2%
ByteDance Seed 2.0 Mini736765616065.1%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Ministral 3 3B100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Qwen 3.6 35B10010010010010099.9%
GPT-5.110010010010010099.9%
GPT-5.6 Luna (Reasoning, Medium)10010010010010099.9%
Kimi K3 (Reasoning, Low)10010010010010099.9%
GPT-5.5 (Reasoning, Medium)1001001001009999.8%
GPT-6 Luna (Reasoning, Medium)1001001001009999.8%
Qwen 3.6 Max Preview1001001001009999.7%
Grok 4.201001001001009899.6%
Hermes 3 405B1001001001009899.6%
Aion 3.0 Mini1001001001009899.6%
GPT-4o, Aug. 6th (temp=0)1001001001009799.5%
DeepSeek V4 Flash (Reasoning)1001001001009799.4%
GPT-5.51001001001009799.4%
GPT-4.11001001001009799.4%
GPT-6 Luna (Reasoning, High)100100100989899.3%
Mistral Medium 3.1100100100999899.3%
Qwen 3.5 122B100100100999899.3%
Grok 4.3 (Reasoning)1001001001009699.3%
Grok 4.5 (Reasoning, Low)100100100999799.2%
Mistral Large 2100100100999799.2%
Ministral 3B10010099999899.2%
GPT-4.1 Mini100100100999799.2%
GPT-510010099999899.2%
DeepSeek-V2 Chat1001001001009699.2%
Mistral Small 4 (Reasoning)100100100989899.2%
o4 Mini1001001001009599.1%
GPT-6 Sol (Reasoning, Medium)1001001001009599.0%
Grok 4.6 (Reasoning, High)1001001001009699.0%
Claude Opus 4.61009999989899.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)1001001001009599.0%
Mistral Medium 3.5100100100999699.0%
Z.AI GLM 5 Turbo100100100989799.0%
GPT-4o Mini (temp=1)100100100999699.0%
Qwen 3.7 Flash (Reasoning)100100100989699.0%
GPT-6.1 Sol (Reasoning, Medium)1001001001009599.0%
Kimi K2.5100100100999699.0%
Writer: Palmyra X5100100100989798.9%
Gemini 2.5 Flash1001001001009598.9%
DeepSeek V4 Pro 0813 (Reasoning, High)10010099999698.9%
GPT-5.4 Mini (Reasoning)10010099989798.9%
GPT-5.4 Nano (Reasoning, Low)100100100989698.8%
GPT-6 Luna10010098989898.8%
Claude Opus 5 (Reasoning)100100100999698.8%
Llama 3.1 70B1009998989898.8%
Mistral Large 31001001001009498.7%
Claude Opus 41001001001009498.7%
Grok 4.5 (Reasoning, High)1001001001009498.7%
MiniMax M2.51001001001009498.7%
Claude Opus 5.5 (Reasoning)100100100979698.7%
Qwen 3.6 Flash100100100989498.5%
GPT-5.21009998989798.5%
Gemini 2.5 Flash (Reasoning)100100100979598.5%
Muse Glimmer 30B (Reasoning, Medium)1001001001009398.5%
Qwen 3.5 9B100100100999498.5%
Qwen 3 235B A22B Instruct 2507100100100979698.4%
Gemma 3 4B100100100999398.4%
GPT-5.4 Mini (Reasoning, Low)100100100969698.4%
Claude Sonnet 41001001001009298.4%
Qwen 3.5 Flash10010099999598.4%
Claude Sonnet 4.5100100100979498.4%
DeepSeek V3 (2024-12-26)100100100979598.3%
Claude Sonnet 4.61001001001009298.3%
GPT-OSS 120B10010099969698.3%
Ministral 3 8B100100100989398.3%
DeepSeek V4 Flash1001001001009198.2%
GPT-5.6 Luna100100100999298.2%
GPT-5.4 Nano (Reasoning)100100100969698.2%
Claude Opus 4.8 (Reasoning, Low)100100100979398.1%
Thinking Machines Inkling10010099979498.1%
Laguna XS 2.1100100100969598.1%
Gemini 3.5 Flash Lite (Reasoning)100100100969498.0%
GPT-5.4 (Reasoning)10010099969597.9%
GPT-4.1 Nano10010099979497.9%
Ministral 8B1001001001009097.9%
Gemini 2.5 Flash Lite (Reasoning)100100100999097.8%
GPT-5.4 Mini10010098969597.8%
Z.AI GLM 5.3 (Reasoning, Max)1001001001008997.7%
GPT-5.4 (Reasoning, Low)10010099979297.7%
Claude Haiku 5.5 (Reasoning, Medium)10010099999197.7%
Grok 4.20 (Reasoning)100100100969297.7%
Thinking Machines Inkling (Reasoning)100100100959397.6%
Hermes 3 70B100100100989097.6%
MiniMax M2.7100100100979097.6%
GPT-5.4 Nano1009998979497.6%
Claude Opus 510010099969397.6%
GPT-4o Mini (temp=0)100100100949497.5%
Ministral 3 14B100100100959397.5%
Aion 2.010010097979397.5%
Gemini 3.7 Flash (Reasoning, Medium)10010096969597.5%
DeepSeek V4.1 Flash (Reasoning, High)100100100969197.5%
Z.AI GLM 4.710010097969497.4%
ByteDance Seed 1.6 Flash100100100949397.4%
Grok 4.7 (Reasoning, High)10010098959497.3%
Qwen 3.5 35B1009997969497.3%
Claude Opus 4.7100100100949397.3%
GPT-5 Nano10010099998897.2%
Qwen 2.5 72B1001001001008797.2%
Arcee AI: Trinity Mini10010098969297.2%
DeepSeek V4 Pro100100100988897.2%
Gemini 3 Flash (Preview)10010098979097.1%
Muse Spark 1.1 (Reasoning, Minimal)999897979497.1%
DeepSeek V4 Pro (Reasoning)100100100998697.1%
Claude Opus 4.7 (Reasoning)100100100978997.1%
Qwen 3.8 Max (Reasoning, XHigh)1009998969297.0%
GPT-4o, Aug. 6th (temp=1)1009999988997.0%
Qwen 3.8 27B (Reasoning, XHigh)1009797969597.0%
Qwen 3.5 397B A17B1009897959497.0%
Z.AI GLM 4.7 Flash10010098949397.0%
Claude Opus 5 (Reasoning, Low)10010097969296.9%
Claude Opus 4.6 (Reasoning)1009797969696.9%
Gemini 3 Flash (Preview, Reasoning)10010098949296.9%
Aion 3.5 (Reasoning, High)100100100998796.9%
Gemini 3.1 Pro (Preview)10010099988896.8%
Gemini 3.8 Flash (Reasoning, Medium)10010096969396.8%
Mistral Large 4.010010097949396.8%
Gemma 4 31B10010095959496.7%
Qwen 3.8 Flash (Reasoning)1009997939296.4%
Mistral NeMO100100100928996.2%
Qwen 3.5 Plus (2026-04-20)100100100978496.2%
Kimi K2.6100100100998196.1%
Muse Spark 1.1 (Reasoning, Medium)999897949396.1%
Grok 4.310010096949096.0%
Gemini 2.5 Flash Lite10010096939095.9%
Nemotron 3 Super100100100928795.9%
Gemini 3.6 Flash (Reasoning)10010095958995.9%
Cydonia 24B V4.1100100100958495.8%
Claude Haiku 5.5 (Adaptive)10010098919095.7%
Xiaomi MIMO v2.6 Pro10010095939195.7%
Inception Mercury 210010097938995.7%
Claude Haiku 4.5100100100978195.6%
DeepSeek V3.210010098909095.5%
Mistral Small 3.2 24B100100100938495.4%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009997928995.4%
Qwen 3.5 Plus (2026-02-15)100100100958295.4%
Z.AI GLM 51009898968495.3%
Qwen 3.5 27B10010098938695.3%
Gemma 4 26B10010096918995.2%
Claude Sonnet 4.6 (Reasoning)10010097968495.2%
Gemini 2.5 Pro10010096968495.2%
Aion 3.01009795939095.1%
Cohere Command R+ (Aug. 2024)100100100987795.1%
Claude Sonnet 5 (Reasoning, Low)100100100977895.0%
Gemini 3.6 Flash (Reasoning, Minimal)10010094928994.9%
Claude Sonnet 5.5 (Reasoning)10010097918794.9%
Xiaomi MIMO v2.5999995948894.9%
WizardLM 2 8x22b10010094919094.9%
Z.AI GLM 4.61009998898894.9%
DeepSeek V3.11009998958294.8%
Gemini 3.5 Flash (Reasoning)10010097928594.7%
Hy4 Preview (Reasoning, High)10010095928794.7%
MiniMax M3999898898994.7%
Qwen 3.7 Max1009696938794.6%
ByteDance Seed 1.610010092919094.5%
Aion 3.5 Mini (Reasoning, High)10010093908994.5%
Gemini 3.5 Flash (Reasoning, Minimal)1009695919194.5%
Nemotron 3 Nano989794939094.4%
Xiaomi MIMO v2.5 Pro1009594938994.3%
Z.AI GLM 5.110010098957894.3%
Muse Spark 1.3 (Reasoning, Medium)100100100888294.2%
GPT-5 Mini989898928394.0%
Gemini 3.1 Flash Lite10010092898893.9%
Z.AI GLM 5.2 (Reasoning, High)10010095898593.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1009797938293.8%
Xiaomi MIMO v2.6 Flash959494939293.7%
Claude Opus 4.8 (Reasoning)1009895958093.6%
Gemma 4 26B (Reasoning)1009692898993.1%
Z.AI GLM 5.3 Flash (Reasoning, Max)1009392908892.5%
Muse Spark 1.2 (Reasoning, Medium)1009392898792.3%
Qwen 3.6 27B1009590898892.3%
Gemma 4 31B (Reasoning)969692888892.1%
Gemini 3.1 Flash Lite (Preview)999393928492.1%
Laguna S 2.11009391898692.0%
Claude Sonnet 510010096917291.7%
Z.AI GLM 4.51009793927791.7%
ByteDance Seed 2.0 Lite989893868391.5%
Kimi K3 (Reasoning, High)1009692868391.5%
Thinking Machines Inkling Small (Reasoning, High)1009998807991.4%
Gemini 3.1 Flash Lite (Reasoning)10010086858390.9%
ByteDance Seed 2.0 Mini1009891828290.7%
Claude Sonnet 5 (Reasoning)1009991777488.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol10010010010010099.9%
GPT-6 Luna (Reasoning, High)1001001001009999.8%
GPT-5.5 (Reasoning, Low)10010010010010099.8%
GPT-5.6 Sol (Reasoning, Medium)100100100999999.6%
GPT-5.5100100100999899.6%
o4 Mini High1001001001009899.5%
GPT-5.5 (Reasoning, Medium)1001001001009899.5%
Writer: Palmyra X5100100100999799.2%
GPT-6.1 Sol (Reasoning, Medium)1001001001009699.2%
Qwen 3.6 27B1001001001009699.1%
GPT-5.1100100100989799.0%
o4 Mini1001001001009599.0%
DeepSeek V3 (2025-03-24)1001001001009599.0%
Ministral 3 3B1009999989898.9%
GPT-5.4 Mini (Reasoning)1009999989898.8%
GPT-6 Sol1001001001009498.8%
Laguna S 2.11001001001009598.8%
GPT-5.4 (Reasoning, Low)100100100989698.8%
Qwen 3 235B A22B Instruct 2507100100100979798.8%
Claude Opus 4.8 (Reasoning)100100100979698.7%
GPT-510010099989698.6%
Grok 4.5 (Reasoning, Low)100100100979798.6%
Qwen 3.7 Flash (Reasoning)10010098979798.6%
GPT-4.110010099989598.4%
Hy4 Preview (Reasoning, High)100100100999398.4%
DeepSeek V3 (2024-12-26)100100100969698.4%
Xiaomi MIMO v2.510010099979698.3%
Claude Haiku 5.5 (Reasoning, Low)98 – – – – 98.2%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010098979598.1%
Hermes 3 405B100100100969397.9%
DeepSeek V3.110010099969497.8%
Qwen 3.6 Max Preview1009898979697.8%
GPT-5.6 Terra (Reasoning, Medium)100100100989197.8%
Cydonia 24B V4.1100100100969397.8%
Mistral Medium 3.11009997969597.7%
Kimi K2.61009997969697.7%
Ministral 3 14B10010099989197.6%
GPT-6 Luna (Reasoning, Medium)1009998969597.5%
Gemma 3 12B1009999989197.5%
Gemma 3 27B100100100959397.4%
Grok 4.201009898979397.3%
DeepSeek-V2 Chat1009998959597.3%
Muse Spark 1.3 (Reasoning, Medium)999898989397.3%
Qwen 3.6 Flash10010097969397.3%
GPT-5.21009898989297.2%
Mistral Small 4 (Reasoning)1009998979297.2%
Z.AI GLM 4.5100100100949297.1%
Qwen 3.5 122B10010099988997.0%
Grok 4.31009998959397.0%
Grok 4.5 (Reasoning, High)1009997969296.8%
GPT-6 Luna1009898969196.7%
GPT-5.4 Mini989797969496.5%
Ministral 3B10010096949296.5%
Qwen 3 32B10010095949396.4%
GPT-5.41009898949296.4%
Gemma 3 4B999996969296.4%
Gemini 3.1 Pro (Preview)999797959496.4%
GPT-6 Sol (Reasoning, Medium)1009998978996.4%
GPT-5.6 Luna (Reasoning, Medium)989797969496.3%
Claude Opus 410010097949096.3%
GPT-5.6 Terra1009999939196.3%
Gemini 2.5 Flash Lite (Reasoning)989897969396.2%
Qwen 3.5 397B A17B10010098939096.1%
Grok 4.7 (Reasoning, High)1009997958996.1%
GPT-5.4 Mini (Reasoning, Low)10010097958996.1%
GPT-4.1 Nano10010097958896.0%
Claude Sonnet 5.5 (Reasoning)1009896959296.0%
GPT-5.4 (Reasoning)1009796949295.8%
Claude Haiku 4.510010097929095.8%
GPT-5.4 Nano (Reasoning)1009795949395.7%
Claude Opus 5 (Reasoning, Low)989898939095.5%
Mistral Small 410010094929195.5%
GPT-4o, Aug. 6th (temp=1)1009993939295.4%
WizardLM 2 8x22b100100100987995.3%
Kimi K3 (Reasoning, Low)1009896938995.3%
DeepSeek V4 Pro1009999938695.3%
Mistral Small 3.2 24B10010096918895.1%
GPT-5.6 Luna1009595939295.1%
Mistral Large 210010098928595.0%
GPT-4o, Aug. 6th (temp=0)999594949295.0%
Claude Sonnet 4.61009797918994.9%
GPT-4o Mini (temp=1)1009695948994.9%
DeepSeek V4 Flash 0731 (Reasoning, High)1009795948994.8%
Z.AI GLM 51009694939094.8%
DeepSeek V4.1 Flash (Reasoning, High)999896938894.7%
Gemini 2.5 Pro1009997958294.7%
GPT-4.1 Mini10010097958294.7%
Gemini 2.5 Flash Lite10010093918994.7%
Grok 4.6 (Reasoning, High)1009693939094.4%
Gemini 2.5 Flash (Reasoning)989695939094.4%
Hermes 3 70B1009897918594.3%
Muse Spark 1.1 (Reasoning, Medium)1009692929194.3%
Nemotron 3 Super989694929194.2%
Mistral Large 4.01009894948494.1%
Aion 3.010010096948194.1%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010097928194.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010098918194.1%
Z.AI GLM 5.2 (Reasoning, High)1009796948494.1%
DeepSeek V4 Pro 0813 (Reasoning, High)989896958393.9%
Mistral Large 4.0 (Reasoning)10010095888693.9%
Claude Opus 4.710010093918693.9%
Muse Spark 1.2 (Reasoning, Medium)1009894908893.9%
GPT-OSS 120B1009593938793.7%
Qwen 3.5 Plus (2026-02-15)1009994898793.6%
Z.AI GLM 4.5 Air1009792918793.5%
GPT-5 Nano1009494908993.5%
Mistral Medium 3.51009593918793.5%
MiniMax M2.51009693908893.4%
Qwen 3.8 Max (Reasoning, XHigh)989693918993.4%
GPT-5.4 Nano (Reasoning, Low)1009893918493.3%
Kimi K3 (Reasoning, High)10010099937593.3%
Z.AI GLM 4.71009695898693.2%
Ministral 3 8B10010089898793.1%
Inception Mercury 2979795898893.1%
Z.AI GLM 5.3 (Reasoning, Max)999594908893.1%
Qwen 3.6 35B1009994908393.1%
Thinking Machines Inkling999893888793.0%
Gemini 3.7 Flash (Reasoning, Medium)10010096967493.0%
Gemini 3.6 Flash (Reasoning)1009895947893.0%
Mistral NeMO989792908993.0%
Ministral 8B1009696888493.0%
ByteDance Seed 1.6 Flash969592929093.0%
Qwen 3.5 27B959493929092.8%
Z.AI GLM 4.6979693908792.7%
Mistral Medium 3.5 (Reasoning)969493918992.6%
Gemini 3.6 Flash (Reasoning, Minimal)1009491918592.4%
Claude Sonnet 4.6 (Reasoning)10010091898292.3%
Claude Opus 5.5 (Reasoning)979594908692.3%
Grok 4.3 (Reasoning)100100100956692.3%
Claude Opus 4.61009796858292.2%
Mistral Large 3999594898492.1%
Claude Sonnet 5 (Reasoning)999792918292.1%
MiniMax M2.71009590898692.1%
ByteDance Seed 1.6999696937792.1%
Qwen 3.8 27B (Reasoning, XHigh)1009290898992.0%
Qwen 3.7 Max1009891878392.0%
Gemini 3 Flash (Preview)1009894927592.0%
Gemini 3.8 Flash (Reasoning, Medium)979393898691.7%
Qwen 3.5 9B969494918491.7%
GPT-5.4 Nano979392908591.4%
Qwen 3.5 Plus (2026-04-20)1009492927991.4%
Gemma 4 31B989895917691.3%
DeepSeek V4 Flash979796897991.3%
Qwen 3.5 Flash989691878591.3%
DeepSeek V3.2989595888091.2%
Aion 3.5 Mini (Reasoning, High)1009894877791.2%
Z.AI GLM 4.7 Flash989292898691.2%
Claude Opus 5 (Reasoning)979290908691.1%
Laguna XS 2.1989592908191.1%
Z.AI GLM 5 Turbo999291888691.1%
Claude Opus 4.5979290898891.1%
Z.AI GLM 5.1949392908691.0%
Claude Sonnet 4.5979491878591.0%
Gemini 3.1 Flash Lite (Reasoning)1009391878490.9%
Muse Spark 1.1 (Reasoning, Minimal)959292918590.9%
Xiaomi MIMO v2.5 Pro979492878590.9%
Muse Glimmer 30B (Reasoning, Medium)1009790868290.9%
MiniMax M3999591878290.8%
Aion 3.5 (Reasoning, High)979390888590.6%
Arcee AI: Trinity Mini989793917390.5%
Gemma 4 26B1009390907990.4%
Qwen 3.5 35B989291868590.2%
Kimi K2.51009897916590.2%
Claude Haiku 5.5 (Reasoning, Max)90 – – – – 90.0%
Claude Sonnet 5 (Reasoning, Low)1009392857989.9%
Thinking Machines Inkling (Reasoning)10010087818189.9%
Claude Sonnet 51009995847189.6%
Gemini 3.5 Flash (Reasoning)1008989898189.6%
Nemotron 3 Nano1009794827589.5%
Claude Opus 4.7 (Reasoning)979392848089.5%
Claude Opus 4.8 (Reasoning, Low)10010090886889.3%
Aion 2.0959592857989.3%
Gemini 3.5 Flash Lite (Reasoning)1009190887789.3%
Grok 4.20 (Reasoning)989896936189.2%
Cohere Command R+ (Aug. 2024)969292897688.8%
Gemini 3.1 Flash Lite10010087817788.8%
Gemini 2.5 Flash1009492867288.8%
Xiaomi MIMO v2.6 Flash1009085848488.7%
Claude Opus 5989087868288.5%
Qwen 2.5 72B1009792807488.5%
Claude Opus 4.6 (Reasoning)949189897988.4%
GPT-5 Mini968988878188.3%
Gemma 4 26B (Reasoning)929090858388.1%
Claude Sonnet 4969487828288.0%
DeepSeek V4 Flash (Reasoning)1009689886788.0%
Gemma 4 31B (Reasoning)969684828187.9%
Gemini 3.5 Flash (Reasoning, Minimal)939287868287.8%
Aion 3.0 Mini989691817287.6%
Gemini 3.1 Flash Lite (Preview)1009588797487.1%
GPT-4o Mini (temp=0)929088848086.9%
Xiaomi MIMO v2.6 Pro939288828086.8%
Llama 3.1 70B1009983757586.4%
Claude Haiku 5.5 (Reasoning, Medium)999485837186.1%
Qwen 3.8 Flash (Reasoning)929183838286.0%
Gemini 3 Flash (Preview, Reasoning)969485817385.8%
ByteDance Seed 2.0 Mini898686848285.4%
Claude Haiku 5.5 (Adaptive)939386747484.2%
DeepSeek V4 Pro (Reasoning)898987817383.7%
ByteDance Seed 2.0 Lite988988875383.0%
Thinking Machines Inkling Small (Reasoning, High)908683767481.9%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite10010010010010099.9%
Kimi K2.51001001001009999.9%
Grok 4.7 (Reasoning, High)1001001001009999.9%
Claude Opus 5.5 (Reasoning)1001001001009999.9%
GPT-5.4 Mini1001001001009999.9%
Claude Opus 4.8 (Reasoning, Low)1001001001009999.8%
GPT-5.4 Mini (Reasoning)1001001001009999.8%
Thinking Machines Inkling1001001001009999.8%
DeepSeek V3 (2025-03-24)1001001001009999.8%
GPT-5.6 Luna (Reasoning, Medium)1001001001009999.7%
GPT-4o, Aug. 6th (temp=0)1001001001009999.7%
Gemini 3.5 Flash (Reasoning, Minimal)100100100999999.7%
GPT-OSS 120B1001001001009899.7%
Mistral NeMO1001001001009899.6%
Aion 3.01001001001009899.6%
GPT-5.4 Nano (Reasoning, Low)100100100999899.6%
Mistral Small 3.2 24B1001001001009799.5%
Nemotron 3 Super1001001001009799.4%
Inception Mercury 2100100100999899.4%
Mistral Small 41001001001009799.4%
Gemini 2.5 Flash1001001001009899.4%
Gemini 2.5 Flash (Reasoning)1001001001009799.4%
Kimi K3 (Reasoning, Low)1001001001009799.3%
Ministral 3 3B100100100999899.2%
Thinking Machines Inkling (Reasoning)1001001001009699.2%
Qwen 3 32B1001001001009699.2%
Muse Glimmer 30B (Reasoning, Medium)1001001001009699.2%
Qwen 3.7 Max100100100989799.2%
Aion 3.5 Mini (Reasoning, High)1001001001009699.2%
DeepSeek V4 Flash1001001001009699.1%
GPT-5.4 Mini (Reasoning, Low)100100100999699.1%
Claude Opus 4.51001001001009699.1%
Qwen 3.5 35B100100100989899.1%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009599.1%
Gemma 4 26B1001001001009599.1%
Mistral Medium 3.5 (Reasoning)1001001001009599.1%
Claude Sonnet 4.61001001001009699.0%
Laguna S 2.1100100100999699.0%
Aion 3.5 (Reasoning, High)1001001001009599.0%
Gemini 2.5 Flash Lite (Reasoning)1001001001009599.0%
GPT-5.4 (Reasoning, Low)100100100999699.0%
GPT-4o Mini (temp=1)1001001001009599.0%
Ministral 8B100100100989799.0%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001009598.9%
GPT-4.1 Mini1001001001009498.9%
DeepSeek V4 Pro (Reasoning)100100100989698.9%
Gemma 4 26B (Reasoning)1001001001009498.8%
DeepSeek V4 Flash (Reasoning)1001001001009498.7%
Claude Sonnet 4100100100999598.7%
DeepSeek V4 Pro10010099989698.7%
Xiaomi MIMO v2.6 Pro100100100999498.7%
GPT-4.1 Nano100100100999498.7%
Mistral Large 210010098989798.6%
Cohere Command R+ (Aug. 2024)10010098989798.6%
Claude Haiku 5.5 (Adaptive)100100100999498.6%
Qwen 3.5 Flash1001001001009398.5%
Gemini 3.7 Flash (Reasoning, Medium)10010099999598.4%
GPT-4o, Aug. 6th (temp=1)100100100999398.4%
Nemotron 3 Nano1001001001009298.4%
DeepSeek V3 (2024-12-26)100100100979598.4%
Mistral Large 310010099979698.4%
ByteDance Seed 1.6 Flash100100100969598.3%
Xiaomi MIMO v2.6 Flash1009998989698.3%
Z.AI GLM 5.2 (Reasoning, High)100100100969598.3%
Claude Opus 4.610010099989598.3%
Z.AI GLM 4.7100100100989398.2%
MiniMax M2.7100100100969498.2%
Mistral Large 4.0100100100979498.1%
Gemma 3 12B100100100979498.1%
Gemma 4 31B (Reasoning)10010097979698.1%
GPT-5 Nano10010099989398.1%
Claude Sonnet 5 (Reasoning)100100100969598.1%
Z.AI GLM 5.3 (Reasoning, Max)100100100979498.1%
GPT-5 Mini10010098979598.0%
Writer: Palmyra X5100100100969498.0%
Qwen 3.8 Flash (Reasoning)1001001001009098.0%
Hermes 3 405B1001001001009097.9%
MiniMax M2.51001001001008997.8%
Z.AI GLM 4.610010099969497.8%
Ministral 3 8B100100100999097.8%
Qwen 3 235B A22B Instruct 250710010099959497.8%
Gemini 3.6 Flash (Reasoning)1001001001008997.8%
GPT-5100100100969397.7%
Claude Opus 5 (Reasoning, Low)100100100969297.7%
Claude Haiku 5.5 (Reasoning, Medium)1009999959497.6%
Ministral 3B10010097979397.3%
Aion 3.0 Mini100100100949297.3%
Laguna XS 2.110010099949397.3%
DeepSeek V3.21009998979397.3%
Z.AI GLM 5100100100988897.3%
Arcee AI: Trinity Mini10010097979297.3%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100959197.2%
Gemma 3 27B10010096969597.2%
Hy4 Preview (Reasoning, High)100100100978997.2%
Claude Opus 5 (Reasoning)100100100969097.1%
Gemini 3.1 Flash Lite10010097959296.8%
Claude Opus 4100100100968896.8%
Mistral Medium 3.5100100100949096.7%
DeepSeek-V2 Chat10010099939296.7%
Z.AI GLM 4.5 Air100100100978696.7%
Ministral 3 14B10010099959096.7%
Aion 2.01009998959196.6%
Gemma 4 31B100100100958796.5%
Claude Opus 51009796969396.5%
Hermes 3 70B10010099948996.4%
Claude Sonnet 510010096968996.2%
MiniMax M3100100100919096.1%
WizardLM 2 8x22b10010095959095.9%
Xiaomi MIMO v2.5 Pro1009797939295.9%
Claude Sonnet 4.6 (Reasoning)10010097938995.8%
Claude Sonnet 5 (Reasoning, Low)10010098928995.7%
Gemini 3.8 Flash (Reasoning, Medium)100100100908895.6%
Gemini 3 Flash (Preview, Reasoning)1009897929095.5%
Claude Opus 4.71009996938995.4%
Gemma 3 4B10010094929095.3%
Gemini 3 Flash (Preview)10010096958494.9%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010094948694.8%
Claude Haiku 5.5 (Reasoning, Low)1009490 – – 94.6%
Cydonia 24B V4.110010095938594.5%
Claude Opus 4.7 (Reasoning)100100100918194.5%
Gemini 3.1 Flash Lite (Preview)10010096908694.3%
DeepSeek V4 Flash 0731 (Reasoning, High)10010098868694.0%
Xiaomi MIMO v2.51009593928993.9%
Z.AI GLM 4.7 Flash989595938893.7%
Qwen 2.5 72B1009492929093.6%
ByteDance Seed 1.610010097967493.3%
ByteDance Seed 2.0 Mini10010095937492.3%
ByteDance Seed 2.0 Lite1009595848491.5%
Gemini 2.5 Pro969695898191.2%
DeepSeek V3.1959186797685.4%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
o4 Mini100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Gemma 3 12B10010010010010099.9%
Qwen 3.5 Flash10010010010010099.9%
Qwen 3.8 Flash (Reasoning)10010010010010099.9%
Thinking Machines Inkling1001001001009999.9%
Hy4 Preview (Reasoning, High)1001001001009999.8%
Thinking Machines Inkling (Reasoning)1001001001009999.7%
DeepSeek V4 Pro1001001001009999.7%
Mistral Medium 3.51001001001009899.7%
GPT-4.11001001001009899.6%
Claude Haiku 4.51001001001009899.6%
Mistral Large 4.0 (Reasoning)1001001001009899.6%
Gemma 3 27B100100100999999.6%
Mistral Large 31001001001009899.6%
Qwen 3.5 Plus (2026-02-15)1001001001009899.5%
DeepSeek V4.1 Flash (Reasoning, High)1001001001009899.5%
Gemini 3.7 Flash (Reasoning, Medium)1001001001009899.5%
Xiaomi MIMO v2.6 Flash100100100999899.5%
GPT-4.1 Nano1001001001009899.5%
Ministral 8B1001001001009899.5%
Gemini 3.8 Flash (Reasoning, Medium)1001001001009799.4%
Aion 3.01001001001009799.4%
Gemma 4 31B100100100999899.4%
Gemma 4 26B1001001001009799.4%
Qwen 3.7 Max100100100999799.4%
GPT-5.4 Nano (Reasoning, Low)1001001001009799.4%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009799.4%
Claude Opus 41001001001009799.4%
Inception Mercury 2100100100989899.4%
GPT-4.1 Mini1001001001009799.3%
Mistral Medium 3.110010099999899.3%
Claude Sonnet 41001001001009699.3%
Gemma 4 26B (Reasoning)10010099999899.3%
Gemini 3.6 Flash (Reasoning, Minimal)100100100999799.2%
GPT-OSS 120B1001001001009699.2%
Claude Opus 4.8 (Reasoning)1001001001009699.2%
Gemini 3.1 Flash Lite (Reasoning)100100100999799.2%
Z.AI GLM 4.5100100100989799.2%
Claude Opus 5.5 (Reasoning)1001001001009699.1%
Gemini 3.1 Flash Lite (Preview)100100100989899.1%
Gemini 3.5 Flash (Reasoning)100100100989799.1%
Gemini 3.6 Flash (Reasoning)100100100999699.0%
Z.AI GLM 5 Turbo1001001001009699.0%
Grok 4.6 (Reasoning, High)100100100989799.0%
DeepSeek V4 Pro (Reasoning)100100100989799.0%
Muse Spark 1.1 (Reasoning, Medium)10010099989898.9%
Gemini 3.5 Flash (Reasoning, Minimal)100100100999698.9%
Mistral Medium 3.5 (Reasoning)100100100989698.9%
Xiaomi MIMO v2.6 Pro1001001001009498.9%
Claude Opus 4.61001001001009498.8%
Muse Glimmer 30B (Reasoning, Medium)100100100999598.8%
Writer: Palmyra X5100100100999598.8%
Gemini 2.5 Flash (Reasoning)100100100979698.6%
MiniMax M2.7100100100989698.6%
Gemini 2.5 Pro100100100999498.6%
Kimi K3 (Reasoning, High)10010099989698.6%
Qwen 3.5 35B10010099979698.5%
Gemma 3 4B10010099989698.5%
Claude Opus 4.5100100100979598.5%
DeepSeek V3 (2024-12-26)100100100979598.4%
Mistral Small 4 (Reasoning)100100100989498.4%
Cohere Command R+ (Aug. 2024)1001001001009298.3%
Ministral 3 3B1001001001009298.3%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100979498.3%
Ministral 3 14B100100100979598.3%
Qwen 3.5 122B100100100999298.3%
Claude Opus 5100100100989398.2%
DeepSeek V3 (2025-03-24)100100100979498.2%
DeepSeek V4 Flash (Reasoning)100100100969598.1%
Claude Opus 4.6 (Reasoning)1009999989598.1%
Z.AI GLM 51009998979798.1%
GPT-4o, Aug. 6th (temp=0)100100100969498.1%
Mistral Small 4100100100969498.0%
GPT-5 Mini10010099999298.0%
Z.AI GLM 5.2 (Reasoning, High)10010098979497.9%
Qwen 3.5 27B10010099979397.8%
GPT-4o Mini (temp=0)100100100979297.8%
Thinking Machines Inkling Small (Reasoning, High)100100100979197.7%
Qwen 2.5 72B10010097969697.7%
Ministral 3B10010098959497.5%
Z.AI GLM 5.3 (Reasoning, Max)100100100998897.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100949297.3%
Gemma 4 31B (Reasoning)1009999998997.3%
Z.AI GLM 4.7 Flash10010099989097.2%
Mistral Large 2100100100939397.2%
DeepSeek-V2 Chat10010097949497.1%
ByteDance Seed 1.6 Flash100100100959197.1%
Aion 3.5 Mini (Reasoning, High)100100100949197.0%
Gemini 2.5 Flash Lite (Reasoning)10010098949397.0%
ByteDance Seed 1.610010098978996.9%
Xiaomi MIMO v2.5100100100988696.8%
Claude Sonnet 5 (Reasoning)10010099959096.8%
WizardLM 2 8x22b10010098939296.8%
Nemotron 3 Nano10010099988796.7%
Claude Opus 5 (Reasoning, Low)10010098949096.6%
GPT-5 Nano1009995959496.5%
Xiaomi MIMO v2.5 Pro10010099949096.5%
Mistral Large 4.010010097939296.4%
Laguna XS 2.110010098939196.4%
Claude Sonnet 4.61001001001008296.3%
Gemini 2.5 Flash10010096939296.2%
Gemini 3 Flash (Preview, Reasoning)1009696959496.2%
DeepSeek V4 Flash 0731 (Reasoning, High)10010098948996.1%
Qwen 3 32B100100100948696.0%
Aion 3.5 (Reasoning, High)10010094939295.9%
Claude Sonnet 4.6 (Reasoning)100100100918895.8%
Claude Opus 4.7989795949495.8%
Nemotron 3 Super100100100908895.7%
DeepSeek V4 Flash10010097968595.7%
Gemini 2.5 Flash Lite1009997958795.6%
Z.AI GLM 4.61009996948995.5%
GPT-4o, Aug. 6th (temp=1)100100100958395.5%
Hermes 3 405B10010096928995.5%
ByteDance Seed 2.0 Lite100100100918595.3%
Claude Opus 4.7 (Reasoning)1009894939295.3%
Claude Haiku 5.5 (Adaptive)10010099958295.3%
Aion 2.010010094919195.1%
Gemini 3 Flash (Preview)979796949195.1%
DeepSeek V3.210010094928995.0%
Arcee AI: Trinity Mini100100100977895.0%
MiniMax M310010095958494.9%
Laguna S 2.11009795948994.9%
Claude Haiku 5.5 (Reasoning, Medium)10010095958394.5%
Claude Opus 5 (Reasoning)1009893908994.3%
MiniMax M2.510010096888794.3%
Z.AI GLM 4.710010092908994.2%
Gemini 3.1 Flash Lite1009695938894.2%
Mistral NeMO1009997908594.0%
Claude Sonnet 510010096898493.7%
Claude Sonnet 5 (Reasoning, Low)999593918893.3%
Cydonia 24B V4.110010096937693.2%
Z.AI GLM 4.5 Air989691918993.0%
Hermes 3 70B1009893897891.5%
ByteDance Seed 2.0 Mini1009693887690.5%
Mistral Small 3.2 24B100100100945790.3%
DeepSeek V3.110010093886188.5%
Llama 3.1 70B989691866286.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
GPT-5100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-5.5 (Reasoning, Low)10010010010010099.9%
Mistral Small 3.2 24B10010010010010099.9%
GPT-5.5 (Reasoning, Medium)10010010010010099.9%
DeepSeek-V2 Chat10010010010010099.9%
Gemini 3.7 Flash (Reasoning, Medium)1001001001009999.9%
Mistral Large 21001001001009999.9%
Claude Sonnet 5.5 (Reasoning)10010010010010099.9%
Qwen 3.5 9B10010010010010099.8%
GPT-OSS 120B1001001001009999.8%
GPT-4.1 Mini1001001001009999.8%
GPT-6.1 Sol (Reasoning, Medium)1001001001009999.8%
Kimi K2.51001001001009999.7%
GPT-4o Mini (temp=0)1001001001009999.7%
GPT-6 Luna (Reasoning, Medium)1001001001009999.7%
Muse Spark 1.1 (Reasoning, Minimal)100100100999999.7%
Z.AI GLM 4.61001001001009899.6%
Arcee AI: Trinity Mini1001001001009899.6%
Mistral Large 4.01001001001009899.6%
Gemini 3.5 Flash (Reasoning)1001001001009899.5%
Qwen 3 235B A22B Instruct 2507100100100999999.5%
GPT-6 Sol (Reasoning, Medium)1001001001009899.5%
GPT-4o, Aug. 6th (temp=1)100100100999899.5%
Nemotron 3 Nano1001001001009899.5%
Qwen 3.8 Flash (Reasoning)1001001001009799.5%
GPT-5.6 Terra (Reasoning, Medium)1001001001009799.5%
GPT-6 Sol1001001001009799.5%
Gemini 2.5 Flash Lite (Reasoning)1001001001009799.4%
Gemini 2.5 Flash1001001001009799.4%
Gemma 3 4B1001001001009799.4%
Gemini 3.1 Flash Lite100100100999899.4%
Laguna XS 2.11001001001009799.4%
Z.AI GLM 4.5 Air100100100999899.4%
Xiaomi MIMO v2.5 Pro100100100999899.3%
Kimi K2.61001001001009699.3%
Z.AI GLM 5 Turbo100100100999799.2%
Grok 4.6 (Reasoning, High)100100100999799.2%
Muse Spark 1.2 (Reasoning, Medium)1001001001009699.2%
Mistral Large 4.0 (Reasoning)1001001001009699.2%
Claude Opus 4.5100100100989899.2%
Qwen 3.6 Flash1001001001009699.2%
Claude Sonnet 4100100100989899.2%
Z.AI GLM 4.7100100100989799.1%
Aion 3.0100100100989799.1%
Grok 4.20100100100999699.1%
Thinking Machines Inkling (Reasoning)1001001001009699.0%
DeepSeek V3 (2024-12-26)10010099989899.0%
Claude Opus 5 (Reasoning)1009999999899.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100979799.0%
DeepSeek V4 Flash (Reasoning)100100100989698.9%
Qwen 3.7 Max100100100999698.9%
Mistral Medium 3.5100100100989698.9%
Gemma 4 31B (Reasoning)1001001001009498.8%
Ministral 3 3B100100100999598.8%
Qwen 3.5 Plus (2026-04-20)100100100989698.8%
Gemini 3 Flash (Preview)1001001001009498.8%
Ministral 8B10010099989798.8%
GPT-4.1 Nano100100100999598.8%
MiniMax M2.71001001001009498.7%
Mistral Small 4100100100999498.7%
Hermes 3 405B10010098989798.7%
ByteDance Seed 1.6 Flash100100100989698.7%
DeepSeek V4 Pro100100100999498.7%
Writer: Palmyra X5100100100999498.7%
Aion 3.5 (Reasoning, High)100100100999498.7%
GPT-5.4 Mini100100100979698.6%
Qwen 3.6 27B1001001001009398.5%
DeepSeek V4 Pro (Reasoning)100100100999398.5%
Gemini 3.6 Flash (Reasoning, Minimal)100100100969698.5%
Mistral NeMO100100100999498.4%
Aion 2.0100100100989498.4%
Claude Sonnet 4.51001001001009298.4%
Claude Opus 4.8 (Reasoning, Low)100100100999398.4%
Aion 3.0 Mini100100100999398.4%
Mistral Medium 3.5 (Reasoning)100100100999398.4%
Laguna S 2.11001001001009198.3%
DeepSeek V4.1 Flash (Reasoning, High)10010098979798.2%
MiniMax M2.51001001001009198.2%
Gemma 3 27B100100100969598.1%
Aion 3.5 Mini (Reasoning, High)10010099979498.1%
Ministral 3 8B10010099979498.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001008997.9%
Gemini 3.1 Flash Lite (Reasoning)1009897979697.8%
Ministral 3 14B100100100979297.8%
Nemotron 3 Super10010099959597.8%
MiniMax M3100100100989197.7%
Gemma 4 26B (Reasoning)100100100999097.7%
Kimi K3 (Reasoning, High)10010099969397.7%
Claude Opus 5.5 (Reasoning)10010097979397.5%
Qwen 2.5 72B100100100949397.5%
Z.AI GLM 5.110010097979397.5%
GPT-5 Nano10010098969497.5%
Cydonia 24B V4.110010098969397.4%
Xiaomi MIMO v2.6 Flash10010097959597.3%
Xiaomi MIMO v2.6 Pro10010098959397.2%
Qwen 3 32B10010096959597.2%
Qwen 3.8 27B (Reasoning, XHigh)1001001001008597.0%
Claude Opus 4.8 (Reasoning)10010099949297.0%
GPT-5 Mini10010097969197.0%
Z.AI GLM 5.3 (Reasoning, Max)10010097949396.9%
DeepSeek V3.21009998979096.9%
WizardLM 2 8x22b100100100998696.9%
Claude Sonnet 4.610010099958996.7%
Claude Opus 510010099939096.4%
Xiaomi MIMO v2.510010096949296.4%
DeepSeek V4 Flash10010098929196.3%
Gemini 2.5 Flash Lite100100100948796.1%
Hermes 3 70B100100100918995.8%
Gemma 4 26B10010098938795.8%
Gemma 4 31B100100100918795.6%
Claude Opus 4.6989897959195.6%
Ministral 3B10010099938695.6%
Z.AI GLM 4.7 Flash10010099908995.6%
Gemini 3 Flash (Preview, Reasoning)10010097968495.5%
Claude Opus 4.7 (Reasoning)100100100978195.5%
Z.AI GLM 51009797958895.4%
Gemma 3 12B10010098978295.3%
Mistral Large 310010098968295.3%
Claude Opus 5 (Reasoning, Low)1009898928795.1%
Gemini 2.5 Pro10010096908995.0%
Claude Opus 4.6 (Reasoning)1009695948994.8%
Claude Haiku 4.51009694939194.7%
Kimi K3 (Reasoning, Low)10010092919094.6%
Z.AI GLM 5.3 Flash (Reasoning, Low)1009897918794.6%
Claude Haiku 5.5 (Reasoning, Medium)989898948494.6%
ByteDance Seed 1.61009896918894.3%
DeepSeek V3.110010094898794.0%
Gemini 3.1 Flash Lite (Preview)10010094928493.9%
Cohere Command R+ (Aug. 2024)1009896908593.8%
ByteDance Seed 2.0 Mini10010095878593.5%
Z.AI GLM 5.3 Flash (Reasoning, Max)1009993918493.4%
Claude Sonnet 51009896888493.2%
Claude Sonnet 5 (Reasoning)979794918693.1%
Z.AI GLM 5.2 (Reasoning, High)979494928993.0%
Claude Opus 4.7999999847992.1%
Llama 3.1 70B1009493888291.5%
ByteDance Seed 2.0 Lite999391888290.6%
Claude Sonnet 4.6 (Reasoning)979692927390.0%
Claude Haiku 5.5 (Adaptive)989289807887.3%
Claude Haiku 5.5 (Reasoning, Low)94858278 – 84.7%
Claude Sonnet 5 (Reasoning, Low)908886796180.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
o4 Mini100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)1001001001009999.9%
Qwen 3.5 Flash1001001001009999.8%
GPT-5.21001001001009999.8%
Claude Opus 41001001001009999.8%
o4 Mini High1001001001009999.8%
Grok 4.20 (Reasoning)1001001001009999.7%
GPT-51001001001009899.7%
GPT-4o, Aug. 6th (temp=1)1001001001009899.7%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009899.6%
GPT-5.6 Sol (Reasoning, Medium)1001001001009899.6%
GPT-5.6 Luna1001001001009899.6%
Qwen 3.5 397B A17B1001001001009899.5%
Thinking Machines Inkling1001001001009899.5%
GPT-4o Mini (temp=1)100100100999999.5%
GPT-4.11001001001009799.4%
Kimi K2.51001001001009799.4%
Qwen 3.5 27B1001001001009799.3%
GPT-6 Sol1001001001009699.1%
Muse Spark 1.2 (Reasoning, Medium)1001001001009599.0%
Mistral Small 4 (Reasoning)10010099989799.0%
Gemini 3.5 Flash Lite (Reasoning)100100100989698.9%
Qwen 3.5 Plus (2026-04-20)100100100999698.9%
Mistral NeMO10010099999698.9%
Grok 4.31001001001009498.9%
Kimi K2.6100100100999598.7%
Qwen 3 32B100100100989598.6%
Gemini 2.5 Flash (Reasoning)1009999989798.5%
GPT-4.1 Mini1001001001009398.5%
Gemini 3.6 Flash (Reasoning)100100100999398.5%
GPT-5.4 Nano (Reasoning)100100100989498.5%
Claude Opus 4.8 (Reasoning)1001001001009298.4%
Qwen 3.5 9B100100100989498.4%
Inception Mercury 210010099999498.4%
Kimi K3 (Reasoning, High)10010099989498.3%
Grok 4.5 (Reasoning, Low)1001001001009198.2%
GPT-5.5 (Reasoning, Medium)1009998979798.2%
GPT-OSS 120B10010099969698.2%
Nemotron 3 Super100100100979498.2%
GPT-5.4 Mini10010098969597.9%
Thinking Machines Inkling (Reasoning)100100100959497.8%
GPT-6 Luna (Reasoning, High)100100100969397.8%
Qwen 3 235B A22B Instruct 2507100100100979197.6%
Qwen 3.5 122B1009996969697.5%
GPT-5.6 Terra (Reasoning, Medium)10010099969297.5%
Qwen 3.5 35B100100100989097.5%
Muse Glimmer 30B (Reasoning, Medium)1009998979397.5%
Hy4 Preview (Reasoning, High)100100100988997.4%
GPT-5.4 Nano (Reasoning, Low)1009998969397.4%
Grok 4.20100100100949297.2%
GPT-4o Mini (temp=0)1001001001008697.2%
Z.AI GLM 510010097959497.1%
Z.AI GLM 5.3 (Reasoning, Max)100100100968997.0%
GPT-5 Nano10010096959397.0%
Gemma 4 26B (Reasoning)100100100969097.0%
GPT-6 Luna (Reasoning, Medium)1009997959397.0%
GPT-5.4 Nano999898979396.9%
Grok 4.7 (Reasoning, High)100100100978896.9%
Gemini 3.5 Flash (Reasoning, Minimal)100100100978796.8%
GPT-5.4 Mini (Reasoning, Low)10010099968996.7%
Gemini 3.6 Flash (Reasoning, Minimal)100100100978796.7%
GPT-5.5 (Reasoning, Low)1009897959396.7%
GPT-5.4 (Reasoning, Low)10010097949396.7%
Gemini 2.5 Flash Lite10010097949296.6%
Qwen 3.5 Plus (2026-02-15)1009795959596.6%
Claude Sonnet 5.5 (Reasoning)100100100958896.5%
GPT-5.51009896969296.5%
Gemma 3 4B10010096949296.4%
Gemini 3.1 Flash Lite (Reasoning)100100100948996.4%
GPT-5.4 (Reasoning)10010098958996.4%
GPT-5.6 Luna (Reasoning, Medium)10010097978796.3%
GPT-5.410010098929196.2%
Hermes 3 405B100100100958696.2%
Claude Opus 5.5 (Reasoning)10010098958896.1%
DeepSeek V4.1 Flash (Reasoning, High)100100100958596.0%
Aion 3.5 Mini (Reasoning, High)1009994949396.0%
GPT-5.6 Terra1009995949195.9%
MiniMax M2.7100100100978295.9%
Mistral Medium 3.5 (Reasoning)1009995949195.8%
Mistral Small 41009595959495.8%
Mistral Large 4.0 (Reasoning)100100100978295.7%
Gemma 3 12B10010098978495.7%
ByteDance Seed 1.6 Flash1009995949095.6%
Gemma 3 27B1009896939195.6%
Claude Opus 5 (Reasoning)999695949495.5%
Gemma 4 26B10010095929095.5%
Writer: Palmyra X510010094929195.4%
Gemini 3.1 Flash Lite (Preview)100100100968195.3%
Ministral 3 3B1009993929295.1%
Z.AI GLM 4.5100100100908595.1%
Mistral Small 3.2 24B100100100997695.0%
Mistral Large 4.010010098958195.0%
GPT-6 Luna999994929195.0%
Ministral 3 8B1009994929094.9%
Qwen 2.5 72B999897928894.6%
Gemini 3 Flash (Preview)999896948694.4%
Gemini 3.8 Flash (Reasoning, Medium)100100100947894.3%
Ministral 3 14B10010096938294.3%
Grok 4.6 (Reasoning, High)1009793919094.2%
Z.AI GLM 5.110010097948094.2%
Cydonia 24B V4.11009991919094.1%
Aion 3.5 (Reasoning, High)10010096888794.1%
DeepSeek V3 (2024-12-26)1009997918394.1%
Gemini 3 Flash (Preview, Reasoning)989493929293.9%
Gemini 2.5 Flash989693919193.8%
MiniMax M3999896908693.8%
Gemini 3.7 Flash (Reasoning, Medium)10010090898993.6%
Cohere Command R+ (Aug. 2024)1009793918793.6%
Claude Opus 5 (Reasoning, Low)10010096918293.6%
MiniMax M2.51009696898793.6%
GPT-4.1 Nano10010095908293.5%
Hermes 3 70B10010095918193.5%
Mistral Medium 3.1979594938893.4%
Claude Opus 4.7 (Reasoning)979693928993.4%
DeepSeek V3 (2025-03-24)1009995918093.0%
Claude Haiku 4.5969694948593.0%
Z.AI GLM 5 Turbo10010095917992.9%
Mistral Medium 3.5979592928892.7%
Llama 3.1 70B10010097887892.5%
WizardLM 2 8x22b1009593928092.2%
Aion 3.0 Mini1009290908992.1%
Thinking Machines Inkling Small (Reasoning, High)1009692878592.1%
DeepSeek V3.21009994858392.1%
Gemini 3.5 Flash (Reasoning)969492928692.0%
Ministral 3B1009691908291.7%
GPT-5.4 Mini (Reasoning)989391908691.7%
DeepSeek V3.11009696897891.7%
Arcee AI: Trinity Mini10010087868591.7%
Gemini 2.5 Flash Lite (Reasoning)10010095838191.6%
Claude Opus 4.5989595917991.5%
Kimi K3 (Reasoning, Low)1009392918291.5%
Gemini 3.1 Flash Lite979693868591.5%
Claude Opus 4.8 (Reasoning, Low)1009591888291.4%
Gemma 4 31B (Reasoning)979696868291.3%
GPT-5 Mini999490888691.3%
Mistral Large 21009992858191.3%
Z.AI GLM 4.7 Flash1009891848291.2%
Ministral 8B1009491868491.0%
Xiaomi MIMO v2.6 Pro1009592897990.8%
Xiaomi MIMO v2.6 Flash959595878390.8%
Gemma 4 31B939291908790.6%
Claude Sonnet 41009088878790.5%
DeepSeek-V2 Chat1009789897890.5%
Claude Opus 4.6 (Reasoning)969593888190.4%
Z.AI GLM 5.2 (Reasoning, High)989490868490.4%
Claude Opus 51009692847890.1%
Claude Sonnet 4.5979690858289.9%
Claude Sonnet 51009089888289.8%
DeepSeek V4 Pro (Reasoning)989390858189.6%
Qwen 3.7 Max1009492837989.5%
Xiaomi MIMO v2.5969492858089.5%
Nemotron 3 Nano1009789867589.4%
DeepSeek V4 Flash1009287878189.4%
Aion 3.01009689808088.9%
Laguna S 2.11009589857788.9%
Claude Opus 4.6959292848188.8%
Z.AI GLM 5.3 Flash (Reasoning, Low)949089868588.7%
Gemini 2.5 Pro999188867788.5%
ByteDance Seed 1.61009189877588.4%
DeepSeek V4 Flash (Reasoning)989688847588.2%
ByteDance Seed 2.0 Lite1009185838288.1%
Claude Opus 4.7928989858588.0%
Xiaomi MIMO v2.5 Pro949188867987.8%
ByteDance Seed 2.0 Mini989289827987.8%
Mistral Large 31008885838187.4%
DeepSeek V4 Pro1009384827486.7%
Claude Sonnet 4.6969290767485.5%
Z.AI GLM 4.7968987847185.3%
Qwen 3.8 Flash (Reasoning)10010082776785.2%
DeepSeek V4 Pro 0813 (Reasoning, High)948988886685.0%
Z.AI GLM 4.6969482777584.8%
Claude Haiku 5.5 (Adaptive)938985837484.7%
Laguna XS 2.11009180767383.9%
Z.AI GLM 4.5 Air998787816583.8%
GPT-4o, Aug. 6th (temp=0)1009886706683.8%
Claude Sonnet 4.6 (Reasoning)958783807383.6%
Claude Sonnet 5 (Reasoning, Low)1009078747282.9%
DeepSeek V4 Flash 0731 (Reasoning, High)948988796182.1%
Claude Sonnet 5 (Reasoning)968581747381.9%
Aion 2.0938584757081.2%
Claude Haiku 5.5 (Reasoning, Medium)987671655472.7%
Claude Haiku 5.5 (Reasoning, Low)7169 – – – 69.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
GPT-6 Luna100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Inception Mercury 2100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Gemma 4 31B (Reasoning)10010010010010099.9%
Qwen 3.5 9B10010010010010099.9%
GPT-4o Mini (temp=1)10010010010010099.9%
Ministral 3 14B10010010010010099.9%
GPT-51001001001009999.9%
Qwen 3.5 35B10010010010010099.9%
Claude Opus 4.8 (Reasoning)1001001001009999.9%
GPT-5.5 (Reasoning, Low)1001001001009999.9%
Grok 4.201001001001009999.9%
Gemini 3.6 Flash (Reasoning)1001001001009999.9%
DeepSeek V3 (2025-03-24)1001001001009999.9%
Thinking Machines Inkling1001001001009999.9%
Gemini 2.5 Flash (Reasoning)1001001001009999.8%
GPT-4o Mini (temp=0)1001001001009999.8%
Mistral Medium 3.51001001001009999.8%
GPT-5 Nano1001001001009999.8%
Claude Opus 51001001001009999.8%
Aion 3.0 Mini1001001001009999.8%
GPT-OSS 120B1001001001009999.7%
Mistral Medium 3.11001001001009999.7%
Qwen 3.5 27B1001001001009899.7%
Z.AI GLM 5.11001001001009899.7%
Mistral Large 4.01001001001009899.7%
Kimi K3 (Reasoning, Low)1001001001009999.7%
DeepSeek V4 Pro (Reasoning)1001001001009899.7%
Ministral 3B1001001001009899.7%
Claude Opus 4.51001001001009899.6%
Claude Sonnet 41001001001009899.6%
Gemini 3 Flash (Preview)1001001001009899.6%
Hermes 3 405B1001001001009899.6%
MiniMax M31001001001009899.6%
Hermes 3 70B1001001001009899.6%
MiniMax M2.51001001001009899.6%
DeepSeek V4 Flash (Reasoning)1001001001009899.6%
GPT-6 Luna (Reasoning, High)1001001001009899.6%
GPT-4.1 Mini1001001001009899.6%
Z.AI GLM 5100100100999999.6%
Writer: Palmyra X51001001001009899.5%
DeepSeek V4 Flash1001001001009799.5%
Qwen 3.8 Flash (Reasoning)100100100999899.5%
Muse Glimmer 30B (Reasoning, Medium)1001001001009799.5%
Xiaomi MIMO v2.5 Pro1001001001009799.5%
Z.AI GLM 4.51001001001009799.5%
Gemma 4 26B (Reasoning)100100100999899.4%
Z.AI GLM 4.5 Air1001001001009799.4%
Claude Opus 5.5 (Reasoning)1001001001009799.4%
DeepSeek V4.1 Flash (Reasoning, High)100100100999899.3%
Ministral 3 3B100100100999799.3%
Gemma 4 26B1001001001009699.3%
Z.AI GLM 5.2 (Reasoning, High)1001001001009699.3%
GPT-5 Mini1001001001009699.3%
DeepSeek V3 (2024-12-26)1001001001009699.3%
Cohere Command R+ (Aug. 2024)100100100999899.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009699.2%
ByteDance Seed 1.6 Flash100100100999799.2%
Thinking Machines Inkling Small (Reasoning, High)1001001001009699.2%
Z.AI GLM 5 Turbo1001001001009699.1%
Aion 3.0100100100989799.1%
Claude Sonnet 5 (Reasoning, Low)1001001001009699.1%
Claude Opus 5 (Reasoning)10010099999899.1%
Cydonia 24B V4.11001001001009599.1%
Claude Opus 4.8 (Reasoning, Low)100100100999699.1%
Gemini 3 Flash (Preview, Reasoning)1001001001009599.0%
Mistral Medium 3.5 (Reasoning)1001001001009599.0%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001009599.0%
Qwen 3.5 Flash1001001001009598.9%
Claude Opus 4.6100100100999698.9%
Claude Opus 4100100100979798.9%
Gemma 3 27B100100100979798.9%
Claude Sonnet 5 (Reasoning)1001001001009498.9%
Z.AI GLM 5.3 Flash (Reasoning, Max)10010099989798.8%
Mistral Large 31001001001009498.7%
Ministral 8B1001001001009398.7%
Mistral Small 3.2 24B10010099999598.6%
Claude Sonnet 4.6 (Reasoning)100100100999598.6%
Qwen 3 235B A22B Instruct 25071001001001009398.6%
Arcee AI: Trinity Mini10010099999598.5%
Claude Haiku 4.51001001001009398.5%
Kimi K3 (Reasoning, High)1001001001009398.5%
Claude Opus 4.6 (Reasoning)1009999989798.4%
MiniMax M2.7100100100989498.4%
Claude Haiku 5.5 (Reasoning, Medium)100100100969698.4%
Claude Opus 5 (Reasoning, Low)10010099989498.3%
Claude Opus 4.710010099989498.3%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099989498.3%
Claude Sonnet 4.610010099989498.2%
Laguna XS 2.110010099979598.1%
Gemini 3.5 Flash (Reasoning, Minimal)100100100969498.1%
Gemini 2.5 Flash Lite1009999969698.1%
Xiaomi MIMO v2.51001001001009098.1%
Nemotron 3 Super1001001001008997.9%
Hy4 Preview (Reasoning, High)10010097979697.9%
Aion 2.010010099989297.8%
Gemini 3.1 Flash Lite100100100989197.8%
Mistral Large 2100100100989197.7%
Claude Opus 4.7 (Reasoning)10010098959497.5%
Qwen 2.5 72B1009998979397.3%
Z.AI GLM 4.7 Flash10010096959597.2%
Claude Sonnet 5100100100949297.2%
Mistral NeMO100100100949297.2%
GPT-4.1 Nano100100100959197.2%
Z.AI GLM 5.3 (Reasoning, Max)100100100959197.1%
Z.AI GLM 4.7100100100969097.1%
Mistral Small 41001001001008597.0%
Gemini 3.1 Flash Lite (Reasoning)100100100968996.9%
Z.AI GLM 4.610010098959196.8%
Ministral 3 8B100100100958896.7%
Aion 3.5 (Reasoning, High)1009997949396.6%
DeepSeek V3.11009897959396.6%
DeepSeek V3.2100100100968496.1%
Qwen 3 32B100100100938695.9%
Aion 3.5 Mini (Reasoning, High)10010099978395.7%
Gemini 2.5 Pro10010097929095.7%
Claude Haiku 5.5 (Reasoning, Low)9893 – – – 95.3%
Xiaomi MIMO v2.6 Flash10010098958395.0%
ByteDance Seed 2.0 Lite10010096908794.6%
Llama 3.1 70B100100100987494.4%
GPT-4o, Aug. 6th (temp=0)10010093878793.2%
Claude Haiku 5.5 (Adaptive)1009997927692.8%
ByteDance Seed 1.61009291888290.7%
ByteDance Seed 2.0 Mini959288858388.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
GPT-6 Sol100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
GPT-6 Luna (Reasoning, High)10010010010010099.9%
Claude Opus 4.6 (Reasoning)1001001001009999.9%
GPT-510010010010010099.9%
Grok 4.6 (Reasoning, High)1001001001009999.9%
GPT-4o, Aug. 6th (temp=1)1001001001009999.8%
Gemini 3.1 Flash Lite (Preview)1001001001009999.8%
Qwen 3 32B1001001001009999.8%
Claude Sonnet 5.5 (Reasoning)1001001001009999.8%
GPT-5.41001001001009999.7%
Z.AI GLM 5.3 (Reasoning, Max)1001001001009999.7%
Z.AI GLM 4.5 Air1001001001009899.6%
GPT-4o Mini (temp=0)1001001001009899.6%
Hy4 Preview (Reasoning, High)1001001001009899.6%
Qwen 3.7 Max1001001001009899.6%
Grok 4.201001001001009899.6%
Inception Mercury 21001001001009799.5%
Gemma 3 12B1001001001009899.5%
Qwen 3.6 Flash1001001001009799.4%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100999999.4%
Thinking Machines Inkling Small (Reasoning, High)100100100999899.4%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001009799.4%
Z.AI GLM 5.3 Flash (Reasoning, Max)1001001001009799.4%
GPT-6 Luna (Reasoning, Medium)1001001001009799.4%
GPT-4.11001001001009799.4%
Qwen 3.5 27B1001001001009799.4%
Mistral Small 4 (Reasoning)100100100999899.3%
GPT-5 Mini1001001001009699.2%
Thinking Machines Inkling (Reasoning)1001001001009699.2%
GPT-6 Luna1001001001009599.1%
Mistral Large 21001001001009599.0%
Gemini 2.5 Flash (Reasoning)100100100989799.0%
Writer: Palmyra X51001001001009599.0%
DeepSeek V3 (2025-03-24)10010099999698.7%
DeepSeek V4 Pro (Reasoning)100100100989698.7%
GPT-OSS 120B1001001001009398.7%
Z.AI GLM 5 Turbo100100100999498.6%
Qwen 3.5 122B100100100989598.6%
GPT-5.4 Nano100100100999498.5%
DeepSeek V4 Flash1009999979798.5%
DeepSeek V4 Pro1001001001009298.4%
Gemma 4 31B (Reasoning)100100100989498.4%
MiniMax M310010098979798.4%
GPT-4.1 Nano100100100979498.3%
Aion 3.5 Mini (Reasoning, High)1001001001009298.3%
Claude Sonnet 5100100100999398.3%
Gemini 2.5 Flash Lite1001001001009198.3%
Mistral Large 4.010010099969698.3%
Gemini 3.1 Flash Lite100100100969598.2%
Qwen 3 235B A22B Instruct 2507100100100969598.1%
Gemini 3.1 Flash Lite (Reasoning)100100100969598.1%
Gemma 4 26B1009999989598.1%
Kimi K3 (Reasoning, Low)100100100969598.1%
MiniMax M2.71001001001009098.1%
DeepSeek V3 (2024-12-26)100100100969598.0%
Laguna XS 2.11001001001009098.0%
Ministral 3 8B1001001001009098.0%
GPT-4o, Aug. 6th (temp=0)10010097979698.0%
Mistral Medium 3.110010099969598.0%
Gemma 4 31B1009998989598.0%
Mistral Large 4.0 (Reasoning)10010099979397.9%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100979297.9%
Gemini 3.6 Flash (Reasoning)100100100969497.9%
Gemini 3 Flash (Preview, Reasoning)10010098969597.9%
Ministral 3B100100100959497.8%
GPT-5 Nano10010098979597.7%
Mistral Large 3100100100959397.7%
Mistral NeMO100100100949497.6%
Gemini 3.5 Flash (Reasoning, Minimal)100100100959397.5%
DeepSeek V4 Flash (Reasoning)10010099989197.5%
Gemma 3 4B1009898969497.4%
Cohere Command R+ (Aug. 2024)100100100949397.4%
GPT-4.1 Mini100100100959297.3%
Qwen 3.5 Flash100100100969197.3%
ByteDance Seed 1.6 Flash100100100949297.2%
DeepSeek-V2 Chat100100100969097.2%
Laguna S 2.11009897979397.1%
WizardLM 2 8x22b1001001001008597.0%
Z.AI GLM 510010099988896.9%
Z.AI GLM 4.7100100100968896.9%
Aion 3.5 (Reasoning, High)10010097959396.8%
Mistral Medium 3.5 (Reasoning)10010097969196.8%
Gemini 3.7 Flash (Reasoning, Medium)100100100998596.8%
Nemotron 3 Super10010099939296.7%
Ministral 8B1001001001008396.6%
ByteDance Seed 2.0 Lite1009696969596.6%
Qwen 3.8 Flash (Reasoning)100100100948996.5%
Claude Opus 410010097969096.5%
Claude Sonnet 5 (Reasoning)1009999939296.5%
Gemini 3.5 Flash (Reasoning)1009897969296.5%
Claude Opus 4.5100100100929196.4%
Claude Opus 4.610010097958996.4%
Claude Sonnet 4.6 (Reasoning)10010099968696.3%
Claude Opus 4.7 (Reasoning)100100100928996.2%
Gemini 2.5 Pro10010098978696.2%
Claude Opus 5 (Reasoning)10010094939396.2%
MiniMax M2.510010098958796.0%
Aion 3.01009897959096.0%
DeepSeek V3.210010097939095.9%
Claude Opus 5.5 (Reasoning)10010096939195.9%
Aion 3.0 Mini1009797939195.6%
Ministral 3 3B10010099948595.6%
Claude Haiku 4.5999996939095.5%
Arcee AI: Trinity Mini10010096948895.5%
Z.AI GLM 5.3 Flash (Reasoning, Low)10010099938495.3%
Mistral Medium 3.510010096948795.2%
Gemini 2.5 Flash Lite (Reasoning)1009997928794.9%
Xiaomi MIMO v2.6 Flash1009998968194.8%
DeepSeek V3.1999996909094.8%
Ministral 3 14B10010093909094.7%
DeepSeek V4.1 Flash (Reasoning, High)10010094938694.6%
Claude Haiku 5.5 (Adaptive)1009998928594.5%
Mistral Small 3.2 24B10010099868694.3%
Gemini 2.5 Flash1001001001007094.0%
Gemini 3 Flash (Preview)1009896938293.8%
Xiaomi MIMO v2.5999793918993.7%
Xiaomi MIMO v2.5 Pro969694938993.6%
Claude Sonnet 410010095947893.5%
Llama 3.1 70B10010091908593.3%
Hermes 3 405B1009995918293.3%
Z.AI GLM 4.7 Flash1009794888793.2%
Claude Opus 51009594948293.1%
Claude Opus 4.71009393898992.8%
Qwen 2.5 72B1009894938092.7%
Hermes 3 70B1009594918492.7%
Claude Opus 4.8 (Reasoning)10010092888492.7%
Claude Sonnet 5 (Reasoning, Low)1009994878292.5%
Claude Haiku 5.5 (Reasoning, Medium)1009292928692.4%
Aion 2.01009993927892.4%
Z.AI GLM 4.61009391908792.0%
Claude Opus 4.8 (Reasoning, Low)969393928692.0%
Claude Opus 5 (Reasoning, Low)999791908291.8%
ByteDance Seed 2.0 Mini999891898191.6%
Cydonia 24B V4.11009292878791.5%
Z.AI GLM 5.2 (Reasoning, High)999493927690.8%
ByteDance Seed 1.6949289898790.1%
Claude Sonnet 4.61009389897889.7%