Cliché density

Test: Bad Writing Habits

Avg. Score
95.9%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.5 Flash Lite (Reasoning, Minimal)100.0%$0.00356.3s100%
2Claude Haiku 5.5 (Reasoning, Medium)100.0%$0.001414.9s100%
3Claude Haiku 5.5 (Adaptive)100.0%$0.001819.3s100%
4GPT-6 Luna100.0%$0.001332.6s100%
5Grok 4.3100.0%$0.006930.5s100%
6GPT-6 Luna (Reasoning, Medium)100.0%$0.001643.0s100%
7Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.01418.0s100%
8Gemini 3.5 Flash Lite (Reasoning)99.6%$0.00356.6s93%
9Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.00051.1m100%
10DeepSeek V4.1 Flash (Reasoning, High)99.6%$0.002935.4s93%
11Claude Haiku 5.5 (Reasoning, Low)99.0%$0.001515.4s89%
12Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0111.0m100%
13Gemma 4 26B99.6%$0.000955.1s93%
14Xiaomi MIMO v2.599.3%$0.005431.8s90%
15Gemini 3.1 Flash Lite98.5%$0.003012.1s86%
16Gemini 3.7 Flash (Reasoning, Medium)99.3%$0.01218.2s90%
17Gemini 3.1 Flash Lite (Preview)98.9%$0.00308.4s84%
18GPT-6 Luna (Reasoning, High)99.6%$0.002357.1s93%
19Claude Sonnet 5 (Reasoning)100.0%$0.03038.9s100%
20Gemini 3.1 Flash Lite (Reasoning)98.9%$0.003011.9s84%
21Gemini 3 Flash (Preview)98.9%$0.007819.6s88%
22Z.AI GLM 5 Turbo99.3%$0.008133.2s90%
23Claude Sonnet 5 (Reasoning, Low)100.0%$0.03138.4s100%
24ByteDance Seed 1.6 Flash98.5%$0.001327.3s86%
25GPT-6 Sol100.0%$0.02751.4s100%
26Gemini 3 Flash (Preview, Reasoning)99.3%$0.01230.1s90%
27Claude Sonnet 4.5100.0%$0.03538.1s100%
28Xiaomi MIMO v2.6 Flash100.0%$0.00081.8m100%
29Gemini 3.5 Flash (Reasoning, Minimal)98.9%$0.01812.0s88%
30Mistral Large 4.099.6%$0.00631.1m93%
31Aion 3.5 (Reasoning, High)100.0%$0.0221.3m100%
32Ministral 3 14B97.4%$0.000711.7s82%
33Muse Spark 1.1 (Reasoning, Minimal)98.5%$0.01219.2s86%
34Qwen 3.7 Flash (Reasoning)98.9%$0.001055.2s88%
35GPT-6 Sol (Reasoning, Medium)100.0%$0.0311.0m100%
36GPT-5.6 Terra (Reasoning, Medium)100.0%$0.04435.2s100%
37Claude Sonnet 599.6%$0.02733.5s93%
38GPT-5.6 Luna (Reasoning, Medium)99.3%$0.01718.0s86%
39Xiaomi MIMO v2.6 Pro100.0%$0.00332.0m100%
40Gemini 3.6 Flash (Reasoning, Minimal)98.5%$0.01714.3s86%
41Claude Haiku 4.598.9%$0.01121.6s84%
42GPT-5 Mini99.3%$0.010057.4s90%
43Grok 4.2098.9%$0.009345.7s88%
44Muse Spark 1.1 (Reasoning, Medium)98.5%$0.01523.9s86%
45Mistral Large 298.5%$0.01329.4s86%
46Muse Glimmer 30B (Reasoning, Medium)98.9%$0.003843.4s84%
47DeepSeek V3 (2025-03-24)98.5%$0.001439.4s83%
48Qwen 3 32B98.5%$0.001554.6s86%
49Mistral Small 497.0%$0.001418.2s81%
50DeepSeek V4 Flash (Reasoning)97.4%$0.000731.1s82%
51Claude Sonnet 4.699.6%$0.03139.3s93%
52Writer: Palmyra X597.8%$0.01122.0s83%
53GPT-5.6 Luna98.1%$0.01515.8s82%
54Gemma 4 31B99.3%$0.00101.6m90%
55Thinking Machines Inkling Small (Reasoning, High)99.6%$0.00881.7m93%
56Qwen 3.6 Flash98.5%$0.01041.4s83%
57GPT-4.1 Mini96.3%$0.002719.0s79%
58DeepSeek V4 Flash98.1%$0.000631.6s77%
59Claude Sonnet 5.5 (Reasoning)99.6%$0.04236.9s93%
60Qwen 3 235B A22B Instruct 250797.8%$0.001159.2s83%
61GPT-6.1 Sol (Reasoning, Medium)100.0%$0.0311.6m100%
62GPT-4o, Aug. 6th (temp=1)97.8%$0.01824.4s83%
63MiniMax M2.598.5%$0.00341.3m86%
64Claude Sonnet 499.3%$0.03243.7s90%
65MiniMax M2.798.1%$0.00401.1m85%
66DeepSeek V4 Pro98.5%$0.00481.3m86%
67Arcee AI: Trinity Mini95.6%$0.00039.2s75%
68Z.AI GLM 598.5%$0.00841.2m86%
69Gemma 4 31B (Reasoning)99.6%$0.00142.2m93%
70Mistral Large 396.7%$0.003330.3s78%
71Claude Opus 4.7100.0%$0.06930.4s100%
72Aion 3.0 Mini98.5%$0.00531.2m83%
73Gemma 4 26B (Reasoning)99.3%$0.00132.0m90%
74GPT-5.4 Mini96.3%$0.01516.8s79%
75Grok 4.5 (Reasoning, Low)98.5%$0.0181.1m86%
76GPT-4.197.8%$0.01844.7s83%
77Laguna XS 2.195.6%$0.000314.4s73%
78Grok 4.3 (Reasoning)100.0%$0.0212.3m100%
79Qwen 3.5 9B97.8%$0.00111.4m83%
80Cydonia 24B V4.196.3%$0.001444.8s77%
81Kimi K3 (Reasoning, Low)98.9%$0.0281.1m88%
82Grok 4.5 (Reasoning, High)99.6%$0.0301.6m93%
83Claude Sonnet 4.6 (Reasoning)100.0%$0.0601.2m100%
84Qwen 3.5 Flash96.3%$0.002547.5s77%
85Mistral Small 4 (Reasoning)96.3%$0.002230.2s73%
86GPT-5.4 Nano (Reasoning)94.8%$0.006124.5s76%
87GPT-5.6 Terra98.9%$0.04636.9s88%
88GPT-5.4 Mini (Reasoning)96.7%$0.02228.1s80%
89Aion 3.098.1%$0.0241.0m85%
90 Kimi K3 (Reasoning, High)100.0%$0.0441.8m100%
91Xiaomi MIMO v2.5 Pro97.4%$0.008553.5s77%
92Gemini 3.6 Flash (Reasoning)98.5%$0.04432.5s86%
93Mistral Medium 3.197.0%$0.004836.5s73%
94Muse Spark 1.2 (Reasoning, Medium)97.0%$0.01838.3s79%
95Aion 3.5 Mini (Reasoning, High)99.6%$0.0112.4m93%
96Qwen 3.6 35B97.0%$0.00831.0m79%
97Laguna S 2.194.8%$0.000522.1s70%
98Z.AI GLM 5.198.1%$0.0141.5m85%
99Gemini 2.5 Flash Lite (Reasoning)94.4%$0.002830.8s73%
100Aion 2.096.7%$0.00641.3m80%
101Grok 4.20 (Reasoning)98.1%$0.0181.5m85%
102Claude Opus 5100.0%$0.08250.1s100%
103Z.AI GLM 4.7 Flash96.7%$0.00171.2m76%
104Z.AI GLM 4.5 Air95.6%$0.002958.2s75%
105Mistral Medium 3.595.9%$0.01818.2s72%
106Claude Opus 4.8 (Reasoning)99.6%$0.07141.7s93%
107Claude Opus 4.7 (Reasoning)99.6%$0.07632.0s93%
108Claude Opus 4.8 (Reasoning, Low)99.6%$0.07141.9s93%
109Qwen 3.5 Plus (2026-02-15)94.1%$0.006031.5s73%
110Thinking Machines Inkling97.8%$0.00751.5m78%
111Z.AI GLM 4.594.1%$0.005142.1s75%
112DeepSeek V4 Flash 0731 (Reasoning, High)98.9%$0.00222.6m88%
113GPT-5.4 Mini (Reasoning, Low)94.4%$0.01516.8s71%
114ByteDance Seed 2.0 Lite98.5%$0.0122.2m86%
115Grok 4.6 (Reasoning, High)100.0%$0.0422.5m100%
116DeepSeek V3.196.7%$0.00201.8m80%
117DeepSeek V3.296.7%$0.00141.9m80%
118Z.AI GLM 4.796.7%$0.0101.4m78%
119Qwen 3.5 35B96.7%$0.0181.0m76%
120Gemma 3 4B93.3%$0.000220.0s65%
121Claude Opus 5.5 (Reasoning)100.0%$0.09256.0s100%
122Z.AI GLM 4.694.8%$0.006551.5s70%
123MiniMax M399.3%$0.00603.1m90%
124o4 Mini94.1%$0.01525.7s69%
125Gemma 3 27B93.7%$0.000652.6s69%
126GPT-5 Nano95.6%$0.00421.4m73%
127Claude Opus 5 (Reasoning)100.0%$0.0981.0m100%
128Gemini 2.5 Pro96.3%$0.03636.2s75%
129GPT-5.498.5%$0.0491.4m86%
130Mistral Medium 3.5 (Reasoning)93.7%$0.01818.0s66%
131Qwen 3.8 Flash (Reasoning)98.5%$0.00643.1m86%
132o4 Mini High95.2%$0.02547.2s71%
133Qwen 3.5 122B95.2%$0.0251.1m75%
134Ministral 8B91.1%$0.000410.4s59%
135Kimi K2.599.3%$0.0193.2m90%
136Claude Opus 4.699.3%$0.0781.2m90%
137GPT-5.4 (Reasoning, Low)98.1%$0.0551.4m85%
138GPT-5.4 Nano (Reasoning, Low)90.4%$0.005520.6s64%
139GPT-5.6 Sol (Reasoning, Medium)100.0%$0.1081.2m100%
140Hermes 3 405B92.6%$0.003253.2s64%
141Gemini 2.5 Flash Lite91.1%$0.00099.5s57%
142Muse Spark 1.3 (Reasoning, Medium)96.7%$0.0251.8m78%
143Ministral 3B90.7%$0.00018.1s57%
144Claude Opus 4.597.8%$0.07053.4s83%
145Claude Opus 5 (Reasoning, Low)99.6%$0.0971.0m93%
146Claude Opus 4.6 (Reasoning)99.6%$0.0881.4m93%
147DeepSeek V4 Pro 0813 (Reasoning, High)96.7%$0.0251.8m76%
148Nemotron 3 Super92.2%$0.00001.4m67%
149Gemini 3.5 Flash (Reasoning)97.0%$0.07137.6s79%
150Gemma 3 12B90.7%$0.000441.3s58%
151Gemini 2.5 Flash (Reasoning)90.0%$0.01121.5s60%
152GPT-4o Mini (temp=1)88.9%$0.001234.8s59%
153ByteDance Seed 1.695.9%$0.0132.5m74%
154WizardLM 2 8x22b93.3%$0.00261.8m65%
155GPT-5.4 Nano87.0%$0.005726.3s61%
156Mistral Large 4.0 (Reasoning)98.1%$0.0233.4m85%
157GPT-5.196.7%$0.0541.8m80%
158Ministral 3 8B90.7%$0.000819.6s49%
159Claude Haiku 5.5 (Reasoning, Max)100.0%$0.0314.7m100%
160Qwen 3.5 Plus (2026-04-20)93.3%$0.0171.8m70%
161DeepSeek V4 Pro (Reasoning)97.8%$0.0153.1m76%
162GPT-5.6 Sol98.9%$0.1051.2m88%
163Qwen 3.5 27B93.0%$0.0201.6m68%
164Qwen 3.6 27B94.4%$0.0252.3m75%
165GPT-599.3%$0.0652.8m90%
166GPT-4.1 Nano86.3%$0.000713.3s51%
167Gemini 3.1 Pro (Preview)99.3%$0.1071.8m90%
168Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.00316.5m100%
169Qwen 3.8 27B (Reasoning, XHigh)99.6%$0.0404.7m93%
170Qwen 3.7 Max96.7%$0.0682.3m80%
171GPT-5.4 (Reasoning)98.9%$0.0892.6m88%
172Gemini 2.5 Flash84.4%$0.005210.6s46%
173Qwen 3.6 Max Preview97.8%$0.0503.5m83%
174Ministral 3 3B85.6%$0.000511.1s40%
175DeepSeek-V2 Chat86.3%$0.002153.3s48%
176Cohere Command R+ (Aug. 2024)86.7%$0.02052.5s55%
177Hermes 3 70B87.0%$0.00101.2m49%
178Qwen 3.5 397B A17B93.0%$0.0143.0m65%
179Grok 4.7 (Reasoning, High)99.3%$0.0743.9m90%
180DeepSeek V3 (2024-12-26)86.3%$0.002154.6s46%
181Hy4 Preview (Reasoning, High)98.5%$0.0404.4m83%
182GPT-5.5 (Reasoning, Medium)99.3%$0.1421.8m90%
183ByteDance Seed 2.0 Mini96.3%$0.00454.9m71%
184GPT-5.5 (Reasoning, Low)98.1%$0.1391.8m85%
185Thinking Machines Inkling (Reasoning)97.8%$0.0255.1m76%
186GPT-5.288.5%$0.0561.5m59%
187GPT-5.597.0%$0.1391.7m81%
188Mistral NeMO78.1%$0.000510.1s36%
189Nemotron 3 Nano80.4%$0.00101.1m44%
190Kimi K2.6100.0%$0.0586.5m100%
191Claude Opus 499.3%$0.2091.4m90%
192GPT-OSS 120B77.4%$0.00151.8m41%
193Z.AI GLM 5.3 (Reasoning, Max)99.6%$0.0667.3m93%
194Qwen 3.8 Max (Reasoning, XHigh)98.1%$0.0835.9m85%
195Llama 3.1 70B70.4%$0.001529.4s24%
196Inception Mercury 264.1%$0.00327.0s24%
197GPT-4o, Aug. 6th (temp=0)68.1%$0.02322.7s24%
198GPT-4o Mini (temp=0)63.7%$0.001234.8s18%
199Qwen 2.5 72B61.1%$0.001036.7s16%
200Mistral Small 3.2 24B52.4%$0.00685.6m9%
95.85%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Gemini 3.1 Pro (Preview)1001001001006793.3%
GPT-6 Luna (Reasoning, High)1001001001006793.3%
Grok 4.7 (Reasoning, High)1001001001006793.3%
GPT-5.5 (Reasoning, Low)1001001001006793.3%
Kimi K3 (Reasoning, Low)1001001001006793.3%
Claude Opus 5 (Reasoning, Low)1001001001006793.3%
GPT-5.4 (Reasoning, Low)1001001001006793.3%
Kimi K2.51001001001006793.3%
o4 Mini High1001001001006793.3%
Qwen 3.7 Flash (Reasoning)1001001001006793.3%
Qwen 3.6 27B1001001001006793.3%
DeepSeek V4 Flash (Reasoning)1001001001006793.3%
Qwen 3.6 35B1001001001006793.3%
Aion 2.01001001001006793.3%
Xiaomi MIMO v2.5 Pro1001001001006793.3%
Qwen 3.5 Flash1001001001006793.3%
GPT-5.6 Luna1001001001006793.3%
DeepSeek V3.11001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
Qwen 2.5 72B1001001001006793.3%
ByteDance Seed 1.6 Flash1001001001006793.3%
Ministral 3 14B1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Qwen 3.5 27B1001001001003386.7%
Qwen 3.5 Plus (2026-04-20)100100100676786.7%
Mistral Medium 3.5 (Reasoning)100100100676786.7%
Mistral Large 3100100100676786.7%
Qwen 3.5 9B100100100676786.7%
Hermes 3 405B1001001001003386.7%
Mistral Small 4 (Reasoning)100100100676786.7%
Llama 3.1 70B1001001001003386.7%
GPT-5.4 Nano100100100676786.7%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
DeepSeek V3 (2024-12-26)1001001001003386.7%
ByteDance Seed 2.0 Mini100100100100080.0%
GPT-4o, Aug. 6th (temp=0)100100100673380.0%
GPT-4o Mini (temp=0)10010010067073.3%
Inception Mercury 21006767333360.0%
Mistral NeMO100676767060.0%
GPT-OSS 120B100100670053.3%
Mistral Small 3.2 24B3300006.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Gemini 3.6 Flash (Reasoning)1001001001006793.3%
Qwen 3.8 27B (Reasoning, XHigh)1001001001006793.3%
Mistral Large 4.0 (Reasoning)1001001001006793.3%
Grok 4.20 (Reasoning)1001001001006793.3%
Qwen 3.6 27B1001001001006793.3%
Z.AI GLM 4.61001001001006793.3%
MiniMax M2.71001001001006793.3%
Gemma 4 31B1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Mistral Large 21001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
GPT-5.4 Mini1001001001006793.3%
Qwen 3 32B1001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
Llama 3.1 70B1001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
Cydonia 24B V4.11001001001006793.3%
WizardLM 2 8x22b1001001001006793.3%
Hermes 3 70B1001001001006793.3%
Qwen 3.5 Plus (2026-02-15)100100100676786.7%
Qwen 3.5 Flash1001001001003386.7%
Mistral Medium 3.5 (Reasoning)1001001001003386.7%
GPT-4o Mini (temp=0)100100100676786.7%
GPT-OSS 120B100100100100080.0%
Inception Mercury 2100100100673380.0%
Mistral NeMO100100100333373.3%
GPT-4o, Aug. 6th (temp=0)10010010033066.7%
GPT-4.1 Nano1001006767066.7%
Qwen 2.5 72B1006767333360.0%
Mistral Small 3.2 24B100100330046.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Mistral NeMO100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Muse Spark 1.1 (Reasoning, Medium)1001001001006793.3%
Z.AI GLM 5.11001001001006793.3%
Z.AI GLM 5 Turbo1001001001006793.3%
Claude Opus 4.61001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
Qwen 3.5 27B1001001001006793.3%
DeepSeek V4 Pro (Reasoning)1001001001006793.3%
Gemma 4 26B (Reasoning)1001001001006793.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006793.3%
Qwen 3.6 35B1001001001006793.3%
GPT-4.11001001001006793.3%
Aion 2.01001001001006793.3%
o4 Mini1001001001006793.3%
Qwen 3.5 Plus (2026-02-15)1001001001006793.3%
Mistral Medium 3.5 (Reasoning)1001001001006793.3%
Mistral Medium 3.51001001001006793.3%
DeepSeek V3.21001001001006793.3%
Z.AI GLM 4.7 Flash1001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
GPT-5 Nano1001001001006793.3%
Laguna S 2.11001001001006793.3%
Gemini 2.5 Flash Lite1001001001006793.3%
Qwen 3 32B1001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
Laguna XS 2.11001001001006793.3%
Mistral Small 41001001001006793.3%
Cydonia 24B V4.11001001001006793.3%
GPT-5.4 Nano1001001001006793.3%
Ministral 3 14B1001001001006793.3%
Gemini 3.5 Flash (Reasoning)100100100676786.7%
GPT-5.2100100100676786.7%
Qwen 3.6 27B100100100676786.7%
Qwen 3.5 Flash100100100676786.7%
Gemini 3.1 Flash Lite100100100676786.7%
Z.AI GLM 4.5100100100676786.7%
Gemini 2.5 Flash (Reasoning)100100100676786.7%
DeepSeek-V2 Chat100100100676786.7%
GPT-5.4 Nano (Reasoning)100100100676786.7%
GPT-5.4 Nano (Reasoning, Low)1001001001003386.7%
Gemma 3 27B100100100676786.7%
GPT-4.1 Nano100100100676786.7%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
Ministral 8B100100100676786.7%
Z.AI GLM 4.610010067676780.0%
DeepSeek V3 (2024-12-26)100100100673380.0%
DeepSeek V4 Flash100100100100080.0%
Ministral 3 8B100100100100080.0%
Hermes 3 70B100100100100080.0%
Arcee AI: Trinity Mini10010067676780.0%
GPT-OSS 120B10010067673373.3%
Gemini 2.5 Flash Lite (Reasoning)1006767676773.3%
Ministral 3B100100100333373.3%
Qwen 3.5 397B A17B1001006767066.7%
o4 Mini High10010067333366.7%
GPT-4o, Aug. 6th (temp=0)10010010033066.7%
Nemotron 3 Nano1001006767066.7%
Gemma 3 4B1001006767066.7%
Mistral Small 3.2 24B100100670053.3%
Qwen 2.5 72B100676733053.3%
Ministral 3 3B1001003333053.3%
Llama 3.1 70B100333333040.0%
Inception Mercury 267333333033.3%
GPT-4o Mini (temp=0)333300013.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006793.3%
Gemini 3.7 Flash (Reasoning, Medium)1001001001006793.3%
Muse Spark 1.2 (Reasoning, Medium)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Medium)1001001001006793.3%
Z.AI GLM 5.11001001001006793.3%
Grok 4.7 (Reasoning, High)1001001001006793.3%
Grok 4.5 (Reasoning, Low)1001001001006793.3%
GPT-5.6 Sol1001001001006793.3%
ByteDance Seed 1.61001001001006793.3%
GPT-5.21001001001006793.3%
Gemini 2.5 Pro1001001001006793.3%
Qwen 3.6 27B1001001001006793.3%
Qwen 3.6 35B1001001001006793.3%
Z.AI GLM 4.61001001001006793.3%
Qwen 3.5 35B1001001001006793.3%
GPT-4.11001001001006793.3%
MiniMax M2.51001001001006793.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001006793.3%
o4 Mini1001001001006793.3%
ByteDance Seed 2.0 Mini1001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
GPT-OSS 120B1001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
Claude Haiku 4.51001001001006793.3%
Mistral Large 21001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
GPT-5.4 Mini1001001001006793.3%
Laguna S 2.11001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Hermes 3 70B1001001001006793.3%
Arcee AI: Trinity Mini1001001001006793.3%
Qwen 3.5 397B A17B1001001001003386.7%
Muse Glimmer 30B (Reasoning, Medium)1001001001003386.7%
Gemini 3.5 Flash (Reasoning, Minimal)100100100676786.7%
Nemotron 3 Super100100100676786.7%
GPT-5 Nano100100100676786.7%
GPT-5.4 Nano100100100676786.7%
ByteDance Seed 1.6 Flash100100100676786.7%
DeepSeek V3 (2024-12-26)1001001001003386.7%
Muse Spark 1.3 (Reasoning, Medium)10010067676780.0%
o4 Mini High100100100673380.0%
Thinking Machines Inkling100100100673380.0%
GPT-5.4 Nano (Reasoning, Low)10010067673373.3%
GPT-4o, Aug. 6th (temp=0)1006767676773.3%
Cohere Command R+ (Aug. 2024)10010067673373.3%
Inception Mercury 21001006767066.7%
Llama 3.1 70B1006767673366.7%
Qwen 2.5 72B100333333040.0%
GPT-4o Mini (temp=0)67673333040.0%
Mistral Small 3.2 24B1003300026.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Gemini 3.5 Flash (Reasoning)1001001001006793.3%
Claude Opus 4.61001001001006793.3%
Kimi K3 (Reasoning, Low)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Minimal)1001001001006793.3%
GPT-5 Mini1001001001006793.3%
Grok 4.5 (Reasoning, Low)1001001001006793.3%
Grok 4.20 (Reasoning)1001001001006793.3%
MiniMax M31001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
GPT-5.4 Mini (Reasoning)1001001001006793.3%
Qwen 3.5 Plus (2026-04-20)1001001001006793.3%
ByteDance Seed 1.61001001001006793.3%
o4 Mini High1001001001006793.3%
Claude Sonnet 51001001001006793.3%
Claude Opus 41001001001006793.3%
GPT-4.11001001001006793.3%
MiniMax M2.51001001001006793.3%
Aion 2.01001001001006793.3%
GPT-5.41001001001006793.3%
DeepSeek V3.21001001001006793.3%
Mistral Large 21001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Grok 4.201001001001006793.3%
Hermes 3 405B1001001001006793.3%
GPT-5 Nano1001001001006793.3%
GPT-5.4 Nano (Reasoning)1001001001006793.3%
Mistral Medium 3.11001001001006793.3%
Laguna XS 2.11001001001006793.3%
Mistral Small 41001001001006793.3%
Ministral 3 14B1001001001006793.3%
Cohere Command R+ (Aug. 2024)1001001001006793.3%
Ministral 3B1001001001006793.3%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100676786.7%
Qwen 3.5 27B100100100676786.7%
Qwen 3.6 27B100100100676786.7%
Qwen 3.5 35B1001001001003386.7%
MiniMax M2.7100100100676786.7%
Qwen 3.5 Plus (2026-02-15)100100100676786.7%
Gemini 3.1 Flash Lite (Reasoning)1001001001003386.7%
Qwen 3.5 Flash100100100676786.7%
Z.AI GLM 4.5100100100676786.7%
GPT-4o Mini (temp=1)100100100676786.7%
Thinking Machines Inkling1001001001003386.7%
GPT-5.4 Nano100100100676786.7%
Gemma 3 4B100100100676786.7%
Qwen 3.5 397B A17B1001001001003386.7%
Mistral NeMO1001001001003386.7%
Qwen 3.6 Flash100100100673380.0%
Qwen 3.6 35B100100100673380.0%
o4 Mini100100100673380.0%
Mistral Medium 3.5 (Reasoning)100100100100080.0%
GPT-OSS 120B100100100673380.0%
Mistral Large 3100100100673380.0%
Gemini 2.5 Flash Lite (Reasoning)100100100673380.0%
DeepSeek V3 (2024-12-26)100100100673380.0%
Gemini 2.5 Flash100100100673380.0%
Hermes 3 70B100100100673380.0%
GPT-5.210010067673373.3%
DeepSeek-V2 Chat10010067673373.3%
Z.AI GLM 4.7 Flash100100100333373.3%
GPT-4o, Aug. 6th (temp=0)10010067673373.3%
Qwen 2.5 72B10010010067073.3%
Ministral 3 3B10010010067073.3%
Inception Mercury 210010067333366.7%
Gemma 3 12B10010067333366.7%
Gemma 3 27B10010067333366.7%
GPT-4.1 Nano10010010033066.7%
Ministral 8B1006767673366.7%
Gemini 2.5 Flash (Reasoning)1006767333360.0%
Llama 3.1 70B1006767333360.0%
Ministral 3 8B1001001000060.0%
Nemotron 3 Nano100676733053.3%
Gemini 2.5 Flash Lite100673333046.7%
Mistral Small 3.2 24B67000013.3%
GPT-4o Mini (temp=0)67000013.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)1001001001006793.3%
Grok 4.20 (Reasoning)1001001001006793.3%
Qwen 3.5 Plus (2026-04-20)1001001001006793.3%
ByteDance Seed 1.61001001001006793.3%
Aion 3.01001001001006793.3%
Claude Sonnet 41001001001006793.3%
Qwen 3.5 35B1001001001006793.3%
o4 Mini1001001001006793.3%
Qwen 3.5 Plus (2026-02-15)1001001001006793.3%
Xiaomi MIMO v2.5 Pro1001001001006793.3%
GPT-5.6 Luna1001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
Mistral Large 4.01001001001006793.3%
ByteDance Seed 2.0 Lite1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
Qwen 3.5 9B1001001001006793.3%
Gemini 2.5 Flash Lite (Reasoning)1001001001006793.3%
DeepSeek V3.21001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Grok 4.201001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
GPT-5 Nano1001001001006793.3%
Gemini 2.5 Flash Lite1001001001006793.3%
Qwen 3 32B1001001001006793.3%
Qwen 3 235B A22B Instruct 25071001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
Laguna XS 2.11001001001006793.3%
GPT-5.4 Nano1001001001006793.3%
Ministral 3 14B1001001001006793.3%
Ministral 3 3B1001001001006793.3%
GPT-5.2100100100676786.7%
Gemma 3 12B1001001001003386.7%
Gemma 3 27B1001001001003386.7%
Ministral 3 8B1001001001003386.7%
Ministral 8B1001001001003386.7%
Ministral 3B1001001001003386.7%
GPT-4o, Aug. 6th (temp=0)10010067676780.0%
GPT-4o Mini (temp=1)100100100100080.0%
GPT-4.1 Nano10010067676780.0%
GPT-OSS 120B1006767676773.3%
Nemotron 3 Nano10010010033066.7%
Cohere Command R+ (Aug. 2024)1001006767066.7%
Mistral Small 3.2 24B1001006733060.0%
GPT-4o Mini (temp=0)1001006733060.0%
Inception Mercury 210067670046.7%
Llama 3.1 70B10067670046.7%
Qwen 2.5 72B10033330033.3%
Mistral NeMO1003300026.7%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Gemini 3.6 Flash (Reasoning)1001001001006793.3%
Muse Spark 1.2 (Reasoning, Medium)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Qwen 3.6 Max Preview1001001001006793.3%
GPT-5.5 (Reasoning, Medium)1001001001006793.3%
Mistral Large 4.0 (Reasoning)1001001001006793.3%
GPT-5.4 (Reasoning, Low)1001001001006793.3%
GPT-5.11001001001006793.3%
Claude Sonnet 4.61001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
Gemini 3 Flash (Preview, Reasoning)1001001001006793.3%
GPT-5.4 Mini (Reasoning)1001001001006793.3%
Z.AI GLM 51001001001006793.3%
GPT-5.21001001001006793.3%
DeepSeek V4 Pro (Reasoning)1001001001006793.3%
GPT-5.6 Terra1001001001006793.3%
Qwen 3.6 35B1001001001006793.3%
Z.AI GLM 4.61001001001006793.3%
Aion 2.01001001001006793.3%
o4 Mini1001001001006793.3%
Gemini 3 Flash (Preview)1001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
Mistral Large 31001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Hermes 3 405B1001001001006793.3%
GPT-5.4 Mini1001001001006793.3%
Qwen 3 32B1001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
Llama 3.1 70B1001001001006793.3%
Mistral Small 3.2 24B1001001001006793.3%
Mistral Small 41001001001006793.3%
WizardLM 2 8x22b1001001001006793.3%
Ministral 3 14B1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Claude Haiku 5.5 (Reasoning, Low)10010067 – – 88.9%
GPT-5.6 Luna (Reasoning, Medium)1001001001003386.7%
Qwen 3 235B A22B Instruct 2507100100100676786.7%
Hermes 3 70B1001001001003386.7%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
Ministral 8B100100100676786.7%
Ministral 3B100100100676786.7%
Mistral Small 4 (Reasoning)1001001001003386.7%
GPT-4o Mini (temp=0)10010067676780.0%
Mistral NeMO10010067676780.0%
ByteDance Seed 2.0 Mini100100100673380.0%
GPT-OSS 120B10010067676780.0%
Gemini 2.5 Flash (Reasoning)100100100673380.0%
Qwen 2.5 72B100100100673380.0%
GPT-5.51006767676773.3%
DeepSeek V3 (2024-12-26)1006767676773.3%
GPT-4o, Aug. 6th (temp=0)10010010067073.3%
Inception Mercury 210010010067073.3%
Nemotron 3 Nano10010067673373.3%
Ministral 3 8B10010010067073.3%
Ministral 3 3B10010010067073.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100 – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 8B100100100100100100.0%
Hy4 Preview (Reasoning, High)1001001001006793.3%
Gemini 3.1 Pro (Preview)1001001001006793.3%
Qwen 3.6 Max Preview1001001001006793.3%
Aion 3.5 Mini (Reasoning, High)1001001001006793.3%
Thinking Machines Inkling (Reasoning)1001001001006793.3%
MiniMax M31001001001006793.3%
GPT-5.51001001001006793.3%
Gemini 2.5 Pro1001001001006793.3%
GPT-5.6 Terra1001001001006793.3%
o4 Mini1001001001006793.3%
Mistral Medium 3.5 (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
DeepSeek V4 Pro1001001001006793.3%
Inception Mercury 21001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
Mistral Small 4 (Reasoning)1001001001006793.3%
Gemma 3 12B1001001001006793.3%
GPT-5.4 Nano1001001001006793.3%
Hermes 3 70B1001001001006793.3%
Ministral 3B1001001001006793.3%
GPT-5100100100676786.7%
GPT-5.1100100100676786.7%
Mistral Small 3.2 24B100100100676786.7%
Cohere Command R+ (Aug. 2024)100100100676786.7%
GPT-OSS 120B100100100673380.0%
GPT-4o Mini (temp=0)10010067676780.0%
Nemotron 3 Nano10010067676780.0%
Qwen 2.5 72B100100100673380.0%
GPT-4o, Aug. 6th (temp=0)10010067673373.3%
Ministral 3 3B10010010067073.3%
Mistral NeMO100100100333373.3%
Llama 3.1 70B1006767673366.7%
GPT-4.1 Nano1006767333360.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Claude Opus 4.6 (Reasoning)1001001001006793.3%
Muse Spark 1.2 (Reasoning, Medium)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Qwen 3.8 Flash (Reasoning)1001001001006793.3%
GPT-5.4 (Reasoning)1001001001006793.3%
Qwen 3.6 Max Preview1001001001006793.3%
GPT-5.4 (Reasoning, Low)1001001001006793.3%
GPT-5.11001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
Gemma 4 31B (Reasoning)1001001001006793.3%
Claude Opus 4.51001001001006793.3%
DeepSeek V4 Pro (Reasoning)1001001001006793.3%
Gemini 2.5 Pro1001001001006793.3%
Xiaomi MIMO v2.5 Pro1001001001006793.3%
Gemini 3 Flash (Preview)1001001001006793.3%
Mistral Medium 3.5 (Reasoning)1001001001006793.3%
Mistral Medium 3.51001001001006793.3%
ByteDance Seed 2.0 Lite1001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
Writer: Palmyra X51001001001006793.3%
Gemma 3 27B1001001001006793.3%
Mistral Small 41001001001006793.3%
Cohere Command R+ (Aug. 2024)1001001001006793.3%
Ministral 3B1001001001006793.3%
Qwen 3.5 397B A17B100100100676786.7%
GPT-5.4 Mini (Reasoning)100100100676786.7%
DeepSeek V4 Flash (Reasoning)100100100676786.7%
Z.AI GLM 4.61001001001003386.7%
Qwen 3.5 35B100100100676786.7%
Aion 2.0100100100676786.7%
Qwen 3.5 Plus (2026-02-15)1001001001003386.7%
Gemini 2.5 Flash Lite (Reasoning)100100100676786.7%
DeepSeek V3.1100100100676786.7%
Nemotron 3 Super100100100676786.7%
GPT-4o Mini (temp=1)1001001001003386.7%
GPT-5.4 Nano (Reasoning, Low)100100100676786.7%
Mistral Medium 3.11001001001003386.7%
Cydonia 24B V4.1100100100676786.7%
WizardLM 2 8x22b100100100676786.7%
Gemma 3 4B100100100676786.7%
Ministral 3 3B1001001001003386.7%
Qwen 3.5 27B10010067676780.0%
GPT-5.4 Nano (Reasoning)10010067676780.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100673380.0%
Qwen 3.5 Plus (2026-04-20)100100100673380.0%
Gemini 3.1 Flash Lite (Preview)100100100673380.0%
GPT-OSS 120B100100100100080.0%
Aion 3.0 Mini100100100673380.0%
Inception Mercury 2100100100673380.0%
Hermes 3 405B100100100673380.0%
Laguna S 2.110010067676780.0%
Nemotron 3 Nano100100100673380.0%
GPT-4.1 Nano100100100100080.0%
GPT-4o, Aug. 6th (temp=0)10010010067073.3%
GPT-5.4 Nano1006767676773.3%
GPT-5.2676767676766.7%
GPT-4o Mini (temp=0)1001006767066.7%
Gemma 3 12B1006767673366.7%
Hermes 3 70B1001006767066.7%
Mistral Small 3.2 24B1001001000060.0%
Gemini 2.5 Flash67673333040.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3B100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006793.3%
Qwen 3.8 Flash (Reasoning)1001001001006793.3%
Mistral Large 4.0 (Reasoning)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Minimal)1001001001006793.3%
GPT-5.4 (Reasoning, Low)1001001001006793.3%
Kimi K2.51001001001006793.3%
Qwen 3.5 27B1001001001006793.3%
o4 Mini High1001001001006793.3%
Gemini 3.1 Flash Lite1001001001006793.3%
ByteDance Seed 2.0 Lite1001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
Qwen 3 235B A22B Instruct 25071001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
Gemma 3 12B1001001001006793.3%
Laguna XS 2.11001001001006793.3%
Mistral Small 41001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Hermes 3 70B1001001001006793.3%
Mistral NeMO1001001001006793.3%
Gemini 3.5 Flash (Reasoning)100100100676786.7%
GPT-5.21001001001003386.7%
Z.AI GLM 4.5100100100676786.7%
DeepSeek V3.1100100100676786.7%
Hermes 3 405B100100100676786.7%
Gemini 2.5 Flash100100100676786.7%
GPT-5.4 Mini100100100676786.7%
GPT-5.4 Nano (Reasoning)100100100676786.7%
Writer: Palmyra X5100100100676786.7%
GPT-5 Nano1001001001003386.7%
GPT-5.4 Nano10010067676780.0%
GPT-5.4 Mini (Reasoning)10010067676780.0%
ByteDance Seed 1.6100100100673380.0%
Gemini 2.5 Pro100100100673380.0%
Mistral Medium 3.5 (Reasoning)100100100673380.0%
Mistral Medium 3.5100100100673380.0%
GPT-5.4 Mini (Reasoning, Low)100100100673380.0%
DeepSeek V3 (2024-12-26)100100100100080.0%
GPT-4o, Aug. 6th (temp=0)10010067676780.0%
Nemotron 3 Super100100100673380.0%
GPT-5.4 Nano (Reasoning, Low)10010067676780.0%
Nemotron 3 Nano10010067676780.0%
Cohere Command R+ (Aug. 2024)10010067676780.0%
Ministral 3 3B100100100673380.0%
Llama 3.1 70B10010067673373.3%
GPT-4o Mini (temp=0)1006767676773.3%
WizardLM 2 8x22b10010067673373.3%
Ministral 8B100100100333373.3%
GPT-OSS 120B1006733333353.3%
Inception Mercury 267676767053.3%
Qwen 2.5 72B100676733053.3%
Mistral Small 3.2 24B10033330033.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-4.1100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)1001001001006793.3%
Qwen 3.8 Flash (Reasoning)1001001001006793.3%
Muse Spark 1.3 (Reasoning, Medium)1001001001006793.3%
Claude Opus 4.8 (Reasoning, Low)1001001001006793.3%
Thinking Machines Inkling (Reasoning)1001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
Qwen 3.5 27B1001001001006793.3%
GPT-5.51001001001006793.3%
Qwen 3.6 Flash1001001001006793.3%
Aion 3.01001001001006793.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006793.3%
Z.AI GLM 4.61001001001006793.3%
Qwen 3.5 35B1001001001006793.3%
MiniMax M2.51001001001006793.3%
MiniMax M2.71001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
GPT-OSS 120B1001001001006793.3%
Mistral Large 31001001001006793.3%
Qwen 3.5 9B1001001001006793.3%
DeepSeek V3 (2024-12-26)1001001001006793.3%
DeepSeek V3.11001001001006793.3%
Z.AI GLM 4.7 Flash1001001001006793.3%
DeepSeek V4 Pro1001001001006793.3%
DeepSeek V4 Flash1001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Mistral Large 21001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
Gemini 2.5 Flash Lite1001001001006793.3%
Writer: Palmyra X51001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
GPT-4o Mini (temp=0)1001001001006793.3%
Mistral Small 41001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
Cydonia 24B V4.11001001001006793.3%
GPT-5.4 Nano1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Arcee AI: Trinity Mini1001001001006793.3%
Gemma 3 4B1001001001006793.3%
GPT-5.1100100100676786.7%
Qwen 3.5 Plus (2026-04-20)100100100676786.7%
GPT-5.21001001001003386.7%
Xiaomi MIMO v2.5 Pro1001001001003386.7%
Gemini 2.5 Flash Lite (Reasoning)100100100676786.7%
Mistral Small 3.2 24B100100100676786.7%
Laguna XS 2.1100100100676786.7%
Cohere Command R+ (Aug. 2024)100100100676786.7%
Ministral 3 3B100100100676786.7%
Ministral 3B1001001001003386.7%
GPT-5.6 Luna1001001001003386.7%
Qwen 3.5 Plus (2026-02-15)10010067676780.0%
Claude Opus 4.510010067676780.0%
Z.AI GLM 510010067676780.0%
DeepSeek V4 Pro (Reasoning)100100100100080.0%
Gemini 2.5 Pro100100100673380.0%
Qwen 3.6 27B10010067676780.0%
Z.AI GLM 4.710010067676780.0%
Mistral Medium 3.5 (Reasoning)10010067676780.0%
Gemini 2.5 Flash (Reasoning)100100100673380.0%
Z.AI GLM 4.5 Air100100100673380.0%
Gemma 3 27B10010067676780.0%
Llama 3.1 70B10010067673373.3%
Gemma 3 12B10010010067073.3%
WizardLM 2 8x22b10010067673373.3%
Ministral 3 8B10010067673373.3%
GPT-4o, Aug. 6th (temp=0)10010067333366.7%
GPT-4o Mini (temp=1)10010067333366.7%
Ministral 8B1001006767066.7%
DeepSeek-V2 Chat100676733053.3%
Gemini 2.5 Flash67676767053.3%
Mistral NeMO1006733333353.3%
Inception Mercury 2676733333346.7%
Qwen 2.5 72B6767330033.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100 – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
GPT-5.4100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 8B100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)1001001001006793.3%
Gemini 3.6 Flash (Reasoning)1001001001006793.3%
Claude Opus 4.7 (Reasoning)1001001001006793.3%
Mistral Large 4.0 (Reasoning)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Minimal)1001001001006793.3%
Grok 4.5 (Reasoning, Low)1001001001006793.3%
Grok 4.20 (Reasoning)1001001001006793.3%
GPT-5.11001001001006793.3%
Qwen 3.5 Plus (2026-04-20)1001001001006793.3%
GPT-5.21001001001006793.3%
Muse Glimmer 30B (Reasoning, Medium)1001001001006793.3%
Qwen 3.6 35B1001001001006793.3%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001006793.3%
Qwen 3.5 Flash1001001001006793.3%
Gemma 4 31B1001001001006793.3%
Gemini 3.5 Flash Lite (Reasoning)1001001001006793.3%
Mistral Large 31001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
DeepSeek V3 (2024-12-26)1001001001006793.3%
DeepSeek V3.11001001001006793.3%
DeepSeek V3.21001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
GPT-5 Nano1001001001006793.3%
Gemini 2.5 Flash Lite1001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
Mistral Medium 3.11001001001006793.3%
Gemma 3 27B1001001001006793.3%
Mistral Small 41001001001006793.3%
Cydonia 24B V4.11001001001006793.3%
GPT-5.4 Nano1001001001006793.3%
Ministral 3 14B1001001001006793.3%
Ministral 3 8B1001001001006793.3%
Qwen 3.7 Max100100100676786.7%
ByteDance Seed 1.61001001001003386.7%
Xiaomi MIMO v2.5100100100676786.7%
Hermes 3 405B1001001001003386.7%
Laguna XS 2.1100100100676786.7%
GPT-4.1 Nano100100100676786.7%
Cohere Command R+ (Aug. 2024)100100100676786.7%
Gemma 3 12B1001001001003386.7%
Ministral 3B10010067676780.0%
GPT-4o Mini (temp=0)10010067676780.0%
Nemotron 3 Nano10010067676780.0%
Hermes 3 70B100100100673380.0%
Mistral Medium 3.5100100100333373.3%
Inception Mercury 21006767676773.3%
Llama 3.1 70B100100100333373.3%
WizardLM 2 8x22b10010010067073.3%
Ministral 3 3B10010010067073.3%
GPT-OSS 120B1001006767066.7%
Mistral NeMO10010010033066.7%
GPT-4o, Aug. 6th (temp=0)10067670046.7%
Mistral Small 3.2 24B10067670046.7%
Qwen 2.5 72B10033330033.3%

Novelcrafter Default Prompt

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5 Nano100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)1001001001006793.3%
Hy4 Preview (Reasoning, High)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Qwen 3.8 Flash (Reasoning)1001001001006793.3%
GPT-5.4 (Reasoning)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Medium)1001001001006793.3%
Z.AI GLM 5.11001001001006793.3%
GPT-5.5 (Reasoning, Medium)1001001001006793.3%
Claude Sonnet 5.5 (Reasoning)1001001001006793.3%
GPT-5.5 (Reasoning, Low)1001001001006793.3%
Claude Opus 4.8 (Reasoning)1001001001006793.3%
Qwen 3.5 397B A17B1001001001006793.3%
GPT-5.6 Sol1001001001006793.3%
DeepSeek V4 Pro 0813 (Reasoning, High)1001001001006793.3%
Claude Opus 4.51001001001006793.3%
GPT-5.51001001001006793.3%
Aion 3.01001001001006793.3%
Qwen 3.7 Flash (Reasoning)1001001001006793.3%
GPT-5.6 Terra1001001001006793.3%
GPT-4.11001001001006793.3%
Gemini 3.1 Flash Lite (Reasoning)1001001001006793.3%
Qwen 3.5 Flash1001001001006793.3%
Gemini 3.1 Flash Lite1001001001006793.3%
GPT-5.6 Luna1001001001006793.3%
GPT-5.41001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
Qwen 3.5 9B1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
DeepSeek V4 Pro1001001001006793.3%
Grok 4.201001001001006793.3%
Z.AI GLM 4.5 Air1001001001006793.3%
GPT-5.4 Mini1001001001006793.3%
GPT-5.4 Nano (Reasoning)1001001001006793.3%
Writer: Palmyra X51001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
GPT-4o Mini (temp=0)1001001001006793.3%
Mistral Medium 3.11001001001006793.3%
WizardLM 2 8x22b1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Qwen 3.5 Plus (2026-04-20)100100100676786.7%
Qwen 3.6 27B100100100676786.7%
GPT-4o, Aug. 6th (temp=0)100100100676786.7%
Nemotron 3 Super1001001001003386.7%
Hermes 3 405B100100100676786.7%
Laguna S 2.1100100100676786.7%
GPT-5.4 Nano (Reasoning, Low)100100100676786.7%
GPT-5.4 Nano100100100676786.7%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
Gemma 3 4B100100100676786.7%
Mistral Small 4 (Reasoning)1001001001003386.7%
Qwen 3.6 Max Preview10010067676780.0%
Inception Mercury 210010067676780.0%
Hermes 3 70B10010067676780.0%
GPT-5.2100100100673380.0%
GPT-OSS 120B100100100673380.0%
DeepSeek V3 (2024-12-26)100100100673380.0%
Llama 3.1 70B100100100673380.0%
Qwen 2.5 72B10010067676780.0%
Qwen 3.5 27B10010067333366.7%
Mistral NeMO1001006767066.7%
Nemotron 3 Nano1001006733060.0%
Mistral Small 3.2 24B100100330046.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Z.AI GLM 5.11001001001006793.3%
GPT-5.5 (Reasoning, Low)1001001001006793.3%
Mistral Large 4.0 (Reasoning)1001001001006793.3%
GPT-5.4 (Reasoning, Low)1001001001006793.3%
GPT-5.11001001001006793.3%
GPT-5.4 Mini (Reasoning)1001001001006793.3%
ByteDance Seed 1.61001001001006793.3%
o4 Mini High1001001001006793.3%
Qwen 3.7 Flash (Reasoning)1001001001006793.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001006793.3%
Qwen 3.5 Plus (2026-02-15)1001001001006793.3%
DeepSeek V3.21001001001006793.3%
Hermes 3 405B1001001001006793.3%
Arcee AI: Trinity Mini1001001001006793.3%
Mistral NeMO1001001001006793.3%
Qwen 3.5 122B100100100676786.7%
Qwen 3.5 Plus (2026-04-20)1001001001003386.7%
DeepSeek-V2 Chat1001001001003386.7%
GPT-4o Mini (temp=1)100100100676786.7%
Llama 3.1 70B1001001001003386.7%
Qwen 3.5 397B A17B10010067676780.0%
GPT-5.2100100100673380.0%
GPT-OSS 120B100100100673380.0%
GPT-4.1 Nano100100100673380.0%
Ministral 3 3B100100100100080.0%
Nemotron 3 Nano10010010067073.3%
Qwen 2.5 72B10010010067073.3%
Mistral Small 3.2 24B100100670 – 66.7%
GPT-4o, Aug. 6th (temp=0)1006733333353.3%
Inception Mercury 26767330033.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100 – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
MiniMax M2.5100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Laguna S 2.1100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Ministral 3B100100100100100100.0%
Qwen 3.7 Max1001001001006793.3%
DeepSeek V4.1 Flash (Reasoning, High)1001001001006793.3%
Muse Spark 1.3 (Reasoning, Medium)1001001001006793.3%
GPT-5.4 (Reasoning)1001001001006793.3%
Z.AI GLM 5.11001001001006793.3%
GPT-5.5 (Reasoning, Low)1001001001006793.3%
GPT-5 Mini1001001001006793.3%
Qwen 3.5 397B A17B1001001001006793.3%
Grok 4.20 (Reasoning)1001001001006793.3%
GPT-5.11001001001006793.3%
Qwen 3.5 27B1001001001006793.3%
GPT-5.4 Mini (Reasoning)1001001001006793.3%
Qwen 3.5 Plus (2026-04-20)1001001001006793.3%
Gemini 2.5 Pro1001001001006793.3%
Qwen 3.6 27B1001001001006793.3%
Thinking Machines Inkling Small (Reasoning, High)1001001001006793.3%
GPT-4.11001001001006793.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001006793.3%
ByteDance Seed 2.0 Mini1001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
Gemma 4 26B1001001001006793.3%
GPT-5.41001001001006793.3%
Aion 3.0 Mini1001001001006793.3%
GPT-5.4 Mini (Reasoning, Low)1001001001006793.3%
Gemini 2.5 Flash Lite (Reasoning)1001001001006793.3%
DeepSeek V3.11001001001006793.3%
Z.AI GLM 4.7 Flash1001001001006793.3%
GPT-5.4 Mini1001001001006793.3%
DeepSeek V3 (2025-03-24)1001001001006793.3%
Gemma 3 27B1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Hermes 3 70B1001001001006793.3%
Cohere Command R+ (Aug. 2024)1001001001006793.3%
Gemma 3 4B1001001001006793.3%
DeepSeek V4 Flash (Reasoning)100100100676786.7%
Z.AI GLM 4.7100100100676786.7%
Aion 2.0100100100676786.7%
DeepSeek-V2 Chat1001001001003386.7%
DeepSeek V3.2100100100676786.7%
Inception Mercury 2100100100676786.7%
GPT-5 Nano1001001001003386.7%
Gemini 2.5 Flash Lite100100100676786.7%
Mistral NeMO100100100676786.7%
Ministral 8B1001001001003386.7%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100673380.0%
DeepSeek V3 (2024-12-26)100100100100080.0%
GPT-5.4 Nano (Reasoning)10010067676780.0%
GPT-5.4 Nano10010067676780.0%
Ministral 3 8B100100100100080.0%
Ministral 3 3B100100100100080.0%
Cydonia 24B V4.110010067673373.3%
GPT-OSS 120B100100100333373.3%
GPT-4o, Aug. 6th (temp=0)10010067673373.3%
GPT-4o Mini (temp=1)10010067673373.3%
Nemotron 3 Nano10010067673373.3%
Qwen 2.5 72B10010010067073.3%
GPT-5.210010067333366.7%
GPT-5.4 Nano (Reasoning, Low)10010067333366.7%
Gemini 2.5 Flash1001001000060.0%
Gemini 2.5 Flash (Reasoning)1006733333353.3%
Llama 3.1 70B100676733053.3%
Mistral Small 3.2 24B10010000040.0%
GPT-4o Mini (temp=0)67000013.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)1001001001006793.3%
Grok 4.5 (Reasoning, Low)1001001001006793.3%
GPT-5.6 Sol1001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
GPT-5.51001001001006793.3%
DeepSeek V4 Flash (Reasoning)1001001001006793.3%
ByteDance Seed 2.0 Mini1001001001006793.3%
Mistral Medium 3.51001001001006793.3%
Mistral Large 31001001001006793.3%
ByteDance Seed 2.0 Lite1001001001006793.3%
Qwen 3.5 9B1001001001006793.3%
Nemotron 3 Super1001001001006793.3%
GPT-4.1 Mini1001001001006793.3%
GPT-4o, Aug. 6th (temp=1)1001001001006793.3%
Hermes 3 405B1001001001006793.3%
Gemini 2.5 Flash1001001001006793.3%
GPT-5.4 Nano (Reasoning)1001001001006793.3%
Gemini 2.5 Flash Lite1001001001006793.3%
Qwen 3 235B A22B Instruct 25071001001001006793.3%
GPT-5.4 Nano (Reasoning, Low)1001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
Thinking Machines Inkling1001001001006793.3%
Cohere Command R+ (Aug. 2024)1001001001006793.3%
Mistral NeMO1001001001006793.3%
Ministral 3B1001001001006793.3%
Muse Spark 1.3 (Reasoning, Medium)100100100676786.7%
o4 Mini1001001001003386.7%
Z.AI GLM 4.5100100100676786.7%
GPT-OSS 120B100100100676786.7%
GPT-5.4 Mini (Reasoning, Low)100100100676786.7%
Laguna XS 2.11001001001003386.7%
Hermes 3 70B1001001001003386.7%
Arcee AI: Trinity Mini100100100676786.7%
Muse Spark 1.2 (Reasoning, Medium)100100100673380.0%
GPT-4o, Aug. 6th (temp=0)100100100673380.0%
GPT-5.4 Mini10010067676780.0%
GPT-4o Mini (temp=1)10010067676780.0%
GPT-5.4 Nano100100100673380.0%
Mistral Small 3.2 24B10010067673373.3%
Thinking Machines Inkling (Reasoning)10010010067073.3%
DeepSeek V3 (2024-12-26)10010067673373.3%
GPT-4o Mini (temp=0)10010067673373.3%
Qwen 2.5 72B10010067673373.3%
Inception Mercury 21006767673366.7%
Llama 3.1 70B10010067333366.7%
DeepSeek-V2 Chat100676767060.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Gemini 3.6 Flash (Reasoning)1001001001006793.3%
Qwen 3.7 Max1001001001006793.3%
Z.AI GLM 5 Turbo1001001001006793.3%
GPT-5.5 (Reasoning, Low)1001001001006793.3%
Qwen 3.5 27B1001001001006793.3%
Gemini 3 Flash (Preview, Reasoning)1001001001006793.3%
Qwen 3.5 Plus (2026-04-20)1001001001006793.3%
Claude Opus 4.51001001001006793.3%
Gemma 4 26B (Reasoning)1001001001006793.3%
o4 Mini High1001001001006793.3%
DeepSeek V4 Flash (Reasoning)1001001001006793.3%
DeepSeek V4 Flash 0731 (Reasoning, High)1001001001006793.3%
Claude Sonnet 41001001001006793.3%
Claude Opus 41001001001006793.3%
GPT-4.11001001001006793.3%
MiniMax M2.71001001001006793.3%
Gemini 3 Flash (Preview)1001001001006793.3%
Mistral Medium 3.5 (Reasoning)1001001001006793.3%
Mistral Medium 3.51001001001006793.3%
GPT-5.41001001001006793.3%
Gemini 2.5 Flash (Reasoning)1001001001006793.3%
DeepSeek-V2 Chat1001001001006793.3%
Gemini 2.5 Flash Lite (Reasoning)1001001001006793.3%
DeepSeek V4 Pro1001001001006793.3%
GPT-5.4 Nano (Reasoning)1001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
Gemma 3 27B1001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
ByteDance Seed 1.6 Flash1001001001006793.3%
Ministral 3 14B1001001001006793.3%
Ministral 3 8B1001001001006793.3%
Ministral 3 3B1001001001006793.3%
Ministral 8B1001001001006793.3%
Hy4 Preview (Reasoning, High)1001001001003386.7%
ByteDance Seed 1.6100100100676786.7%
Aion 3.0100100100676786.7%
Qwen 3.6 27B100100100676786.7%
Z.AI GLM 4.5100100100676786.7%
Claude Haiku 4.51001001001003386.7%
Z.AI GLM 4.7 Flash100100100676786.7%
GPT-5 Nano100100100676786.7%
Laguna S 2.11001001001003386.7%
GPT-5.4 Nano (Reasoning, Low)100100100676786.7%
Laguna XS 2.11001001001003386.7%
Hermes 3 70B1001001001003386.7%
Muse Spark 1.3 (Reasoning, Medium)1001001001003386.7%
Qwen 3.5 35B1001001001003386.7%
Mistral Small 4 (Reasoning)1001001001003386.7%
Qwen 3.5 397B A17B10010067676780.0%
Z.AI GLM 4.5 Air10010067676780.0%
Gemini 3.5 Flash (Reasoning)100100100673380.0%
o4 Mini100100100673380.0%
Qwen 3.5 Plus (2026-02-15)10010067676780.0%
GPT-5.4 Mini (Reasoning, Low)100100100673380.0%
DeepSeek V3 (2024-12-26)100100100100080.0%
Hermes 3 405B100100100673380.0%
DeepSeek V3 (2025-03-24)100100100673380.0%
Mistral Medium 3.1100100100100080.0%
Arcee AI: Trinity Mini100100100673380.0%
Gemma 3 4B100100100673380.0%
Mistral NeMO10010067676780.0%
Qwen 3.5 122B10010067673373.3%
Z.AI GLM 4.710010067673373.3%
GPT-OSS 120B10010067673373.3%
Cohere Command R+ (Aug. 2024)10010067673373.3%
Z.AI GLM 4.610010067333366.7%
Inception Mercury 210010067333366.7%
Nemotron 3 Super1006767673366.7%
Mistral Small 3.2 24B10010010033066.7%
Gemma 3 12B1006767673366.7%
GPT-5.4 Nano10010067333366.7%
Llama 3.1 70B1001006733060.0%
GPT-4o Mini (temp=0)1006767333360.0%
Gemini 2.5 Flash67676767053.3%
Ministral 3B100100670053.3%
Qwen 2.5 72B100673333046.7%
Gemini 2.5 Flash Lite67673333040.0%
GPT-4o, Aug. 6th (temp=0)6767330033.3%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100 – – – 100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)1001001001006793.3%
Grok 4.5 (Reasoning, High)1001001001006793.3%
Kimi K3 (Reasoning, Low)1001001001006793.3%
Muse Spark 1.1 (Reasoning, Minimal)1001001001006793.3%
Qwen 3.5 122B1001001001006793.3%
MiniMax M2.51001001001006793.3%
Gemini 3.6 Flash (Reasoning, Minimal)1001001001006793.3%
Aion 2.01001001001006793.3%
Qwen 3.5 Plus (2026-02-15)1001001001006793.3%
ByteDance Seed 2.0 Mini1001001001006793.3%
Qwen 3.5 Flash1001001001006793.3%
Z.AI GLM 4.51001001001006793.3%
GPT-OSS 120B1001001001006793.3%
Gemini 2.5 Flash Lite (Reasoning)1001001001006793.3%
DeepSeek V3.11001001001006793.3%
DeepSeek V4 Flash1001001001006793.3%
Nemotron 3 Super1001001001006793.3%
Mistral Small 4 (Reasoning)1001001001006793.3%
Writer: Palmyra X51001001001006793.3%
Qwen 3 235B A22B Instruct 25071001001001006793.3%
GPT-4o Mini (temp=1)1001001001006793.3%
Gemma 3 27B1001001001006793.3%
Mistral Small 41001001001006793.3%
Nemotron 3 Nano1001001001006793.3%
WizardLM 2 8x22b1001001001006793.3%
Ministral 3 8B1001001001006793.3%
GPT-4.1 Nano1001001001006793.3%
Arcee AI: Trinity Mini1001001001006793.3%
Ministral 3 3B1001001001006793.3%
Ministral 8B1001001001006793.3%
Ministral 3B1001001001006793.3%
Qwen 3.5 27B100100100676786.7%
Qwen 3.5 Plus (2026-04-20)100100100676786.7%
Xiaomi MIMO v2.5 Pro1001001001003386.7%
DeepSeek V3.2100100100676786.7%
Hermes 3 405B1001001001003386.7%
Gemini 2.5 Flash100100100676786.7%
Cohere Command R+ (Aug. 2024)1001001001003386.7%
Gemma 3 4B1001001001003386.7%
o4 Mini10010067676780.0%
GPT-4.1 Mini10010067676780.0%
GPT-5.4 Nano100100100333373.3%
Mistral NeMO10010010067073.3%
DeepSeek V3 (2024-12-26)10010010033066.7%
Laguna S 2.110010067333366.7%
DeepSeek-V2 Chat1001001000060.0%
Hermes 3 70B1001003333053.3%
GPT-4o, Aug. 6th (temp=0)676733333346.7%
Inception Mercury 2100673333046.7%
Llama 3.1 70B100673333046.7%
GPT-4o Mini (temp=0)100673333046.7%
Mistral Small 3.2 24B10067330040.0%
Qwen 2.5 72B100000020.0%