Matches paragraph count

Test: Write N of X

Avg. Score
97.6%
Scenarios
3

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Ministral 3 3B100.0%$0.00021.4s100%
2Gemini 2.5 Flash Lite100.0%$0.00031.3s100%
3Inception Mercury 2100.0%$0.00061.0s100%
4Ministral 3 8B100.0%$0.00032.3s100%
5GPT-5.4 Nano100.0%$0.00061.9s100%
6Gemini 3.5 Flash Lite (Reasoning, Minimal)100.0%$0.00101.4s100%
7GPT-5.4 Nano (Reasoning)100.0%$0.00062.0s100%
8GPT-5.4 Nano (Reasoning, Low)100.0%$0.00062.0s100%
9Gemini 3.1 Flash Lite (Preview)100.0%$0.00081.8s100%
10Gemini 3.5 Flash Lite (Reasoning)100.0%$0.00101.4s100%
11Gemini 3.1 Flash Lite100.0%$0.00081.9s100%
12Claude Haiku 5.5 (Reasoning, Low)100.0%$0.00042.8s100%
13Gemini 2.5 Flash100.0%$0.00092.1s100%
14Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00082.4s100%
15GPT-6 Luna100.0%$0.00013.6s100%
16GPT-6 Luna (Reasoning, Medium)100.0%$0.00014.0s100%
17GPT-5.4 Mini100.0%$0.00151.7s100%
18Ministral 3 14B100.0%$0.00043.6s100%
19Mistral Small 4100.0%$0.00043.6s100%
20GPT-6 Luna (Reasoning, High)100.0%$0.00014.1s100%
21Laguna XS 2.1100.0%$0.00014.3s100%
22GPT-5.4 Mini (Reasoning, Low)100.0%$0.00171.6s100%
23GPT-4.1 Nano100.0%$0.00024.2s100%
24Mistral Small 3.2 24B100.0%$0.00024.2s100%
25DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.00044.1s100%
26GPT-5.6 Luna100.0%$0.00152.2s100%
27GPT-5.4 Mini (Reasoning)100.0%$0.00172.2s100%
28GPT-4.1 Mini100.0%$0.00074.1s100%
29GPT-5.6 Luna (Reasoning, Medium)100.0%$0.00172.3s100%
30DeepSeek V4 Flash (Reasoning)100.0%$0.00025.2s100%
31ByteDance Seed 1.6 Flash100.0%$0.00035.2s100%
32Llama 3.1 70B100.0%$0.00173.0s100%
33Gemini 3 Flash (Preview)100.0%$0.00173.5s100%
34Gemini 2.5 Flash Lite (Reasoning)100.0%$0.00065.4s100%
35Nemotron 3 Super100.0%$0.00006.5s100%
36Mistral Small 4 (Reasoning)100.0%$0.00076.3s100%
37Nemotron 3 Nano100.0%$0.00027.3s100%
38GPT-6 Sol100.0%$0.00224.0s100%
39Grok 4.20100.0%$0.00243.7s100%
40Gemma 3 12B100.0%$0.00017.7s100%
41GPT-6 Sol (Reasoning, Medium)100.0%$0.00234.2s100%
42Mistral Medium 3.1100.0%$0.00136.6s100%
43Muse Glimmer 30B (Reasoning, Medium)100.0%$0.00077.7s100%
44Mistral Medium 3.5 (Reasoning)100.0%$0.00392.3s100%
45Mistral Large 4.0100.0%$0.00117.1s100%
46Mistral Large 3100.0%$0.00137.1s100%
47Gemma 4 26B100.0%$0.00029.1s100%
48Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.00019.6s100%
49Qwen 3 235B A22B Instruct 2507100.0%$0.00039.7s100%
50GPT-5.6 Terra100.0%$0.00413.2s100%
51GPT-5.6 Terra (Reasoning, Medium)100.0%$0.00413.3s100%
52Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.00462.5s100%
53GPT-5 Mini100.0%$0.00167.6s100%
54Laguna S 2.1100.0%$0.000110.3s100%
55Qwen 2.5 72B100.0%$0.00089.3s100%
56Gemma 3 27B100.0%$0.000210.5s100%
57Z.AI GLM 4.5100.0%$0.00119.1s100%
58Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.00502.5s100%
59DeepSeek V3 (2024-12-26)100.0%$0.00089.7s100%
60Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.00414.1s100%
61GPT-4.1100.0%$0.00384.8s100%
62Xiaomi MIMO v2.5 Pro100.0%$0.00169.1s100%
63Gemini 2.5 Flash (Reasoning)100.0%$0.00228.2s100%
64Qwen 3 32B100.0%$0.000411.6s100%
65Qwen 3.7 Flash (Reasoning)100.0%$0.000312.0s100%
66GPT-6.1 Sol (Reasoning, Medium)100.0%$0.00248.3s100%
67GPT-OSS 120B100.0%$0.000312.3s100%
68Grok 4.20 (Reasoning)100.0%$0.00298.0s100%
69o4 Mini100.0%$0.00317.7s100%
70Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.00494.6s100%
71GPT-5.4100.0%$0.00455.8s100%
72Xiaomi MIMO v2.6 Pro100.0%$0.000413.4s100%
73Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.00476.0s100%
74Qwen 3.6 Flash100.0%$0.00289.4s100%
75GPT-5.2100.0%$0.00476.2s100%
76Muse Spark 1.1 (Reasoning, Medium)100.0%$0.00505.6s100%
77MiniMax M2.5100.0%$0.000913.2s100%
78DeepSeek V4 Flash 0731 (Reasoning, High)100.0%$0.000314.7s100%
79Writer: Palmyra X5100.0%$0.00309.9s100%
80Xiaomi MIMO v2.6 Flash100.0%$0.000114.9s100%
81DeepSeek-V2 Chat100.0%$0.000314.7s100%
82Grok 4.7 (Reasoning, High)100.0%$0.00437.7s100%
83Gemini 3 Flash (Preview, Reasoning)100.0%$0.00438.1s100%
84Z.AI GLM 4.5 Air100.0%$0.000714.3s100%
85GPT-5.1100.0%$0.00457.8s100%
86GPT-5.4 (Reasoning, Low)100.0%$0.00595.5s100%
87Qwen 3.8 27B (Reasoning, XHigh)100.0%$0.002012.6s100%
88Gemma 4 31B100.0%$0.000315.8s100%
89Mistral Large 2100.0%$0.00527.4s100%
90Qwen 3.6 35B100.0%$0.002412.2s100%
91DeepSeek V4 Flash100.0%$0.000216.2s100%
92GPT-4o, Aug. 6th (temp=0)100.0%$0.00714.7s100%
93GPT-4o, Aug. 6th (temp=1)100.0%$0.00744.7s100%
94DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.003012.7s100%
95Muse Spark 1.2 (Reasoning, Medium)100.0%$0.00578.0s100%
96DeepSeek V3.2100.0%$0.000517.1s100%
97GPT-5.4 (Reasoning)100.0%$0.00666.8s100%
98Aion 2.0100.0%$0.002214.6s100%
99Qwen 3.5 Flash100.0%$0.001117.3s100%
100GPT-5.6 Sol100.0%$0.00834.9s100%
101DeepSeek V4 Pro100.0%$0.001616.6s100%
102Z.AI GLM 5 Turbo100.0%$0.004312.0s100%
103Grok 4.3 (Reasoning)100.0%$0.003214.2s100%
104GPT-5.6 Sol (Reasoning, Medium)100.0%$0.00875.3s100%
105o4 Mini High100.0%$0.005011.8s100%
106GPT-5 Nano100.0%$0.000719.6s100%
107Qwen 3.5 Plus (2026-02-15)100.0%$0.001418.4s100%
108Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.005711.0s100%
109MiniMax M2.7100.0%$0.001618.2s100%
110Claude Sonnet 5.5 (Reasoning)100.0%$0.00974.7s100%
111Kimi K3 (Reasoning, Low)100.0%$0.005711.8s100%
112Qwen 3.8 Flash (Reasoning)100.0%$0.000222.4s100%
113MiniMax M3100.0%$0.000821.9s100%
114Aion 3.0 Mini100.0%$0.002120.1s100%
115Qwen 3.5 35B100.0%$0.004915.7s100%
116Aion 3.5 Mini (Reasoning, High)100.0%$0.001621.3s100%
117Claude Sonnet 4.6100.0%$0.00977.3s100%
118Aion 3.0100.0%$0.007711.0s100%
119Muse Spark 1.3 (Reasoning, Medium)100.0%$0.005515.4s100%
120Claude Sonnet 4.5100.0%$0.01007.7s100%
121Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.000325.0s100%
122Gemini 3.6 Flash (Reasoning)100.0%$0.0116.5s100%
123Z.AI GLM 4.7 Flash100.0%$0.000625.1s100%
124Claude Sonnet 4100.0%$0.0108.3s100%
125Claude Sonnet 5100.0%$0.0108.9s100%
126Claude Sonnet 5 (Reasoning)100.0%$0.0109.1s100%
127Qwen 3.5 122B100.0%$0.006715.7s100%
128GPT-5100.0%$0.007614.4s100%
129Claude Sonnet 5 (Reasoning, Low)100.0%$0.0109.6s100%
130Z.AI GLM 5.2 (Reasoning, High)100.0%$0.005118.8s100%
131Claude Sonnet 4.6 (Reasoning)100.0%$0.0118.6s100%
132Mistral Large 4.0 (Reasoning)100.0%$0.003523.0s100%
133Grok 4.6 (Reasoning, High)100.0%$0.006818.0s100%
134Gemini 3.5 Flash (Reasoning)100.0%$0.0136.5s100%
135Kimi K2.5100.0%$0.003424.5s100%
136 Kimi K3 (Reasoning, High)100.0%$0.007917.1s100%
137GPT-5.5 (Reasoning, Medium)100.0%$0.0146.3s100%
138GPT-5.5100.0%$0.0145.9s100%
139Qwen 3.5 27B100.0%$0.005022.5s100%
140GPT-5.5 (Reasoning, Low)100.0%$0.0146.2s100%
141Gemini 2.5 Pro100.0%$0.01210.4s100%
142Claude Opus 4.5100.0%$0.0168.1s100%
143ByteDance Seed 1.6100.0%$0.003032.3s100%
144Qwen 3.5 Plus (2026-04-20)100.0%$0.004829.2s100%
145Qwen 3.6 27B100.0%$0.006428.1s100%
146Claude Opus 4.6100.0%$0.0179.8s100%
147Gemma 4 31B (Reasoning)100.0%$0.000538.9s100%
148Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.005929.6s100%
149Claude Haiku 5.5 (Reasoning, Medium)96.7%$0.00053.2s64%
150Claude Opus 4.6 (Reasoning)100.0%$0.01810.2s100%
151GPT-4o Mini (temp=0)100.0%$0.000440.5s100%
152Claude Opus 5.5 (Reasoning)100.0%$0.0207.1s100%
153Gemma 4 26B (Reasoning)100.0%$0.000542.2s100%
154Mistral Medium 3.596.7%$0.00392.3s64%
155DeepSeek V4 Pro (Reasoning)100.0%$0.003340.8s100%
156Gemini 3.1 Pro (Preview)100.0%$0.01815.8s100%
157Hy4 Preview (Reasoning, High)100.0%$0.005938.1s100%
158Qwen 3.5 9B100.0%$0.000647.8s100%
159Claude Haiku 5.5 (Reasoning, Max)100.0%$0.005240.7s100%
160Thinking Machines Inkling Small (Reasoning, High)96.7%$0.001610.7s64%
161Claude Opus 4.7 (Reasoning)100.0%$0.0267.4s100%
162Z.AI GLM 4.6100.0%$0.003346.7s100%
163Claude Opus 4.7100.0%$0.0267.6s100%
164Z.AI GLM 5.1100.0%$0.007540.6s100%
165Claude Opus 4.8 (Reasoning)100.0%$0.0269.4s100%
166Claude Opus 4.8 (Reasoning, Low)100.0%$0.0269.2s100%
167ByteDance Seed 2.0 Lite100.0%$0.004447.1s100%
168Grok 4.5 (Reasoning, High)96.7%$0.004612.0s64%
169GPT-4o Mini (temp=1)100.0%$0.000457.0s100%
170Claude Opus 5 (Reasoning)100.0%$0.02811.1s100%
171Claude Opus 5100.0%$0.02811.3s100%
172Claude Opus 5 (Reasoning, Low)100.0%$0.02811.3s100%
173Aion 3.5 (Reasoning, High)96.7%$0.005114.6s64%
174Qwen 3.7 Max100.0%$0.01829.4s100%
175Cydonia 24B V4.193.3%$0.00056.5s50%
176Xiaomi MIMO v2.593.3%$0.00105.9s50%
177Z.AI GLM 5100.0%$0.005851.6s100%
178DeepSeek V3 (2025-03-24)93.3%$0.000610.5s50%
179Qwen 3.5 397B A17B100.0%$0.007654.5s100%
180DeepSeek V3.193.3%$0.000615.3s50%
181ByteDance Seed 2.0 Mini100.0%$0.00121.1m100%
182Claude Haiku 5.5 (Adaptive)90.0%$0.00053.6s40%
183Qwen 3.6 Max Preview100.0%$0.01450.6s100%
184Kimi K2.696.7%$0.005732.7s64%
185Cohere Command R+ (Aug. 2024)90.0%$0.00655.6s40%
186Grok 4.386.7%$0.00223.8s32%
187Grok 4.5 (Reasoning, Low)90.0%$0.003918.7s40%
188Thinking Machines Inkling (Reasoning)96.7%$0.004249.0s64%
189Hermes 3 405B86.7%$0.000015.6s32%
190Z.AI GLM 4.7100.0%$0.00321.5m100%
191Arcee AI: Trinity Mini80.0%$0.00012.4s20%
192Claude Opus 4100.0%$0.05116.8s100%
193WizardLM 2 8x22b90.0%$0.001745.4s40%
194Claude Haiku 4.570.0%$0.00325.0s8%
195Hermes 3 70B66.7%$0.00079.2s6%
196Gemma 3 4B53.3%$0.00013.8s0%
197Thinking Machines Inkling66.7%$0.002522.6s6%
198Mistral NeMO40.0%$0.00032.7s0%
199Ministral 3B33.3%$0.00011.6s0%
200Ministral 8B33.3%$0.00022.1s0%
97.63%

Individual Scenarios

paragraphs

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100 – – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100 – – – – – – – 100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
GPT-6 Luna100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
Ministral 3B100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100090.0%
Claude Haiku 4.5100100100100100100100100100090.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100 – – – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – – – – – – 100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Mistral Medium 3.5100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
GPT-6 Luna100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100090.0%
Hermes 3 405B100100100100100100100100100090.0%
Thinking Machines Inkling100100100100100100100100100090.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)1001001001001001001001000080.0%
Hermes 3 70B10010010010010010010000070.0%
Gemma 3 4B100100100100100100000060.0%
Mistral NeMO10000000000010.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Max)100100100100 – – – – – – 100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-6 Sol100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100 – – – – – – – – – 100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Mistral Large 4.0100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
GPT-6 Luna100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100090.0%
Kimi K2.6100100100100100100100100100090.0%
Aion 3.5 (Reasoning, High)100100100100100100100100100090.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100090.0%
Mistral Medium 3.5100100100100100100100100100090.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100100100100090.0%
Grok 4.5 (Reasoning, Low)1001001001001001001001000080.0%
Xiaomi MIMO v2.51001001001001001001001000080.0%
DeepSeek V3.11001001001001001001001000080.0%
Cydonia 24B V4.11001001001001001001001000080.0%
Cohere Command R+ (Aug. 2024)1001001001001001001001000080.0%
Claude Haiku 5.5 (Adaptive)10010010010010010010000070.0%
Hermes 3 405B10010010010010010010000070.0%
WizardLM 2 8x22b10010010010010010010000070.0%
Grok 4.3100100100100100100000060.0%
Arcee AI: Trinity Mini10010010010000000040.0%
Hermes 3 70B100100100000000030.0%
Claude Haiku 4.51001000000000020.0%
Thinking Machines Inkling10000000000010.0%
Mistral NeMO10000000000010.0%
Gemma 3 4B00000000000.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%