Matches paragraph count

Test: Write N of X

Avg. Score
97.5%
Scenarios
3

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Ministral 3 3B100.0%$0.00021.4s100%
2Gemini 2.5 Flash Lite100.0%$0.00031.3s100%
3Inception Mercury 2100.0%$0.00061.0s100%
4Ministral 3 8B100.0%$0.00032.3s100%
5GPT-5.4 Nano100.0%$0.00061.9s100%
6Gemini 3.5 Flash Lite (Reasoning, Minimal)100.0%$0.00101.4s100%
7GPT-5.4 Nano (Reasoning)100.0%$0.00062.0s100%
8GPT-5.4 Nano (Reasoning, Low)100.0%$0.00062.0s100%
9Gemini 3.1 Flash Lite (Preview)100.0%$0.00081.8s100%
10Gemini 3.5 Flash Lite (Reasoning)100.0%$0.00101.4s100%
11Gemini 3.1 Flash Lite100.0%$0.00081.9s100%
12Gemini 2.5 Flash100.0%$0.00092.1s100%
13Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00082.4s100%
14GPT-5.4 Mini100.0%$0.00151.7s100%
15Ministral 3 14B100.0%$0.00043.6s100%
16Mistral Small 4100.0%$0.00043.6s100%
17Laguna XS 2.1100.0%$0.00014.3s100%
18GPT-5.4 Mini (Reasoning, Low)100.0%$0.00171.6s100%
19GPT-4.1 Nano100.0%$0.00024.2s100%
20Mistral Small 3.2 24B100.0%$0.00024.2s100%
21DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.00044.1s100%
22GPT-5.6 Luna100.0%$0.00152.2s100%
23GPT-5.4 Mini (Reasoning)100.0%$0.00172.2s100%
24GPT-4.1 Mini100.0%$0.00074.1s100%
25GPT-5.6 Luna (Reasoning)100.0%$0.00172.3s100%
26DeepSeek V4 Flash (Reasoning)100.0%$0.00025.2s100%
27ByteDance Seed 1.6 Flash100.0%$0.00035.2s100%
28Llama 3.1 70B100.0%$0.00173.0s100%
29Gemini 3 Flash (Preview)100.0%$0.00173.5s100%
30Gemini 2.5 Flash Lite (Reasoning)100.0%$0.00065.4s100%
31Nemotron 3 Super100.0%$0.00006.5s100%
32Mistral Small 4 (Reasoning)100.0%$0.00076.3s100%
33Nemotron 3 Nano100.0%$0.00027.3s100%
34Grok 4.20100.0%$0.00243.7s100%
35Gemma 3 12B100.0%$0.00017.7s100%
36Mistral Medium 3.1100.0%$0.00136.6s100%
37Muse Glimmer 30B (Reasoning, Medium)100.0%$0.00077.7s100%
38Mistral Large 3100.0%$0.00137.1s100%
39Gemma 4 26B100.0%$0.00029.1s100%
40Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.00019.6s100%
41Qwen 3 235B A22B Instruct 2507100.0%$0.00039.7s100%
42GPT-5.6 Terra100.0%$0.00413.2s100%
43GPT-5.6 Terra (Reasoning)100.0%$0.00413.3s100%
44Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.00462.5s100%
45GPT-5 Mini100.0%$0.00167.6s100%
46Laguna S 2.1100.0%$0.000110.3s100%
47Qwen 2.5 72B100.0%$0.00089.3s100%
48Gemma 3 27B100.0%$0.000210.5s100%
49Z.AI GLM 4.5100.0%$0.00119.1s100%
50Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.00502.5s100%
51DeepSeek V3 (2024-12-26)100.0%$0.00089.7s100%
52Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.00414.1s100%
53GPT-4.1100.0%$0.00384.8s100%
54Xiaomi MIMO v2.5 Pro100.0%$0.00169.1s100%
55Gemini 2.5 Flash (Reasoning)100.0%$0.00228.2s100%
56Qwen 3 32B100.0%$0.000411.6s100%
57Qwen 3.7 Flash (Reasoning)100.0%$0.000312.0s100%
58GPT-OSS 120B100.0%$0.000312.3s100%
59Grok 4.20 (Reasoning)100.0%$0.00298.0s100%
60o4 Mini100.0%$0.00317.7s100%
61Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.00494.6s100%
62GPT-5.4100.0%$0.00455.8s100%
63Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.00476.0s100%
64Qwen 3.6 Flash100.0%$0.00289.4s100%
65GPT-5.2100.0%$0.00476.2s100%
66Muse Spark 1.1 (Reasoning, Medium)100.0%$0.00505.6s100%
67MiniMax M2.5100.0%$0.000913.2s100%
68DeepSeek V4 Flash 0731 (Reasoning, High)100.0%$0.000314.7s100%
69Writer: Palmyra X5100.0%$0.00309.9s100%
70DeepSeek-V2 Chat100.0%$0.000314.7s100%
71Gemini 3 Flash (Preview, Reasoning)100.0%$0.00438.1s100%
72Z.AI GLM 4.5 Air100.0%$0.000714.3s100%
73GPT-5.1100.0%$0.00457.8s100%
74GPT-5.4 (Reasoning, Low)100.0%$0.00595.5s100%
75Qwen 3.8 27B (Reasoning, XHigh)100.0%$0.002012.6s100%
76Gemma 4 31B100.0%$0.000315.8s100%
77Mistral Large 2100.0%$0.00527.4s100%
78Qwen 3.6 35B100.0%$0.002412.2s100%
79DeepSeek V4 Flash100.0%$0.000216.2s100%
80GPT-4o, Aug. 6th (temp=0)100.0%$0.00714.7s100%
81GPT-4o, Aug. 6th (temp=1)100.0%$0.00744.7s100%
82DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.003012.7s100%
83Muse Spark 1.2 (Reasoning, Medium)100.0%$0.00578.0s100%
84DeepSeek V3.2100.0%$0.000517.1s100%
85GPT-5.4 (Reasoning)100.0%$0.00666.8s100%
86Aion 2.0100.0%$0.002214.6s100%
87Qwen 3.5 Flash100.0%$0.001117.3s100%
88GPT-5.6 Sol100.0%$0.00834.9s100%
89DeepSeek V4 Pro100.0%$0.001616.6s100%
90Z.AI GLM 5 Turbo100.0%$0.004312.0s100%
91Grok 4.3 (Reasoning)100.0%$0.003214.2s100%
92GPT-5.6 Sol (Reasoning)100.0%$0.00875.3s100%
93o4 Mini High100.0%$0.005011.8s100%
94GPT-5 Nano100.0%$0.000719.6s100%
95Qwen 3.5 Plus (2026-02-15)100.0%$0.001418.4s100%
96Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.005711.0s100%
97MiniMax M2.7100.0%$0.001618.2s100%
98Kimi K3 (Reasoning, Low)100.0%$0.005711.8s100%
99Qwen 3.8 Flash (Reasoning)100.0%$0.000222.4s100%
100MiniMax M3100.0%$0.000821.9s100%
101Aion 3.0 Mini100.0%$0.002120.1s100%
102Qwen 3.5 35B100.0%$0.004915.7s100%
103Claude Sonnet 4.6100.0%$0.00977.3s100%
104Aion 3.0100.0%$0.007711.0s100%
105Muse Spark 1.3 (Reasoning, Medium)100.0%$0.005515.4s100%
106Claude Sonnet 4.5100.0%$0.01007.7s100%
107Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.000325.0s100%
108Gemini 3.6 Flash (Reasoning)100.0%$0.0116.5s100%
109Z.AI GLM 4.7 Flash100.0%$0.000625.1s100%
110Claude Sonnet 4100.0%$0.0108.3s100%
111Claude Sonnet 5100.0%$0.0108.9s100%
112Claude Sonnet 5 (Reasoning)100.0%$0.0109.1s100%
113Qwen 3.5 122B100.0%$0.006715.7s100%
114GPT-5100.0%$0.007614.4s100%
115Claude Sonnet 5 (Reasoning, Low)100.0%$0.0109.6s100%
116Z.AI GLM 5.2 (Reasoning, High)100.0%$0.005118.8s100%
117Claude Sonnet 4.6 (Reasoning)100.0%$0.0118.6s100%
118Grok 4.6 (Reasoning, High)100.0%$0.006818.0s100%
119Gemini 3.5 Flash (Reasoning)100.0%$0.0136.5s100%
120Kimi K2.5100.0%$0.003424.5s100%
121 Kimi K3 (Reasoning, High)100.0%$0.007917.1s100%
122GPT-5.5 (Reasoning)100.0%$0.0146.3s100%
123GPT-5.5100.0%$0.0145.9s100%
124Qwen 3.5 27B100.0%$0.005022.5s100%
125GPT-5.5 (Reasoning, Low)100.0%$0.0146.2s100%
126Gemini 2.5 Pro100.0%$0.01210.4s100%
127Claude Opus 4.5100.0%$0.0168.1s100%
128ByteDance Seed 1.6100.0%$0.003032.3s100%
129Qwen 3.5 Plus (2026-04-20)100.0%$0.004829.2s100%
130Qwen 3.6 27B100.0%$0.006428.1s100%
131Claude Opus 4.6100.0%$0.0179.8s100%
132Gemma 4 31B (Reasoning)100.0%$0.000538.9s100%
133Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.005929.6s100%
134Claude Opus 4.6 (Reasoning)100.0%$0.01810.2s100%
135GPT-4o Mini (temp=0)100.0%$0.000440.5s100%
136Gemma 4 26B (Reasoning)100.0%$0.000542.2s100%
137DeepSeek V4 Pro (Reasoning)100.0%$0.003340.8s100%
138Gemini 3.1 Pro (Preview)100.0%$0.01815.8s100%
139Hy4 Preview (Reasoning, High)100.0%$0.005938.1s100%
140Qwen 3.5 9B100.0%$0.000647.8s100%
141Thinking Machines Inkling Small (Reasoning, High)96.7%$0.001610.7s64%
142Claude Opus 4.7 (Reasoning)100.0%$0.0267.4s100%
143Z.AI GLM 4.6100.0%$0.003346.7s100%
144Claude Opus 4.7100.0%$0.0267.6s100%
145Z.AI GLM 5.1100.0%$0.007540.6s100%
146Claude Opus 4.8 (Reasoning)100.0%$0.0269.4s100%
147Claude Opus 4.8 (Reasoning, Low)100.0%$0.0269.2s100%
148ByteDance Seed 2.0 Lite100.0%$0.004447.1s100%
149Grok 4.5 (Reasoning, High)96.7%$0.004612.0s64%
150GPT-4o Mini (temp=1)100.0%$0.000457.0s100%
151Claude Opus 5 (Reasoning)100.0%$0.02811.1s100%
152Claude Opus 5100.0%$0.02811.3s100%
153Claude Opus 5 (Reasoning, Low)100.0%$0.02811.3s100%
154Qwen 3.7 Max100.0%$0.01829.4s100%
155Cydonia 24B V4.193.3%$0.00056.5s50%
156Xiaomi MIMO v2.593.3%$0.00105.9s50%
157Z.AI GLM 5100.0%$0.005851.6s100%
158DeepSeek V3 (2025-03-24)93.3%$0.000610.5s50%
159Qwen 3.5 397B A17B100.0%$0.007654.5s100%
160DeepSeek V3.193.3%$0.000615.3s50%
161ByteDance Seed 2.0 Mini100.0%$0.00121.1m100%
162Qwen 3.6 Max Preview100.0%$0.01450.6s100%
163Kimi K2.696.7%$0.005732.7s64%
164Cohere Command R+ (Aug. 2024)90.0%$0.00655.6s40%
165Grok 4.386.7%$0.00223.8s32%
166Grok 4.5 (Reasoning, Low)90.0%$0.003918.7s40%
167Thinking Machines Inkling (Reasoning)96.7%$0.004249.0s64%
168Hermes 3 405B86.7%$0.000015.6s32%
169Z.AI GLM 4.7100.0%$0.00321.5m100%
170Arcee AI: Trinity Mini80.0%$0.00012.4s20%
171Claude Opus 4100.0%$0.05116.8s100%
172WizardLM 2 8x22b90.0%$0.001745.4s40%
173Claude Haiku 4.570.0%$0.00325.0s8%
174Hermes 3 70B66.7%$0.00079.2s6%
175Gemma 3 4B53.3%$0.00013.8s0%
176Thinking Machines Inkling66.7%$0.002522.6s6%
177Mistral NeMO40.0%$0.00032.7s0%
178Ministral 3B33.3%$0.00011.6s0%
179Ministral 8B33.3%$0.00022.1s0%
97.47%

Individual Scenarios

paragraphs

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
Ministral 3B100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100090.0%
Claude Haiku 4.5100100100100100100100100100090.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100090.0%
Hermes 3 405B100100100100100100100100100090.0%
Thinking Machines Inkling100100100100100100100100100090.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)1001001001001001001001000080.0%
Hermes 3 70B10010010010010010010000070.0%
Gemma 3 4B100100100100100100000060.0%
Mistral NeMO10000000000010.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100100100100100100.0%
Qwen 3.7 Max100100100100100100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Kimi K2.5100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100090.0%
Kimi K2.6100100100100100100100100100090.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100090.0%
Grok 4.5 (Reasoning, Low)1001001001001001001001000080.0%
Xiaomi MIMO v2.51001001001001001001001000080.0%
DeepSeek V3.11001001001001001001001000080.0%
Cydonia 24B V4.11001001001001001001001000080.0%
Cohere Command R+ (Aug. 2024)1001001001001001001001000080.0%
Hermes 3 405B10010010010010010010000070.0%
WizardLM 2 8x22b10010010010010010010000070.0%
Grok 4.3100100100100100100000060.0%
Arcee AI: Trinity Mini10010010010000000040.0%
Hermes 3 70B100100100000000030.0%
Claude Haiku 4.51001000000000020.0%
Thinking Machines Inkling10000000000010.0%
Mistral NeMO10000000000010.0%
Gemma 3 4B00000000000.0%
Ministral 8B00000000000.0%
Ministral 3B00000000000.0%