Sentence length variance

Test: Bad Writing Habits

Avg. Score
99.7%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Ministral 3B100.0%$0.00018.1s100%
2Ministral 8B100.0%$0.000410.4s100%
3Gemini 2.5 Flash Lite100.0%$0.00099.5s100%
4Ministral 3 3B100.0%$0.000511.1s100%
5Ministral 3 14B100.0%$0.000711.7s100%
6Laguna XS 2.1100.0%$0.000314.4s100%
7Gemma 3 4B100.0%$0.000220.0s100%
8Mistral Small 4100.0%$0.001418.2s100%
9Ministral 3 8B100.0%$0.000819.6s100%
10Gemini 3.1 Flash Lite (Preview)100.0%$0.00308.4s99%
11Gemini 3.1 Flash Lite (Reasoning)100.0%$0.003011.9s100%
12Laguna S 2.1100.0%$0.000522.1s100%
13GPT-4.1 Mini100.0%$0.002719.0s100%
14ByteDance Seed 1.6 Flash100.0%$0.001327.3s100%
15GPT-5.4 Nano (Reasoning, Low)100.0%$0.005520.6s100%
16DeepSeek V4 Flash (Reasoning)100.0%$0.000731.1s100%
17DeepSeek V4 Flash100.0%$0.000631.6s100%
18Mistral Small 4 (Reasoning)100.0%$0.002230.2s100%
19Gemini 3 Flash (Preview)100.0%$0.007819.6s100%
20Gemini 2.5 Flash Lite (Reasoning)100.0%$0.002830.8s100%
21Mistral Large 3100.0%$0.003330.3s100%
22GPT-5.4 Nano (Reasoning)100.0%$0.006124.5s100%
23GPT-5.4 Nano100.0%$0.005726.3s100%
24DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.002935.4s100%
25Gemma 3 12B100.0%$0.000441.3s100%
26DeepSeek V3 (2025-03-24)100.0%$0.001439.4s100%
27Xiaomi MIMO v2.5100.0%$0.005431.8s100%
28Qwen 3.5 Plus (2026-02-15)100.0%$0.006031.5s100%
29Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.01219.2s100%
30Gemini 2.5 Flash (Reasoning)100.0%$0.01121.5s100%
31Grok 4.3100.0%$0.006930.5s100%
32Claude Haiku 4.5100.0%$0.01121.6s100%
33Writer: Palmyra X5100.0%$0.01122.0s100%
34Mistral Medium 3.1100.0%$0.004836.5s100%
35GPT-5.6 Luna100.0%$0.01515.8s100%
36GPT-5.4 Mini (Reasoning, Low)100.0%$0.01516.8s100%
37Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.01418.0s100%
38GPT-5.4 Mini100.0%$0.01516.8s100%
39Cydonia 24B V4.1100.0%$0.001444.8s100%
40Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.01714.3s100%
41Arcee AI: Trinity Mini99.8%$0.00039.2s97%
42Z.AI GLM 5 Turbo100.0%$0.008133.2s100%
43Muse Glimmer 30B (Reasoning, Medium)100.0%$0.003843.4s100%
44Qwen 3.5 Flash100.0%$0.002547.5s100%
45Z.AI GLM 4.5100.0%$0.005142.1s100%
46GPT-5.6 Luna (Reasoning)100.0%$0.01718.0s100%
47Gemma 3 27B100.0%$0.000652.6s100%
48Muse Spark 1.1 (Reasoning, Medium)100.0%$0.01523.9s100%
49o4 Mini100.0%$0.01525.7s100%
50Gemini 3 Flash (Preview, Reasoning)100.0%$0.01230.1s100%
51Mistral Large 2100.0%$0.01329.4s100%
52Gemma 4 26B100.0%$0.000955.1s100%
53Qwen 3.7 Flash (Reasoning)100.0%$0.001055.2s100%
54Qwen 3 32B100.0%$0.001554.6s100%
55Gemini 3.7 Flash (Reasoning, Medium)99.9%$0.01218.2s99%
56DeepSeek-V2 Chat100.0%$0.002153.3s100%
57Qwen 3 235B A22B Instruct 2507100.0%$0.001159.2s100%
58Qwen 3.6 Flash100.0%$0.01041.4s100%
59GPT-4o Mini (temp=0)99.8%$0.001234.8s98%
60Z.AI GLM 4.5 Air100.0%$0.002958.2s100%
61Gemini 3.1 Flash Lite99.7%$0.003012.1s97%
62Grok 4.20100.0%$0.009345.7s100%
63Z.AI GLM 4.6100.0%$0.006551.5s100%
64Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.00051.1m100%
65Xiaomi MIMO v2.5 Pro100.0%$0.008553.5s100%
66GPT-5.4 Mini (Reasoning)100.0%$0.02228.1s100%
67Gemini 3.5 Flash (Reasoning, Minimal)99.9%$0.01812.0s98%
68Z.AI GLM 4.7 Flash100.0%$0.00171.2m100%
69MiniMax M2.7100.0%$0.00401.1m100%
70Gemini 2.5 Flash99.7%$0.005210.6s96%
71Muse Spark 1.2 (Reasoning, Medium)100.0%$0.01838.3s100%
72GPT-5 Mini100.0%$0.010057.4s100%
73Qwen 3.6 35B100.0%$0.00831.0m100%
74GPT-4o Mini (temp=1)99.8%$0.001234.8s97%
75GPT-4.1100.0%$0.01844.7s100%
76MiniMax M2.5100.0%$0.00341.3m100%
77Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0111.0m100%
78Aion 3.0 Mini100.0%$0.00531.2m100%
79DeepSeek V3 (2024-12-26)99.9%$0.002154.6s98%
80DeepSeek V4 Pro100.0%$0.00481.3m100%
81Z.AI GLM 5100.0%$0.00841.2m100%
82Claude Sonnet 5100.0%$0.02733.5s100%
83Aion 2.0100.0%$0.00641.3m100%
84GPT-4.1 Nano99.5%$0.000713.3s95%
85o4 Mini High100.0%$0.02547.2s100%
86Gemma 4 31B100.0%$0.00101.6m100%
87Claude Sonnet 5 (Reasoning)100.0%$0.03038.9s100%
88Grok 4.5 (Reasoning, Low)100.0%$0.0181.1m100%
89Claude Sonnet 5 (Reasoning, Low)100.0%$0.03138.4s100%
90Claude Sonnet 4.6100.0%$0.03139.3s100%
91Mistral NeMO99.4%$0.000510.1s93%
92Z.AI GLM 4.7100.0%$0.0101.4m100%
93Claude Sonnet 4.5100.0%$0.03538.1s100%
94Aion 3.0100.0%$0.0241.0m100%
95Gemini 2.5 Pro100.0%$0.03636.2s100%
96DeepSeek V3.1100.0%$0.00201.8m100%
97DeepSeek V3.2100.0%$0.00141.9m100%
98Qwen 3.5 122B100.0%$0.0251.1m100%
99Thinking Machines Inkling Small (Reasoning, High)100.0%$0.00881.7m100%
100GPT-5 Nano99.9%$0.00421.4m98%
101Z.AI GLM 5.1100.0%$0.0141.5m100%
102Gemma 4 26B (Reasoning)100.0%$0.00132.0m100%
103Thinking Machines Inkling99.9%$0.00751.5m98%
104GPT-5.6 Terra (Reasoning)100.0%$0.04435.2s100%
105Kimi K3 (Reasoning, Low)100.0%$0.0281.1m100%
106Grok 4.20 (Reasoning)100.0%$0.0181.5m100%
107Claude Sonnet 499.9%$0.03243.7s99%
108GPT-5.6 Terra100.0%$0.04636.9s100%
109Gemini 3.6 Flash (Reasoning)100.0%$0.04432.5s99%
110Gemma 4 31B (Reasoning)100.0%$0.00142.2m100%
111Gemini 3.5 Flash Lite (Reasoning)98.9%$0.00356.6s92%
112Qwen 3.5 Plus (2026-04-20)100.0%$0.0171.8m100%
113Grok 4.5 (Reasoning, High)100.0%$0.0301.6m100%
114DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.0251.8m100%
115Muse Spark 1.3 (Reasoning, Medium)100.0%$0.0251.8m100%
116DeepSeek V4 Flash 0731 (Reasoning, High)100.0%$0.00222.6m100%
117Claude Opus 4.7100.0%$0.06930.4s100%
118ByteDance Seed 1.6100.0%$0.0132.5m100%
119Gemini 3.5 Flash (Reasoning)100.0%$0.07137.6s100%
120Claude Opus 4.8 (Reasoning)100.0%$0.07141.7s100%
121GPT-5.4100.0%$0.0491.4m100%
122Claude Opus 4.7 (Reasoning)100.0%$0.07632.0s100%
123Claude Opus 4.8 (Reasoning, Low)100.0%$0.07141.9s100%
124Qwen 3.5 35B99.5%$0.0181.0m93%
125ByteDance Seed 2.0 Lite99.9%$0.0122.2m97%
126Cohere Command R+ (Aug. 2024)99.2%$0.02052.5s94%
127Claude Sonnet 4.6 (Reasoning)100.0%$0.0601.2m100%
128GPT-5.4 (Reasoning, Low)100.0%$0.0551.4m100%
129Qwen 3.8 Flash (Reasoning)100.0%$0.00643.1m100%
130Claude Opus 4.5100.0%$0.07053.4s100%
131 Kimi K3 (Reasoning, High)100.0%$0.0441.8m100%
132MiniMax M3100.0%$0.00603.1m100%
133GPT-5.2100.0%$0.0561.5m100%
134Qwen 3.5 397B A17B100.0%$0.0143.0m100%
135Nemotron 3 Super99.1%$0.00001.4m92%
136DeepSeek V4 Pro (Reasoning)100.0%$0.0153.1m100%
137Qwen 2.5 72B98.3%$0.001036.7s90%
138GPT-5.1100.0%$0.0541.8m100%
139Claude Opus 5100.0%$0.08250.1s100%
140Kimi K2.5100.0%$0.0193.2m100%
141Claude Opus 4.6100.0%$0.0781.2m100%
142Grok 4.6 (Reasoning, High)100.0%$0.0422.5m100%
143Hermes 3 70B98.4%$0.00101.2m90%
144Claude Opus 5 (Reasoning, Low)100.0%$0.0971.0m100%
145Claude Opus 4.6 (Reasoning)100.0%$0.0881.4m100%
146Claude Opus 5 (Reasoning)100.0%$0.0981.0m100%
147Hermes 3 405B98.1%$0.003253.2s88%
148GPT-OSS 120B98.6%$0.00151.8m90%
149Qwen 3.7 Max100.0%$0.0682.3m100%
150GPT-5.6 Sol100.0%$0.1051.2m100%
151GPT-5.6 Sol (Reasoning)100.0%$0.1081.2m100%
152Qwen 3.6 27B99.5%$0.0252.3m92%
153Gemini 3.5 Flash Lite (Reasoning, Minimal)97.3%$0.00356.3s83%
154GPT-5100.0%$0.0652.8m100%
155Qwen 3.6 Max Preview100.0%$0.0503.5m100%
156Gemini 3.1 Pro (Preview)100.0%$0.1071.8m100%
157GPT-5.4 (Reasoning)100.0%$0.0892.6m100%
158Hy4 Preview (Reasoning, High)100.0%$0.0404.4m100%
159Grok 4.3 (Reasoning)98.7%$0.0212.3m89%
160Inception Mercury 296.4%$0.00327.0s82%
161Thinking Machines Inkling (Reasoning)100.0%$0.0255.1m100%
162Qwen 3.8 27B (Reasoning, XHigh)100.0%$0.0404.7m100%
163GPT-5.5100.0%$0.1391.7m100%
164GPT-4o, Aug. 6th (temp=1)96.3%$0.01824.4s84%
165ByteDance Seed 2.0 Mini99.5%$0.00454.9m93%
166GPT-5.5 (Reasoning, Low)100.0%$0.1391.8m100%
167Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.00316.5m100%
168GPT-5.5 (Reasoning)100.0%$0.1421.8m100%
169Qwen 3.5 9B97.9%$0.00111.4m78%
170Qwen 3.5 27B98.7%$0.0201.6m79%
171WizardLM 2 8x22b97.0%$0.00261.8m81%
172Llama 3.1 70B94.9%$0.001529.4s81%
173Kimi K2.6100.0%$0.0586.5m100%
174Claude Opus 4100.0%$0.2091.4m100%
175Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.0835.9m100%
176Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.0667.3m100%
177Nemotron 3 Nano94.0%$0.00101.1m72%
178GPT-4o, Aug. 6th (temp=0)93.1%$0.02322.7s73%
179Mistral Small 3.2 24B90.6%$0.00695.7m57%
99.67%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
GPT-5 Nano100100100100100100.0%
Gemini 3.1 Pro (Preview)1001001001009899.6%
Nemotron 3 Nano1001001001009899.5%
Mistral NeMO1001001001009799.4%
Cohere Command R+ (Aug. 2024)1001001001009398.5%
Llama 3.1 70B1001001001008897.6%
GPT-4o Mini (temp=1)1001001001008897.5%
ByteDance Seed 2.0 Lite1001001001008797.5%
GPT-4.1 Nano1001001001008697.1%
GPT-OSS 120B1001001001008396.5%
Inception Mercury 2100100100978095.5%
GPT-4o, Aug. 6th (temp=1)100100100897693.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100936491.4%
Mistral Small 3.2 24B100100100766688.5%
GPT-4o, Aug. 6th (temp=0)1009085827285.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
GPT-4o Mini (temp=0)1001001001009899.7%
Arcee AI: Trinity Mini1001001001008997.8%
GPT-OSS 120B100100100949397.5%
Hermes 3 405B1001001001008496.8%
Qwen 2.5 72B10010095928895.0%
GPT-4o, Aug. 6th (temp=1)100100100888294.0%
Mistral Small 3.2 24B1001001001006693.3%
Llama 3.1 70B100100100848293.2%
Hermes 3 70B100100100847291.2%
Inception Mercury 2100100100935890.2%
GPT-4o, Aug. 6th (temp=0)999588605679.5%
Nemotron 3 Nano10010062412665.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Laguna S 2.1100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Ministral 3B100100100100100100.0%
Cohere Command R+ (Aug. 2024)1001001001009598.9%
Inception Mercury 21001001001009298.5%
GPT-4o, Aug. 6th (temp=0)1001001001009198.3%
Mistral Small 3.2 24B1001001001002084.0%