Passive voice overuse

Test: Bad Writing Habits

Avg. Score
96.7%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Grok 4.1 Fast99.9%$0.001837.8s99%
2Grok 4 Fast99.6%$0.001724.1s96%
3o4 Mini99.5%$0.01525.7s97%
4o4 Mini High99.8%$0.02547.2s99%
5GPT-4o Mini (temp=1)99.0%$0.001234.8s96%
6Writer: Palmyra X598.8%$0.01122.0s96%
7Qwen3 235B A22B Instruct 250799.0%$0.001159.2s96%
8Mistral Small 4 (Reasoning)98.7%$0.002230.2s95%
9DeepSeek V3 (2025-03-24)98.8%$0.001439.4s94%
10GPT-4.199.3%$0.01844.7s95%
11Mistral Small 498.2%$0.001418.2s93%
12LFM2 24B98.2%$0.000228.4s93%
13Gemini 2.5 Flash (Reasoning)98.1%$0.01121.5s93%
14Grok 4.398.6%$0.006930.5s92%
15GPT-4.1 Mini98.1%$0.002719.0s91%
16Mistral Small Creative97.3%$0.00079.1s92%
17GPT-5.4 Nano (Reasoning, Low)97.7%$0.005520.6s92%
18GPT-5.4 Nano (Reasoning)98.0%$0.006124.5s91%
19Grok 4.2098.5%$0.009345.7s92%
20GPT-5.4 Mini (Reasoning, Low)97.9%$0.01516.8s92%
21Hermes 3 405B97.9%$0.003253.2s93%
22GPT-4o, May 13th (temp=1)98.2%$0.03314.4s93%
23Grok 4.20 (Beta)98.1%$0.01815.8s91%
24GPT-5.4 Mini97.8%$0.01516.8s91%
25Ministral 3 3B97.3%$0.000511.1s90%
26DeepSeek V3 (2024-12-26)97.8%$0.002154.6s92%
27Qwen 3.6 Flash98.3%$0.01041.4s91%
28Stealth: Aurora Alpha97.0%$0.00009.8s90%
29GPT-5.4 Nano97.3%$0.005726.3s91%
30GPT-4o Mini (temp=0)97.4%$0.001234.8s91%
31Qwen 3 32B97.6%$0.001554.6s92%
32GPT-4.1 Nano97.0%$0.000713.3s90%
33Qwen 3.5 Plus (2026-02-15)97.6%$0.006031.5s90%
34Qwen 3.5 Flash97.5%$0.002547.5s91%
35Mistral Medium 3.197.5%$0.004836.5s91%
36Gemini 2.5 Flash97.3%$0.005210.6s89%
37DeepSeek-V2 Chat97.5%$0.002153.3s91%
38Gemma 3 4B96.7%$0.000220.0s90%
39Gemma 3 12B97.1%$0.000441.3s91%
40Gemma 3 27B97.2%$0.000652.6s91%
41GPT-4o, Aug. 6th (temp=1)97.9%$0.01824.4s90%
42Qwen 3.6 35B98.2%$0.00831.0m91%
43Qwen 3.5 9B97.9%$0.00111.4m92%
44Qwen 3.5 122B98.1%$0.0251.1m93%
45Ministral 3B96.5%$0.00018.1s89%
46Claude Sonnet 4.598.1%$0.03538.1s92%
47ByteDance Seed 1.6 Flash96.6%$0.001327.3s90%
48Ministral 3 14B96.5%$0.000711.7s89%
49GPT-5.199.5%$0.0541.8m96%
50Ministral 3 8B96.3%$0.000819.6s90%
51Claude Haiku 4.596.9%$0.01121.6s90%
52Claude 3.7 Sonnet98.1%$0.04246.7s93%
53Grok 4.20 (Beta, Reasoning)98.0%$0.03934.0s92%
54Inception Mercury 296.8%$0.00327.0s87%
55Z.AI GLM 4.597.0%$0.005142.1s90%
56DeepSeek V4 Flash (Reasoning)96.6%$0.000731.1s89%
57GPT-5.498.8%$0.0491.4m95%
58Z.AI GLM 5 Turbo97.0%$0.008133.2s89%
59Mistral Large96.8%$0.01430.9s90%
60Mistral NeMO95.9%$0.000510.1s88%
61Z.AI GLM 597.1%$0.00841.2m91%
62GPT-5.4 Mini (Reasoning)97.5%$0.02228.1s89%
63Grok 499.1%$0.0481.7m94%
64Qwen 3.5 Plus (2026-04-20)98.3%$0.0171.8m92%
65Grok 4.20 (Reasoning)98.4%$0.0181.5m90%
66Qwen 3.5 27B97.8%$0.0201.6m92%
67Gemini 2.5 Flash Lite (Reasoning)96.2%$0.002830.8s89%
68GPT-5.298.7%$0.0561.5m94%
69Claude 3 Haiku95.9%$0.002514.9s88%
70MiniMax M2.596.5%$0.00341.3m91%
71Arcee AI: Trinity Large (Preview)96.1%$0.000043.6s89%
72MiniMax M2.796.7%$0.00401.1m90%
73DeepSeek V4 Flash96.0%$0.000631.6s88%
74GPT-5 Nano96.7%$0.00421.4m91%
75Z.AI GLM 5.197.3%$0.0141.5m91%
76Gemini 2.5 Flash Lite95.4%$0.00099.5s87%
77Ministral 8B95.6%$0.000410.4s86%
78GPT-5.4 (Reasoning, Low)98.4%$0.0551.4m93%
79Z.AI GLM 4.5 Air96.2%$0.002958.2s88%
80GPT-4o, May 13th (temp=0)96.1%$0.03514.1s89%
81Mistral Large 395.5%$0.003330.3s87%
82Claude 3.5 Sonnet97.1%$0.04835.4s90%
83GPT-OSS 120B97.0%$0.00151.8m88%
84Rocinante 12B95.9%$0.001438.4s86%
85Claude Sonnet 496.6%$0.03243.7s89%
86Mistral Large 296.2%$0.01329.4s86%
87Arcee AI: Trinity Mini95.3%$0.00039.2s85%
88Stealth: Hunter Alpha95.8%$0.000055.0s87%
89Gemini 3.1 Flash Lite (Reasoning)95.0%$0.003011.9s86%
90Xiaomi MIMO v2.5 Pro95.8%$0.008553.5s87%
91DeepSeek V4 Pro96.7%$0.00481.3m87%
92Gemini 3 Pro (Preview)96.9%$0.05554.4s91%
93Stealth: Healer Alpha94.9%$0.000023.7s85%
94Z.AI GLM 4.796.0%$0.0101.4m88%
95Qwen 3.5 397B A17B98.2%$0.0143.0m91%
96Gemini 3.1 Flash Lite (Preview)94.5%$0.00308.4s84%
97Gemini 3.1 Flash Lite94.6%$0.003012.1s84%
98Hermes 3 70B95.5%$0.00101.2m86%
99Grok 4.3 (Reasoning)98.0%$0.0212.3m88%
100GPT-4o, Aug. 6th (temp=0)95.6%$0.02322.7s85%
101GPT-598.8%$0.0652.8m95%
102Qwen 3.6 27B97.6%$0.0252.3m89%
103GPT-5 Mini95.3%$0.010057.4s86%
104Xiaomi MIMO v2.594.7%$0.005431.8s85%
105Qwen3.6 Max Preview99.1%$0.0503.5m94%
106Claude Opus 4.597.1%$0.07053.4s90%
107Cohere Command R+ (Aug. 2024)95.5%$0.02052.5s86%
108Llama 3.1 8B95.4%$0.00031.3m85%
109Gemini 3 Flash (Preview)94.1%$0.007819.6s85%
110GPT-5.5 (Reasoning)99.6%$0.1421.8m97%
111Qwen 3.5 35B96.1%$0.0181.0m84%
112Gemma 4 26B94.9%$0.000955.1s84%
113GPT-5.4 (Reasoning)98.9%$0.0892.6m95%
114MoonshotAI: Kimi K2.597.9%$0.0193.2m89%
115Z.AI GLM 4.7 Flash94.5%$0.00171.2m85%
116GPT-5.5 (Reasoning, Low)99.3%$0.1391.8m96%
117DeepSeek V3.295.3%$0.00141.9m86%
118Gemini 3 Flash (Preview, Reasoning)94.4%$0.01230.1s83%
119GPT-5.599.2%$0.1391.7m95%
120Gemma 4 31B (Reasoning)95.5%$0.00142.2m87%
121Nemotron 3 Super95.2%$0.00001.4m83%
122Gemma 4 31B94.9%$0.00101.6m85%
123Gemma 4 26B (Reasoning)95.0%$0.00132.0m85%
124Gemini 3.1 Pro (Preview)98.3%$0.1071.8m91%
125Aion 2.094.3%$0.00641.3m84%
126Z.AI GLM 4.693.7%$0.006551.5s83%
127Claude Opus 4.696.4%$0.0781.2m88%
128Qwen 2.5 72B93.3%$0.001036.7s81%
129Gemini 2.5 Pro94.1%$0.03636.2s84%
130DeepSeek V4 Pro (Reasoning)96.1%$0.0153.1m87%
131Nemotron 3 Nano94.4%$0.00101.1m80%
132Llama 3.1 Nemotron 70B93.2%$0.003831.7s80%
133Claude Sonnet 4.693.7%$0.03139.3s83%
134Claude Opus 4.6 (Reasoning)96.2%$0.0881.4m88%
135WizardLM 2 8x22b94.8%$0.00261.8m80%
136Claude Opus 4.7 (Reasoning)94.4%$0.07632.0s85%
137Llama 3.1 70B92.5%$0.001529.4s78%
138Claude Sonnet 4.6 (Reasoning)94.6%$0.0601.2m84%
139DeepSeek V3.193.2%$0.00201.8m81%
140Claude Opus 4.793.8%$0.06930.4s83%
141Claude Opus 498.5%$0.2091.4m94%
142MoonshotAI: Kimi K2.698.5%$0.0586.5m92%
143Mistral Small 3.2 24B95.8%$0.00695.7m84%
144Inception Mercury90.1%$0.01117.6s71%
145ByteDance Seed 1.692.1%$0.0132.5m76%
146ByteDance Seed 2.0 Lite89.5%$0.0122.2m71%
147ByteDance Seed 2.0 Mini87.5%$0.00454.9m70%
96.66%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Gemini 3.1 Pro (Preview)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Grok 4.20 (Beta, Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.2100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
MiniMax M2.7100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Grok 4.20 (Beta)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Grok 4.20100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-4o Mini (temp=0)10010010010010099.9%
Writer: Palmyra X51001001001009999.9%
GPT-4.1 Nano1001001001009999.9%
Grok 4.3 (Reasoning)1001001001009999.9%
GPT-5.4 (Reasoning, Low)1001001001009999.9%
Qwen 3.6 Flash1001001001009999.9%
Grok 4 Fast1001001001009999.9%
Qwen 3.5 27B1001001001009999.8%
GPT-5.41001001001009999.8%
Grok 4.20 (Reasoning)1001001001009999.8%
Claude Sonnet 4.51001001001009999.7%
Inception Mercury 21001001001009999.7%
Claude Opus 4.61001001001009899.7%
Qwen 3.5 Plus (2026-02-15)1001001001009899.6%
GPT-5.4 Nano1001001001009899.6%
Claude Sonnet 4100100100999999.6%
LFM2 24B1001001001009899.6%
Claude Haiku 4.51001001001009899.5%
Claude 3.7 Sonnet1001001001009799.5%
Gemini 2.5 Flash1001001001009799.5%
Arcee AI: Trinity Mini100100100999899.5%
Xiaomi MIMO v2.5 Pro100100100999899.4%
Z.AI GLM 4.7100100100999899.4%
Claude Opus 4.6 (Reasoning)100100100999899.4%
Qwen 3.5 Plus (2026-04-20)1001001001009799.4%
GPT-5.4 Mini (Reasoning)1001001001009799.3%
Mistral Small 41001001001009799.3%
Mistral Medium 3.11001001001009699.3%
Claude Sonnet 4.6 (Reasoning)100100100989899.3%
Qwen 3.5 35B1001001001009699.3%
Qwen 3.5 397B A17B100100100989899.3%
Rocinante 12B100100100999899.2%
GPT-4o, May 13th (temp=1)1001001001009699.2%
Claude Opus 4.71001001001009699.2%
GPT-5.4 Nano (Reasoning)1001001001009699.2%
MoonshotAI: Kimi K2.51001001001009699.2%
DeepSeek V4 Pro (Reasoning)1001001001009699.1%
GPT-4.1 Mini1001001001009599.1%
GPT-5 Nano100100100999699.0%
Gemini 2.5 Flash (Reasoning)100100100989799.0%
Ministral 8B1001001001009599.0%
Ministral 3 14B100100100999699.0%
Qwen 3.5 Flash1001001001009598.9%
Stealth: Aurora Alpha1001001001009498.9%
Z.AI GLM 51001001001009498.8%
Gemma 3 27B1001001001009498.7%
Qwen 3 32B100100100999498.7%
Gemini 2.5 Flash Lite (Reasoning)1001001001009398.6%
Nemotron 3 Super100100100989598.6%
GPT-5 Mini10010099999598.6%
Gemma 3 4B100100100969698.5%
Llama 3.1 8B100100100979598.5%
Mistral Large100100100999398.5%
Gemma 4 31B10010099979698.5%
Claude Opus 4.7 (Reasoning)100100100979598.4%
Aion 2.0999998989898.3%
Hermes 3 405B100100100989398.3%
Xiaomi MIMO v2.510010098989598.3%
Stealth: Hunter Alpha100100100979498.2%
Ministral 3B100100100969598.2%
GPT-4o, Aug. 6th (temp=0)100100100999298.2%
Ministral 3 8B100100100969498.1%
WizardLM 2 8x22b100100100989298.0%
Gemma 4 26B (Reasoning)100100100969498.0%
GPT-5.4 Nano (Reasoning, Low)10010099989297.8%
Gemini 3 Flash (Preview, Reasoning)100100100989197.7%
MiniMax M2.5100100100959397.6%
ByteDance Seed 1.6100100100989097.5%
Gemma 3 12B100100100949397.5%
Gemini 3 Pro (Preview)100100100949397.5%
Gemini 3.1 Flash Lite (Preview)100100100979097.4%
DeepSeek V3.21009998979397.4%
DeepSeek V4 Flash (Reasoning)10010098979297.3%
Stealth: Healer Alpha100100100988997.3%
Claude 3.5 Sonnet100100100988997.3%
Mistral Small Creative100100100998897.2%
Gemma 4 31B (Reasoning)100100100949297.1%
Mistral Large 31009996959396.8%
Gemini 3.1 Flash Lite10010097969196.6%
Claude Opus 41009796959596.6%
Nemotron 3 Nano10010096959296.5%
Arcee AI: Trinity Large (Preview)100100100958796.5%
Gemini 2.5 Pro10010096949396.5%
ByteDance Seed 1.6 Flash1009896959396.4%
Gemini 3 Flash (Preview)10010098959096.4%
GPT-4o, May 13th (temp=0)1001001001008196.2%
Hermes 3 70B10010095949196.1%
Gemini 3.1 Flash Lite (Reasoning)100100100978396.0%
Ministral 3 3B100100100968496.0%
Inception Mercury1001001001007995.8%
Gemma 4 26B999797949195.7%
Mistral Large 21009996968895.6%
DeepSeek V3.11009696959195.6%
Z.AI GLM 4.610010096938895.6%
Claude Sonnet 4.610010096948494.9%
Claude 3 Haiku10010097918594.7%
Llama 3.1 Nemotron 70B10010096948394.6%
Cohere Command R+ (Aug. 2024)100100100888494.4%
Gemini 2.5 Flash Lite1009693918994.0%
Mistral NeMO1009998957893.9%
Z.AI GLM 4.7 Flash10010092918493.5%
Qwen 2.5 72B10010099967193.1%
Mistral Small 3.2 24B1009792898792.8%
ByteDance Seed 2.0 Mini10010099877892.7%
Llama 3.1 70B1009796837089.2%
ByteDance Seed 2.0 Lite989679737283.9%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen3.6 Max Preview100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Grok 4.20 (Beta, Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.2100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
Claude Opus 4100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Grok 4 Fast100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
GPT-5.4100100100100100100.0%
Grok 4.20 (Beta)100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Grok 4.3100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
Mistral Small 4100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Claude 3.7 Sonnet10010010010010099.9%
Writer: Palmyra X510010010010010099.9%
Grok 4.2010010010010010099.9%
MiniMax M2.710010010010010099.9%
GPT-5.4 Nano (Reasoning)10010010010010099.9%
Qwen 3.5 397B A17B1001001001009999.8%
Z.AI GLM 51001001001009999.8%
Grok 4.3 (Reasoning)1001001001009999.8%
Claude Sonnet 4.51001001001009999.8%
GPT-5.4 (Reasoning)1001001001009999.8%
DeepSeek V3 (2025-03-24)1001001001009999.8%
Ministral 3 3B1001001001009999.8%
Qwen 3.5 122B1001001001009999.8%
Mistral Small 4 (Reasoning)1001001001009999.7%
GPT-5.4 Mini (Reasoning, Low)1001001001009899.7%
Qwen3 235B A22B Instruct 2507100100100999999.7%
Mistral Large 31001001001009899.6%
GPT-5 Mini1001001001009999.6%
Qwen 3.5 35B1001001001009899.6%
Qwen 3.5 Flash1001001001009899.6%
MiniMax M2.51001001001009999.6%
Mistral Large 21001001001009899.6%
Z.AI GLM 5.11001001001009899.6%
Claude Opus 4.61001001001009899.6%
DeepSeek V4 Pro1001001001009899.5%
GPT-4.1 Mini1001001001009799.4%
Claude 3.5 Sonnet1001001001009799.4%
GPT-4o, May 13th (temp=1)100100100999899.4%
Qwen 3.5 9B1001001001009799.4%
DeepSeek V4 Pro (Reasoning)10010099999899.4%
Claude Opus 4.5100100100989899.3%
Nemotron 3 Super1001001001009699.3%
Qwen 3.5 27B1001001001009699.3%
Gemini 2.5 Flash (Reasoning)1001001001009699.3%
GPT-5.4 Nano (Reasoning, Low)1001001001009699.2%
Hermes 3 405B1001001001009699.2%
Gemini 2.5 Flash100100100989799.1%
Mistral Small Creative100100100979798.9%
Rocinante 12B100100100989798.9%
Gemma 3 12B10010099999698.9%
Claude Haiku 4.5100100100979698.7%
GPT-4o Mini (temp=1)1001001001009398.7%
Gemma 4 26B (Reasoning)10010098989798.5%
Claude Opus 4.6 (Reasoning)10010099979698.3%
Gemma 3 27B1009999979698.3%
Stealth: Hunter Alpha10010099989598.2%
Arcee AI: Trinity Large (Preview)1001001001009198.1%
DeepSeek V3 (2024-12-26)100100100959598.1%
DeepSeek V3.210010099979598.0%
Qwen 3 32B10010099969498.0%
Arcee AI: Trinity Mini1001001001009097.9%
Mistral Medium 3.110010099989397.9%
GPT-4o Mini (temp=0)1001001001008997.7%
Claude Sonnet 4.6 (Reasoning)1009998959597.5%
DeepSeek V4 Flash (Reasoning)100100100969297.5%
Inception Mercury 210010099979297.5%
DeepSeek-V2 Chat1001001001008897.5%
Mistral Large100100100969297.5%
Gemini 3.1 Flash Lite10010097979397.5%
Gemini 3.1 Flash Lite (Reasoning)100100100988997.4%
Gemini 2.5 Flash Lite (Reasoning)100100100949397.3%
DeepSeek V4 Flash100100100949397.3%
Gemini 3 Pro (Preview)10010098989197.3%
WizardLM 2 8x22b1009797969597.3%
Aion 2.010010098949397.1%
Stealth: Aurora Alpha10010098949397.0%
Gemma 4 31B (Reasoning)100100100949096.9%
Gemini 3 Flash (Preview, Reasoning)1001001001008596.9%
Z.AI GLM 4.510010096959296.7%
Cohere Command R+ (Aug. 2024)10010096939396.5%
GPT-OSS 120B1001001001008296.5%
GPT-4o, May 13th (temp=0)10010099939096.4%
Gemini 2.5 Pro1009796969396.3%
Z.AI GLM 4.5 Air100100100958696.2%
Z.AI GLM 4.71009998968796.1%
GPT-5 Nano1009998949096.1%
Ministral 3 8B10010095939296.0%
Llama 3.1 70B10010096939095.9%
Stealth: Healer Alpha989897969195.8%
ByteDance Seed 1.6 Flash1009895939295.8%
Gemma 4 31B10010094939295.8%
Z.AI GLM 4.7 Flash1009997938995.6%
Claude Opus 4.71009999938895.6%
Gemini 3 Flash (Preview)10010096938995.6%
Ministral 3B1001001001007895.5%
Nemotron 3 Nano10010098918995.4%
Gemini 3.1 Flash Lite (Preview)10010098968295.4%
Ministral 8B1009997958695.1%
Gemma 3 4B1009897919095.1%
Claude 3 Haiku10010099948395.1%
Gemma 4 26B1009797968394.6%
Claude Sonnet 4.61009594949094.3%
Claude Opus 4.7 (Reasoning)1009994938594.2%
Hermes 3 70B1001001001007094.0%
GPT-4o, Aug. 6th (temp=0)10010096908393.9%
GPT-4.1 Nano10010097977593.9%
Mistral NeMO1009993898893.9%
Qwen 2.5 72B10010093908693.8%
Z.AI GLM 4.6979695938693.4%
DeepSeek V3.110010098977293.3%
Xiaomi MIMO v2.51009795938393.3%
ByteDance Seed 1.610010094908092.6%
Llama 3.1 8B10010099936791.9%
Gemini 2.5 Flash Lite1009891917991.8%
ByteDance Seed 2.0 Lite989795867991.1%
LFM2 24B969592878591.1%
ByteDance Seed 2.0 Mini1009489878190.1%
Llama 3.1 Nemotron 70B979292857688.5%
Inception Mercury1009894846688.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Grok 4 Fast100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Beta)100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Stealth: Aurora Alpha100100100100100100.0%
Claude 3.7 Sonnet100100100100100100.0%
Grok 4.20100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
GPT-4o, May 13th (temp=0)100100100100100100.0%
Arcee AI: Trinity Large (Preview)10010010010010099.9%
Mistral NeMO10010010010010099.9%
GPT-5.41001001001009999.9%
GPT-4o, May 13th (temp=1)1001001001009999.9%
Grok 4.3 (Reasoning)1001001001009999.8%
GPT-4o, Aug. 6th (temp=1)1001001001009999.8%
Mistral Small 41001001001009999.8%
Qwen 3 32B1001001001009999.8%
GPT-4o, Aug. 6th (temp=0)1001001001009999.8%
GPT-5.4 Nano100100100999999.8%
DeepSeek-V2 Chat1001001001009899.6%
Writer: Palmyra X51001001001009899.6%
Z.AI GLM 4.7100100100999999.6%
Mistral Large 21001001001009899.6%
Gemini 2.5 Flash (Reasoning)1001001001009899.6%
Z.AI GLM 5100100100999999.6%
Stealth: Hunter Alpha1001001001009899.6%
Gemini 2.5 Flash1001001001009899.5%
Qwen 3.5 Flash1001001001009899.5%
Gemma 4 31B (Reasoning)1001001001009899.5%
DeepSeek V4 Flash (Reasoning)1001001001009899.4%
GPT-5.4 Nano (Reasoning)1001001001009799.4%
DeepSeek V3.21009999999999.4%
GPT-5.4 Nano (Reasoning, Low)100100100989899.3%
Qwen 3.5 Plus (2026-02-15)100100100989899.3%
GPT-5.4 Mini1001001001009699.2%
Mistral Small Creative1001001001009699.2%
Qwen 3.6 27B1001001001009699.2%
Gemini 3 Pro (Preview)100100100999799.1%
Ministral 3 14B1001001001009699.1%
Claude Opus 4.51001001001009699.1%
Z.AI GLM 5 Turbo1001001001009699.1%
GPT-4.1 Mini100100100989899.1%
GPT-5.21001001001009599.1%
Claude 3.5 Sonnet100100100989799.1%
GPT-4o Mini (temp=1)1001001001009699.1%
MoonshotAI: Kimi K2.51001001001009599.0%
Nemotron 3 Super100100100999699.0%
Gemma 4 31B1001001001009599.0%
Nemotron 3 Nano1001001001009599.0%
Ministral 3 3B10010099989798.9%
DeepSeek V3 (2024-12-26)100100100999598.9%
MiniMax M2.51001001001009498.9%
GPT-4.1 Nano100100100999598.9%
Grok 4.31001001001009498.9%
DeepSeek V4 Pro (Reasoning)100100100989698.8%
Grok 4.20 (Beta, Reasoning)1001001001009498.7%
Aion 2.01001001001009398.6%
DeepSeek V3 (2025-03-24)100100100989598.6%
LFM2 24B100100100969698.6%
Z.AI GLM 4.5 Air1001001001009398.5%
MiniMax M2.7100100100979698.5%
Z.AI GLM 5.11001001001009398.5%
Gemma 3 27B100100100989498.5%
WizardLM 2 8x22b100100100999398.5%
ByteDance Seed 1.6 Flash10010098989698.4%
Hermes 3 405B1001001001009298.4%
Claude Sonnet 4.5100100100969598.2%
GPT-5 Mini100100100969498.0%
Gemini 3 Flash (Preview, Reasoning)1001001001009098.0%
Mistral Large100100100959497.9%
Gemini 2.5 Flash Lite100100100969397.9%
Ministral 3 8B10010099969497.9%
Qwen 2.5 72B1001001001009097.9%
Claude Sonnet 4100100100969397.7%
Ministral 8B100100100959497.7%
Arcee AI: Trinity Mini1001001001008997.7%
Hermes 3 70B100100100969397.7%
Claude Opus 4.61009997979597.6%
GPT-5 Nano100100100979097.5%
Qwen 3.5 9B10010099969297.4%
Claude 3 Haiku10010099959397.4%
Xiaomi MIMO v2.5 Pro1001001001008797.4%
Gemini 3.1 Flash Lite10010099949497.4%
Gemini 3.1 Flash Lite (Preview)100100100949397.4%
DeepSeek V4 Flash100100100998797.3%
Gemini 2.5 Flash Lite (Reasoning)1009998969397.2%
Claude Haiku 4.510010098949497.2%
DeepSeek V4 Pro100100100939397.1%
Gemini 2.5 Pro100100100978796.8%
Stealth: Healer Alpha1009995959596.6%
Gemini 3.1 Flash Lite (Reasoning)1001001001008396.6%
Z.AI GLM 4.7 Flash1009997959296.6%
Mistral Medium 3.11001001001008396.6%
Llama 3.1 8B100100100948996.5%
ByteDance Seed 1.610010096969196.5%
Gemma 4 26B (Reasoning)10010099939096.4%
Xiaomi MIMO v2.510010099968796.3%
Gemma 4 26B10010096929296.0%
Llama 3.1 Nemotron 70B10010096968996.0%
ByteDance Seed 2.0 Lite10010096968795.9%
Mistral Large 3100100100908895.7%
ByteDance Seed 2.0 Mini1009998918995.3%
Mistral Small 3.2 24B1001001001007695.2%
Cohere Command R+ (Aug. 2024)10010096938695.1%
Gemma 3 12B1009796919094.9%
Z.AI GLM 4.610010093929094.8%
Claude Sonnet 4.6 (Reasoning)979494939394.4%
Claude Opus 4.7100100100918094.2%
Claude Opus 4.7 (Reasoning)10010099917893.5%
DeepSeek V3.11009996868593.3%
Gemma 3 4B1009592918793.1%
Ministral 3B10010088888692.5%
Gemini 3 Flash (Preview)1009994858291.9%
Inception Mercury100100100837691.9%
Claude Sonnet 4.6979391908891.9%
Rocinante 12B10010095935588.7%
Llama 3.1 70B1008988806283.7%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen3.6 Max Preview100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-5.1100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
Grok 4 Fast100100100100100100.0%
Stealth: Aurora Alpha100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4.1 Mini10010010010010099.9%
Inception Mercury 21001001001009999.9%
Grok 4.201001001001009999.8%
GPT-5.5 (Reasoning, Low)1001001001009999.8%
Grok 4.20 (Beta)1001001001009999.7%
o4 Mini High1001001001009899.7%
Qwen 3.6 27B1001001001009899.6%
Qwen 3.5 397B A17B100100100999899.6%
GPT-5.4 Mini (Reasoning)100100100999999.5%
GPT-5.4 Mini100100100999899.4%
Writer: Palmyra X51001001001009799.4%
Qwen 3.5 27B100100100999799.2%
GPT-5.4 Nano (Reasoning)100100100999799.2%
MoonshotAI: Kimi K2.51001001001009699.2%
MiniMax M2.71001001001009699.1%
GPT-OSS 120B100100100989799.1%
Claude 3 Haiku100100100999699.1%
Rocinante 12B1001001001009599.0%
DeepSeek-V2 Chat100100100989798.9%
Qwen 3.5 Plus (2026-02-15)1001001001009598.9%
Grok 4.20 (Beta, Reasoning)1001001001009598.9%
Grok 4.20 (Reasoning)100100100999598.8%
GPT-5100100100979798.8%
Claude Opus 41001001001009498.8%
Z.AI GLM 510010099989698.7%
Nemotron 3 Super1009999999798.7%
GPT-5.4 (Reasoning, Low)100100100989598.6%
Grok 4.3 (Reasoning)100100100989498.5%
GPT-5.210010097979798.4%
Claude Sonnet 4.510010098979698.3%
Hermes 3 405B100100100989398.2%
DeepSeek V3 (2025-03-24)10010097979698.1%
Gemini 2.5 Flash (Reasoning)10010099989398.1%
GPT-5.4 Nano (Reasoning, Low)10010098969598.0%
Claude 3.5 Sonnet100100100999197.9%
Gemini 2.5 Flash1009897979797.9%
GPT-4o Mini (temp=1)100100100999197.9%
Hermes 3 70B10010097969697.9%
Llama 3.1 8B10010099979397.8%
LFM2 24B100100100999097.8%
GPT-4o Mini (temp=0)10010099969497.7%
DeepSeek V4 Flash10010099998997.5%
DeepSeek V4 Pro (Reasoning)10010097969497.4%
Qwen 3.5 9B1001001001008697.2%
Claude Opus 4.6 (Reasoning)10010097959397.1%
GPT-5.4999998969497.0%
Claude Haiku 4.51009997969397.0%
Qwen 3 32B100100100929296.8%
Llama 3.1 Nemotron 70B10010095959496.7%
Claude Sonnet 41009896969396.6%
DeepSeek V3 (2024-12-26)1001001001008396.6%
GPT-5.4 Mini (Reasoning, Low)1009896969396.6%
Ministral 3B100100100998496.5%
Xiaomi MIMO v2.5 Pro10010097959096.4%
Nemotron 3 Nano100100100988496.4%
Qwen 3.5 122B100100100918996.1%
DeepSeek V4 Flash (Reasoning)1009996969096.1%
Claude 3.7 Sonnet1009999948896.1%
Claude Opus 4.5100100100938796.0%
Gemini 3 Pro (Preview)1009796969195.8%
ByteDance Seed 1.6 Flash1009994939295.6%
Z.AI GLM 5.110010097918995.4%
GPT-5.4 Nano1009997919095.4%
Gemma 4 31B (Reasoning)10010096928895.2%
Ministral 3 3B10010098948495.1%
Qwen 3.5 Flash10010096968495.1%
Mistral NeMO100100100898695.1%
Mistral Small 4 (Reasoning)1009795938995.0%
Qwen 3.5 35B989696949195.0%
GPT-5 Nano989894929294.9%
Gemma 4 26B (Reasoning)1009695929094.8%
Mistral Small Creative989796948894.7%
Gemma 3 27B10010094938694.6%
GPT-5 Mini1009898968194.6%
Mistral Small 410010097928494.6%
GPT-4o, May 13th (temp=1)999696938894.6%
Gemma 3 12B1009695948794.4%
Claude Opus 4.61009796908994.4%
Claude Sonnet 4.6 (Reasoning)1009894928794.3%
Mistral Small 3.2 24B100100100977494.3%
Xiaomi MIMO v2.510010099908194.1%
Gemini 3.1 Flash Lite (Reasoning)1009692919094.0%
Z.AI GLM 4.7 Flash1009896948293.9%
Ministral 8B999796918793.8%
Z.AI GLM 4.5 Air1009897898493.7%
Aion 2.01009994888893.6%
Cohere Command R+ (Aug. 2024)100100100987093.6%
Gemma 4 31B10010095878693.5%
Stealth: Healer Alpha1009393938893.4%
GPT-4.1 Nano1009790909093.3%
Arcee AI: Trinity Large (Preview)10010092918493.1%
Z.AI GLM 4.510010090908593.0%
Ministral 3 8B1009892888792.8%
Arcee AI: Trinity Mini10010092888492.8%
Z.AI GLM 5 Turbo10010094947592.7%
GPT-4o, May 13th (temp=0)949494928992.6%
GPT-4o, Aug. 6th (temp=0)1009695918292.6%
Z.AI GLM 4.71009595868592.3%
Mistral Medium 3.1969594888691.9%
Gemma 3 4B1009691908291.7%
DeepSeek V3.2989590898391.1%
MiniMax M2.5969593888290.9%
ByteDance Seed 1.61009089898790.9%
Ministral 3 14B969493908190.8%
Gemini 3.1 Flash Lite1009994817890.4%
Gemini 3.1 Flash Lite (Preview)979391868490.3%
Llama 3.1 70B1009996946189.9%
WizardLM 2 8x22b959492848489.8%
Gemini 3 Flash (Preview, Reasoning)1009292848189.6%
Gemini 2.5 Pro1009592897289.5%
DeepSeek V4 Pro10010091906689.4%
Inception Mercury100100100836289.1%
Claude Opus 4.7 (Reasoning)1009087848389.0%
Mistral Large 21009998836588.8%
Gemini 2.5 Flash Lite989791817688.7%
Mistral Large 3969188877888.0%
DeepSeek V3.1999288867588.0%
Claude Opus 4.71008886838287.9%
Gemini 2.5 Flash Lite (Reasoning)969087838387.6%
Claude Sonnet 4.61009588787487.2%
ByteDance Seed 2.0 Mini979691886487.0%
Z.AI GLM 4.61009683817587.0%
Mistral Large969386847686.8%
Gemini 3 Flash (Preview)958985857986.5%
Gemma 4 26B969285807986.1%
Stealth: Hunter Alpha988784847084.8%
Qwen 2.5 72B968985796983.5%
ByteDance Seed 2.0 Lite1007877745777.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen3.6 Max Preview100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Grok 4.20 (Beta, Reasoning)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.2100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
Aion 2.0100100100100100100.0%
MiniMax M2.7100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
MiniMax M2.5100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Opus 4100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Grok 4 Fast100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Claude 3.5 Sonnet100100100100100100.0%
Grok 4.20 (Beta)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
Claude 3.7 Sonnet100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Grok 4.20100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
Mistral Small Creative100100100100100100.0%
Ministral 3 14B100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
GPT-4o Mini (temp=1)10010010010010099.9%
GPT-5.4 (Reasoning, Low)10010010010010099.9%
GPT-5.410010010010010099.9%
Z.AI GLM 4.5 Air10010010010010099.9%
Gemma 4 26B (Reasoning)10010010010010099.9%
Claude Sonnet 41001001001009999.9%
Mistral Small 3.2 24B1001001001009999.9%
GPT-4o, May 13th (temp=1)1001001001009999.8%
Hermes 3 405B1001001001009999.8%
DeepSeek V4 Pro1001001001009999.8%
Claude Opus 4.6 (Reasoning)1001001001009999.8%
Z.AI GLM 4.51001001001009999.8%
GPT-5.4 (Reasoning)1001001001009999.8%
DeepSeek-V2 Chat1001001001009999.8%
Qwen 3 32B1001001001009999.8%
Stealth: Hunter Alpha1001001001009999.8%
Claude Opus 4.51001001001009999.7%
GPT-5.4 Nano (Reasoning, Low)1001001001009999.7%
LFM2 24B1001001001009999.7%
Gemini 3.1 Flash Lite1001001001009999.7%
DeepSeek V3 (2025-03-24)1001001001009899.6%
Mistral NeMO1001001001009899.6%
Qwen3 235B A22B Instruct 25071001001001009899.6%
Qwen 3.5 397B A17B1001001001009899.6%
DeepSeek V4 Pro (Reasoning)1001001001009899.6%
Arcee AI: Trinity Mini100100100999999.6%
Gemini 2.5 Flash1001001001009799.5%
Gemma 4 31B (Reasoning)100100100999899.5%
Qwen 3.5 27B1001001001009799.5%
Mistral Large 21001001001009699.3%
Z.AI GLM 4.71001001001009699.2%
Qwen 3.5 Flash1001001001009699.2%
Qwen 3.5 122B1001001001009699.2%
Mistral Medium 3.110010099999899.2%
GPT-5 Mini100100100999799.2%
GPT-4.1 Mini1001001001009699.1%
Gemini 2.5 Flash (Reasoning)1001001001009699.1%
Z.AI GLM 4.61001001001009699.1%
Gemini 3 Flash (Preview)100100100999699.1%
Mistral Small 4 (Reasoning)1001001001009599.1%
Mistral Large100100100999699.0%
Z.AI GLM 4.7 Flash10010099989899.0%
ByteDance Seed 1.6 Flash1001001001009599.0%
Mistral Small 41001001001009599.0%
Xiaomi MIMO v2.5 Pro100100100999698.9%
Gemma 3 12B100100100989698.9%
Stealth: Aurora Alpha100100100989698.8%
Gemma 3 4B1001001001009498.8%
GPT-4.1 Nano100100100999598.7%
Gemma 4 31B1001001001009498.7%
Inception Mercury 21001001001009398.7%
Claude Haiku 4.5100100100979698.6%
Ministral 3B100100100989598.5%
Gemini 2.5 Flash Lite1009999989698.3%
Mistral Large 31001001001009198.3%
GPT-5 Nano10010099969698.2%
Gemini 2.5 Flash Lite (Reasoning)100100100979398.2%
GPT-4o Mini (temp=0)10010099999398.1%
DeepSeek V4 Flash100100100969498.1%
Gemini 3 Pro (Preview)10010098979397.8%
GPT-4o, May 13th (temp=0)100100100999097.8%
Gemini 3.1 Flash Lite (Reasoning)10010099989297.6%
Claude 3 Haiku10010099959497.6%
Qwen 2.5 72B100100100959397.6%
Claude Opus 4.7100100100969297.5%
DeepSeek V3.2999898979697.5%
Xiaomi MIMO v2.510010099979197.4%
Ministral 3 3B10010096959597.4%
Arcee AI: Trinity Large (Preview)10010097969497.3%
ByteDance Seed 1.610010099979197.3%
Ministral 3 8B1001001001008697.2%
GPT-4o, Aug. 6th (temp=0)1001001001008597.1%
Cohere Command R+ (Aug. 2024)1001001001008596.9%
Gemini 3.1 Flash Lite (Preview)1009898959496.8%
Gemma 3 27B10010096959396.7%
Gemma 4 26B10010098939296.7%
Ministral 8B1009898949296.5%
Nemotron 3 Nano100100100968696.4%
Stealth: Healer Alpha10010097948996.0%
GPT-4o, Aug. 6th (temp=1)100100100997995.7%
ByteDance Seed 2.0 Mini1009997928895.3%
Claude Sonnet 4.6 (Reasoning)10010098938394.9%
Claude Opus 4.7 (Reasoning)1009995919094.9%
Llama 3.1 70B10010096928694.8%
Llama 3.1 8B10010096898994.7%
Rocinante 12B10010098888694.2%
Claude Sonnet 4.610010096948294.2%
Gemini 2.5 Pro1009692909093.7%
Hermes 3 70B100100100977093.5%
Qwen 3.5 35B1001001001003987.8%
Llama 3.1 Nemotron 70B1009997934987.5%
ByteDance Seed 2.0 Lite10010097525079.9%
Inception Mercury100100100712879.8%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen3.6 Max Preview100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.1100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
GPT-5100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
o4 Mini High100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
GPT-5.5100100100100100100.0%
GPT-4.1100100100100100100.0%
o4 Mini100100100100100100.0%
Grok 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Grok 4 Fast100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Hermes 3 405B100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
Grok 4.20100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.310010010010010099.9%
Stealth: Aurora Alpha10010010010010099.9%
Qwen 3.5 122B10010010010010099.9%
GPT-5.410010010010010099.9%
GPT-4.1 Nano10010010010010099.9%
Grok 4.20 (Beta)1001001001009999.8%
Claude Opus 41001001001009999.8%
Qwen 3.5 397B A17B1001001001009999.8%
Qwen 3.5 Plus (2026-02-15)1001001001009999.8%
Qwen 3.6 35B1001001001009999.7%
Inception Mercury 21001001001009999.7%
DeepSeek V3 (2024-12-26)1001001001009899.6%
Claude Sonnet 41001001001009899.6%
Mistral Small 4 (Reasoning)100100100999999.6%
Qwen 3.6 27B1001001001009899.6%
GPT-5.21001001001009799.3%
GPT-OSS 120B100100100999899.3%
Gemini 2.5 Flash1001001001009799.3%
Mistral Small 3.2 24B1001001001009699.3%
Qwen 3.5 27B100100100999899.3%
Gemini 3.1 Flash Lite (Preview)1001001001009699.3%
DeepSeek-V2 Chat1001001001009699.3%
LFM2 24B100100100999899.3%
Qwen 3 32B100100100999799.2%
Gemini 2.5 Flash (Reasoning)1001001001009799.2%
Grok 4.20 (Beta, Reasoning)100100100989899.1%
Claude Opus 4.6100100100999799.1%
Claude Opus 4.5100100100989799.1%
Gemma 4 26B10010099999799.1%
Rocinante 12B100100100989799.1%
Z.AI GLM 5.11001001001009599.0%
Nemotron 3 Super1001001001009599.0%
Claude 3.5 Sonnet100100100999699.0%
MiniMax M2.7100100100999699.0%
Qwen 3.5 9B100100100989799.0%
Grok 4.3 (Reasoning)100100100999699.0%
GPT-5.4 Nano (Reasoning, Low)10010099999699.0%
GPT-5.4 Mini (Reasoning, Low)1001001001009599.0%
GPT-4o Mini (temp=1)1001001001009598.9%
DeepSeek V3 (2025-03-24)1001001001009498.8%
Gemma 4 31B (Reasoning)1001001001009498.8%
Gemini 3 Pro (Preview)10010098989798.6%
Ministral 3 14B100100100989598.5%
DeepSeek V3.210010099979698.4%
Z.AI GLM 4.71009998979798.4%
MiniMax M2.5100100100979598.3%
GPT-5.4 Nano10010098989598.3%
GPT-5.4 Nano (Reasoning)100100100999298.2%
Claude Opus 4.6 (Reasoning)1001001001009198.2%
Z.AI GLM 4.5 Air100100100999298.2%
WizardLM 2 8x22b100100100999298.2%
Z.AI GLM 5 Turbo1009998989598.1%
Gemma 4 26B (Reasoning)10010099989498.1%
Claude Sonnet 4.6 (Reasoning)10010097979698.1%
Claude Opus 4.7 (Reasoning)100100100999298.1%
Gemini 3 Flash (Preview, Reasoning)10010099989398.1%
Mistral Medium 3.11001001001009097.9%
GPT-5 Mini10010099979497.9%
Z.AI GLM 4.510010099989397.9%
Llama 3.1 70B100100100999197.8%
DeepSeek V4 Flash (Reasoning)1001001001008997.8%
Ministral 3 3B1001001001008997.8%
Gemma 3 12B1009999989397.8%
Xiaomi MIMO v2.510010099969397.7%
ByteDance Seed 1.6 Flash100100100979297.7%
GPT-4o Mini (temp=0)100100100979197.6%
Cohere Command R+ (Aug. 2024)10010099998997.5%
Claude 3 Haiku100100100979097.4%
Qwen 3.5 35B10010097969397.4%
Arcee AI: Trinity Large (Preview)1001001001008797.4%
GPT-4o, May 13th (temp=1)10010098979297.3%
Gemma 3 4B10010097969397.3%
DeepSeek V4 Flash1009897969597.3%
Mistral Large1009999999097.3%
GPT-5 Nano10010099969197.2%
Claude Sonnet 4.610010098979097.1%
Xiaomi MIMO v2.5 Pro10010097959397.1%
Mistral Small 410010098979197.1%
Stealth: Hunter Alpha989898969597.0%
Ministral 3B10010099969097.0%
Claude Haiku 4.5100100100988797.0%
Mistral Small Creative1009897969296.8%
Z.AI GLM 4.7 Flash10010096949496.8%
Claude 3.7 Sonnet10010098978996.8%
Hermes 3 70B100100100998396.4%
Gemma 4 31B1009998949196.2%
ByteDance Seed 1.61009895959396.2%
GPT-4o, May 13th (temp=0)1009796949396.0%
Aion 2.010010099928995.9%
Arcee AI: Trinity Mini100100100928895.9%
Z.AI GLM 510010095949095.7%
DeepSeek V4 Pro (Reasoning)100100100988095.6%
Claude Opus 4.710010094939095.3%
Llama 3.1 Nemotron 70B10010096968595.2%
DeepSeek V3.11009795948995.2%
ByteDance Seed 2.0 Lite1009996968595.0%
Gemini 3.1 Flash Lite969696959295.0%
Stealth: Healer Alpha10010096928795.0%
Gemini 3.1 Flash Lite (Reasoning)1009796958794.9%
Mistral Large 3999895948994.9%
Gemini 2.5 Pro10010097918794.8%
Gemini 2.5 Flash Lite (Reasoning)10010099898594.6%
Ministral 3 8B999796948694.4%
Qwen 2.5 72B989694929194.3%
Gemma 3 27B10010093928594.1%
Ministral 8B1009795928694.0%
Mistral Large 21009393929093.7%
Nemotron 3 Nano100100100977093.4%
Llama 3.1 8B1009893888793.3%
Gemini 3 Flash (Preview)999994888693.2%
Z.AI GLM 4.61009994868693.1%
Inception Mercury100100100897592.8%
GPT-4o, Aug. 6th (temp=0)100100100897392.5%
Gemini 2.5 Flash Lite949392898791.0%
Mistral NeMO989385857887.9%
ByteDance Seed 2.0 Mini948969676677.0%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.5 (Reasoning)100100100100100100.0%
Grok 4.1 Fast100100100100100100.0%
o4 Mini100100100100100100.0%
Claude Opus 4100100100100100100.0%
Grok 4 Fast100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Gemini 2.5 Flash (Reasoning)10010010010010099.9%
GPT-4.1 Mini10010010010010099.9%
Mistral Small 410010010010010099.9%
Mistral Small 4 (Reasoning)1001001001009999.9%
GPT-4.1 Nano1001001001009999.9%
Writer: Palmyra X51001001001009999.8%
Grok 4.201001001001009999.8%
Qwen 3.5 Plus (2026-04-20)100100100999999.7%
GPT-4o, Aug. 6th (temp=0)100100100999999.6%
Grok 4.3 (Reasoning)1001001001009899.6%
Grok 41001001001009899.6%
Gemma 4 31B10010099999999.5%
Qwen 3.5 122B1001001001009899.5%
o4 Mini High1001001001009899.5%
Claude 3.7 Sonnet100100100999999.5%
Qwen3.6 Max Preview1001001001009799.3%
GPT-5.41001001001009699.3%
GPT-4o, Aug. 6th (temp=1)100100100999899.3%
Grok 4.3100100100989899.2%
GPT-5.5 (Reasoning, Low)1001001001009699.2%
Qwen 3.5 27B100100100989899.1%
Mistral Large 31001001001009599.1%
GPT-5.4 (Reasoning, Low)100100100989799.0%
GPT-4o Mini (temp=0)1001001001009699.0%
MiniMax M2.51001001001009599.0%
Z.AI GLM 4.7100100100999699.0%
GPT-5.5100100100989799.0%
GPT-5.4 (Reasoning)10010099989798.9%
Grok 4.20 (Reasoning)10010099989898.9%
Qwen 3.5 Plus (2026-02-15)100100100979798.8%
Z.AI GLM 5100100100979698.7%
GPT-5.110010099979798.6%
Mistral Large 2100100100979698.6%
Ministral 3B10010098979798.6%
Qwen 3 32B100100100989598.6%
MoonshotAI: Kimi K2.6100100100979698.6%
Grok 4.20 (Beta, Reasoning)100100100979698.6%
Gemini 2.5 Flash Lite (Reasoning)10010099999598.6%
Gemma 3 27B1001001001009398.5%
Mistral Small Creative10010098979798.5%
Gemini 3 Pro (Preview)1001001001009298.4%
Claude Opus 4.61009999999498.3%
ByteDance Seed 1.6 Flash100100100999398.3%
Claude Sonnet 4100100100999398.3%
GPT-OSS 120B1009999989698.3%
Qwen 3.6 Flash100100100979498.1%
Claude Opus 4.5100100100979398.1%
Qwen 3.5 397B A17B1001001001009098.1%
GPT-4.11001001001009098.1%
Z.AI GLM 4.5 Air1001001001009098.1%
Claude 3 Haiku10010099999398.1%
Nemotron 3 Nano10010098989498.1%
Mistral Large100100100999198.1%
DeepSeek V4 Flash (Reasoning)100100100979398.0%
Claude Sonnet 4.51001001001009098.0%
GPT-5.21009999969698.0%
Z.AI GLM 5.1100100100979397.9%
GPT-5100100100979397.9%
MoonshotAI: Kimi K2.5100100100959497.9%
GPT-4o, May 13th (temp=1)100100100979297.8%
Arcee AI: Trinity Mini1001001001008997.7%
DeepSeek-V2 Chat100100100959497.7%
Mistral NeMO100100100989097.7%
ByteDance Seed 1.6100100100969197.5%
Gemini 2.5 Flash10010099969297.3%
Claude Opus 4.6 (Reasoning)100100100988997.3%
Qwen 3.5 9B100100100969097.2%
Claude 3.5 Sonnet100100100988797.0%
GPT-5.4 Nano (Reasoning, Low)1009999959197.0%
DeepSeek V4 Pro10010098949396.9%
Gemma 3 4B999999949396.9%
Rocinante 12B10010097949496.8%
Nemotron 3 Super10010098939396.8%
Gemini 2.5 Flash Lite10010098949296.8%
DeepSeek V4 Flash10010096969296.7%
Hermes 3 70B10010098939396.6%
Mistral Medium 3.1100100100948996.6%
Cohere Command R+ (Aug. 2024)10010099939296.6%
GPT-5.4 Mini10010098939196.5%
LFM2 24B1009998949296.5%
Qwen 3.6 35B100100100948996.5%
Z.AI GLM 5 Turbo100100100978596.4%
GPT-5 Nano1009997959196.4%
Grok 4.20 (Beta)10010099939096.4%
Gemini 3.1 Pro (Preview)10010097958996.3%
Z.AI GLM 4.7 Flash100