Technical jargon density

Test: Bad Writing Habits

Avg. Score
65.0%
Scenarios
18

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.6 Luna (Reasoning)97.6%$0.01718.0s85%
2GPT-5.6 Luna96.5%$0.01515.8s81%
3GPT-5.6 Terra (Reasoning)97.7%$0.04435.2s87%
4GPT-5.6 Terra97.1%$0.04636.9s82%
5o4 Mini89.3%$0.01525.7s63%
6Qwen 2.5 72B89.9%$0.001036.7s59%
7o4 Mini High92.7%$0.02547.2s69%
8GPT-5.6 Sol99.6%$0.1051.2m96%
9GPT-4.186.5%$0.01844.7s61%
10GPT-5.6 Sol (Reasoning)99.6%$0.1081.2m95%
11Qwen 3.5 Flash84.9%$0.002547.5s53%
12DeepSeek V3 (2025-03-24)86.4%$0.001439.4s49%
13Hermes 3 405B88.8%$0.003253.2s49%
14GPT-5.4 Mini82.3%$0.01516.8s49%
15GPT-5.4 Mini (Reasoning, Low)80.7%$0.01516.8s50%
16Qwen 3.5 35B88.1%$0.0181.0m55%
17Gemma 3 27B82.9%$0.000652.6s49%
18Mistral Small 477.8%$0.001418.2s44%
19Qwen3 235B A22B Instruct 250782.0%$0.001159.2s49%
20GPT-5.4 (Reasoning, Low)90.8%$0.0551.4m71%
21Qwen 3.5 9B86.9%$0.00111.4m49%
22GPT-5.490.4%$0.0491.4m69%
23Gemma 3 12B80.6%$0.000441.3s45%
24GPT-5.4 Mini (Reasoning)81.8%$0.02228.1s50%
25Writer: Palmyra X580.3%$0.01122.0s43%
26Aion 2.082.3%$0.00641.3m51%
27GPT-5.4 Nano77.0%$0.005726.3s44%
28Qwen 3.6 Flash80.1%$0.01041.4s46%
29Gemini 2.5 Flash (Reasoning)79.3%$0.01121.5s42%
30DeepSeek-V2 Chat80.2%$0.002153.3s45%
31GPT-5.4 Nano (Reasoning, Low)74.5%$0.005520.6s43%
32Gemini 2.5 Flash76.7%$0.005210.6s38%
33GPT-5.4 Nano (Reasoning)73.7%$0.006124.5s42%
34Qwen 3.6 35B81.3%$0.00831.0m42%
35Mistral Large 375.0%$0.003330.3s35%
36Qwen 3 32B77.7%$0.001554.6s37%
37Mistral NeMO72.4%$0.000510.1s31%
38Arcee AI: Trinity Mini72.5%$0.00039.2s29%
39Mistral Large 276.0%$0.01329.4s37%
40DeepSeek V3 (2024-12-26)76.3%$0.002154.6s35%
41Qwen 3.5 122B80.4%$0.0251.1m44%
42GPT-4.1 Mini71.3%$0.002719.0s31%
43Qwen 3.5 27B81.1%$0.0201.6m47%
44Qwen 3.5 397B A17B88.7%$0.0143.0m55%
45ByteDance Seed 1.6 Flash69.9%$0.001327.3s30%
46Ministral 3 14B68.7%$0.000711.7s26%
47Qwen3.7 Max91.4%$0.0682.3m65%
48Mistral Small 4 (Reasoning)69.9%$0.002230.2s28%
49GPT-5.184.8%$0.0541.8m55%
50Qwen 3.5 Plus (2026-04-20)79.9%$0.0171.8m44%
51Gemini 2.5 Pro76.3%$0.03636.2s37%
52GPT-5.4 (Reasoning)92.8%$0.0892.6m75%
53Ministral 3 8B66.4%$0.000819.6s27%
54Gemini 2.5 Flash Lite63.2%$0.00099.5s27%
55Mistral Medium 3.169.4%$0.004836.5s29%
56DeepSeek V3.273.9%$0.00141.9m40%
57Grok 4.369.5%$0.006930.5s26%
58GPT-5.594.6%$0.1391.7m80%
59GPT-588.9%$0.0652.8m69%
60Ministral 3 3B66.4%$0.000511.1s21%
61GPT-5.5 (Reasoning, Low)93.5%$0.1391.8m81%
62Gemini 3.1 Pro (Preview)92.4%$0.1071.8m67%
63Grok 4.2066.3%$0.009345.7s32%
64Z.AI GLM 4.667.9%$0.006551.5s30%
65GPT-5.5 (Reasoning)94.1%$0.1421.8m79%
66Llama 3.1 70B67.2%$0.001529.4s21%
67Hermes 3 70B70.1%$0.00101.2m24%
68Gemma 3 4B60.1%$0.000220.0s21%
69DeepSeek V4 Flash (Reasoning)62.0%$0.000731.1s21%
70Z.AI GLM 4.7 Flash67.3%$0.00171.2m26%
71Gemini 3 Flash (Preview)57.5%$0.007819.6s24%
72Z.AI GLM 4.564.1%$0.005142.1s21%
73GPT-4o, Aug. 6th (temp=1)63.5%$0.01824.4s23%
74Grok 4.20 (Reasoning)69.1%$0.0181.5m33%
75GPT-5 Mini63.4%$0.010057.4s27%
76Cohere Command R+ (Aug. 2024)67.9%$0.02052.5s25%
77Z.AI GLM 4.767.1%$0.0101.4m28%
78GPT-4.1 Nano57.0%$0.000713.3s16%
79Qwen3.6 Max Preview87.2%$0.0503.5m57%
80Ministral 8B56.1%$0.000410.4s14%
81Gemini 3 Flash (Preview, Reasoning)57.3%$0.01230.1s23%
82DeepSeek V3.165.6%$0.00201.8m28%
83WizardLM 2 8x22b69.4%$0.00261.8m25%
84GPT-4o Mini (temp=0)57.6%$0.001234.8s16%
85Xiaomi MIMO v2.5 Pro60.8%$0.008553.5s21%
86Ministral 3B55.1%$0.00018.1s11%
87Aion 3.0 Mini62.9%$0.00531.2m21%
88Xiaomi MIMO v2.555.3%$0.005431.8s17%
89GPT-5.272.1%$0.0561.5m37%
90DeepSeek V4 Flash54.1%$0.000631.6s14%
91Gemini 3.5 Flash (Reasoning, Minimal)51.3%$0.01812.0s16%
92Grok 4.5 (Reasoning, Low)60.9%$0.0181.1m19%
93GPT-4o, Aug. 6th (temp=0)55.0%$0.02322.7s17%
94Gemini 3.1 Flash Lite (Preview)42.5%$0.00308.4s15%
95Z.AI GLM 4.5 Air54.4%$0.002958.2s14%
96Claude Sonnet 4.558.5%$0.03538.1s20%
97Qwen 3.5 Plus (2026-02-15)47.3%$0.006031.5s16%
98Z.AI GLM 5 Turbo50.3%$0.008133.2s14%
99Gemini 3.5 Flash (Reasoning)64.7%$0.07137.6s28%
100Gemini 3.1 Flash Lite40.2%$0.003012.1s14%
101Claude Haiku 4.544.1%$0.01121.6s16%
102Gemini 3.1 Flash Lite (Reasoning)38.5%$0.003011.9s15%
103Gemma 4 26B49.2%$0.000955.1s14%
104DeepSeek V4 Pro54.1%$0.00481.3m16%
105GPT-4o Mini (temp=1)46.5%$0.001234.8s11%
106Grok 4.3 (Reasoning)68.8%$0.0212.3m23%
107Qwen 3.6 27B68.6%$0.0252.3m24%
108Cydonia 24B V4.145.1%$0.001444.8s12%
109Aion 3.055.0%$0.0241.0m16%
110Gemini 2.5 Flash Lite (Reasoning)40.4%$0.002830.8s13%
111Z.AI GLM 550.8%$0.00841.2m14%
112Inception Mercury 238.9%$0.00327.0s5%
113Grok 4.5 (Reasoning, High)57.6%$0.0301.6m18%
114Claude Opus 4.7 (Reasoning)60.6%$0.07632.0s20%
115Claude Opus 4.8 (Reasoning)60.2%$0.07141.7s20%
116Claude Sonnet 4.644.3%$0.03139.3s16%
117Claude Opus 4.756.1%$0.06930.4s19%
118Gemma 4 31B (Reasoning)50.1%$0.00142.2m18%
119Gemma 4 31B45.6%$0.00101.6m13%
120Claude Opus 4.8 (Reasoning, Low)58.2%$0.07141.9s19%
121MiniMax M2.742.0%$0.00401.1m10%
122MiniMax M2.540.4%$0.00341.3m10%
123Z.AI GLM 5.2 (Reasoning, High)39.8%$0.0111.0m10%
124Z.AI GLM 5.145.5%$0.0141.5m13%
125Gemma 4 26B (Reasoning)45.8%$0.00132.0m13%
126Claude Sonnet 443.1%$0.03243.7s10%
127Claude Sonnet 535.9%$0.02733.5s7%
128DeepSeek V4 Pro (Reasoning)57.0%$0.0153.1m17%
129Claude Opus 4.541.9%$0.07053.4s17%
130Claude Sonnet 4.6 (Reasoning)44.1%$0.0601.2m10%
131MiniMax M342.2%$0.00603.1m16%
132Nemotron 3 Super28.2%$0.00001.4m2%
133GPT-OSS 120B28.5%$0.00151.8m3%
134Claude Sonnet 5 (Reasoning)26.0%$0.03038.9s1%
135Claude Sonnet 5 (Reasoning, Low)25.8%$0.03138.4s0%
136Mistral Small 3.2 24B69.0%$0.00695.7m20%
137Nemotron 3 Nano17.3%$0.00101.1m0%
138ByteDance Seed 1.633.1%$0.0132.5m4%
139Claude Opus 4.6 (Reasoning)39.1%$0.0881.4m15%
140Claude Opus 4.632.3%$0.0781.2m11%
141MoonshotAI: Kimi K2.537.5%$0.0193.2m7%
142Claude Opus 471.3%$0.2091.4m33%
143ByteDance Seed 2.0 Lite20.6%$0.0122.2m0%
144GPT-5 Nano4.6%$0.00421.4m0%
145ByteDance Seed 2.0 Mini44.0%$0.00454.9m11%
146MoonshotAI: Kimi K2.655.1%$0.0586.5m16%
64.97%

Individual Scenarios

Detailed Writing Rules

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
GPT-5.6 Luna (Reasoning)1001001001009799.4%
Qwen 3.5 35B1001001001009599.0%
Hermes 3 405B1001001001009599.0%
Qwen 3.5 397B A17B1001001001009398.6%
Qwen 3.5 Flash100100100979598.4%
Qwen3.7 Max1001001001009097.9%
GPT-5.5 (Reasoning, Low)100100100979197.7%
GPT-5.5 (Reasoning)10010098969196.8%
GPT-5.4 (Reasoning)100100100939196.6%
GPT-5.5100100100898895.4%
Qwen3.6 Max Preview100100100898594.8%
GPT-5989694929294.5%
Qwen 3.5 9B1001001001006392.7%
Qwen 3.5 122B10010094817890.5%
GPT-5.410010098705484.3%
Qwen 2.5 72B10010094755084.0%
DeepSeek V3.2949288806383.3%
GPT-4.1989483716883.0%
Qwen 3.5 27B1007979767582.0%
Writer: Palmyra X5100100100634481.5%
Qwen 3.6 Flash100100100564880.8%
Hermes 3 70B100100100614380.8%
GPT-5.110010097713480.3%
DeepSeek V3 (2025-03-24)10010010098079.6%
o4 Mini100100100573979.2%
Gemini 2.5 Flash1008271716377.7%
GPT-5.4 Mini (Reasoning, Low)949082774477.4%
Mistral NeMO1009077665477.2%
GPT-5.4 (Reasoning, Low)1009681733376.7%
o4 Mini High1009686553975.3%
WizardLM 2 8x22b10010086721774.9%
Qwen 3.5 Plus (2026-04-20)1009085514373.9%
GPT-5.4 Mini898273705172.9%
Grok 4.20838277744672.5%
Aion 2.01008578544572.3%
DeepSeek-V2 Chat10010075543171.9%
Claude Opus 4.7 (Reasoning)10010076443370.6%
DeepSeek V4 Pro (Reasoning)838076614669.3%
DeepSeek V3.1947878583869.1%
Claude Opus 4.8 (Reasoning, Low)1007463545468.8%
Grok 4.20 (Reasoning)1008769632468.7%
Z.AI GLM 4.51001008062068.3%
Qwen 3.6 27B100927859666.9%
Gemini 2.5 Flash (Reasoning)1008555543966.4%
Z.AI GLM 4.71007865453564.6%
Z.AI GLM 5 Turbo100918844064.6%
Qwen 3.6 35B1001007344464.2%
Qwen3 235B A22B Instruct 25071006969503364.1%
Gemini 3 Flash (Preview, Reasoning)847470662463.8%
MoonshotAI: Kimi K2.61006563611360.5%
GPT-4o, Aug. 6th (temp=0)1001006536060.2%
GPT-5 Mini837960601860.1%
Llama 3.1 70B100100970059.4%
Ministral 3 14B1007168441258.9%
Claude Opus 4.71006054512858.5%
Mistral Large 3918746362957.8%
Z.AI GLM 4.7 Flash100925641057.7%
GPT-5.4 Nano (Reasoning, Low)676760603357.5%
Mistral Small 3.2 24B100736546056.8%
GPT-5.4 Mini (Reasoning)727261483156.8%
GPT-4.1 Mini100766041656.6%
Claude Sonnet 4.51007454451056.5%
Z.AI GLM 4.6807560333356.2%
Claude Opus 4100775841456.0%
DeepSeek V4 Pro10086719454.2%
GPT-5.4 Nano735656562653.5%
Xiaomi MIMO v2.51005849411853.1%
Gemini 2.5 Pro967556211352.3%
ByteDance Seed 1.6 Flash76685957052.0%
Gemma 3 12B100794436051.9%
Aion 3.0 Mini100834133051.4%
Mistral Medium 3.1737168271450.6%
Gemma 3 27B946341292450.3%
GPT-5.4 Nano (Reasoning)675849413750.3%
Aion 3.0785149443050.2%
Mistral Small 499715127049.5%
Gemini 3 Flash (Preview)885846371649.0%
DeepSeek V3 (2024-12-26)100100329048.1%
Claude Sonnet 4.6 (Reasoning)706038363648.0%
Qwen 3 32B10074630047.6%
Grok 4.5 (Reasoning, Low)100814310046.8%
GPT-5.2785754271746.6%
Cohere Command R+ (Aug. 2024)83584441045.3%
Mistral Small 4 (Reasoning)9175580044.8%
Arcee AI: Trinity Mini9473515044.5%
Gemini 3.5 Flash (Reasoning)656243311643.3%
Qwen 3.5 Plus (2026-02-15)9461527042.9%
Claude Sonnet 4.693513627041.4%
Grok 4.3 (Reasoning)76454441041.3%
Claude Opus 4.8 (Reasoning)63605131041.2%
Ministral 3 8B71543838040.2%
Gemma 4 31B (Reasoning)89632418339.5%
ByteDance Seed 2.0 Mini8671330038.0%
Claude Opus 4.6 (Reasoning)57553939037.9%
Mistral Large 2923327191336.6%
Nemotron 3 Nano8954360035.7%
DeepSeek V4 Flash (Reasoning)5954540033.2%
MiniMax M361393924032.6%
Claude Opus 4.56866209032.5%
Z.AI GLM 4.5 Air7148360031.1%
Gemini 3.5 Flash (Reasoning, Minimal)60512413831.0%
Grok 4.5 (Reasoning, High)8548140029.3%
Gemma 3 4B6857183029.3%
Cydonia 24B V4.186242115029.3%
Gemma 4 26B (Reasoning)7539240027.5%
Z.AI GLM 563411716027.4%
GPT-4o, Aug. 6th (temp=1)73292013027.0%
Gemini 3.1 Flash Lite755700026.3%
Grok 4.37036240025.8%
Claude Haiku 4.56548130025.2%
MoonshotAI: Kimi K2.5695600025.0%
Claude Sonnet 5 (Reasoning, Low)883500024.5%
Inception Mercury 2833500023.6%
Claude Sonnet 55033205021.6%
Z.AI GLM 5.2 (Reasoning, High)653290021.2%
GPT-4o Mini (temp=1)8213100020.9%
Claude Opus 4.6653600020.2%
Gemma 4 26B6219128020.1%
Xiaomi MIMO v2.5 Pro6026112019.9%
GPT-4o Mini (temp=0)5127170019.0%
Nemotron 3 Super3737200018.8%
Gemini 3.1 Flash Lite (Preview)4332190018.7%
DeepSeek V4 Flash81000016.1%
MiniMax M2.7601550015.9%
Claude Sonnet 471700015.6%
ByteDance Seed 1.674300015.4%
Gemini 2.5 Flash Lite (Reasoning)433300015.1%
Gemini 2.5 Flash Lite453000015.1%
Z.AI GLM 5.1452100013.3%
MiniMax M2.560000012.1%
Ministral 8B272094012.0%
Claude Sonnet 5 (Reasoning)411300010.8%
GPT-4.1 Nano391300010.3%
Gemini 3.1 Flash Lite (Reasoning)4100008.2%
GPT-OSS 120B4100008.2%
Gemma 4 31B3600007.1%
Ministral 3 3B2480006.4%
ByteDance Seed 2.0 Lite2400004.8%
GPT-5 Nano000000.0%
Ministral 3B000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-5.6 Terra1001001001009699.3%
o4 Mini High100100100959297.4%
Ministral 3 3B100100100958896.6%
GPT-5.5 (Reasoning)1001001001007795.4%
GPT-5.1100100100918294.6%
DeepSeek V3 (2025-03-24)100100100987193.9%
Claude Sonnet 4.6 (Reasoning)10010096898293.4%
Z.AI GLM 5.1100100100996592.9%
GPT-5.4 (Reasoning)10010093888192.2%
GPT-5100100100936090.6%
Qwen 3.5 122B10010098926090.0%
GPT-5.410010095876789.7%
GPT-5.4 (Reasoning, Low)100100100787089.7%
o4 Mini10010084837889.1%
GPT-5.4 Mini1009687867689.0%
DeepSeek V3.210010089797588.6%
Gemma 3 27B100100100925188.6%
GPT-5.4 Mini (Reasoning)1009883837688.2%
GPT-5.5100100100914988.1%
Hermes 3 405B1001001001003787.4%
Qwen 3.6 35B1009883827186.9%
Qwen 3.5 397B A17B100100100775486.1%
GPT-5.5 (Reasoning, Low)978987797885.8%
Qwen3 235B A22B Instruct 250710010092756085.3%
Xiaomi MIMO v2.5 Pro989491706984.5%
Claude Opus 4.7 (Reasoning)100100100764483.9%
Z.AI GLM 4.7 Flash100100100902983.8%
Cohere Command R+ (Aug. 2024)10010079736583.6%
Writer: Palmyra X510010092636083.2%
WizardLM 2 8x22b10010073707082.4%
Qwen 2.5 72B10010078765782.2%
DeepSeek V3 (2024-12-26)100100100684382.1%
GPT-5.4 Nano (Reasoning, Low)1008584746381.3%
Grok 4.3 (Reasoning)1008479717181.3%
Mistral Small 410010094743780.9%
Grok 4.31008976716380.1%
Claude Opus 4.8 (Reasoning)10010080714980.0%
Claude Opus 41009889713678.9%
MoonshotAI: Kimi K2.61008180755778.6%
Qwen 3.5 Plus (2026-04-20)100100100632978.4%
Z.AI GLM 4.71009686703878.1%
GPT-4o, Aug. 6th (temp=1)10010079743477.4%
GPT-5.4 Nano947673726976.8%
Grok 4.20 (Reasoning)1008078745076.3%
GPT-4.1 Mini1007671706175.8%
GPT-4.11009876584174.7%
Gemini 3 Flash (Preview, Reasoning)1008380703974.7%
Gemini 2.5 Flash888885605274.6%
Aion 2.01007673655874.4%
Z.AI GLM 4.51009886543273.8%
Qwen 3.6 27B10010091443473.8%
GPT-5.4 Mini (Reasoning, Low)989181673173.6%
Arcee AI: Trinity Mini100908681572.2%
Z.AI GLM 4.5 Air1008883662472.1%
Qwen 3.5 27B1009778444172.0%
Xiaomi MIMO v2.5949481513771.5%
DeepSeek V4 Pro100928382071.4%
GPT-5.2100978574071.2%
Z.AI GLM 5947671555269.9%
Gemini 3.5 Flash (Reasoning)947962545468.5%
Claude Opus 4.7898263564667.4%
Mistral Large 2987463544566.8%
GPT-5.4 Nano (Reasoning)998674393666.7%
Claude Sonnet 5 (Reasoning, Low)92918366066.3%
Qwen 3 32B100908852066.0%
Gemma 3 12B968262464165.4%
Gemini 2.5 Pro1001007349565.4%
Ministral 3 8B100938349065.0%
DeepSeek-V2 Chat1009892241165.0%
Grok 4.2086858466364.9%
ByteDance Seed 1.6 Flash100836562062.2%
Gemma 4 26B927456464161.7%
GPT-4o, Aug. 6th (temp=0)100927339060.7%
Grok 4.5 (Reasoning, Low)866854523960.0%
Aion 3.0 Mini1006657512459.6%
Qwen 3.5 Plus (2026-02-15)858363422459.6%
Z.AI GLM 4.61008650481359.4%
DeepSeek V4 Pro (Reasoning)978571261759.3%
Mistral Medium 3.189766663059.0%
Claude Sonnet 493886935958.7%
DeepSeek V3.195827541058.6%
MoonshotAI: Kimi K2.51007161431357.7%
Gemini 3.5 Flash (Reasoning, Minimal)100766346057.2%
DeepSeek V4 Flash (Reasoning)10010054211156.9%
Mistral NeMO10094833056.1%
Gemini 2.5 Flash (Reasoning)89886043056.0%
Claude Sonnet 4.5100954338055.2%
Mistral Small 4 (Reasoning)787473411055.2%
MiniMax M2.7100785938055.0%
Aion 3.0656357444354.5%
Ministral 3B986359411154.4%
ByteDance Seed 2.0 Mini877152451253.5%
Gemma 4 31B (Reasoning)1006548411353.3%
GPT-5 Mini1005547422253.2%
Grok 4.5 (Reasoning, High)100656239053.1%
Gemma 4 31B100913529852.5%
Claude Sonnet 5100884624051.6%
ByteDance Seed 1.610089630050.6%
Claude Sonnet 5 (Reasoning)10083598050.0%
Claude Sonnet 4.686635936048.9%
Mistral Large 3100675017948.5%
Gemma 3 4B100100225045.4%
Gemini 3 Flash (Preview)100494326744.7%
Gemini 2.5 Flash Lite10084343044.3%
Claude Opus 4.8 (Reasoning, Low)8654518440.5%
Cydonia 24B V4.169545029040.2%
Hermes 3 70B1009800039.6%
GPT-4o Mini (temp=1)10065310039.1%
Claude Opus 4.697383027038.4%
Gemini 3.1 Flash Lite (Preview)73483528036.6%
Z.AI GLM 5.2 (Reasoning, High)75622116936.5%
MiniMax M366454421536.2%
Claude Opus 4.566564111034.7%
Ministral 3 14B54514424034.5%
Gemini 3.1 Flash Lite (Reasoning)68622214033.3%
Gemma 4 26B (Reasoning)49493429533.1%
Claude Opus 4.6 (Reasoning)55492718230.3%
Z.AI GLM 5 Turbo735690027.6%
Llama 3.1 70B5443380027.0%
Nemotron 3 Super835100026.9%
GPT-4.1 Nano41331615021.0%
MiniMax M2.548241514020.1%
Mistral Small 3.2 24B100000020.0%
Claude Haiku 4.5543570019.0%
DeepSeek V4 Flash563200017.5%
Ministral 8B612000016.2%
ByteDance Seed 2.0 Lite411600011.3%
Gemini 3.1 Flash Lite3990009.6%
Inception Mercury 22550006.1%
GPT-OSS 120B1597006.1%
GPT-4o Mini (temp=0)1800003.5%
Gemini 2.5 Flash Lite (Reasoning)1100002.2%
GPT-5 Nano000000.0%
Nemotron 3 Nano000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Qwen3.7 Max100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Hermes 3 405B100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
Writer: Palmyra X51001001001009899.6%
GPT-5.5 (Reasoning)1001001001009599.0%
DeepSeek-V2 Chat1001001001009599.0%
Qwen 3 32B1001001001009599.0%
Qwen 3.5 Plus (2026-04-20)100100100979798.7%
Grok 4.201001001001009398.5%
GPT-5.41001001001009198.2%
GPT-4.1 Mini1001001001009098.0%
GPT-5.6 Sol1001001001008897.6%
Aion 2.0100100100979097.3%
Gemini 3.5 Flash (Reasoning)100100100949297.1%
Qwen 3.5 Flash10010098959297.1%
Qwen 3.5 397B A17B100100100929296.7%
GPT-5.4 Mini100100100988596.7%
Ministral 3 3B1001001001008396.7%
GPT-5.6 Sol (Reasoning)1001001001008396.7%
o4 Mini100100100988396.3%
Qwen 3.5 27B100100100958696.2%
GPT-5.5 (Reasoning, Low)1001001001007995.8%
GPT-5.6 Terra (Reasoning)1001001001007394.6%
GPT-5.4 (Reasoning)100100100987394.2%
GPT-5.51001001001007194.1%
Nemotron 3 Super100100100888293.9%
WizardLM 2 8x22b100100100888293.9%
Qwen 2.5 72B1001001001006693.1%
Grok 4.3 (Reasoning)10010097838292.3%
Qwen3.6 Max Preview10010090908192.1%
Mistral Large 21001001001006092.1%
MoonshotAI: Kimi K2.6100100100926891.9%
Gemma 3 27B100100100827891.8%
Mistral Medium 3.1100100100986091.7%
Ministral 3 14B1001001001005891.6%
Qwen 3.6 35B100100100926391.1%
GPT-5.6 Luna100100100807089.9%
Z.AI GLM 4.5100100100866389.8%
Arcee AI: Trinity Mini100100100955489.8%
Gemini 2.5 Flash100100100886089.7%
Z.AI GLM 4.6100100100945489.5%
Z.AI GLM 4.7 Flash1001001001004889.5%
GPT-5.4 Nano100100100776788.9%
Grok 4.20 (Reasoning)10010088837388.8%
DeepSeek V3.210010092886388.6%
Gemini 2.5 Pro1001001001004188.2%
Claude Opus 410010083787787.6%
Claude Opus 4.8 (Reasoning, Low)100100100785987.3%
GPT-5.4 Nano (Reasoning)10010081807486.9%
Gemini 3 Flash (Preview)1009984826385.8%
Qwen 3.6 Flash100100100715685.5%
GPT-51009285796985.0%
Z.AI GLM 5.2 (Reasoning, High)10010090735984.3%
Z.AI GLM 4.7100100100635884.3%
DeepSeek V4 Pro10010092834584.1%
GPT-5.6 Terra10010094794583.8%
Xiaomi MIMO v2.51009389706683.6%
ByteDance Seed 1.6 Flash1009692785083.1%
Mistral NeMO10010098813683.1%
Gemma 4 26B10010095734682.9%
GPT-5.4 (Reasoning, Low)10010078756082.8%
Llama 3.1 70B10010094922782.5%
Gemini 3 Flash (Preview, Reasoning)100100100634982.4%
Qwen 3.5 Plus (2026-02-15)10010091695081.8%
Gemini 2.5 Flash (Reasoning)10010094615481.7%
Mistral Large 310010094803481.6%
o4 Mini High10010080715481.0%
GPT-4o Mini (temp=0)10010088714581.0%
Ministral 3B100100100683780.9%
Cohere Command R+ (Aug. 2024)100100100713380.9%
GPT-5.110010085784180.7%
Mistral Small 4 (Reasoning)100100100544880.2%
Z.AI GLM 4.5 Air10010088813079.7%
GPT-5.4 Mini (Reasoning, Low)968885765279.3%
GPT-5.21007675737179.1%
Mistral Small 410010097564078.6%
GPT-5.4 Nano (Reasoning, Low)988682615977.2%
GPT-4o, Aug. 6th (temp=1)989888574477.2%
Ministral 3 8B1008075706077.0%
Z.AI GLM 5.1100100100542976.4%
DeepSeek V4 Flash (Reasoning)10010095543376.4%
DeepSeek V3.11008378615575.6%
Grok 4.5 (Reasoning, Low)1008680634474.5%
MiniMax M2.510010063604874.3%
GPT-4o, Aug. 6th (temp=0)10010071574374.2%
DeepSeek V4 Flash100100100452473.9%
ByteDance Seed 1.610010094502473.4%
DeepSeek V4 Pro (Reasoning)1007871605773.4%
Gemma 4 26B (Reasoning)989671544472.6%
Qwen 3.5 122B10010092413072.5%
GPT-5 Mini928683584472.5%
ByteDance Seed 2.0 Mini1009859545272.5%
GPT-4.1 Nano1001008174872.4%
DeepSeek V3 (2024-12-26)10010078542871.8%
Claude Opus 4.71009063634171.5%
Gemma 4 31B (Reasoning)1009456545471.3%
Grok 4.5 (Reasoning, High)10010061454570.3%
Gemma 4 31B1009478482769.3%
Aion 3.0 Mini1001008854068.3%
Inception Mercury 2100939255067.9%
Gemma 3 12B979488372467.8%
Grok 4.310010078332466.9%
Claude Sonnet 410010081292065.8%
GPT-5.4 Mini (Reasoning)1008257454365.3%
Xiaomi MIMO v2.5 Pro1001006359064.5%
Claude Opus 4.6 (Reasoning)1007571561663.6%
Claude Opus 4.8 (Reasoning)100866863063.4%
Aion 3.0100908341062.8%
Claude Sonnet 588888157062.7%
Ministral 8B100999117462.0%
Claude Opus 4.51006060543661.9%
Gemini 2.5 Flash Lite1001001009061.8%
Z.AI GLM 51008668312461.7%
Qwen 3.6 27B100987830061.2%
Gemini 3.1 Flash Lite (Preview)100977632060.9%
GPT-OSS 120B100797546060.2%
Claude Sonnet 4.51001007410056.7%
Claude Haiku 4.5815856464356.7%
Hermes 3 70B1001005724056.2%
Gemini 3.5 Flash (Reasoning, Minimal)716648414153.4%
Z.AI GLM 5 Turbo100784441052.6%
MiniMax M3100756520052.2%
Nemotron 3 Nano1006044421051.1%
Claude Sonnet 4.6 (Reasoning)100943320049.3%
Claude Opus 4.7 (Reasoning)1007130191346.6%
Claude Opus 4.69580560046.2%
MoonshotAI: Kimi K2.510060450041.2%
Gemini 2.5 Flash Lite (Reasoning)684544271740.2%
MiniMax M2.78881208039.2%
Claude Sonnet 5 (Reasoning)10048410037.7%
ByteDance Seed 2.0 Lite7871310036.1%
Gemini 3.1 Flash Lite8644247032.0%
Claude Sonnet 4.68335289030.9%
GPT-4o Mini (temp=1)1004650030.2%
Gemma 3 4B54353324429.8%
Gemini 3.1 Flash Lite (Reasoning)41383627028.4%
Claude Sonnet 5 (Reasoning, Low)5048280025.0%
Cydonia 24B V4.1434150017.8%
GPT-5 Nano3380008.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
GPT-5.5100100100100100100.0%
Aion 3.0100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Qwen3.6 Max Preview1001001001009899.6%
Qwen 3.5 122B1001001001009899.6%
GPT-5.4 Mini1001001001009899.6%
Llama 3.1 70B1001001001009899.6%
GPT-5.5 (Reasoning)1001001001009699.2%
GPT-5.5 (Reasoning, Low)1001001001009599.0%
Claude Opus 4.8 (Reasoning, Low)1001001001009599.0%
Gemini 2.5 Flash (Reasoning)1001001001009599.0%
o4 Mini High1001001001008897.6%
Qwen 3.5 35B1001001001008897.6%
o4 Mini1001001001008897.6%
GPT-5.410010098988997.0%
GPT-5.4 Mini (Reasoning)100100100939297.0%
GPT-5.4 (Reasoning, Low)1001001001008396.7%
Qwen 3.5 Flash100100100958896.6%
Grok 4.5 (Reasoning, Low)1001001001007895.6%
GPT-4.11001001001007895.5%
Z.AI GLM 5 Turbo100100100898895.4%
GPT-5100100100898394.6%
Mistral NeMO100100100957694.3%
DeepSeek V4 Flash1001001001007194.3%
Qwen 3 32B1001001001007194.3%
GPT-4o, Aug. 6th (temp=0)100100100888193.7%
DeepSeek V4 Flash (Reasoning)10010092907891.9%
ByteDance Seed 1.6 Flash1001001001005991.8%
Inception Mercury 210010092897691.3%
Grok 4.310010098787890.8%
Writer: Palmyra X5100100100906390.7%
GPT-4.1 Mini100100100866089.2%
GPT-5.4 Mini (Reasoning, Low)10010089837389.1%
Claude Opus 41009591867188.6%
Z.AI GLM 4.710010097747188.5%
Qwen 3.6 Flash1001001001004188.2%
GPT-5.110010088827088.1%
Gemma 3 12B100100100865487.9%
GPT-4.1 Nano10010090806687.2%
DeepSeek-V2 Chat10010095924987.2%
Grok 4.20 (Reasoning)10010094924987.0%
Aion 2.010010088806686.8%
GPT-4o, Aug. 6th (temp=1)1001001001003386.6%
Z.AI GLM 4.7 Flash10010098973886.6%
Claude Opus 4.7 (Reasoning)10010086866186.5%
Grok 4.3 (Reasoning)100100100953786.5%
Mistral Small 410010091815986.1%
Claude Opus 4.8 (Reasoning)10010092785685.2%
DeepSeek V3 (2025-03-24)10010095784884.2%
Gemini 2.5 Pro100100100793883.4%
Gemini 3.5 Flash (Reasoning)10010097883183.3%
Hermes 3 70B100100100902482.8%
MiniMax M2.510010090784482.4%
MoonshotAI: Kimi K2.6100100100922082.3%
DeepSeek V4 Pro (Reasoning)100100100783181.8%
Ministral 3 14B1008886716381.7%
Claude Haiku 4.5949491636381.1%
Gemini 2.5 Flash Lite1008583716580.9%
WizardLM 2 8x22b10010070666580.2%
Mistral Small 3.2 24B100100100100080.0%
Claude Sonnet 51009278715779.7%
Qwen 3.5 397B A17B10010010097079.4%
DeepSeek V3.21009783754179.2%
Qwen3 235B A22B Instruct 250710010010095079.0%
GPT-4o Mini (temp=0)1008176736078.0%
GPT-5.4 Nano1008376666477.9%
MoonshotAI: Kimi K2.51007878716177.7%
Cydonia 24B V4.1100100100681977.3%
Gemma 4 26B1009188624577.3%
Mistral Large 3929085764176.7%
GPT-5.21007978715576.4%
GPT-5.4 Nano (Reasoning, Low)1008076715175.7%
ByteDance Seed 2.0 Mini1001009580075.0%
Claude Sonnet 4.510010060575774.8%
Grok 4.201008988632974.0%
Nemotron 3 Super1009366614873.5%
Arcee AI: Trinity Mini1001009571073.3%
Aion 3.0 Mini10010059544972.2%
Qwen 3.6 27B10010010059071.8%
Gemini 2.5 Flash1001009563071.7%
DeepSeek V3 (2024-12-26)1008678781370.9%
Z.AI GLM 4.510010078413670.9%
Qwen 3.5 27B1008875484170.1%
GPT-5 Mini1009461544270.1%
MiniMax M3989074542467.9%
Qwen 3.5 Plus (2026-02-15)1008366493967.5%
GPT-5.4 Nano (Reasoning)907571703067.1%
Gemini 3.1 Flash Lite (Preview)887966623966.7%
Xiaomi MIMO v2.5 Pro10010071313066.5%
Z.AI GLM 4.6100827369365.4%
Claude Sonnet 41001009235065.3%
Grok 4.5 (Reasoning, High)1008963551564.5%
Gemini 3 Flash (Preview, Reasoning)1009261521664.1%
Claude Sonnet 4.6 (Reasoning)1008670442064.0%
Gemma 4 26B (Reasoning)1007958562463.3%
Ministral 3 3B1001007141062.4%
Cohere Command R+ (Aug. 2024)1008345414162.1%
DeepSeek V4 Pro1001007831061.8%
GPT-OSS 120B90817354059.6%
DeepSeek V3.11008366242459.5%
Claude Sonnet 4.61001007620059.1%
Ministral 3B100100950059.0%
Ministral 3 8B88787554058.8%
Claude Opus 4.5100835145456.7%
Mistral Large 2100786528955.9%
Z.AI GLM 5757163442455.6%
Xiaomi MIMO v2.5100974528054.0%
Z.AI GLM 4.5 Air1001004124052.9%
GPT-4o Mini (temp=1)100886015052.7%
Gemma 3 4B766649363151.7%
Z.AI GLM 5.1100635632551.4%
Mistral Small 4 (Reasoning)1005243382451.4%
Nemotron 3 Nano100686024050.3%
Gemini 3.5 Flash (Reasoning, Minimal)100685627050.1%
Gemma 4 31B (Reasoning)94765818049.0%
Gemini 3 Flash (Preview)94795513048.3%
ByteDance Seed 2.0 Lite1001002813048.1%
Gemini 3.1 Flash Lite100595427047.9%
Gemma 4 31B785950341847.7%
Claude Opus 4.6 (Reasoning)737054291047.2%
Z.AI GLM 5.2 (Reasoning, High)754948282444.6%
Gemini 3.1 Flash Lite (Reasoning)76714120041.8%
Claude Sonnet 5 (Reasoning)88633715040.7%
Claude Opus 4.6100542718039.6%
Claude Sonnet 5 (Reasoning, Low)8344419035.5%
Claude Opus 4.7100302819035.3%
ByteDance Seed 1.61007000033.9%
Ministral 8B75442413031.2%
Mistral Medium 3.168511915030.4%
MiniMax M2.76041194024.8%
Gemini 2.5 Flash Lite (Reasoning)451300011.7%
GPT-5 Nano600001.2%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
o4 Mini1001001001009899.6%
GPT-5.41001001001009899.6%
Qwen3 235B A22B Instruct 25071001001001009899.6%
Qwen 3 32B1001001001009799.4%
Z.AI GLM 4.71001001001009298.4%
Qwen 3.5 35B1001001001009298.4%
Qwen 3.5 Flash1001001001009298.4%
GPT-5.11001001001008897.6%
Hermes 3 70B1001001001008697.1%
GPT-5.5 (Reasoning)100100100968997.0%
GPT-5.4 (Reasoning, Low)1001001001008296.3%
Gemini 2.5 Flash100100100928895.9%
Writer: Palmyra X51001001001007895.6%
GPT-5.5 (Reasoning, Low)100100100968295.5%
Grok 4.3 (Reasoning)1001001001007695.2%
Qwen 3.5 122B1001001001007595.0%
Qwen 3.6 35B1001001001007595.0%
DeepSeek V3 (2024-12-26)1001001001007595.0%
Ministral 3 14B1001001001007595.0%
GPT-5.4 (Reasoning)1009595929294.8%
Mistral Large 3100100100928294.8%
Aion 3.0100100100888394.2%
GPT-5.4 Mini (Reasoning)100100100878394.0%
Qwen 3.5 27B100100100868393.8%
Aion 2.0100100100868393.8%
GPT-5.51001001001006893.5%
GPT-5.4 Nano100100100937293.1%
Arcee AI: Trinity Mini100100100927493.0%
DeepSeek V4 Flash10010098887892.8%
DeepSeek V4 Flash (Reasoning)1001001001006392.7%
Gemini 2.5 Flash (Reasoning)1001001001006192.2%
Grok 4.31001001001006192.2%
Qwen 3.6 Flash1001001001006092.1%
GPT-5.4 Mini (Reasoning, Low)1001001001006091.9%
Claude Opus 4.8 (Reasoning)1001001001005991.8%
Grok 4.20 (Reasoning)100100100797891.4%
Z.AI GLM 510010094926890.6%
GPT-5100100100817190.5%
GPT-4.110010097975489.4%
GPT-5.4 Mini10010092817489.4%
Claude Sonnet 4.510010098757489.4%
DeepSeek V3 (2025-03-24)100100100925489.1%
Qwen 3.6 27B100100100836088.8%
Grok 4.5 (Reasoning, High)10010094866388.7%
DeepSeek-V2 Chat1001001001004188.2%
WizardLM 2 8x22b100100100756688.1%
DeepSeek V3.21009793886087.5%
DeepSeek V4 Pro100100100944186.9%
Claude Sonnet 5 (Reasoning)1009592836386.8%
DeepSeek V3.1100100100963786.7%
Mistral Small 41001001001003386.6%
Gemini 2.5 Pro1001001001003386.5%
Mistral Medium 3.110010092915086.4%
Qwen 3.5 Plus (2026-02-15)10010089885285.8%
ByteDance Seed 1.6 Flash10010094944185.7%
Claude Opus 4100100100804585.1%
Hermes 3 405B1001001001002484.8%
Gemini 3 Flash (Preview)10010099754884.3%
ByteDance Seed 1.6100100100665483.8%
Grok 4.201009283717183.6%
GPT-4.1 Mini10010095754883.5%
GPT-4o, Aug. 6th (temp=1)10010094853883.3%
Z.AI GLM 4.610010094922882.6%
Qwen 2.5 72B1001001001001382.6%
Mistral Small 4 (Reasoning)10010092753680.6%
Claude Opus 4.7 (Reasoning)10010098861980.5%
Gemini 3.5 Flash (Reasoning)100100100861780.5%
Ministral 3 3B100100100633880.3%
Claude Sonnet 5 (Reasoning, Low)100100100100080.0%
Cohere Command R+ (Aug. 2024)100100100100080.0%
Inception Mercury 21007978766379.1%
Aion 3.0 Mini10010010095079.0%
Claude Sonnet 410010092614178.8%
Z.AI GLM 5.2 (Reasoning, High)100100100692478.6%
MiniMax M2.710010092881378.5%
Cydonia 24B V4.1100100100821178.4%
Mistral Large 2100100100632477.5%
GPT-5.21009285773177.0%
MiniMax M310010085633676.8%
Claude Opus 4.71008675606076.3%
Gemini 2.5 Flash Lite1008381655276.2%
Z.AI GLM 4.7 Flash947674716375.6%
Gemma 4 26B100100100542475.5%
GPT-5.4 Nano (Reasoning, Low)827874727075.1%
Mistral Small 3.2 24B1001008983074.5%
Gemma 3 27B1009482662873.8%
Z.AI GLM 4.51009886711373.7%
MiniMax M2.510010088541771.7%
Gemma 3 12B10010088482071.0%
Grok 4.5 (Reasoning, Low)100948278070.8%
Mistral NeMO1008863604170.5%
Z.AI GLM 4.5 Air1008378454570.4%
GPT-5.4 Nano (Reasoning)877866615569.3%
Gemma 4 31B (Reasoning)918678632468.5%
ByteDance Seed 2.0 Mini10010083302868.2%
Gemma 4 31B947166565267.7%
Xiaomi MIMO v2.5100958954067.6%
MoonshotAI: Kimi K2.610010056542867.4%
DeepSeek V4 Pro (Reasoning)1006968633366.8%
Claude Sonnet 4.6 (Reasoning)10010010024766.1%
Gemini 3.5 Flash (Reasoning, Minimal)100979033965.7%
Llama 3.1 70B1001007151064.4%
MoonshotAI: Kimi K2.5100948148064.4%
Claude Opus 4.8 (Reasoning, Low)100986848764.1%
Gemini 3.1 Flash Lite (Preview)1008068382161.4%
Qwen 3.5 9B1001001000060.0%
Gemini 3 Flash (Preview, Reasoning)887877352259.8%
GPT-4o Mini (temp=0)100715954056.8%
Z.AI GLM 5 Turbo97907817056.3%
Z.AI GLM 5.11009741331156.2%
GPT-OSS 120B96716741255.5%
Ministral 3 8B100974238055.5%
Xiaomi MIMO v2.5 Pro1005651481954.5%
Gemini 2.5 Flash Lite (Reasoning)100905518052.6%
Gemini 3.1 Flash Lite706961372452.1%
Gemma 4 26B (Reasoning)1006054271951.7%
Claude Opus 4.592855724051.5%
GPT-5 Mini80635551751.2%
Claude Opus 4.6 (Reasoning)83605450350.1%
Ministral 8B10066650046.1%
GPT-4.1 Nano95614133046.0%
Gemma 3 4B86544829043.1%
Claude Sonnet 4.663636013040.1%
GPT-4o, Aug. 6th (temp=0)85613416039.2%
Nemotron 3 Nano7566530038.6%
Nemotron 3 Super100363224038.3%
Gemini 3.1 Flash Lite (Reasoning)63484430037.0%
Claude Sonnet 58841307534.2%
Claude Opus 4.65945245026.6%
Claude Haiku 4.545412420026.1%
GPT-5 Nano351040010.0%
ByteDance Seed 2.0 Lite3700007.4%
Ministral 3B1200002.3%
GPT-4o Mini (temp=1)000000.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
o4 Mini High100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
Hermes 3 405B100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Hermes 3 70B1001001001009899.6%
Gemini 2.5 Flash1001001001009799.4%
GPT-5.4 Mini (Reasoning)1001001001009699.3%
GPT-5.4 (Reasoning)1001001001009599.0%
GPT-4.110010099989498.4%
Qwen 2.5 72B100100100979498.2%
Grok 4.5 (Reasoning, High)1001001001009198.2%
GPT-5.6 Luna100100100989298.0%
GPT-5.4100100100959598.0%
GPT-5.51001001001008997.7%
GPT-5.4 Mini (Reasoning, Low)100100100969297.7%
Qwen 3.5 397B A17B1001001001008897.6%
WizardLM 2 8x22b100100100939296.9%
Gemini 3.5 Flash (Reasoning)1001001001008596.9%
Qwen 3.5 122B1001001001008396.7%
Aion 2.01001001001008296.3%
DeepSeek V3.11001001001008095.9%
GPT-5.5 (Reasoning)100100100988095.6%
GPT-5.6 Terra (Reasoning)1001001001007895.6%
Cohere Command R+ (Aug. 2024)100100100888694.9%
ByteDance Seed 1.6 Flash10010099928394.9%
Qwen 3.5 Plus (2026-04-20)1001001001007394.6%
Gemma 3 12B10010098947994.2%
GPT-5100100100888193.9%
GPT-5.11001001001006893.6%
Qwen 3.5 Flash100100100927593.3%
Qwen3.6 Max Preview10010092888693.2%
Xiaomi MIMO v2.510010094908193.1%
GPT-5.5 (Reasoning, Low)1001001001006392.7%
GPT-4o, Aug. 6th (temp=1)100100100986592.7%
GPT-4o Mini (temp=0)10010092868592.4%
Writer: Palmyra X510010098946992.2%
DeepSeek V3 (2024-12-26)100100100837691.9%
Z.AI GLM 4.51009996917091.2%
Qwen 3 32B100100100886891.1%
GPT-5 Mini10010097847190.5%
GPT-5.4 Mini1009987838089.9%
Qwen3 235B A22B Instruct 2507100100100974888.9%
Mistral Small 4100100100855988.8%
Mistral NeMO10010094915988.7%
DeepSeek-V2 Chat100100100925188.5%
Aion 3.01001001001004188.2%
Gemini 2.5 Flash (Reasoning)100100100895087.7%
Grok 4.20 (Reasoning)10010088797087.5%
Mistral Large 31009283797886.4%
Claude Opus 4.8 (Reasoning)100100100884185.7%
Grok 4.31009795954185.6%
Z.AI GLM 4.61009579787485.3%
Claude Opus 4.6 (Reasoning)10010096755485.1%
Z.AI GLM 4.7 Flash10010089815484.7%
Claude Sonnet 4.510010086716384.3%
Claude Opus 4.8 (Reasoning, Low)10010085716384.0%
GPT-4.1 Nano1009993755283.7%
Z.AI GLM 4.710010089755283.2%
Gemini 2.5 Pro10010094754182.0%
DeepSeek V4 Pro (Reasoning)100100100713180.5%
DeepSeek V3.2100100100584580.5%
Ministral 3B100100100100080.0%
GPT-4o Mini (temp=1)100100100524879.9%
Mistral Small 4 (Reasoning)10010083674979.7%
GPT-5.21009292882679.7%
Qwen 3.6 27B10010010098079.6%
Claude Opus 4.710010086594978.8%
Gemma 3 4B968585735278.1%
Qwen 3.5 35B10010010088077.6%
DeepSeek V4 Flash (Reasoning)10010086693377.4%
Mistral Small 3.2 24B100100100463075.4%
Gemma 4 31B (Reasoning)10010092522673.9%
Grok 4.3 (Reasoning)1001009474073.7%
Grok 4.5 (Reasoning, Low)1009182702473.2%
Gemma 4 26B (Reasoning)979579613273.0%
Z.AI GLM 5 Turbo938580545172.5%
Mistral Large 2100929179072.4%
Aion 3.0 Mini1008883513972.2%
MiniMax M2.71009276751371.1%
Claude Opus 4.7 (Reasoning)1001008371071.0%
Gemini 2.5 Flash Lite1008977711870.9%
Xiaomi MIMO v2.5 Pro1008171653169.7%
Mistral Medium 3.11007468564969.2%
MoonshotAI: Kimi K2.61001009055069.1%
Claude Opus 41007760584968.8%
Z.AI GLM 5.110010063433668.6%
Z.AI GLM 5.2 (Reasoning, High)997871573468.0%
GPT-5.4 Nano877971564266.8%
Claude Sonnet 4100867571066.4%
Ministral 3 3B1001009233766.3%
Cydonia 24B V4.1827371653866.0%
GPT-5.4 Nano (Reasoning)857759575065.8%
MoonshotAI: Kimi K2.51001009330064.6%
Gemini 3.5 Flash (Reasoning, Minimal)1001008427863.8%
Z.AI GLM 51008876351863.4%
GPT-4o, Aug. 6th (temp=0)937566522662.6%
Grok 4.201007656522662.1%
Z.AI GLM 4.5 Air100867050061.2%
Qwen 3.5 27B1001005448060.2%
Nemotron 3 Super836757494460.0%
Claude Sonnet 4.6 (Reasoning)100706862059.8%
Gemma 3 27B1005955434159.5%
Gemini 3.1 Flash Lite1007667431059.3%
Gemini 3 Flash (Preview)888352482458.9%
GPT-5.4 Nano (Reasoning, Low)727163454358.9%
Ministral 3 8B1006157373658.3%
DeepSeek V4 Pro100855452058.0%
Gemini 2.5 Flash Lite (Reasoning)887571261855.6%
Claude Sonnet 5100785141054.0%
Gemma 4 31B93757030053.7%
ByteDance Seed 1.6100905918053.3%
Gemini 3 Flash (Preview, Reasoning)100746329053.2%
Claude Sonnet 4.693767518052.4%
Gemini 3.1 Flash Lite (Reasoning)676547413751.3%
Ministral 8B100824131050.8%
Gemma 4 26B100493935746.0%
DeepSeek V4 Flash71715424945.8%
Qwen 3.5 Plus (2026-02-15)78545047045.7%
Gemini 3.1 Flash Lite (Preview)78494948044.7%
Inception Mercury 2807929201544.3%
MiniMax M370604341543.6%
ByteDance Seed 2.0 Mini92564124042.5%
Ministral 3 14B10054419040.7%
GPT-OSS 120B63623634039.1%
MiniMax M2.59290130039.0%
Claude Sonnet 5 (Reasoning, Low)8349460035.7%
Claude Opus 4.565452721733.1%
Nemotron 3 Nano1005600031.3%
Claude Opus 4.666393112330.2%
ByteDance Seed 2.0 Lite781550019.4%
Claude Sonnet 5 (Reasoning)3833214019.1%
Claude Haiku 4.548930011.9%
GPT-5 Nano4200008.5%

genre

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.6 Luna100100100969698.5%
GPT-5.6 Terra1001001001008797.3%
GPT-5.6 Luna (Reasoning)1001001001007394.6%
GPT-5.5 (Reasoning)100100100848092.8%
GPT-5.6 Terra (Reasoning)1001001001006092.0%
GPT-5.4 (Reasoning)1009894837690.2%
GPT-5.5 (Reasoning, Low)1009895837189.4%
GPT-5.51009288877889.0%
Hermes 3 405B10010095785886.2%
Qwen3.7 Max10010098755184.8%
Gemma 3 12B1009190865584.4%
Gemini 3.1 Pro (Preview)1008480797183.0%
GPT-5.4 (Reasoning, Low)10010099724382.8%
o4 Mini1008281735778.5%
GPT-4.1908979705877.2%
DeepSeek-V2 Chat1007869674171.0%
Mistral Large 2100888773069.5%
Qwen 3.5 9B1007068604568.5%
GPT-5928170623067.0%
GPT-5.41008171512966.5%
Qwen3.6 Max Preview1007860444164.5%
Grok 4.20847457514662.2%
Qwen 3.5 35B98747068062.1%
Mistral NeMO1009260362261.9%
Gemini 2.5 Flash Lite797363484361.2%
Qwen 3.5 122B10010045382160.8%
Z.AI GLM 4.6786057545260.2%
GPT-5.4 Nano (Reasoning, Low)747068533660.1%
o4 Mini High867469332858.0%
GPT-5.4 Mini (Reasoning)786767423457.3%
Qwen 2.5 72B98897420056.3%
Grok 4.20 (Reasoning)825352504556.3%
Mistral Small 4 (Reasoning)100746234054.0%
Qwen 3.5 397B A17B100696924052.4%
Qwen 3.5 27B868555221352.1%
GPT-5.4 Mini827939352551.9%
GPT-5.2665049484451.3%
Mistral Small 4785449413551.2%
GPT-5.4 Nano646156443050.9%
GPT-4o, Aug. 6th (temp=1)81735836750.8%
Mistral Small 3.2 24B100100492050.4%
Gemini 2.5 Pro100525241550.2%
Aion 2.0706565272049.2%
GPT-5.191634835648.7%
Writer: Palmyra X5928830181348.1%
GPT-5.4 Nano (Reasoning)7955403826