Matches word count

Test: N-Length Sentences

Avg. Score
81.0%
Scenarios
3

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite (Preview)100.0%$0.00011.2s100%
2Gemini 3.1 Flash Lite100.0%$0.00011.5s100%
3Inception Mercury 299.9%$0.00071.2s98%
4GPT-5.4 Nano (Reasoning)100.0%$0.00107.5s100%
5GPT-5.4 Mini (Reasoning, Low)100.0%$0.00256.3s100%
6Gemini 3 Flash (Preview)99.2%$0.00041.9s95%
7Nemotron 3 Super100.0%$0.000016.0s100%
8GPT-5.4 Mini (Reasoning)100.0%$0.00388.1s100%
9GPT-5.4 Nano (Reasoning, Low)99.5%$0.00085.7s95%
10GPT-OSS 120B99.8%$0.000420.3s98%
11GPT-5 Nano100.0%$0.001028.2s100%
12GPT-5.4 (Reasoning, Low)100.0%$0.009310.4s100%
13Gemini 3.1 Flash Lite (Reasoning)98.0%$0.00012.0s85%
14Grok 4.5 (Reasoning, Low)100.0%$0.009015.4s100%
15o4 Mini100.0%$0.008320.8s100%
16GPT-5.2100.0%$0.01115.0s100%
17Gemini 3 Flash (Preview, Reasoning)100.0%$0.01017.7s100%
18Qwen 3.5 Flash100.0%$0.002438.6s100%
19GPT-5 Mini99.3%$0.004326.2s94%
20Z.AI GLM 5 Turbo100.0%$0.01126.6s100%
21Gemma 4 26B96.0%$0.00003.8s79%
22GPT-5.4 (Reasoning)99.8%$0.01319.5s98%
23o4 Mini High100.0%$0.01127.6s100%
24Z.AI GLM 5.2 (Reasoning, High)100.0%$0.010031.0s100%
25Grok 4.3 (Reasoning)100.0%$0.007138.6s100%
26Grok 4.20 (Reasoning)99.4%$0.006926.9s94%
27Grok 4.5 (Reasoning, High)100.0%$0.01227.8s100%
28GPT-5.5 (Reasoning, Low)99.8%$0.01911.7s98%
29Gemini 3.5 Flash (Reasoning)100.0%$0.02310.4s100%
30MiniMax M2.598.8%$0.003139.2s90%
31MiniMax M2.798.9%$0.004144.4s93%
32GPT-5.199.7%$0.01726.6s97%
33Claude Opus 4.593.6%$0.00526.8s79%
34Claude Sonnet 5 (Reasoning)99.9%$0.02319.1s99%
35GPT-5.5 (Reasoning)99.9%$0.02513.6s98%
36Qwen 3.5 35B99.7%$0.01339.4s96%
37ByteDance Seed 2.0 Lite99.3%$0.005158.7s96%
38Claude Sonnet 5 (Reasoning, Low)100.0%$0.02520.7s100%
39MoonshotAI: Kimi K2.599.8%$0.008655.1s98%
40GPT-5.4 Mini88.4%$0.00061.1s71%
41GPT-4.188.1%$0.00122.8s73%
42Gemini 3.5 Flash (Reasoning, Minimal)88.4%$0.00111.6s68%
43Qwen 3.6 Flash96.0%$0.008723.4s78%
44Qwen 3.6 35B96.3%$0.007038.8s83%
45Gemma 4 31B88.9%$0.00018.6s67%
46Claude Opus 4.790.6%$0.00795.1s72%
47GPT-4o Mini (temp=0)86.1%$0.00019.2s69%
48Mistral Small 4 (Reasoning)90.4%$0.001516.7s70%
49Qwen 3.5 27B100.0%$0.0161.0m100%
50Aion 2.096.6%$0.003450.7s82%
51ByteDance Seed 1.695.8%$0.002731.1s71%
52Claude Opus 4.7 (Reasoning)98.7%$0.0338.9s93%
53GPT-5.486.7%$0.00194.4s63%
54MiniMax M399.0%$0.00431.3m89%
55Qwen3.7 Max100.0%$0.02650.1s100%
56Claude Opus 4.8 (Reasoning)99.9%$0.04218.1s99%
57Qwen 3.5 122B100.0%$0.02657.1s100%
58Llama 3.1 70B83.6%$0.00022.1s56%
59ByteDance Seed 1.6 Flash87.4%$0.000713.5s57%
60GPT-4o Mini (temp=1)84.5%$0.00016.1s56%
61Claude Opus 4.8 (Reasoning, Low)99.7%$0.04027.8s97%
62Qwen 3.5 9B100.0%$0.00132.1m100%
63GPT-599.9%$0.03151.9s99%
64Qwen 3.6 27B98.3%$0.0151.1m88%
65Gemma 4 31B (Reasoning)100.0%$0.00112.1m100%
66Qwen 3.5 Plus (2026-04-20)99.0%$0.0121.4m92%
67Mistral Medium 3.181.0%$0.00034.3s54%
68Claude Opus 487.2%$0.01513.2s66%
69Z.AI GLM 4.7 Flash91.7%$0.00181.3m77%
70Z.AI GLM 5.199.9%$0.0171.7m99%
71Claude Opus 4.683.8%$0.00557.6s53%
72GPT-4.1 Nano77.8%$0.00012.4s50%
73Z.AI GLM 598.5%$0.0111.6m89%
74MoonshotAI: Kimi K2.6100.0%$0.0161.9m100%
75GPT-4.1 Mini79.6%$0.00022.2s45%
76Claude Opus 4.6 (Reasoning)99.8%$0.05227.5s98%
77Claude Sonnet 4.581.9%$0.00336.0s46%
78Nemotron 3 Nano99.7%$0.00232.5m97%
79Gemini 3.1 Pro (Preview)100.0%$0.05143.9s100%
80Gemma 4 26B (Reasoning)99.4%$0.00192.4m94%
81Claude Sonnet 479.0%$0.00295.2s40%
82Qwen 2.5 72B77.4%$0.000316.6s44%
83Gemini 2.5 Pro85.2%$0.01816.6s57%
84ByteDance Seed 2.0 Mini99.5%$0.00262.7m98%
85GPT-4o, Aug. 6th (temp=1)74.4%$0.00152.4s35%
86Aion 3.091.2%$0.01757.7s61%
87GPT-5.574.9%$0.00324.0s35%
88Qwen3.6 Max Preview100.0%$0.0331.9m100%
89Gemma 3 27B72.9%$0.00005.4s31%
90Ministral 3 14B65.9%$0.00012.0s37%
91Gemini 2.5 Flash Lite (Reasoning)70.0%$0.00055.6s34%
92DeepSeek V3 (2025-03-24)70.2%$0.00016.9s28%
93Qwen3 235B A22B Instruct 250766.5%$0.00016.9s32%
94Claude Haiku 4.567.1%$0.00092.9s28%
95Xiaomi MIMO v2.5 Pro75.3%$0.003517.6s29%
96Claude Sonnet 4.670.1%$0.00244.6s25%
97GPT-4o, Aug. 6th (temp=0)67.5%$0.00132.2s23%
98DeepSeek V3 (2024-12-26)65.5%$0.00026.6s26%
99Writer: Palmyra X562.2%$0.00147.9s32%
100Claude Sonnet 4.6 (Reasoning)100.0%$0.07849.2s100%
101Z.AI GLM 4.795.1%$0.00652.5m71%
102DeepSeek V4 Pro (Reasoning)86.2%$0.00421.3m40%
103Mistral Small 458.1%$0.00011.6s23%
104Qwen 3.5 397B A17B100.0%$0.0253.0m100%
105Aion 3.0 Mini90.5%$0.00571.8m47%
106GPT-5.4 Nano58.0%$0.00021.4s20%
107Gemma 3 12B62.9%$0.00004.1s15%
108Grok 4.2059.1%$0.00032.1s19%
109Gemini 2.5 Flash (Reasoning)64.0%$0.00387.4s20%
110Mistral Small 3.2 24B54.7%$0.00012.6s22%
111DeepSeek V4 Pro63.9%$0.00037.9s12%
112Gemma 3 4B57.3%$0.00001.8s15%
113Hermes 3 405B58.2%$0.000011.9s18%
114Mistral Large 356.9%$0.00034.6s16%
115Qwen 3.5 Plus (2026-02-15)52.4%$0.00035.9s20%
116Gemini 2.5 Flash Lite51.9%$0.0000785ms16%
117Cydonia 24B V4.152.0%$0.00014.2s16%
118Xiaomi MIMO v2.555.3%$0.00168.1s16%
119Grok 4.352.1%$0.00021.4s14%
120DeepSeek V3.260.8%$0.000316.5s11%
121DeepSeek V3.153.6%$0.00019.1s14%
122Ministral 3 3B41.8%$0.00001.0s21%
123DeepSeek V4 Flash47.1%$0.00007.2s17%
124Cohere Command R+ (Aug. 2024)44.8%$0.00082.0s17%
125WizardLM 2 8x22b43.7%$0.00028.4s19%
126Claude Sonnet 548.2%$0.00357.5s16%
127Gemini 2.5 Flash44.0%$0.00031.3s12%
128DeepSeek V4 Flash (Reasoning)58.3%$0.000251.7s21%
129Ministral 3 8B41.6%$0.00001.5s10%
130Hermes 3 70B42.1%$0.00015.8s11%
131Qwen 3 32B38.4%$0.000313.8s19%
132Z.AI GLM 4.541.9%$0.00035.8s8%
133Z.AI GLM 4.5 Air38.0%$0.000512.9s12%
134Z.AI GLM 4.657.6%$0.003455.9s15%
135Mistral Large 237.5%$0.00072.9s7%
136Arcee AI: Trinity Mini31.3%$0.00013.2s11%
137Ministral 3B26.1%$0.0000768ms14%
138Ministral 8B28.4%$0.0000904ms7%
139DeepSeek-V2 Chat33.3%$0.000110.5s3%
140Mistral NeMO18.6%$0.00001.9s7%
81.02%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Z.AI GLM 4.71001001001001001001001001009999.9%
Aion 3.01001001001001001001001001009999.9%
Claude Sonnet 5 (Reasoning)1001001001001001001001001009999.9%
Claude Opus 4.71001001001001001001001001009899.8%
Llama 3.1 70B1001001001001001001001001009899.8%
Qwen 3.6 27B1001001001001001001001001009899.8%
GPT-OSS 120B1001001001001001001001001009899.8%
Claude Opus 4.8 (Reasoning)100100100100100100100100999899.7%
ByteDance Seed 1.61001001001001001001001001009699.6%
GPT-5.5100100100100100100100100989699.5%
MoonshotAI: Kimi K2.51001001001001001001001001009499.4%
Qwen 3.5 Plus (2026-04-20)10010010010010010010098989899.3%
ByteDance Seed 2.0 Mini10010010010010010010098989799.3%
GPT-5.11001001001001001001001001009299.2%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100959599.0%
Mistral Medium 3.11001001001001001009898979799.0%
ByteDance Seed 2.0 Lite100100100100100100100100989298.9%
Claude Opus 4.51001001001001001001001001008998.9%
MiniMax M2.71001001001001001001001001008998.9%
Gemini 2.5 Pro1001001001001001009897979698.9%
Aion 3.0 Mini1001001001001001001001001008898.8%
GPT-5.4 Mini100100100100100989898979698.6%
DeepSeek V4 Pro10010010010010010010098988998.5%
GPT-4o Mini (temp=0)10098989898989898989698.3%
Gemini 2.5 Flash Lite (Reasoning)1001001009998989897979698.3%
DeepSeek V4 Pro (Reasoning)10010010010010010010099948898.2%
GPT-4.1 Mini10010010010099989897969398.1%
Gemma 3 27B100100100100100989896969398.0%
Claude Opus 4.61001001001001001009895949397.9%
Claude Opus 4.7 (Reasoning)1001001001001001009995959097.8%
GPT-4o Mini (temp=1)1001001001001001009695949397.8%
Claude Opus 41001001001001001009795949397.8%
Gemini 2.5 Flash (Reasoning)10099999999979796959597.5%
GPT-5.41001001001001001009896918997.5%
Aion 2.010010010010010010010097908397.1%
GPT-4.1 Nano100100100100100989796918997.1%
Mistral Small 4 (Reasoning)10010010010098979694949196.9%
DeepSeek V3 (2025-03-24)100100100100100989898888196.3%
Z.AI GLM 4.7 Flash10010010010010010010096878096.3%
Gemma 3 12B1001001009896969696938796.0%
Qwen 3.6 Flash1001001001001001009494918095.9%
Z.AI GLM 4.610098989897969493929095.7%
Claude Sonnet 410010010010097979392918695.6%
GPT-4o, Aug. 6th (temp=1)100100999996959493918995.5%
Claude Sonnet 4.510010010010099969491898695.5%
Gemma 3 4B1001001009898989493897794.6%
DeepSeek V3 (2024-12-26)1001001001001001009693867094.5%
GPT-4o, Aug. 6th (temp=0)9896969493939393939294.2%
GPT-4.110098989897969689887893.7%
Qwen 3.6 35B100100100100100969291807893.6%
DeepSeek V3.2100100100100100999387787893.6%
Z.AI GLM 4.51001001009898988987828193.2%
DeepSeek V3.1100100999897979085848293.2%
Claude Haiku 4.59999999897929088868493.1%
Grok 4.31001001001001001008978787892.3%
Xiaomi MIMO v2.5 Pro10010010010099959480787392.0%
Qwen3 235B A22B Instruct 25079998949393929190868091.6%
Mistral Large 39693939391918989898991.4%
Grok 4.20100100989897979682826591.3%
Mistral Small 410096969693929187827690.8%
Gemini 2.5 Flash Lite10098969593918986867290.7%
Qwen 2.5 72B1001001001001001001009593088.9%
Claude Sonnet 59995939090888783807588.0%
ByteDance Seed 1.6 Flash100100969191898785726087.0%
Cydonia 24B V4.19894949393898579786486.7%
DeepSeek-V2 Chat10093918989828280787285.6%
Ministral 3 14B9391908988878080797284.9%
Mistral Small 3.2 24B9593919087858380776384.6%
Gemini 2.5 Flash9898959393928884644084.3%
Hermes 3 70B100100989290878769585683.7%
Hermes 3 405B9090888785848380766983.1%
Qwen 3.5 Plus (2026-02-15)10091827878787878787881.9%
GPT-5.4 Nano8987857878787875727078.9%
Writer: Palmyra X510098969083827876731178.6%
DeepSeek V4 Flash9391898583827069635377.8%
DeepSeek V4 Flash (Reasoning)9387878181807270615376.4%
Z.AI GLM 4.5 Air9696939389767652523776.1%
Xiaomi MIMO v2.51001001001009779786132174.8%
Mistral Large 29191918987827060521673.0%
Cohere Command R+ (Aug. 2024)9489827876766553513669.9%
Ministral 3 3B9384747464635656525066.5%
WizardLM 2 8x22b9189898581686450231065.0%
Ministral 8B100100787864564536322061.0%
Arcee AI: Trinity Mini9789767363534545272459.3%
Ministral 3 8B9693908555363497751.1%
Ministral 3B716464645252403720046.5%
Qwen 3 32B90846754342922131039.5%
Mistral NeMO72474537352221171129.8%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
GPT-51001001001001001001001001009899.8%
GPT-5 Mini1001001001001001001001001009799.7%
Claude Opus 4.51001001001001001001001001009799.7%
Gemma 4 31B1001001001001001001001001009799.7%
Claude Sonnet 5 (Reasoning)1001001001001001001001001009799.7%
Z.AI GLM 5.1100100100100100100100100989899.7%
GPT-OSS 120B1001001001001001001001001009699.6%
Inception Mercury 21001001001001001001001001009699.6%
ByteDance Seed 2.0 Lite100100100100100100100100989799.5%
Claude Opus 4.6 (Reasoning)100100100100100100100100989499.3%
Qwen 3.6 35B1001001001001001001001001009199.1%
Nemotron 3 Nano1001001001001001001001001009199.1%
ByteDance Seed 2.0 Mini10010010010010010010097979799.1%
Qwen 3.5 35B1001001001001001001001001009099.0%
Claude Opus 41001001001001001001001001008898.8%
MiniMax M2.51001001001001001001001001008898.8%
Aion 2.0100100100100100100100100979098.7%
Claude Opus 4.7100100100100100989898959498.4%
MiniMax M2.7100100100100100100100100898997.8%
DeepSeek V4 Pro (Reasoning)10010010010010010010098918897.8%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001001001009894949297.7%
Z.AI GLM 51001001001001001001001001007497.4%
Claude Sonnet 4.51001001001001001009897908797.2%
Llama 3.1 70B1001001001001001009795878496.4%
Qwen 3.6 Flash1001001001001001001001001004894.8%
Claude Opus 4.61001001001001001009998767494.7%
GPT-4o, Aug. 6th (temp=1)10097959595959595909094.6%
GPT-5.41001001009795959490878494.2%
Gemini 2.5 Pro1001001009696959190858493.9%
GPT-4o, Aug. 6th (temp=0)10095959592929292909093.3%
GPT-4o Mini (temp=1)9795959592929292908392.4%
GPT-4.1 Mini9797959292929190888492.0%
GPT-4.110097979592929290837991.8%
Claude Sonnet 4100100100100100979088746991.8%
GPT-5.51001001009594909084807991.1%
DeepSeek V4 Pro100100979594939287747290.4%
Z.AI GLM 4.710010010010010010010090743990.3%
Gemma 3 27B9592929292909087848389.7%
Z.AI GLM 4.7 Flash10010010010096967977747489.7%
Xiaomi MIMO v2.5 Pro10010010010091878779777489.6%
DeepSeek V3.2100100979595909090725988.8%
GPT-4o Mini (temp=0)9290909090909087848488.6%
Hermes 3 405B9797929288878787846787.9%
ByteDance Seed 1.610010010010010010010095424187.8%
Gemma 3 12B9592929090878785847487.6%
GPT-5.4 Nano9795929290878484817187.4%
GPT-5.4 Mini9494939189898786856587.3%
Qwen 2.5 72B100100929190888583653783.3%
Mistral Medium 3.19592909090797977726883.2%
DeepSeek V3 (2025-03-24)9797929284747474727283.1%
ByteDance Seed 1.6 Flash1001001001009594837776382.8%
Aion 3.0 Mini10010010010098979797261182.7%
Gemini 2.5 Flash (Reasoning)9789878685847875716581.7%
Mistral Small 4 (Reasoning)100100979087807565585080.2%
DeepSeek V3 (2024-12-26)9290898787827770655979.9%
Aion 3.0100100100100100787474383579.9%
Claude Haiku 4.58989868682777474716779.5%
Claude Sonnet 4.610097747474747474747478.9%
Mistral Large 39090908484848266595978.8%
GPT-4.1 Nano8484838382777572665576.1%
Ministral 3 14B9288858076757271695275.9%
Gemma 3 4B8888878077757265635274.8%
Writer: Palmyra X58987877876757373544873.9%
Qwen3 235B A22B Instruct 25079592908785797362432373.0%
Ministral 3 8B9087858480727263504272.6%
Grok 4.209587848477736357534972.3%
Qwen 3.5 Plus (2026-02-15)10084847472727065523570.9%
Xiaomi MIMO v2.510091847675746251493770.0%
Mistral Small 49580807876756159484569.8%
Gemini 2.5 Flash Lite (Reasoning)9587878483756843403069.2%
DeepSeek V4 Flash (Reasoning)10095787777737140371866.6%
DeepSeek V3.18484838279756739373166.2%
Cydonia 24B V4.19290858180746336342566.1%
Z.AI GLM 4.610093878074705542351865.2%
Mistral Small 3.2 24B8079777064595752514863.8%
DeepSeek V4 Flash9078767069675848453563.5%
Grok 4.310083747474685230302461.0%
Cohere Command R+ (Aug. 2024)9584817070595656181060.0%
WizardLM 2 8x22b7774666659575452462057.1%
Claude Sonnet 57070686764634645423056.5%
Gemini 2.5 Flash Lite8574736161605039372256.2%
Ministral 3 3B827865645856545315752.9%
Gemini 2.5 Flash6962625452504541271447.6%
Qwen 3 32B7366634645373427241643.1%
Mistral Large 28173574643281919171439.6%
Hermes 3 70B8157424140363087634.6%
Z.AI GLM 4.556544839393925118532.5%
Arcee AI: Trinity Mini64525138343124157732.3%
Z.AI GLM 4.5 Air433737363026241411426.2%
Mistral NeMO574845242415141110925.7%
Ministral 3B39323130272626217624.5%
Ministral 8B49363428281615100021.6%
DeepSeek-V2 Chat2523181815131087414.2%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)1001001001001001001001001009699.6%
GPT-5.5 (Reasoning, Low)1001001001001001001001001009599.5%
GPT-5.4 (Reasoning)1001001001001001001001001009499.4%
ByteDance Seed 2.0 Lite1001001001001001001001001009399.3%
GPT-5.4 Nano (Reasoning, Low)1001001001001001001001001008698.6%
Claude Opus 4.7 (Reasoning)1001001001001001001001001008398.3%
Grok 4.20 (Reasoning)1001001001001001001001001008398.3%
Gemma 4 26B (Reasoning)1001001001001001001001001008398.3%
GPT-5 Mini1001001001001001001001001008398.3%
Z.AI GLM 51001001001001001001001001008098.0%
Qwen 3.5 Plus (2026-04-20)1001001001001001001001001007697.6%
MiniMax M2.51001001001001001001001001007597.5%
Gemini 3 Flash (Preview)1001001001001001009595949097.5%
Qwen 3.6 Flash1001001001001001001001001007297.2%
MiniMax M31001001001001001001001001007097.0%
Qwen 3.6 35B1001001001001001001001001006196.1%
Z.AI GLM 4.71001001001001001001001001005195.1%
Qwen 3.6 27B10010010010010010010092906995.1%
Mistral Small 4 (Reasoning)10010010010094939090898494.1%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100707094.1%
Aion 2.010010010010010010010093925493.9%
Aion 3.01001001001001001001001001003793.7%
ByteDance Seed 1.6 Flash1001001001001001008783787592.3%
Aion 3.0 Mini100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100939074746089.2%
Gemma 4 26B100100100100100929274616187.9%
Claude Opus 4.510096888884807575746082.1%
GPT-5.4 Mini10092878378767474705979.3%
GPT-4.19392858484807272675778.7%
Claude Opus 4.78380808077767370665073.5%
GPT-4o Mini (temp=0)7272727272727272726871.3%
GPT-5.410090807067665959514068.4%
Gemini 3.5 Flash (Reasoning, Minimal)9274747069656161565567.6%
Gemma 4 31B9084666561616161616166.9%
Claude Opus 48375706666616161565365.1%
GPT-4o Mini (temp=1)10080767270655955342363.2%
DeepSeek V4 Pro (Reasoning)10010010010093706300062.7%
Gemini 2.5 Pro8380808078595751382062.7%
Mistral Medium 3.17672686867615857542960.9%
GPT-4.1 Nano7676766564595957383060.1%
Qwen 2.5 72B10061616161616161403560.0%
Claude Opus 4.610093806155474737373258.9%
Llama 3.1 70B7469605854535046433854.5%
Claude Sonnet 4.5927269655958494220252.9%
Claude Sonnet 4917876726649321712349.7%
GPT-4.1 Mini878259595142383432448.8%
Xiaomi MIMO v2.5 Pro100100928823201910044.3%
Gemini 2.5 Flash Lite (Reasoning)6765555352493525131042.4%
Ministral 3 14B65514946444232324336.8%
Qwen3 235B A22B Instruct 2507755857393931241312034.8%
GPT-5.5595943424237311810234.2%
Writer: Palmyra X571585144383722148034.2%
GPT-4o, Aug. 6th (temp=1)595752463427221412933.2%
Qwen 3 32B56554847382824207332.5%
DeepSeek V4 Flash (Reasoning)1001001002000000032.0%
Claude Sonnet 4.687773432232322151031.4%
DeepSeek V3 (2025-03-24)74585139272418118031.1%
Gemma 3 27B6056534744281722230.9%
Claude Haiku 4.5676657503610000028.7%
DeepSeek V3 (2024-12-26)49443521211918102022.0%
Xiaomi MIMO v2.51008321510000021.0%
Mistral Small 3.2 24B5147271975100015.7%
GPT-4o, Aug. 6th (temp=0)2519171513131212121114.9%
Mistral Small 449251916139600013.7%
Grok 4.204742341100000013.5%
Gemini 2.5 Flash (Reasoning)5134121096310012.8%
Z.AI GLM 4.659367653200011.9%
Z.AI GLM 4.5 Air373231772000011.6%
Gemini 2.5 Flash Lite4734422000008.9%
WizardLM 2 8x22b41211455110008.9%
Hermes 3 70B27161587600007.9%
GPT-5.4 Nano4711444331007.7%
Ministral 3B231915114000007.3%
Ministral 3 3B23191042200005.9%
Gemma 3 12B1313992220005.1%
Cohere Command R+ (Aug. 2024)2519000000004.5%
Qwen 3.5 Plus (2026-02-15)2312332000004.4%
Hermes 3 405B2016000000003.6%
Grok 4.3301000000003.2%
Cydonia 24B V4.11310620000003.1%
DeepSeek V4 Pro126640000002.8%
Gemma 3 4B1210210000002.5%
Ministral 8B137221000002.5%
Arcee AI: Trinity Mini88700000002.2%
DeepSeek V3.176000000001.3%
Ministral 3 8B91000000001.0%
Mistral Large 321110000000.5%
DeepSeek V4 Flash20000000000.2%
Mistral NeMO20000000000.2%
DeepSeek V3.210000000000.1%
Claude Sonnet 500000000000.0%
Gemini 2.5 Flash00000000000.0%
DeepSeek-V2 Chat00000000000.0%
Z.AI GLM 4.500000000000.0%
Mistral Large 200000000000.0%