Contains a count of nouns

Test: Novel outline

Avg. Score
80.6%
Scenarios
5

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.4 Mini (Reasoning, Low)100.0%$0.00152.6s100%
2Gemini 2.5 Flash (Reasoning)100.0%$0.00152.8s100%
3GPT-5.4 (Reasoning, Low)100.0%$0.00252.6s100%
4Gemini 3 Flash (Preview, Reasoning)100.0%$0.00243.6s100%
5o4 Mini100.0%$0.00235.1s100%
6DeepSeek V4 Flash (Reasoning)100.0%$0.00018.4s100%
7GPT-5.4 (Reasoning)100.0%$0.00286.0s100%
8o4 Mini High100.0%$0.00286.5s100%
9Grok 4.20 (Reasoning)100.0%$0.00306.6s100%
10Qwen 3.6 35B100.0%$0.00178.8s100%
11GPT-5.5 (Reasoning, Low)100.0%$0.00932.7s100%
12GPT-5 Nano100.0%$0.000413.0s100%
13GPT-5.5 (Reasoning)100.0%$0.00993.5s100%
14Gemini 3.5 Flash (Reasoning)100.0%$0.00973.9s100%
15Claude Sonnet 5 (Reasoning, Low)100.0%$0.00835.4s100%
16Gemini 2.5 Flash Lite (Reasoning)98.0%$0.00032.0s72%
17Qwen 3.5 Flash100.0%$0.000814.3s100%
18Qwen 3.5 35B100.0%$0.003911.7s100%
19Gemini 2.5 Pro100.0%$0.00896.4s100%
20Aion 2.0100.0%$0.002013.7s100%
21Qwen 3.5 122B100.0%$0.005010.8s100%
22MoonshotAI: Kimi K2.5100.0%$0.002013.9s100%
23Claude Opus 4.6100.0%$0.0124.1s100%
24GPT-5.198.0%$0.00174.1s72%
25GPT-5 Mini98.0%$0.00106.9s72%
26Gemini 3.1 Pro (Preview)100.0%$0.0119.2s100%
27MoonshotAI: Kimi K2.6100.0%$0.002918.7s100%
28Claude Opus 4.6 (Reasoning)100.0%$0.0156.0s100%
29GPT-5.4 Mini (Reasoning)96.0%$0.00163.1s61%
30Claude Opus 4.7 (Reasoning)100.0%$0.0193.1s100%
31Claude Sonnet 598.0%$0.00654.1s72%
32Qwen 3.5 Plus (2026-04-20)100.0%$0.003419.9s100%
33Z.AI GLM 5.1100.0%$0.004520.6s100%
34Qwen 3.5 27B100.0%$0.003621.8s100%
35Qwen 3.6 Flash96.0%$0.00215.9s61%
36Claude Sonnet 5 (Reasoning)98.0%$0.00825.3s72%
37Inception Mercury 292.0%$0.0003513ms46%
38Claude Sonnet 4.6 (Reasoning)98.0%$0.00945.7s72%
39MiniMax M2.596.0%$0.00079.1s61%
40Qwen3.7 Max100.0%$0.01215.8s100%
41GPT-5.294.0%$0.00252.9s53%
42GPT-OSS 120B96.0%$0.000310.1s61%
43MiniMax M396.0%$0.00079.8s61%
44Gemma 4 26B (Reasoning)100.0%$0.000328.2s100%
45Claude Opus 4.8 (Reasoning)100.0%$0.0225.2s100%
46Xiaomi MIMO v2.5 Pro94.0%$0.00146.8s53%
47Gemma 4 31B (Reasoning)100.0%$0.000430.7s100%
48Z.AI GLM 5 Turbo92.0%$0.00194.6s46%
49DeepSeek V4 Pro (Reasoning)98.0%$0.001520.5s72%
50Claude Sonnet 494.0%$0.00754.2s53%
51Gemini 3.1 Flash Lite (Reasoning)88.0%$0.00071.2s35%
52Gemini 3.1 Flash Lite88.0%$0.00061.4s35%
53Qwen3.6 Max Preview100.0%$0.009026.1s100%
54Qwen 3.6 27B96.0%$0.004416.7s61%
55GPT-5.4 Nano (Reasoning, Low)86.0%$0.00042.9s31%
56Aion 3.0 Mini94.0%$0.001216.1s53%
57Qwen 3.5 397B A17B100.0%$0.005734.3s100%
58Claude Opus 4.8 (Reasoning, Low)98.0%$0.0225.3s72%
59Gemini 3.1 Flash Lite (Preview)84.0%$0.00061.1s27%
60Nemotron 3 Super90.0%$0.000011.3s40%
61Aion 3.092.0%$0.00519.9s46%
62GPT-4.186.0%$0.00223.5s31%
63DeepSeek V3.290.0%$0.000411.9s40%
64Z.AI GLM 4.7 Flash92.0%$0.000415.7s46%
65Qwen3 235B A22B Instruct 250790.0%$0.000312.5s40%
66Z.AI GLM 5.2 (Reasoning, High)88.0%$0.00247.2s35%
67MiniMax M2.786.0%$0.00077.2s31%
68GPT-5.4 Nano (Reasoning)82.0%$0.00052.8s23%
69Mistral Small 4 (Reasoning)82.0%$0.00043.4s23%
70Claude Opus 4.590.0%$0.0133.8s40%
71Claude Sonnet 4.586.0%$0.00743.4s31%
72Z.AI GLM 590.0%$0.002415.8s40%
73ByteDance Seed 1.6 Flash80.0%$0.00045.2s20%
74Z.AI GLM 4.696.0%$0.001931.1s61%
75Qwen 3 32B86.0%$0.000515.3s31%
76Z.AI GLM 4.796.0%$0.001732.6s61%
77Ministral 3 14B76.0%$0.00033.0s15%
78Mistral Large 282.0%$0.00446.2s23%
79Gemma 4 31B78.0%$0.00026.6s17%
80Mistral NeMO74.0%$0.00022.4s12%
81Claude Haiku 4.576.0%$0.00262.4s15%
82DeepSeek V3 (2025-03-24)82.0%$0.000612.1s23%
83Grok 4.5 (Reasoning, High)80.0%$0.00417.3s20%
84Gemini 3.5 Flash (Reasoning, Minimal)74.0%$0.00351.4s12%
85Ministral 3 8B70.0%$0.00021.7s8%
86Grok 4.2072.0%$0.00182.2s10%
87Grok 4.5 (Reasoning, Low)78.0%$0.00337.6s17%
88Grok 4.3 (Reasoning)82.0%$0.003013.1s23%
89Qwen 3.5 9B96.0%$0.000639.5s61%
90ByteDance Seed 1.680.0%$0.001513.5s20%
91Claude Opus 4.784.0%$0.0172.3s27%
92Qwen 3.5 Plus (2026-02-15)78.0%$0.001611.7s17%
93Mistral Medium 3.168.0%$0.00092.9s7%
94GPT-4.1 Mini66.0%$0.00021.8s5%
95Cydonia 24B V4.168.0%$0.00034.1s7%
96Claude Sonnet 4.672.0%$0.00642.1s10%
97DeepSeek V3 (2024-12-26)70.0%$0.00076.4s8%
98Xiaomi MIMO v2.568.0%$0.00094.5s7%
99DeepSeek V4 Flash64.0%$0.00012.6s4%
100Arcee AI: Trinity Mini64.0%$0.00013.4s4%
101Gemma 3 12B64.0%$0.00013.8s4%
102Z.AI GLM 4.5 Air74.0%$0.000613.6s12%
103Ministral 3 3B60.0%$0.00021.2s2%
104Llama 3.1 70B66.0%$0.00115.8s5%
105Z.AI GLM 4.566.0%$0.00077.2s5%
106ByteDance Seed 2.0 Lite80.0%$0.002121.0s20%
107GPT-5.4 Nano58.0%$0.00042.3s1%
108DeepSeek-V2 Chat64.0%$0.00038.0s4%
109Nemotron 3 Nano66.0%$0.000210.1s5%
110Gemini 3 Flash (Preview)56.0%$0.00121.6s1%
111Mistral Small 454.0%$0.00021.5s0%
112Writer: Palmyra X566.0%$0.00259.1s5%
113GPT-5.456.0%$0.00221.6s1%
114Ministral 8B52.0%$0.00021.4s0%
115Gemma 4 26B60.0%$0.00027.5s2%
116DeepSeek V3.164.0%$0.000410.9s4%
117Mistral Large 354.0%$0.00102.6s0%
118Ministral 3B50.0%$0.00011.2s0%
119Qwen 2.5 72B58.0%$0.00066.5s1%
120Gemini 2.5 Flash Lite48.0%$0.0001482ms0%
121Gemini 2.5 Flash48.0%$0.0002535ms0%
122DeepSeek V4 Pro60.0%$0.00109.4s2%
123GPT-4o Mini (temp=1)46.0%$0.0002919ms0%
124Hermes 3 70B50.0%$0.00063.6s0%
125Gemma 3 4B42.0%$0.00011.1s0%
126WizardLM 2 8x22b52.0%$0.00156.3s0%
127Gemma 3 27B46.0%$0.00024.4s0%
128GPT-4o Mini (temp=0)40.0%$0.0002811ms0%
129GPT-558.0%$0.00429.0s1%
130GPT-4.1 Nano40.0%$0.00011.3s0%
131GPT-4o, Aug. 6th (temp=1)46.0%$0.00381.3s0%
132GPT-5.4 Mini40.0%$0.0011651ms0%
133Mistral Small 3.2 24B42.0%$0.00023.0s0%
134GPT-5.550.0%$0.00731.2s0%
135GPT-4o, Aug. 6th (temp=0)44.0%$0.00371.2s0%
136Grok 4.340.0%$0.00141.7s0%
137Cohere Command R+ (Aug. 2024)44.0%$0.00492.9s0%
138Hermes 3 405B44.0%$0.00008.1s0%
139Claude Opus 484.0%$0.0379.8s27%
140ByteDance Seed 2.0 Mini76.0%$0.000839.1s15%
80.56%

Individual Scenarios

outline-count

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
Ministral 3B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Grok 4.3100100100100100100100100100090.0%
GPT-5100100100100100100000060.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
GPT-5100100100100100100100100100090.0%
Aion 3.0 Mini100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Ministral 3B1001001001001001001001000080.0%
ByteDance Seed 2.0 Mini10010010010000000040.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100090.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Aion 3.0100100100100100100100100100090.0%
Z.AI GLM 4.7100100100100100100100100100090.0%
Z.AI GLM 4.6100100100100100100100100100090.0%
MiniMax M2.5100100100100100100100100100090.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Mistral Small 4 (Reasoning)100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Mistral NeMO100100100100100100100100100090.0%
Claude Opus 4.51001001001001001001001000080.0%
Claude Sonnet 41001001001001001001001000080.0%
Claude Sonnet 4.51001001001001001001001000080.0%
GPT-OSS 120B1001001001001001001001000080.0%
Mistral Large 21001001001001001001001000080.0%
Grok 4.201001001001001001001001000080.0%
Qwen3 235B A22B Instruct 25071001001001001001001001000080.0%
Z.AI GLM 510010010010010010010000070.0%
ByteDance Seed 1.610010010010010010010000070.0%
GPT-5.210010010010010010010000070.0%
MiniMax M2.710010010010010010010000070.0%
Gemini 3.1 Flash Lite10010010010010010010000070.0%
DeepSeek V3.210010010010010010010000070.0%
Z.AI GLM 5 Turbo100100100100100100000060.0%
GPT-4.1100100100100100100000060.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100000060.0%
ByteDance Seed 2.0 Mini100100100100100100000060.0%
Inception Mercury 2100100100100100100000060.0%
Xiaomi MIMO v2.51001001001001000000050.0%
Claude Haiku 4.51001001001001000000050.0%
GPT-5.4 Nano (Reasoning)1001001001001000000050.0%
Nemotron 3 Nano1001001001001000000050.0%
Ministral 3 3B1001001001001000000050.0%
Gemini 3.1 Flash Lite (Preview)10010010010000000040.0%
Gemma 4 31B10010010010000000040.0%
DeepSeek V3 (2024-12-26)10010010010000000040.0%
Claude Sonnet 4.6100100100000000030.0%
Claude Opus 4100100100000000030.0%
ByteDance Seed 2.0 Lite100100100000000030.0%
DeepSeek-V2 Chat100100100000000030.0%
Z.AI GLM 4.5 Air100100100000000030.0%
Mistral Small 4100100100000000030.0%
Cydonia 24B V4.1100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
Claude Opus 4.71001000000000020.0%
Z.AI GLM 4.51001000000000020.0%
Gemma 4 26B1001000000000020.0%
DeepSeek V4 Flash1001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Ministral 3 14B1001000000000020.0%
GPT-5.510000000000010.0%
Qwen 3.5 Plus (2026-02-15)10000000000010.0%
GPT-5.410000000000010.0%
Mistral Large 310000000000010.0%
DeepSeek V3.110000000000010.0%
DeepSeek V4 Pro10000000000010.0%
GPT-4.1 Mini10000000000010.0%
Writer: Palmyra X510000000000010.0%
GPT-4o Mini (temp=1)10000000000010.0%
Llama 3.1 70B10000000000010.0%
Mistral Medium 3.110000000000010.0%
Gemma 3 12B10000000000010.0%
Ministral 3 8B10000000000010.0%
Hermes 3 70B10000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Ministral 8B10000000000010.0%
Gemini 3.5 Flash (Reasoning, Minimal)00000000000.0%
Gemini 3 Flash (Preview)00000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
GPT-4o, Aug. 6th (temp=1)00000000000.0%
Hermes 3 405B00000000000.0%
Gemini 2.5 Flash00000000000.0%
GPT-5.4 Mini00000000000.0%
Gemini 2.5 Flash Lite00000000000.0%
Grok 4.300000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 27B00000000000.0%
Qwen 2.5 72B00000000000.0%
GPT-4.1 Nano00000000000.0%
Gemma 3 4B00000000000.0%
Ministral 3B00000000000.0%

pov-count

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100090.0%
GPT-5.1100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
ByteDance Seed 1.6100100100100100100100100100090.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
Z.AI GLM 4.7100100100100100100100100100090.0%
MiniMax M2.5100100100100100100100100100090.0%
Gemini 3.1 Flash Lite100100100100100100100100100090.0%
Xiaomi MIMO v2.5100100100100100100100100100090.0%
Claude Haiku 4.5100100100100100100100100100090.0%
DeepSeek V3.1100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100090.0%
Grok 4.5 (Reasoning, Low)1001001001001001001001000080.0%
MiniMax M31001001001001001001001000080.0%
Z.AI GLM 51001001001001001001001000080.0%
Qwen 3.5 Plus (2026-02-15)1001001001001001001001000080.0%
Xiaomi MIMO v2.5 Pro1001001001001001001001000080.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001001001001001000080.0%
Z.AI GLM 4.7 Flash1001001001001001001001000080.0%
Qwen 3 32B1001001001001001001001000080.0%
Writer: Palmyra X51001001001001001001001000080.0%
ByteDance Seed 1.6 Flash1001001001001001001001000080.0%
Grok 4.5 (Reasoning, High)10010010010010010010000070.0%
Claude Opus 4.510010010010010010010000070.0%
MiniMax M2.710010010010010010010000070.0%
Z.AI GLM 4.510010010010010010010000070.0%
GPT-5.410010010010010010010000070.0%
DeepSeek-V2 Chat10010010010010010010000070.0%
DeepSeek V4 Flash10010010010010010010000070.0%
Mistral Large 210010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
GPT-5.4 Nano (Reasoning)10010010010010010010000070.0%
Mistral Small 4 (Reasoning)10010010010010010010000070.0%
Llama 3.1 70B10010010010010010010000070.0%
Cydonia 24B V4.110010010010010010010000070.0%
Grok 4.3 (Reasoning)100100100100100100000060.0%
Gemma 4 31B100100100100100100000060.0%
Mistral Large 3100100100100100100000060.0%
DeepSeek V3 (2024-12-26)100100100100100100000060.0%
Nemotron 3 Super100100100100100100000060.0%
Grok 4.20100100100100100100000060.0%
Nemotron 3 Nano100100100100100100000060.0%
Ministral 3 14B100100100100100100000060.0%
Ministral 3 8B100100100100100100000060.0%
Gemini 3 Flash (Preview)1001001001001000000050.0%
Gemma 4 26B1001001001001000000050.0%
DeepSeek V3 (2025-03-24)1001001001001000000050.0%
GPT-5.510010010010000000040.0%
Gemini 2.5 Flash Lite10010010010000000040.0%
Mistral Small 410010010010000000040.0%
Qwen 2.5 72B10010010010000000040.0%
Ministral 3 3B10010010010000000040.0%
Mistral NeMO10010010010000000040.0%
Ministral 8B10010010010000000040.0%
Claude Sonnet 4.6100100100000000030.0%
DeepSeek V4 Pro100100100000000030.0%
GPT-4.1 Mini100100100000000030.0%
GPT-4o, Aug. 6th (temp=1)100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
Ministral 3B100100100000000030.0%
GPT-51001000000000020.0%
GPT-4o, Aug. 6th (temp=0)1001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Hermes 3 70B1001000000000020.0%
Hermes 3 405B10000000000010.0%
Grok 4.310000000000010.0%
Arcee AI: Trinity Mini10000000000010.0%
Gemma 3 4B10000000000010.0%
Gemini 2.5 Flash00000000000.0%
GPT-5.4 Mini00000000000.0%
GPT-4o Mini (temp=1)00000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 27B00000000000.0%
GPT-4.1 Nano00000000000.0%
Cohere Command R+ (Aug. 2024)00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
Z.AI GLM 4.6100100100100100100100100100090.0%
Claude Sonnet 4100100100100100100100100100090.0%
Claude Sonnet 5100100100100100100100100100090.0%
Claude Opus 4100100100100100100100100100090.0%
MiniMax M2.7100100100100100100100100100090.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100090.0%
Gemma 4 31B100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Nemotron 3 Super100100100100100100100100100090.0%
GPT-4.1 Mini100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Gemini 3.1 Flash Lite (Reasoning)1001001001001001001001000080.0%
ByteDance Seed 2.0 Mini1001001001001001001001000080.0%
Gemini 3.1 Flash Lite (Preview)1001001001001001001001000080.0%
Gemini 3.1 Flash Lite1001001001001001001001000080.0%
Aion 3.0 Mini1001001001001001001001000080.0%
DeepSeek V3.21001001001001001001001000080.0%
Ministral 3 8B1001001001001001001001000080.0%
Aion 3.010010010010010010010000070.0%
GPT-4.110010010010010010010000070.0%
ByteDance Seed 2.0 Lite10010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
Qwen3 235B A22B Instruct 250710010010010010010010000070.0%
Grok 4.3 (Reasoning)100100100100100100000060.0%
DeepSeek V4 Pro100100100100100100000060.0%
Mistral Large 2100100100100100100000060.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001001000000050.0%
Claude Sonnet 4.51001001001001000000050.0%
DeepSeek V3 (2024-12-26)1001001001001000000050.0%
Mistral Small 4 (Reasoning)1001001001001000000050.0%
Qwen 3 32B1001001001001000000050.0%
GPT-5.4 Nano (Reasoning, Low)1001001001001000000050.0%
Llama 3.1 70B1001001001001000000050.0%
Qwen 2.5 72B1001001001001000000050.0%
ByteDance Seed 1.610010010010000000040.0%
Z.AI GLM 4.510010010010000000040.0%
Claude Haiku 4.510010010010000000040.0%
Gemini 2.5 Flash10010010010000000040.0%
Writer: Palmyra X510010010010000000040.0%
Cydonia 24B V4.110010010010000000040.0%
ByteDance Seed 1.6 Flash10010010010000000040.0%
Mistral NeMO10010010010000000040.0%
Ministral 3B10010010010000000040.0%
Grok 4.5 (Reasoning, High)100100100000000030.0%
Gemini 3 Flash (Preview)100100100000000030.0%
Gemma 4 26B100100100000000030.0%
DeepSeek V4 Flash100100100000000030.0%
Mistral Medium 3.1100100100000000030.0%
Gemma 3 27B100100100000000030.0%
Nemotron 3 Nano100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
GPT-51001000000000020.0%
DeepSeek-V2 Chat1001000000000020.0%
DeepSeek V3.11001000000000020.0%
Grok 4.201001000000000020.0%
GPT-4o Mini (temp=1)1001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Hermes 3 70B1001000000000020.0%
Grok 4.5 (Reasoning, Low)10000000000010.0%
Hermes 3 405B10000000000010.0%
Mistral Small 3.2 24B10000000000010.0%
Gemma 3 12B10000000000010.0%
Arcee AI: Trinity Mini10000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Ministral 3 3B10000000000010.0%
Ministral 8B10000000000010.0%
GPT-5.500000000000.0%
GPT-5.400000000000.0%
Mistral Large 300000000000.0%
Xiaomi MIMO v2.500000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
GPT-4o, Aug. 6th (temp=1)00000000000.0%
GPT-5.4 Mini00000000000.0%
Gemini 2.5 Flash Lite00000000000.0%
Grok 4.300000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Mistral Small 400000000000.0%
GPT-4.1 Nano00000000000.0%
Gemma 3 4B00000000000.0%