Contains a count of nouns

Test: Novel outline

Avg. Score
80.3%
Scenarios
5

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1GPT-5.4 Mini (Reasoning, Low)100.0%$0.00152.6s100%
2Gemini 2.5 Flash (Reasoning)100.0%$0.00152.8s100%
3GPT-5.4 (Reasoning, Low)100.0%$0.00252.6s100%
4Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.00302.8s100%
5Gemini 3 Flash (Preview, Reasoning)100.0%$0.00243.6s100%
6o4 Mini100.0%$0.00235.1s100%
7Muse Spark 1.1 (Reasoning, Medium)100.0%$0.00383.9s100%
8DeepSeek V4 Flash (Reasoning)100.0%$0.00018.4s100%
9GPT-5.4 (Reasoning)100.0%$0.00286.0s100%
10o4 Mini High100.0%$0.00286.5s100%
11Grok 4.20 (Reasoning)100.0%$0.00306.6s100%
12Gemini 3.6 Flash (Reasoning)100.0%$0.00713.0s100%
13Qwen 3.6 35B100.0%$0.00178.8s100%
14GPT-5.5 (Reasoning, Low)100.0%$0.00932.7s100%
15GPT-5 Nano100.0%$0.000413.0s100%
16GPT-5.5 (Reasoning)100.0%$0.00993.5s100%
17Gemini 3.5 Flash (Reasoning)100.0%$0.00973.9s100%
18Claude Sonnet 5 (Reasoning, Low)100.0%$0.00835.4s100%
19Gemini 2.5 Flash Lite (Reasoning)98.0%$0.00032.0s72%
20Qwen 3.5 Flash100.0%$0.000814.3s100%
21Qwen 3.5 35B100.0%$0.003911.7s100%
22Gemini 2.5 Pro100.0%$0.00896.4s100%
23Aion 2.0100.0%$0.002013.7s100%
24Qwen 3.5 122B100.0%$0.005010.8s100%
25MoonshotAI: Kimi K2.5100.0%$0.002013.9s100%
26MoonshotAI: Kimi K3 (Reasoning, High)100.0%$0.005610.6s100%
27Claude Opus 4.6100.0%$0.0124.1s100%
28GPT-5.198.0%$0.00174.1s72%
29Thinking Machines Inkling (Reasoning)100.0%$0.002515.7s100%
30GPT-5 Mini98.0%$0.00106.9s72%
31Gemini 3.1 Pro (Preview)100.0%$0.0119.2s100%
32MoonshotAI: Kimi K2.6100.0%$0.002918.7s100%
33Claude Opus 4.6 (Reasoning)100.0%$0.0156.0s100%
34GPT-5.4 Mini (Reasoning)96.0%$0.00163.1s61%
35Claude Opus 4.7 (Reasoning)100.0%$0.0193.1s100%
36Claude Sonnet 598.0%$0.00654.1s72%
37Qwen 3.5 Plus (2026-04-20)100.0%$0.003419.9s100%
38MoonshotAI: Kimi K3 (Reasoning, Low)98.0%$0.00418.4s72%
39Z.AI GLM 5.1100.0%$0.004520.6s100%
40Qwen 3.5 27B100.0%$0.003621.8s100%
41GPT-5.6 Terra (Reasoning)94.0%$0.00191.6s53%
42Qwen 3.6 Flash96.0%$0.00215.9s61%
43Claude Sonnet 5 (Reasoning)98.0%$0.00825.3s72%
44Inception Mercury 292.0%$0.0003513ms46%
45Claude Sonnet 4.6 (Reasoning)98.0%$0.00945.7s72%
46MiniMax M2.596.0%$0.00079.1s61%
47Qwen3.7 Max100.0%$0.01215.8s100%
48GPT-5.294.0%$0.00252.9s53%
49GPT-OSS 120B96.0%$0.000310.1s61%
50MiniMax M396.0%$0.00079.8s61%
51Gemma 4 26B (Reasoning)100.0%$0.000328.2s100%
52Claude Opus 4.8 (Reasoning)100.0%$0.0225.2s100%
53Xiaomi MIMO v2.5 Pro94.0%$0.00146.8s53%
54Gemma 4 31B (Reasoning)100.0%$0.000430.7s100%
55Z.AI GLM 5 Turbo92.0%$0.00194.6s46%
56DeepSeek V4 Pro (Reasoning)98.0%$0.001520.5s72%
57Claude Sonnet 494.0%$0.00754.2s53%
58Gemini 3.1 Flash Lite (Reasoning)88.0%$0.00071.2s35%
59Gemini 3.1 Flash Lite88.0%$0.00061.4s35%
60Qwen3.6 Max Preview100.0%$0.009026.1s100%
61Qwen 3.6 27B96.0%$0.004416.7s61%
62GPT-5.4 Nano (Reasoning, Low)86.0%$0.00042.9s31%
63Aion 3.0 Mini94.0%$0.001216.1s53%
64Qwen 3.5 397B A17B100.0%$0.005734.3s100%
65Claude Opus 4.8 (Reasoning, Low)98.0%$0.0225.3s72%
66Gemini 3.1 Flash Lite (Preview)84.0%$0.00061.1s27%
67Nemotron 3 Super90.0%$0.000011.3s40%
68Laguna XS 2.184.0%$0.00012.2s27%
69Aion 3.092.0%$0.00519.9s46%
70GPT-4.186.0%$0.00223.5s31%
71DeepSeek V3.290.0%$0.000411.9s40%
72Z.AI GLM 4.7 Flash92.0%$0.000415.7s46%
73Qwen3 235B A22B Instruct 250790.0%$0.000312.5s40%
74Z.AI GLM 5.2 (Reasoning, High)88.0%$0.00247.2s35%
75MiniMax M2.786.0%$0.00077.2s31%
76GPT-5.4 Nano (Reasoning)82.0%$0.00052.8s23%
77Mistral Small 4 (Reasoning)82.0%$0.00043.4s23%
78Claude Opus 4.590.0%$0.0133.8s40%
79Claude Sonnet 4.586.0%$0.00743.4s31%
80Z.AI GLM 590.0%$0.002415.8s40%
81Gemini 3.5 Flash Lite (Reasoning)78.0%$0.0009812ms17%
82Gemini 3.5 Flash Lite (Reasoning, Minimal)78.0%$0.0009815ms17%
83GPT-5.6 Sol (Reasoning)80.0%$0.00341.9s20%
84ByteDance Seed 1.6 Flash80.0%$0.00045.2s20%
85Z.AI GLM 4.696.0%$0.001931.1s61%
86Qwen 3 32B86.0%$0.000515.3s31%
87Z.AI GLM 4.796.0%$0.001732.6s61%
88Ministral 3 14B76.0%$0.00033.0s15%
89Mistral Large 282.0%$0.00446.2s23%
90Gemma 4 31B78.0%$0.00026.6s17%
91Mistral NeMO74.0%$0.00022.4s12%
92Claude Haiku 4.576.0%$0.00262.4s15%
93DeepSeek V3 (2025-03-24)82.0%$0.000612.1s23%
94Grok 4.5 (Reasoning, High)80.0%$0.00417.3s20%
95Gemini 3.5 Flash (Reasoning, Minimal)74.0%$0.00351.4s12%
96Ministral 3 8B70.0%$0.00021.7s8%
97Grok 4.2072.0%$0.00182.2s10%
98Grok 4.5 (Reasoning, Low)78.0%$0.00337.6s17%
99Grok 4.3 (Reasoning)82.0%$0.003013.1s23%
100Qwen 3.5 9B96.0%$0.000639.5s61%
101ByteDance Seed 1.680.0%$0.001513.5s20%
102Claude Opus 4.784.0%$0.0172.3s27%
103Gemini 3.6 Flash (Reasoning, Minimal)70.0%$0.00321.3s8%
104Thinking Machines Inkling72.0%$0.00145.2s10%
105Qwen 3.5 Plus (2026-02-15)78.0%$0.001611.7s17%
106Laguna S 2.180.0%$0.000116.2s20%
107Mistral Medium 3.168.0%$0.00092.9s7%
108GPT-4.1 Mini66.0%$0.00021.8s5%
109Cydonia 24B V4.168.0%$0.00034.1s7%
110Claude Sonnet 4.672.0%$0.00642.1s10%
111DeepSeek V3 (2024-12-26)70.0%$0.00076.4s8%
112Xiaomi MIMO v2.568.0%$0.00094.5s7%
113DeepSeek V4 Flash64.0%$0.00012.6s4%
114Arcee AI: Trinity Mini64.0%$0.00013.4s4%
115Gemma 3 12B64.0%$0.00013.8s4%
116Z.AI GLM 4.5 Air74.0%$0.000613.6s12%
117Ministral 3 3B60.0%$0.00021.2s2%
118GPT-5.6 Luna (Reasoning)60.0%$0.00071.0s2%
119Llama 3.1 70B66.0%$0.00115.8s5%
120Z.AI GLM 4.566.0%$0.00077.2s5%
121ByteDance Seed 2.0 Lite80.0%$0.002121.0s20%
122GPT-5.4 Nano58.0%$0.00042.3s1%
123DeepSeek-V2 Chat64.0%$0.00038.0s4%
124Nemotron 3 Nano66.0%$0.000210.1s5%
125Gemini 3 Flash (Preview)56.0%$0.00121.6s1%
126Mistral Small 454.0%$0.00021.5s0%
127Writer: Palmyra X566.0%$0.00259.1s5%
128GPT-5.6 Terra54.0%$0.00131.1s0%
129GPT-5.456.0%$0.00221.6s1%
130Ministral 8B52.0%$0.00021.4s0%
131Gemma 4 26B60.0%$0.00027.5s2%
132DeepSeek V3.164.0%$0.000410.9s4%
133Mistral Large 354.0%$0.00102.6s0%
134Ministral 3B50.0%$0.00011.2s0%
135Qwen 2.5 72B58.0%$0.00066.5s1%
136Gemini 2.5 Flash Lite48.0%$0.0001482ms0%
137Gemini 2.5 Flash48.0%$0.0002535ms0%
138DeepSeek V4 Pro60.0%$0.00109.4s2%
139Claude Opus 582.0%$0.0248.2s23%
140GPT-4o Mini (temp=1)46.0%$0.0002919ms0%
141Hermes 3 70B50.0%$0.00063.6s0%
142Gemma 3 4B42.0%$0.00011.1s0%
143WizardLM 2 8x22b52.0%$0.00156.3s0%
144Gemma 3 27B46.0%$0.00024.4s0%
145GPT-4o Mini (temp=0)40.0%$0.0002811ms0%
146GPT-558.0%$0.00429.0s1%
147GPT-4.1 Nano40.0%$0.00011.3s0%
148GPT-4o, Aug. 6th (temp=1)46.0%$0.00381.3s0%
149GPT-5.6 Luna40.0%$0.00041.0s0%
150GPT-5.4 Mini40.0%$0.0011651ms0%
151Mistral Small 3.2 24B42.0%$0.00023.0s0%
152GPT-5.550.0%$0.00731.2s0%
153GPT-4o, Aug. 6th (temp=0)44.0%$0.00371.2s0%
154Grok 4.340.0%$0.00141.7s0%
155GPT-5.6 Sol40.0%$0.00241.2s0%
156Cohere Command R+ (Aug. 2024)44.0%$0.00492.9s0%
157Hermes 3 405B44.0%$0.00008.1s0%
158Claude Opus 5 (Reasoning)74.0%$0.0268.2s12%
159Claude Opus 484.0%$0.0379.8s27%
160ByteDance Seed 2.0 Mini76.0%$0.000839.1s15%
161Claude Opus 5 (Reasoning, Low)72.0%$0.0278.3s10%
80.34%

Individual Scenarios

outline-count

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Nemotron 3 Nano100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
Ministral 3B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Grok 4.3100100100100100100100100100090.0%
GPT-5100100100100100100000060.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Sol100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
ByteDance Seed 1.6100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
GPT-5.5100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
GPT-5.6 Terra100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
MiniMax M2.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
Gemma 4 31B100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100100100100100100.0%
GPT-5.6 Luna100100100100100100100100100100100.0%
Z.AI GLM 4.5100100100100100100100100100100100.0%
Gemma 4 26B100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100100100.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
GPT-5.4100100100100100100100100100100100.0%
Mistral Large 3100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
DeepSeek-V2 Chat100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Claude Haiku 4.5100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100100100100100100.0%
DeepSeek V3.1100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100100100100100100.0%
DeepSeek V4 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
Mistral Large 2100100100100100100100100100100100.0%
GPT-4.1 Mini100100100100100100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100100100100100100.0%
Grok 4.20100100100100100100100100100100100.0%
Hermes 3 405B100100100100100100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100100100100100100.0%
Gemini 2.5 Flash100100100100100100100100100100100.0%
GPT-5.4 Mini100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Writer: Palmyra X5100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Grok 4.3100100100100100100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100100100.0%
Llama 3.1 70B100100100100100100100100100100100.0%
Mistral Small 3.2 24B100100100100100100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Gemma 3 27B100100100100100100100100100100100.0%
Laguna XS 2.1100100100100100100100100100100100.0%
Mistral Small 4100100100100100100100100100100100.0%
Thinking Machines Inkling100100100100100100100100100100100.0%
Qwen 2.5 72B100100100100100100100100100100100.0%
Cydonia 24B V4.1100100100100100100100100100100100.0%
GPT-5.4 Nano100100100100100100100100100100100.0%
WizardLM 2 8x22b100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
Ministral 3 8B100100100100100100100100100100100.0%
GPT-4.1 Nano100100100100100100100100100100100.0%
Hermes 3 70B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100100100100100100.0%
Gemma 3 4B100100100100100100100100100100100.0%
Ministral 3 3B100100100100100100100100100100100.0%
Mistral NeMO100100100100100100100100100100100.0%
Ministral 8B100100100100100100100100100100100.0%
GPT-5100100100100100100100100100090.0%
Aion 3.0 Mini100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Nemotron 3 Nano100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Ministral 3B1001001001001001001001000080.0%
ByteDance Seed 2.0 Mini10010010010000000040.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
Qwen 3.6 27B100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Nemotron 3 Super100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Qwen 3 32B100100100100100100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100090.0%
MoonshotAI: Kimi K3 (Reasoning, Low)100100100100100100100100100090.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Aion 3.0100100100100100100100100100090.0%
Z.AI GLM 4.7100100100100100100100100100090.0%
Z.AI GLM 4.6100100100100100100100100100090.0%
MiniMax M2.5100100100100100100100100100090.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Z.AI GLM 4.7 Flash100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Mistral Small 4 (Reasoning)100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100090.0%
ByteDance Seed 1.6 Flash100100100100100100100100100090.0%
Mistral NeMO100100100100100100100100100090.0%
Claude Opus 4.51001001001001001001001000080.0%
Claude Sonnet 41001001001001001001001000080.0%
Claude Sonnet 4.51001001001001001001001000080.0%
GPT-OSS 120B1001001001001001001001000080.0%
Mistral Large 21001001001001001001001000080.0%
Grok 4.201001001001001001001001000080.0%
Qwen3 235B A22B Instruct 25071001001001001001001001000080.0%
Laguna XS 2.11001001001001001001001000080.0%
Z.AI GLM 510010010010010010010000070.0%
ByteDance Seed 1.610010010010010010010000070.0%
GPT-5.210010010010010010010000070.0%
MiniMax M2.710010010010010010010000070.0%
Gemini 3.1 Flash Lite10010010010010010010000070.0%
DeepSeek V3.210010010010010010010000070.0%
Z.AI GLM 5 Turbo100100100100100100000060.0%
GPT-4.1100100100100100100000060.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100000060.0%
ByteDance Seed 2.0 Mini100100100100100100000060.0%
Inception Mercury 2100100100100100100000060.0%
Xiaomi MIMO v2.51001001001001000000050.0%
Claude Haiku 4.51001001001001000000050.0%
GPT-5.4 Nano (Reasoning)1001001001001000000050.0%
Nemotron 3 Nano1001001001001000000050.0%
Ministral 3 3B1001001001001000000050.0%
Gemini 3.1 Flash Lite (Preview)10010010010000000040.0%
Gemma 4 31B10010010010000000040.0%
DeepSeek V3 (2024-12-26)10010010010000000040.0%
Claude Sonnet 4.6100100100000000030.0%
Claude Opus 4100100100000000030.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100000000030.0%
ByteDance Seed 2.0 Lite100100100000000030.0%
DeepSeek-V2 Chat100100100000000030.0%
Z.AI GLM 4.5 Air100100100000000030.0%
Mistral Small 4100100100000000030.0%
Thinking Machines Inkling100100100000000030.0%
Cydonia 24B V4.1100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
Claude Opus 4.71001000000000020.0%
Z.AI GLM 4.51001000000000020.0%
Gemma 4 26B1001000000000020.0%
Gemini 3.5 Flash Lite (Reasoning)1001000000000020.0%
DeepSeek V4 Flash1001000000000020.0%
Laguna S 2.11001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Ministral 3 14B1001000000000020.0%
Claude Opus 510000000000010.0%
GPT-5.510000000000010.0%
Qwen 3.5 Plus (2026-02-15)10000000000010.0%
GPT-5.410000000000010.0%
Mistral Large 310000000000010.0%
DeepSeek V3.110000000000010.0%
DeepSeek V4 Pro10000000000010.0%
GPT-4.1 Mini10000000000010.0%
Writer: Palmyra X510000000000010.0%
GPT-4o Mini (temp=1)10000000000010.0%
Llama 3.1 70B10000000000010.0%
Mistral Medium 3.110000000000010.0%
Gemma 3 12B10000000000010.0%
Ministral 3 8B10000000000010.0%
Hermes 3 70B10000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Ministral 8B10000000000010.0%
GPT-5.6 Sol00000000000.0%
GPT-5.6 Luna (Reasoning)00000000000.0%
GPT-5.6 Terra00000000000.0%
Gemini 3.6 Flash (Reasoning, Minimal)00000000000.0%
Gemini 3.5 Flash (Reasoning, Minimal)00000000000.0%
Gemini 3 Flash (Preview)00000000000.0%
GPT-5.6 Luna00000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
GPT-4o, Aug. 6th (temp=1)00000000000.0%
Hermes 3 405B00000000000.0%
Gemini 2.5 Flash00000000000.0%
GPT-5.4 Mini00000000000.0%
Gemini 2.5 Flash Lite00000000000.0%
Grok 4.300000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 27B00000000000.0%
Qwen 2.5 72B00000000000.0%
GPT-4.1 Nano00000000000.0%
Gemma 3 4B00000000000.0%
Ministral 3B00000000000.0%

pov-count

Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
Qwen 3.6 Flash100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
Aion 3.0100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Z.AI GLM 4.6100100100100100100100100100100100.0%
Claude Sonnet 4100100100100100100100100100100100.0%
Claude Sonnet 4.5100100100100100100100100100100100.0%
Claude Sonnet 5100100100100100100100100100100100.0%
Claude Opus 4100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
GPT-4.1100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 9B100100100100100100100100100100100.0%
Aion 3.0 Mini100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
DeepSeek V3.2100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Laguna S 2.1100100100100100100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100100100100100100.0%
Mistral Medium 3.1100100100100100100100100100100100.0%
Gemma 3 12B100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100090.0%
GPT-5.1100100100100100100100100100090.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100090.0%
ByteDance Seed 1.6100100100100100100100100100090.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
Z.AI GLM 4.7100100100100100100100100100090.0%
MiniMax M2.5100100100100100100100100100090.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100100100100090.0%
Gemini 3.1 Flash Lite100100100100100100100100100090.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100100100100100100090.0%
Gemini 3.5 Flash Lite (Reasoning)100100100100100100100100100090.0%
Xiaomi MIMO v2.5100100100100100100100100100090.0%
Claude Haiku 4.5100100100100100100100100100090.0%
DeepSeek V3.1100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100100100100090.0%
Laguna XS 2.1100100100100100100100100100090.0%
Grok 4.5 (Reasoning, Low)1001001001001001001001000080.0%
MiniMax M31001001001001001001001000080.0%
Z.AI GLM 51001001001001001001001000080.0%
Qwen 3.5 Plus (2026-02-15)1001001001001001001001000080.0%
Xiaomi MIMO v2.5 Pro1001001001001001001001000080.0%
Gemini 3.5 Flash (Reasoning, Minimal)1001001001001001001001000080.0%
Z.AI GLM 4.7 Flash1001001001001001001001000080.0%
Qwen 3 32B1001001001001001001001000080.0%
Writer: Palmyra X51001001001001001001001000080.0%
ByteDance Seed 1.6 Flash1001001001001001001001000080.0%
Grok 4.5 (Reasoning, High)10010010010010010010000070.0%
GPT-5.6 Terra (Reasoning)10010010010010010010000070.0%
Claude Opus 4.510010010010010010010000070.0%
MiniMax M2.710010010010010010010000070.0%
Z.AI GLM 4.510010010010010010010000070.0%
GPT-5.410010010010010010010000070.0%
DeepSeek-V2 Chat10010010010010010010000070.0%
DeepSeek V4 Flash10010010010010010010000070.0%
Mistral Large 210010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
GPT-5.4 Nano (Reasoning)10010010010010010010000070.0%
Mistral Small 4 (Reasoning)10010010010010010010000070.0%
Llama 3.1 70B10010010010010010010000070.0%
Cydonia 24B V4.110010010010010010010000070.0%
Grok 4.3 (Reasoning)100100100100100100000060.0%
Gemma 4 31B100100100100100100000060.0%
Mistral Large 3100100100100100100000060.0%
DeepSeek V3 (2024-12-26)100100100100100100000060.0%
Nemotron 3 Super100100100100100100000060.0%
Grok 4.20100100100100100100000060.0%
Nemotron 3 Nano100100100100100100000060.0%
Ministral 3 14B100100100100100100000060.0%
Ministral 3 8B100100100100100100000060.0%
Gemini 3 Flash (Preview)1001001001001000000050.0%
Gemma 4 26B1001001001001000000050.0%
DeepSeek V3 (2025-03-24)1001001001001000000050.0%
GPT-5.510010010010000000040.0%
Gemini 2.5 Flash Lite10010010010000000040.0%
Mistral Small 410010010010000000040.0%
Thinking Machines Inkling10010010010000000040.0%
Qwen 2.5 72B10010010010000000040.0%
Ministral 3 3B10010010010000000040.0%
Mistral NeMO10010010010000000040.0%
Ministral 8B10010010010000000040.0%
Claude Opus 5 (Reasoning, Low)100100100000000030.0%
Claude Sonnet 4.6100100100000000030.0%
DeepSeek V4 Pro100100100000000030.0%
GPT-4.1 Mini100100100000000030.0%
GPT-4o, Aug. 6th (temp=1)100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
Ministral 3B100100100000000030.0%
GPT-51001000000000020.0%
Claude Opus 5 (Reasoning)1001000000000020.0%
GPT-4o, Aug. 6th (temp=0)1001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Hermes 3 70B1001000000000020.0%
Hermes 3 405B10000000000010.0%
Grok 4.310000000000010.0%
Arcee AI: Trinity Mini10000000000010.0%
Gemma 3 4B10000000000010.0%
GPT-5.6 Sol00000000000.0%
GPT-5.6 Terra00000000000.0%
GPT-5.6 Luna00000000000.0%
Gemini 2.5 Flash00000000000.0%
GPT-5.4 Mini00000000000.0%
GPT-4o Mini (temp=1)00000000000.0%
Mistral Small 3.2 24B00000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Gemma 3 27B00000000000.0%
GPT-4.1 Nano00000000000.0%
Cohere Command R+ (Aug. 2024)00000000000.0%
Model # 1 # 2 # 3 # 4 # 5 # 6 # 7 # 8 # 9 # 10 Avg ▼
Claude Opus 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100100100100100100.0%
Qwen3.7 Max100100100100100100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100100100100100100.0%
Z.AI GLM 5.1100100100100100100100100100100100.0%
Qwen3.6 Max Preview100100100100100100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, High)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.6100100100100100100100100100100100.0%
MoonshotAI: Kimi K3 (Reasoning, Low)100100100100100100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100100100100100100.0%
GPT-5.1100100100100100100100100100100100.0%
Claude Sonnet 4.6100100100100100100100100100100100.0%
MiniMax M3100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 122B100100100100100100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100100100100100100.0%
Qwen 3.5 27B100100100100100100100100100100100.0%
Claude Opus 5100100100100100100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.7100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100100100100100100.0%
Claude Opus 4.5100100100100100100100100100100100.0%
Z.AI GLM 5100100100100100100100100100100100.0%
GPT-5.2100100100100100100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100100100100100100.0%
o4 Mini High100100100100100100100100100100100.0%
Gemini 2.5 Pro100100100100100100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7100100100100100100100100100100100.0%
Qwen 3.6 35B100100100100100100100100100100100.0%
Qwen 3.5 35B100100100100100100100100100100100.0%
MiniMax M2.5100100100100100100100100100100100.0%
Aion 2.0100100100100100100100100100100100.0%
o4 Mini100100100100100100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100100100100100100.0%
Qwen 3.5 Flash100100100100100100100100100100100.0%
GPT-OSS 120B100100100100100100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100100100100100100.0%
Inception Mercury 2100100100100100100100100100100100.0%
GPT-5 Nano100100100100100100100100100100100.0%
Ministral 3 14B100100100100100100100100100100100.0%
GPT-5 Mini100100100100100100100100100090.0%
Qwen 3.6 Flash100100100100100100100100100090.0%
Qwen 3.6 27B100100100100100100100100100090.0%
Z.AI GLM 4.6100100100100100100100100100090.0%
Claude Sonnet 4100100100100100100100100100090.0%
Claude Sonnet 5100100100100100100100100100090.0%
Claude Opus 4100100100100100100100100100090.0%
MiniMax M2.7100100100100100100100100100090.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100100100100090.0%
Gemma 4 31B100100100100100100100100100090.0%
Qwen 3.5 9B100100100100100100100100100090.0%
Nemotron 3 Super100100100100100100100100100090.0%
GPT-4.1 Mini100100100100100100100100100090.0%
GPT-5.4 Nano (Reasoning)100100100100100100100100100090.0%
DeepSeek V3 (2025-03-24)100100100100100100100100100090.0%
Thinking Machines Inkling100100100100100100100100100090.0%
Gemini 3.1 Flash Lite (Reasoning)1001001001001001001001000080.0%
ByteDance Seed 2.0 Mini1001001001001001001001000080.0%
Gemini 3.1 Flash Lite (Preview)1001001001001001001001000080.0%
Gemini 3.1 Flash Lite1001001001001001001001000080.0%
Gemini 3.5 Flash Lite (Reasoning)1001001001001001001001000080.0%
Aion 3.0 Mini1001001001001001001001000080.0%
DeepSeek V3.21001001001001001001001000080.0%
Laguna S 2.11001001001001001001001000080.0%
Ministral 3 8B1001001001001001001001000080.0%
Aion 3.010010010010010010010000070.0%
GPT-5.6 Terra10010010010010010010000070.0%
GPT-4.110010010010010010010000070.0%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010010010010010010000070.0%
ByteDance Seed 2.0 Lite10010010010010010010000070.0%
Z.AI GLM 4.5 Air10010010010010010010000070.0%
Qwen3 235B A22B Instruct 250710010010010010010010000070.0%
Grok 4.3 (Reasoning)100100100100100100000060.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100000060.0%
DeepSeek V4 Pro100100100100100100000060.0%
Mistral Large 2100100100100100100000060.0%
Z.AI GLM 5.2 (Reasoning, High)1001001001001000000050.0%
Claude Opus 5 (Reasoning)1001001001001000000050.0%
Claude Sonnet 4.51001001001001000000050.0%
DeepSeek V3 (2024-12-26)1001001001001000000050.0%
Mistral Small 4 (Reasoning)1001001001001000000050.0%
Qwen 3 32B1001001001001000000050.0%
GPT-5.4 Nano (Reasoning, Low)1001001001001000000050.0%
Llama 3.1 70B1001001001001000000050.0%
Laguna XS 2.11001001001001000000050.0%
Qwen 2.5 72B1001001001001000000050.0%
ByteDance Seed 1.610010010010000000040.0%
Z.AI GLM 4.510010010010000000040.0%
Claude Haiku 4.510010010010000000040.0%
Gemini 2.5 Flash10010010010000000040.0%
Writer: Palmyra X510010010010000000040.0%
Cydonia 24B V4.110010010010000000040.0%
ByteDance Seed 1.6 Flash10010010010000000040.0%
Mistral NeMO10010010010000000040.0%
Ministral 3B10010010010000000040.0%
Grok 4.5 (Reasoning, High)100100100000000030.0%
Claude Opus 5 (Reasoning, Low)100100100000000030.0%
Gemini 3 Flash (Preview)100100100000000030.0%
Gemma 4 26B100100100000000030.0%
DeepSeek V4 Flash100100100000000030.0%
Mistral Medium 3.1100100100000000030.0%
Gemma 3 27B100100100000000030.0%
Nemotron 3 Nano100100100000000030.0%
GPT-5.4 Nano100100100000000030.0%
GPT-51001000000000020.0%
DeepSeek-V2 Chat1001000000000020.0%
DeepSeek V3.11001000000000020.0%
Grok 4.201001000000000020.0%
GPT-4o Mini (temp=1)1001000000000020.0%
WizardLM 2 8x22b1001000000000020.0%
Hermes 3 70B1001000000000020.0%
Grok 4.5 (Reasoning, Low)10000000000010.0%
Hermes 3 405B10000000000010.0%
Mistral Small 3.2 24B10000000000010.0%
Gemma 3 12B10000000000010.0%
Arcee AI: Trinity Mini10000000000010.0%
Cohere Command R+ (Aug. 2024)10000000000010.0%
Ministral 3 3B10000000000010.0%
Ministral 8B10000000000010.0%
GPT-5.6 Sol (Reasoning)00000000000.0%
GPT-5.6 Sol00000000000.0%
GPT-5.6 Luna (Reasoning)00000000000.0%
GPT-5.500000000000.0%
GPT-5.6 Luna00000000000.0%
GPT-5.400000000000.0%
Mistral Large 300000000000.0%
Xiaomi MIMO v2.500000000000.0%
GPT-4o, Aug. 6th (temp=0)00000000000.0%
GPT-4o, Aug. 6th (temp=1)00000000000.0%
GPT-5.4 Mini00000000000.0%
Gemini 2.5 Flash Lite00000000000.0%
Grok 4.300000000000.0%
GPT-4o Mini (temp=0)00000000000.0%
Mistral Small 400000000000.0%
GPT-4.1 Nano00000000000.0%
Gemma 3 4B00000000000.0%