Character precision

Test: Relationship tree

Avg. Score
97.0%
Scenarios
2

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite100.0%$0.00313.3s100%
2Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00333.2s100%
3Gemini 2.5 Flash Lite100.0%$0.00234.8s100%
4Gemini 3.1 Flash Lite (Preview)100.0%$0.00463.2s100%
5GPT-6 Luna100.0%$0.001212.1s100%
6Gemini 3 Flash (Preview)100.0%$0.00877.1s100%
7Grok 4.3100.0%$0.00947.8s100%
8Claude Haiku 5.5 (Reasoning, Medium)100.0%$0.004616.7s100%
9GPT-4o Mini (temp=0)100.0%$0.001920.7s100%
10GPT-5.6 Luna100.0%$0.0128.7s100%
11Inception Mercury 2100.0%$0.009612.8s100%
12Claude Haiku 5.5 (Reasoning, Low)100.0%$0.005019.9s100%
13DeepSeek V4 Pro100.0%$0.008317.3s100%
14Ministral 3 14B100.0%$0.003125.4s100%
15Gemma 4 26B100.0%$0.001827.2s100%
16Gemma 3 27B100.0%$0.001627.5s100%
17Mistral Large 3100.0%$0.009117.5s100%
18MiniMax M2.7100.0%$0.006321.4s100%
19Grok 4.3 (Reasoning)100.0%$0.01313.9s100%
20Grok 4.20100.0%$0.0207.5s100%
21GPT-4o Mini (temp=1)100.0%$0.002633.4s100%
22Claude Haiku 5.5 (Adaptive)100.0%$0.006429.8s100%
23Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.0246.3s100%
24DeepSeek V3.2100.0%$0.004633.9s100%
25DeepSeek-V2 Chat100.0%$0.004934.0s100%
26GPT-4.1100.0%$0.0248.5s100%
27Mistral Large 4.0100.0%$0.008030.1s100%
28Claude Haiku 4.5100.0%$0.0248.2s100%
29Z.AI GLM 5.3 Flash (Reasoning, Low)100.0%$0.001242.5s100%
30DeepSeek V3 (2024-12-26)100.0%$0.004540.2s100%
31Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.0297.1s100%
32MiniMax M2.5100.0%$0.003645.0s100%
33Mistral Medium 3.5 (Reasoning)100.0%$0.0328.6s100%
34GPT-4o, Aug. 6th (temp=0)100.0%$0.0328.4s100%
35Mistral Medium 3.5100.0%$0.0338.3s100%
36GPT-5.4 Nano (Reasoning)100.0%$0.008841.7s100%
37DeepSeek V4 Flash100.0%$0.002051.4s100%
38GPT-5.6 Terra100.0%$0.0349.4s100%
39Z.AI GLM 4.5100.0%$0.007548.1s100%
40DeepSeek V3.1100.0%$0.005552.0s100%
41Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.03018.2s100%
42GPT-5.4100.0%$0.03317.4s100%
43DeepSeek V4.1 Flash 1017 (Reasoning, High)100.0%$0.005658.2s100%
44GPT-6 Sol100.0%$0.03521.1s100%
45Mistral Large 2100.0%$0.03720.5s100%
46Xiaomi MIMO v2.5100.0%$0.00271.1m100%
47Gemini 4 Argon (Reasoning, Medium)100.0%$0.03919.1s100%
48Muse Glimmer 30B (Reasoning, Medium)100.0%$0.00621.1m100%
49Qwen 3.6 Flash100.0%$0.01551.7s100%
50GPT-6 Luna (Reasoning, Medium)100.0%$0.00351.1m100%
51Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.03623.4s100%
52Grok 4.20 (Reasoning)100.0%$0.02740.0s100%
53Gemini 2.5 Flash98.6%$0.00756.1s92%
54GPT-5.4 Mini98.6%$0.00877.9s92%
55Ministral 3 8B98.5%$0.002217.0s91%
56Qwen 3.6 35B100.0%$0.0141.1m100%
57ByteDance Seed 1.6100.0%$0.0141.2m100%
58Muse Spark 1.2 (Reasoning, Medium)100.0%$0.04629.8s100%
59Muse Spark 1.1 (Reasoning, Medium)100.0%$0.04235.1s100%
60GPT-6 Luna (Reasoning, High)100.0%$0.00551.4m100%
61o4 Mini100.0%$0.03745.7s100%
62Ministral 8B97.3%$0.001615.6s89%
63Grok 4.5 (Reasoning, Low)100.0%$0.04049.7s100%
64Writer: Palmyra X598.5%$0.01618.4s91%
65DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.0141.5m100%
66GPT-5.6 Terra (Reasoning, Medium)100.0%$0.06024.2s100%
67GPT-6.1 Sol (Reasoning, Medium)100.0%$0.04250.1s100%
68GPT-5.4 (Reasoning, Low)100.0%$0.05335.5s100%
69Claude Sonnet 5100.0%$0.06817.1s100%
70GPT-5.198.6%$0.02517.7s92%
71GPT-6 Sol (Reasoning, Medium)100.0%$0.05146.3s100%
72GPT-4o, Aug. 6th (temp=1)98.4%$0.0299.1s91%
73Gemma 4 31B100.0%$0.00281.9m100%
74GPT-4.1 Mini97.2%$0.004626.0s89%
75Qwen 3 235B A22B Instruct 250798.6%$0.00171.0m92%
76Claude Sonnet 4.5100.0%$0.07718.6s100%
77Xiaomi MIMO v2.6 Pro100.0%$0.00712.0m100%
78Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.06742.1s100%
79Claude Sonnet 4.6100.0%$0.08123.3s100%
80GPT-5.2100.0%$0.06250.7s100%
81GPT-OSS 120B100.0%$0.00402.2m100%
82Gemini 3 Flash (Preview, Reasoning)98.6%$0.03040.3s92%
83Qwen 3.5 35B100.0%$0.0152.0m100%
84Thinking Machines Inkling Small (Reasoning, High)98.6%$0.0131.1m92%
85DeepSeek V3 (2025-03-24)97.1%$0.003750.3s88%
86GPT-5.6 Sol100.0%$0.09618.1s100%
87Kimi K3 (Reasoning, Low)100.0%$0.0591.2m100%
88Mistral Medium 3.197.3%$0.01021.2s84%
89o4 Mini High100.0%$0.0591.3m100%
90Thinking Machines Inkling97.1%$0.01843.6s89%
91Mistral Small 3.2 24B94.7%$0.001713.8s83%
92Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0391.8m100%
93Laguna XS 2.197.3%$0.001241.3s84%
94DeepSeek V4 Pro (Reasoning)100.0%$0.0202.3m100%
95Claude Sonnet 5.5 (Reasoning)100.0%$0.10128.5s100%
96Gemini 3.6 Flash (Reasoning)100.0%$0.09641.4s100%
97GPT-5.5 (Reasoning, Low)100.0%$0.09742.6s100%
98Qwen 2.5 72B96.9%$0.00561.2m87%
99Qwen 3.7 Flash (Reasoning)97.3%$0.001756.4s84%
100Muse Wonder (Reasoning, Medium)100.0%$0.11620.5s100%
101GPT-5.5100.0%$0.10537.1s100%
102Mistral NeMO96.1%$0.002415.4s77%
103Gemini 2.5 Pro100.0%$0.09958.2s100%
104Gemma 3 4B94.7%$0.000727.5s79%
105Claude Opus 4.5100.0%$0.13119.8s100%
106GPT-5 Mini98.6%$0.0192.0m92%
107Gemini 3.5 Flash (Reasoning)100.0%$0.11349.4s100%
108Qwen 3.6 27B100.0%$0.0342.7m100%
109Z.AI GLM 4.6100.0%$0.0183.0m100%
110Aion 2.0100.0%$0.0243.0m100%
111DeepSeek V4 Flash (Reasoning)100.0%$0.00413.5m100%
112Qwen 3.5 397B A17B100.0%$0.0452.6m100%
113Qwen 3.5 Plus (2026-04-20)100.0%$0.0233.1m100%
114Arcee AI: Trinity Mini96.5%$0.00371.9m86%
115Grok 4.5 (Reasoning, High)100.0%$0.0802.0m100%
116GPT-5.4 Nano (Reasoning, Low)95.1%$0.003813.8s71%
117ByteDance Seed 2.0 Lite100.0%$0.0143.6m100%
118Xiaomi MIMO v2.5 Pro97.4%$0.00761.9m84%
119Claude Opus 4.6100.0%$0.15431.4s100%
120Laguna S 2.196.1%$0.00062.0m83%
121Muse Spark 1.3 (Reasoning, Medium)98.6%$0.0551.9m92%
122Z.AI GLM 4.7100.0%$0.0253.7m100%
123WizardLM 2 8x22b97.4%$0.00982.3m85%
124GPT-5100.0%$0.0922.3m100%
125Qwen 3.5 Plus (2026-02-15)100.0%$0.0213.9m100%
126GPT-5.6 Luna (Reasoning, Medium)95.1%$0.02718.6s71%
127Z.AI GLM 5 Turbo100.0%$0.0443.6m100%
128Claude Opus 4.7100.0%$0.18224.3s100%
129GPT-4.1 Nano88.3%$0.00096.9s69%
130Claude Opus 4.7 (Reasoning)100.0%$0.18425.0s100%
131GPT-5.4 Mini (Reasoning, Low)92.5%$0.01414.4s68%
132Qwen 3.5 122B100.0%$0.0354.0m100%
133Gemini 3.5 Flash Lite (Reasoning)88.5%$0.00623.1s68%
134Qwen 3.5 Flash98.6%$0.00403.8m92%
135Claude Opus 5100.0%$0.19526.4s100%
136DeepSeek V4 Pro 0813 (Reasoning, High)100.0%$0.0603.5m100%
137Mistral Large 4.0 (Reasoning)100.0%$0.0453.9m100%
138Z.AI GLM 4.7 Flash95.9%$0.00502.8m82%
139GPT-5 Nano95.2%$0.00802.2m79%
140Qwen 3.8 Flash (Reasoning)100.0%$0.0154.9m100%
141GPT-5.6 Sol (Reasoning, Medium)100.0%$0.18659.0s100%
142Ministral 3B86.5%$0.00079.8s65%
143Claude Opus 5.5 (Reasoning)100.0%$0.20340.6s100%
144Gemini 3.1 Pro (Preview)100.0%$0.1721.5m100%
145Z.AI GLM 5100.0%$0.0374.6m100%
146 Kimi K3 (Reasoning, High)100.0%$0.1023.1m100%
147Nemotron 3 Super100.0%$0.00005.5m100%
148Claude Sonnet 495.1%$0.07217.5s71%
149Thinking Machines Inkling (Reasoning)100.0%$0.0604.1m100%
150Aion 3.0 Mini100.0%$0.0304.9m100%
151Qwen 3.6 Max Preview100.0%$0.0843.7m100%
152Claude Sonnet 5 (Reasoning)100.0%$0.1721.7m100%
153Claude Sonnet 5 (Reasoning, Low)100.0%$0.1751.7m100%
154DeepSeek V4 Flash 0731 (Reasoning, High)100.0%$0.00735.6m100%
155Llama 3.1 70B91.6%$0.006434.0s58%
156Hy4 Preview (Reasoning, High)100.0%$0.0564.7m100%
157Grok 4.6 (Reasoning, High)100.0%$0.1043.7m100%
158Claude Opus 5 (Reasoning, Low)100.0%$0.24646.5s100%
159Claude Opus 5 (Reasoning)100.0%$0.24747.3s100%
160GPT-5.4 Nano83.1%$0.002611.2s57%
161GPT-5.4 (Reasoning)100.0%$0.1752.6m100%
162Kimi K2.6100.0%$0.0825.0m100%
163Gemini 2.5 Flash Lite (Reasoning)84.9%$0.00731.0m60%
164Hermes 3 405B92.3%$0.0151.0m54%
165Kimi K2.598.6%$0.0315.4m92%
166Xiaomi MIMO v2.6 Flash100.0%$0.00787.0m100%
167Ministral 3 3B81.7%$0.00079.9s50%
168GPT-5.4 Mini (Reasoning)97.3%$0.1172.8m84%
169Aion 3.0100.0%$0.0745.8m100%
170Mistral Small 4 (Reasoning)87.9%$0.005124.7s45%
171GPT-5.5 (Reasoning, Medium)100.0%$0.2512.0m100%
172Qwen 3 32B88.7%$0.00422.9m64%
173Aion 3.5 (Reasoning, High)100.0%$0.0836.1m100%
174Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.00628.0m100%
175Qwen 3.8 27B (Reasoning, XHigh)97.3%$0.0534.9m84%
176Ember-1 (Reasoning, Max)100.0%$0.2113.4m100%
177Grok 4.7 (Reasoning, High)100.0%$0.1315.4m100%
178Gemini 3.5 Flash Lite (Reasoning, Minimal)77.4%$0.00573.2s44%
179Aion 3.5 Mini (Reasoning, High)100.0%$0.0367.7m100%
180Mistral Small 480.3%$0.00307.4s39%
181ByteDance Seed 2.0 Mini100.0%$0.00628.7m100%
182Z.AI GLM 5.1100.0%$0.0817.3m100%
183Gemma 4 31B (Reasoning)95.1%$0.00435.8m71%
184Z.AI GLM 4.5 Air91.4%$0.00713.2m49%
185Cydonia 24B V4.179.4%$0.00401.0m38%
186MiniMax M3100.0%$0.0369.3m100%
187ByteDance Seed 1.6 Flash71.6%$0.002034.2s36%
188Claude Opus 4.8 (Reasoning, Low)100.0%$0.3831.9m100%
189Claude Opus 4.8 (Reasoning)100.0%$0.3811.9m100%
190Claude Opus 4.6 (Reasoning)100.0%$0.3562.6m100%
191Qwen 3.5 27B90.0%$0.0293.7m40%
192Hermes 3 70B68.6%$0.004542.7s25%
193Gemma 4 26B (Reasoning)82.2%$0.00413.1m29%
194Qwen 3.5 9B90.3%$0.00407.8m65%
195Gemini 2.5 Flash (Reasoning)62.8%$0.02337.3s29%
196Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.1609.6m100%
197Cohere Command R+ (Aug. 2024)69.1%$0.05756.5s16%
198Claude Opus 495.1%$0.3682.4m71%
199Qwen 3.7 Max81.2%$0.0453.5m25%
200Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.18710.3m100%
201Nemotron 3 Nano66.5%$0.00392.8m19%
202Claude Sonnet 4.6 (Reasoning)100.0%$0.4485.9m100%
203Gemma 3 12B10.1%$0.001430.4s0%
96.97%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Ember-1 (Reasoning, Max)100100100100100100.0%
Muse Wonder (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Max100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash 1017 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
Muse Spark 1.3 (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Gemini 4 Argon (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Kimi K2.5100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Claude Opus 5100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Thinking Machines Inkling Small (Reasoning, High)100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen 3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Thinking Machines Inkling100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
Laguna S 2.11001001001007494.9%
Qwen 3 32B1001001001007494.9%
Mistral Small 3.2 24B1001001001007494.9%
WizardLM 2 8x22b1001001001007494.9%
GPT-4.1 Nano1001001001007494.9%
Qwen 3.8 27B (Reasoning, XHigh)1001001001007394.5%
Qwen 3.7 Flash (Reasoning)1001001001007394.5%
Z.AI GLM 4.7 Flash1001001001007394.5%
Mistral Medium 3.11001001001007394.5%
Laguna XS 2.11001001001007394.5%
Gemma 3 4B1001001001007394.5%
GPT-5.6 Luna (Reasoning, Medium)1001001001005190.3%
Gemma 4 31B (Reasoning)1001001001005190.3%
Claude Sonnet 41001001001005190.3%
Claude Opus 41001001001005190.3%
Gemini 3.5 Flash Lite (Reasoning)1001001001005190.3%
GPT-5.4 Mini (Reasoning, Low)1001001001005190.3%
GPT-5.4 Nano (Reasoning, Low)1001001001005190.3%
Qwen 3.5 9B1001001001004488.7%
Ministral 3B10010074737383.9%
Z.AI GLM 4.5 Air1001001001001482.9%
GPT-5.4 Nano10010073735680.3%
Qwen 3.5 27B100100100100080.0%
Ministral 3 3B1007474745475.4%
Gemini 2.5 Flash Lite (Reasoning)10010073515175.0%
Mistral Small 410010010073174.7%
Cydonia 24B V4.110010010071074.1%
Hermes 3 70B10010073483571.2%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010051515170.8%
ByteDance Seed 1.6 Flash10010051514569.5%
Nemotron 3 Nano1001007351064.8%
Cohere Command R+ (Aug. 2024)10010010020064.0%
Gemini 2.5 Flash (Reasoning)1005151515161.0%
Gemma 3 12B100000020.0%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Ember-1 (Reasoning, Max)100100100100100100.0%
Muse Wonder (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Gemini 3.6 Flash (Reasoning)100100100100100100.0%
Gemini 3.7 Flash (Reasoning, Medium)100100100100100100.0%
Hy4 Preview (Reasoning, High)100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)100100100100100100.0%
DeepSeek V4.1 Flash (Reasoning, High)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.8 Flash (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
DeepSeek V4.1 Flash 1017 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-6 Luna (Reasoning, High)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Muse Spark 1.1 (Reasoning, Medium)100100100100100100.0%
Gemini 4 Argon (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning, Medium)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
Kimi K3 (Reasoning, High)100100100100100100.0%
Qwen 3.8 27B (Reasoning, XHigh)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Grok 4.6 (Reasoning, High)100100100100100100.0%
GPT-6 Sol (Reasoning, Medium)100100100100100100.0%
Grok 4.7 (Reasoning, High)100100100100100100.0%
Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning, Medium)100100100100100100.0%
GPT-6 Luna (Reasoning, Medium)100100100100100100.0%
Aion 3.5 Mini (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Mistral Large 4.0 (Reasoning)100100100100100100.0%
Kimi K3 (Reasoning, Low)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
Aion 3.5 (Reasoning, High)100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
Xiaomi MIMO v2.6 Pro100100100100100100.0%
GPT-5100100100100100100.0%
Muse Spark 1.1 (Reasoning, Minimal)100100100100100100.0%
Claude Opus 5 (Reasoning)100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning, Medium)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
GPT-6 Sol100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Claude Opus 5100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
DeepSeek V4 Flash 0731 (Reasoning, High)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Xiaomi MIMO v2.6 Flash100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Gemini 3.6 Flash (Reasoning, Minimal)100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Mistral Medium 3.5 (Reasoning)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Low)100100100100100100.0%
Mistral Large 4.0100100100100100100.0%
Mistral Medium 3.5100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Claude Haiku 5.5 (Reasoning, Medium)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
GPT-6 Luna100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
Grok 4.20100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Laguna XS 2.1100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
Ministral 3 14B100100100100100100.0%
GPT-5 Mini1001001001008697.3%
GPT-5.11001001001008697.3%
Gemini 3 Flash (Preview, Reasoning)1001001001008697.3%
Thinking Machines Inkling Small (Reasoning, High)1001001001008697.3%
Z.AI GLM 4.7 Flash1001001001008697.3%
GPT-5.4 Mini1001001001008697.3%
Laguna S 2.11001001001008697.3%
Qwen 3 235B A22B Instruct 25071001001001008697.3%
Muse Spark 1.3 (Reasoning, Medium)1001001001008697.2%
Kimi K2.51001001001008697.2%
Qwen 3.5 Flash1001001001008697.2%
Gemini 2.5 Flash1001001001008697.2%
Writer: Palmyra X51001001001008597.1%
Ministral 3 8B1001001001008597.1%
GPT-4o, Aug. 6th (temp=1)1001001001008496.9%
Gemma 3 4B1001001001007494.9%
Xiaomi MIMO v2.5 Pro1001001001007494.7%
GPT-5.4 Mini (Reasoning, Low)1001001001007494.7%
Gemini 2.5 Flash Lite (Reasoning)1001001001007494.7%
Ministral 8B100100100868694.6%
GPT-5.4 Mini (Reasoning)1001001001007394.5%
GPT-4.1 Mini100100100868694.5%
Mistral Small 3.2 24B100100100868694.5%
Thinking Machines Inkling100100100868594.3%
DeepSeek V3 (2025-03-24)100100100868594.2%
Qwen 2.5 72B100100100858493.7%
Arcee AI: Trinity Mini100100100838293.1%
Mistral NeMO1001001001006192.2%
Qwen 3.5 9B100100100857492.0%
GPT-5 Nano100100100866690.3%
Ministral 3B10010086857489.1%
Ministral 3 3B100100100746688.0%
Gemini 3.5 Flash Lite (Reasoning)10010086747486.7%
Mistral Small 4100100100745585.9%
GPT-5.4 Nano10010086865685.9%
Cydonia 24B V4.110010085736684.7%
Hermes 3 405B1001001001002384.6%
Gemini 3.5 Flash Lite (Reasoning, Minimal)10010074747484.1%
Llama 3.1 70B100100100863083.2%
Qwen 3 32B100100100595482.5%
ByteDance Seed 1.6 Flash82 – – – – 82.3%
GPT-4.1 Nano1008482727181.8%
Mistral Small 4 (Reasoning)1001008685775.7%
Cohere Command R+ (Aug. 2024)1001008584174.2%
Nemotron 3 Nano10010010038468.2%
Hermes 3 70B10010010030066.0%
Gemini 2.5 Flash (Reasoning)100747474364.7%
Gemma 4 26B (Reasoning)100100100121064.4%
Qwen 3.7 Max10010010012062.5%
Gemma 3 12B100000.2%