Relationship precision

Test: Relationship tree

Avg. Score
70.3%
Scenarios
2

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00333.2s100%
2Gemini 3.1 Flash Lite (Preview)100.0%$0.00463.2s100%
3Gemma 3 12B100.0%$0.001430.4s100%
4Claude Haiku 5.5 (Reasoning, Low)98.3%$0.005019.9s93%
5Claude Haiku 5.5 (Adaptive)97.6%$0.006429.8s92%
6Gemma 4 26B96.6%$0.001827.2s89%
7Qwen 3.6 35B98.4%$0.0141.1m90%
8Gemini 2.5 Flash94.5%$0.00756.1s82%
9Qwen 3.6 Flash97.1%$0.01551.7s88%
10Muse Spark 1.2 (Reasoning, Medium)97.0%$0.04629.8s86%
11GPT-5.4 (Reasoning, Low)97.0%$0.05335.5s85%
12Claude Sonnet 497.3%$0.07217.5s84%
13Claude Sonnet 4.595.3%$0.07718.6s85%
14GPT-5 Mini96.0%$0.0192.0m86%
15GPT-5.6 Terra92.1%$0.0349.4s76%
16Muse Glimmer 30B (Reasoning, Medium)95.7%$0.00621.1m74%
17GPT-5100.0%$0.0922.3m100%
18GPT-5.294.5%$0.06250.7s78%
19GPT-5.4 Mini (Reasoning, Low)88.9%$0.01414.4s68%
20GPT-5.4 Nano (Reasoning)88.4%$0.008841.7s71%
21Qwen 3.7 Flash (Reasoning)91.5%$0.001756.4s66%
22Xiaomi MIMO v2.588.4%$0.00271.1m69%
23Claude Haiku 5.5 (Reasoning, Medium)90.8%$0.004616.7s58%
24o4 Mini High91.7%$0.0591.3m77%
25DeepSeek V4 Pro (Reasoning)93.1%$0.0202.3m77%
26Kimi K3 (Reasoning, Low)89.8%$0.0591.2m74%
27Gemini 3 Flash (Preview)83.8%$0.00877.1s56%
28Gemini 3.1 Flash Lite88.2%$0.00313.3s49%
29Nemotron 3 Nano93.1%$0.00392.8m71%
30Muse Spark 1.3 (Reasoning, Medium)90.8%$0.0551.9m75%
31Claude Opus 4.592.4%$0.13119.8s75%
32Z.AI GLM 5.2 (Reasoning, High)89.8%$0.0391.8m71%
33GPT-5.6 Terra (Reasoning, Medium)86.4%$0.06024.2s65%
34DeepSeek V4.1 Flash 1017 (Reasoning, High)84.7%$0.005658.2s59%
35Muse Wonder (Reasoning, Medium)89.4%$0.11620.5s71%
36Grok 4.20 (Reasoning)85.4%$0.02740.0s58%
37Claude Sonnet 4.684.6%$0.08123.3s66%
38Thinking Machines Inkling Small (Reasoning, High)83.1%$0.0131.1m59%
39GPT-5.480.9%$0.03317.4s57%
40o4 Mini85.4%$0.03745.7s57%
41Grok 4.380.0%$0.00947.8s50%
42Muse Spark 1.1 (Reasoning, Medium)84.7%$0.04235.1s56%
43GPT-5.4 Mini (Reasoning)95.6%$0.1172.8m82%
44Qwen 3.6 Max Preview95.0%$0.0843.7m84%
45Qwen 3.5 Plus (2026-04-20)90.3%$0.0233.1m70%
46Xiaomi MIMO v2.6 Pro83.8%$0.00712.0m62%
47Qwen 3.5 35B87.4%$0.0152.0m60%
48Mistral Large 378.2%$0.009117.5s52%
49Xiaomi MIMO v2.5 Pro84.8%$0.00761.9m60%
50Grok 4.3 (Reasoning)84.6%$0.01313.9s44%
51GPT-5.6 Luna (Reasoning, Medium)81.0%$0.02718.6s51%
52GPT-4o Mini (temp=0)80.0%$0.001920.7s46%
53DeepSeek V4 Pro 0813 (Reasoning, High)94.0%$0.0603.5m75%
54Grok 4.5 (Reasoning, Low)82.6%$0.04049.7s55%
55Qwen 3.8 Flash (Reasoning)92.3%$0.0154.9m78%
56Qwen 3.5 122B91.0%$0.0354.0m75%
57GPT-OSS 120B83.2%$0.00402.2m58%
58Muse Spark 1.1 (Reasoning, Minimal)87.0%$0.03018.2s41%
59Gemini 2.5 Flash (Reasoning)82.4%$0.02337.3s45%
60DeepSeek V4 Flash79.7%$0.002051.4s43%
61DeepSeek V4 Pro78.5%$0.008317.3s40%
62Claude Sonnet 580.8%$0.06817.1s51%
63GPT-5.5 (Reasoning, Low)82.0%$0.09742.6s60%
64Gemini 3.6 Flash (Reasoning)80.2%$0.09641.4s61%
65 Kimi K3 (Reasoning, High)90.7%$0.1023.1m74%
66GPT-4o, Aug. 6th (temp=0)83.1%$0.0328.4s36%
67Qwen 3.6 27B87.7%$0.0342.7m56%
68Thinking Machines Inkling (Reasoning)93.5%$0.0604.1m70%
69Inception Mercury 274.8%$0.009612.8s39%
70Claude Opus 4.683.7%$0.15431.4s64%
71Claude Sonnet 5 (Reasoning)90.4%$0.1721.7m73%
72Gemma 4 26B (Reasoning)89.1%$0.00413.1m50%
73DeepSeek V3.273.5%$0.004633.9s41%
74GPT-5.6 Sol80.7%$0.09618.1s51%
75Gemma 4 31B (Reasoning)93.1%$0.00435.8m69%
76Z.AI GLM 4.574.3%$0.007548.1s39%
77Qwen 3.5 Plus (2026-02-15)87.6%$0.0213.9m58%
78Z.AI GLM 590.4%$0.0374.6m64%
79Claude Sonnet 5.5 (Reasoning)79.2%$0.10128.5s49%
80Thinking Machines Inkling69.0%$0.01843.6s42%
81Gemma 4 31B75.5%$0.00281.9m44%
82Claude Opus 4.784.4%$0.18224.3s59%
83Z.AI GLM 5 Turbo83.6%$0.0443.6m57%
84GPT-6 Luna67.3%$0.001212.1s32%
85Mistral Large 270.1%$0.03720.5s37%
86Aion 2.080.6%$0.0243.0m49%
87Z.AI GLM 4.5 Air80.9%$0.00713.2m46%
88Qwen 3.5 Flash79.6%$0.00403.8m51%
89GPT-6 Luna (Reasoning, Medium)69.0%$0.00351.1m36%
90Gemini 3.8 Flash (Reasoning, Medium)75.4%$0.06742.1s39%
91Claude Sonnet 5 (Reasoning, Low)85.3%$0.1751.7m63%
92ByteDance Seed 1.671.4%$0.0141.2m35%
93Claude Opus 4.7 (Reasoning)84.7%$0.18425.0s49%
94GPT-4o Mini (temp=1)63.8%$0.002633.4s31%
95Z.AI GLM 5.3 Flash (Reasoning, Low)67.8%$0.001242.5s28%
96GPT-5.4 Nano (Reasoning, Low)59.2%$0.003813.8s31%
97Llama 3.1 70B61.5%$0.006434.0s32%
98Claude Haiku 4.567.7%$0.0248.2s25%
99DeepSeek-V2 Chat71.6%$0.004934.0s20%
100Laguna XS 2.165.0%$0.001241.3s27%
101DeepSeek V3 (2025-03-24)69.2%$0.003750.3s23%
102Aion 3.087.3%$0.0745.8m67%
103Gemini 3.5 Flash Lite (Reasoning, Minimal)67.5%$0.00573.2s17%
104Gemini 3 Flash (Preview, Reasoning)67.5%$0.03040.3s27%
105DeepSeek V3.171.1%$0.005552.0s19%
106Gemini 2.5 Pro76.7%$0.09958.2s35%
107Gemini 3.7 Flash (Reasoning, Medium)56.2%$0.03623.4s36%
108Mistral Medium 3.5 (Reasoning)59.0%$0.0328.6s29%
109Claude Opus 496.6%$0.3682.4m86%
110GPT-6 Luna (Reasoning, High)62.4%$0.00551.4m31%
111Gemini 3.5 Flash (Reasoning)72.9%$0.11349.4s37%
112GPT-6.1 Sol (Reasoning, Medium)68.3%$0.04250.1s25%
113Gemini 3.5 Flash (Reasoning, Minimal)62.4%$0.0246.3s20%
114GPT-5.566.6%$0.10537.1s37%
115ByteDance Seed 2.0 Lite81.0%$0.0143.6m31%
116ByteDance Seed 2.0 Mini88.8%$0.00628.7m70%
117Gemini 4 Argon (Reasoning, Medium)54.1%$0.03919.1s31%
118Qwen 3 32B70.0%$0.00422.9m31%
119Qwen 3.5 397B A17B72.1%$0.0452.6m35%
120GPT-6 Sol (Reasoning, Medium)61.4%$0.05146.3s29%
121DeepSeek V4.1 Flash (Reasoning, High)63.8%$0.0141.5m25%
122Z.AI GLM 5.3 Flash (Reasoning, Max)85.4%$0.00628.0m64%
123GPT-4o, Aug. 6th (temp=1)58.8%$0.0299.1s20%
124GPT-6 Sol55.6%$0.03521.1s25%
125GPT-4.157.6%$0.0248.5s19%
126Qwen 3.5 27B71.5%$0.0293.7m39%
127Gemini 3.5 Flash Lite (Reasoning)59.2%$0.00623.1s11%
128GPT-5 Nano63.4%$0.00802.2m27%
129GPT-4.1 Mini52.4%$0.004626.0s19%
130Hermes 3 70B59.5%$0.004542.7s14%
131Mistral Small 456.1%$0.00307.4s11%
132Gemma 3 27B53.1%$0.001627.5s15%
133GPT-5.4 Mini43.1%$0.00877.9s22%
134Hy4 Preview (Reasoning, High)68.4%$0.0564.7m49%
135Ember-1 (Reasoning, Max)83.1%$0.2113.4m55%
136GPT-5.151.0%$0.02517.7s17%
137Mistral Medium 3.548.2%$0.0338.3s20%
138GPT-5.6 Luna43.9%$0.0128.7s20%
139Mistral Small 4 (Reasoning)49.2%$0.005124.7s15%
140DeepSeek V4 Flash (Reasoning)65.0%$0.00413.5m28%
141Z.AI GLM 5.185.1%$0.0817.3m59%
142DeepSeek V3 (2024-12-26)49.0%$0.004540.2s14%
143Cohere Command R+ (Aug. 2024)61.3%$0.05756.5s14%
144Grok 4.5 (Reasoning, High)56.8%$0.0802.0m33%
145Kimi K2.675.1%$0.0825.0m42%
146Aion 3.0 Mini75.1%$0.0304.9m29%
147Writer: Palmyra X541.8%$0.01618.4s14%
148DeepSeek V4 Flash 0731 (Reasoning, High)63.5%$0.00735.6m41%
149MiniMax M2.742.5%$0.006321.4s10%
150Gemini 3.6 Flash (Reasoning, Minimal)44.4%$0.0297.1s11%
151Claude Opus 5.5 (Reasoning)70.0%$0.20340.6s28%
152Claude Opus 4.8 (Reasoning)85.2%$0.3811.9m64%
153Qwen 3 235B A22B Instruct 250741.7%$0.00171.0m15%
154Kimi K2.570.6%$0.0315.4m32%
155ByteDance Seed 1.6 Flash40.9%$0.002034.2s9%
156Mistral Large 4.045.0%$0.008030.1s5%
157GPT-5.6 Sol (Reasoning, Medium)68.2%$0.18659.0s25%
158GPT-5.4 (Reasoning)67.5%$0.1752.6m38%
159Z.AI GLM 4.7 Flash44.8%$0.00502.8m25%
160Qwen 3.7 Max60.2%$0.0453.5m26%
161Qwen 2.5 72B47.0%$0.00561.2m7%
162Grok 4.2030.5%$0.0207.5s14%
163Aion 3.5 (Reasoning, High)78.6%$0.0836.1m36%
164Ministral 3 8B34.5%$0.002217.0s7%
165GPT-5.4 Nano21.8%$0.002611.2s18%
166MiniMax M2.527.1%$0.003645.0s18%
167Nemotron 3 Super66.5%$0.00005.5m22%
168Gemini 2.5 Flash Lite (Reasoning)37.6%$0.00731.0m7%
169Ministral 8B29.3%$0.001615.6s7%
170GPT-4.1 Nano22.8%$0.00096.9s12%
171Mistral Large 4.0 (Reasoning)53.3%$0.0453.9m26%
172Laguna S 2.136.0%$0.00062.0m15%
173Hermes 3 405B38.0%$0.0151.0m7%
174Qwen 3.8 27B (Reasoning, XHigh)61.5%$0.0534.9m27%
175Claude Opus 4.6 (Reasoning)78.4%$0.3562.6m54%
176GPT-5.5 (Reasoning, Medium)68.3%$0.2512.0m35%
177Z.AI GLM 4.747.3%$0.0253.7m22%
178Grok 4.6 (Reasoning, High)54.3%$0.1043.7m31%
179Aion 3.5 Mini (Reasoning, High)73.0%$0.0367.7m36%
180Z.AI GLM 4.645.0%$0.0183.0m15%
181WizardLM 2 8x22b44.7%$0.00982.3m6%
182Z.AI GLM 5.3 (Reasoning, Max)91.2%$0.18710.3m73%
183Claude Opus 558.3%$0.19526.4s12%
184Gemini 2.5 Flash Lite23.6%$0.00234.8s2%
185Ministral 3 14B19.3%$0.003125.4s9%
186Xiaomi MIMO v2.6 Flash63.9%$0.00787.0m27%
187Claude Opus 5 (Reasoning, Low)67.3%$0.24646.5s16%
188Cydonia 24B V4.126.6%$0.00401.0m3%
189Mistral Medium 3.118.1%$0.01021.2s7%
190Mistral Small 3.2 24B18.3%$0.001713.8s3%
191Arcee AI: Trinity Mini32.6%$0.00371.9m4%
192Qwen 3.8 Max (Reasoning, XHigh)84.0%$0.1609.6m56%
193Gemini 3.1 Pro (Preview)47.8%$0.1721.5m16%
194Ministral 3B7.4%$0.00079.8s4%
195Ministral 3 3B6.6%$0.00079.9s3%
196Claude Opus 4.8 (Reasoning, Low)73.7%$0.3831.9m34%
197Claude Opus 5 (Reasoning)49.4%$0.24747.3s18%
198Claude Sonnet 4.6 (Reasoning)89.8%$0.4485.9m70%
199Mistral NeMO4.4%$0.002415.4s3%
200Qwen 3.5 9B55.6%$0.00407.8m23%
201Grok 4.7 (Reasoning, High)63.0%$0.1315.4m18%
202Gemma 3 4B3.2%$0.000727.5s2%
203MiniMax M355.9%$0.0369.3m22%
70.27%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
Claude Opus 5.5 (Reasoning)100100100100100100.0%
Qwen 3.8 Max (Reasoning, XHigh)100100100100100100.0%
GPT-6.1 Sol (Reasoning, Medium)100100100100100100.0%
Gemini 3.8 Flash (Reasoning, Medium)100100100100100100.0%
Muse Wonder (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 (Reasoning, Max)100100100100100100.0%
GPT-5.6 Sol (Reasoning, Medium)100100100100100100.0%
Z.AI GLM 5.3 Flash (Reasoning, Max)100100100100100100.0%
Qwen 3.6 Max Preview100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Claude Sonnet 5.5 (Reasoning)100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 5 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
Thinking Machines Inkling (Reasoning)100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
GPT-5.2100100100100100100.0%
Claude Haiku 5.5 (Adaptive)100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Muse Glimmer 30B (Reasoning, Medium)100100100100100100.0%
Qwen 3.7 Flash (Reasoning)100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
o4 Mini100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 26B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
DeepSeek V4.1 Flash 1017 (Reasoning, High)1001001001009198.2%
GPT-5.6 Terra (Reasoning, Medium)1001001001008997.9%
Claude Haiku 5.5 (Reasoning, Low)1001001001008997.9%
GPT-5 Mini1001001001008697.3%
GPT-5.4 Mini (Reasoning, Low)1001001001008496.9%
Kimi K3 (Reasoning, High)1001001001008396.7%
Claude Opus 4.51001001001008396.7%
o4 Mini High1001001001008196.2%
Xiaomi MIMO v2.6 Pro100100100918996.0%
Claude Opus 41001001001007895.6%
Nemotron 3 Nano1001001001007795.4%
Ember-1 (Reasoning, Max)1001001001007695.3%
Muse Spark 1.2 (Reasoning, Medium)1001001001007695.3%
Qwen 3.8 Flash (Reasoning)1001001001007695.3%
Muse Spark 1.3 (Reasoning, Medium)1001001001007695.3%
Grok 4.7 (Reasoning, High)1001001001007695.3%
Kimi K2.61001001001007494.9%
GPT-OSS 120B1001001001007394.5%
Claude Sonnet 51001001001007294.4%
Qwen 3.5 122B1001001001007094.0%
Gemini 2.5 Flash100100100887692.7%
Qwen 3.5 27B100100100827992.3%
Z.AI GLM 5 Turbo1001001001005991.9%
Claude Opus 4.6 (Reasoning)10010091917691.8%
GPT-5.4 Nano (Reasoning)100100100797791.3%
Claude Sonnet 4.610010089897691.0%
GPT-5.6 Terra100100100896691.0%
Claude Sonnet 5 (Reasoning, Low)1001001001005591.0%
Xiaomi MIMO v2.5 Pro1001001001005490.8%
Grok 4.5 (Reasoning, Low)100100100837090.7%
Qwen 3.6 27B1001001001005390.6%
GPT-5.5 (Reasoning, Medium)100100100767690.5%
Laguna XS 2.1100100100856790.5%
Mistral Small 41001001001005290.4%
ByteDance Seed 1.6100100100807089.9%
Kimi K2.51001001001004789.4%
Kimi K3 (Reasoning, Low)10010091777688.8%
Z.AI GLM 5.11001001001004288.4%
Aion 2.01001001001004188.2%
Inception Mercury 21001001001003987.8%
Claude Opus 4.7100100100696987.6%
ByteDance Seed 2.0 Mini100100100686686.8%
DeepSeek V4.1 Flash (Reasoning, High)100100100765586.2%
Aion 3.0100100100765586.2%
GPT-5.6 Luna (Reasoning, Medium)10010080767486.2%
Z.AI GLM 5.3 Flash (Reasoning, Low)100100100904085.9%
Gemini 3.6 Flash (Reasoning)10010076767685.8%
GPT-5.4 (Reasoning)10010076767685.8%
GPT-6 Sol (Reasoning, Medium)10010076767685.8%
GPT-6 Luna (Reasoning, High)10010076767685.7%
Thinking Machines Inkling Small (Reasoning, High)100100100794985.7%
Claude Haiku 5.5 (Reasoning, Medium)1001001001002885.6%
Gemini 2.5 Flash (Reasoning)1001001001002885.6%
Qwen 3.5 Flash100100100656285.3%
GPT-6 Luna (Reasoning, Medium)100100100765085.3%
GPT-5.410010081806484.8%
Grok 4.310010087845184.5%
GPT-5.5 (Reasoning, Low)1009176767684.1%
ByteDance Seed 2.0 Lite1001001001001883.7%
DeepSeek-V2 Chat1001001001001683.3%
DeepSeek V4 Pro1001001001001683.1%
Claude Opus 4.610010073707082.5%
Qwen 3.8 27B (Reasoning, XHigh)10010076765982.4%
MiniMax M31008382816582.1%
Xiaomi MIMO v2.6 Flash100100100555581.9%
Qwen 2.5 72B100100100664381.6%
Gemini 3.1 Pro (Preview)1007676767681.1%
DeepSeek V4 Flash 0731 (Reasoning, High)1007676767681.1%
Qwen 3 32B100100100832281.0%
DeepSeek V4 Flash100100100861880.9%
Gemma 4 26B (Reasoning)100100100881680.8%
DeepSeek V4 Flash (Reasoning)100100100802380.6%
Hy4 Preview (Reasoning, High)1007676767380.5%
Gemini 3.1 Flash Lite100100100871480.2%
Gemma 3 27B100100100514879.9%
Aion 3.5 Mini (Reasoning, High)100100100554279.3%
Grok 4.5 (Reasoning, High)838376767679.2%
Qwen 3.5 397B A17B10010080803178.1%
Muse Spark 1.1 (Reasoning, Medium)10010091554077.2%
Z.AI GLM 4.510010076585176.9%
Muse Spark 1.1 (Reasoning, Minimal)10010010083076.7%
Thinking Machines Inkling1008668656476.7%
Cohere Command R+ (Aug. 2024)100100100414176.4%
Gemini 3.7 Flash (Reasoning, Medium)767676767676.4%
Gemini 4 Argon (Reasoning, Medium)767676767676.4%
Grok 4.6 (Reasoning, High)767676767676.4%
Gemini 3 Flash (Preview)1008180734475.5%
Aion 3.0 Mini10010010076175.5%
Mistral Small 4 (Reasoning)10010067663974.4%
GPT-6 Sol1007676764274.2%
GPT-5.51007676703772.0%
Claude Opus 4.8 (Reasoning, Low)10010010055171.3%
Claude Haiku 4.5100100100302170.2%
Qwen 3.7 Max1008376761570.2%
GPT-4o, Aug. 6th (temp=0)10010010048069.7%
Z.AI GLM 4.5 Air10010066611668.5%
Hermes 3 70B10010073541368.0%
Aion 3.5 (Reasoning, High)1001008355167.9%
GPT-4o Mini (temp=1)10010050483967.5%
GPT-5.1100787572766.6%
Qwen 3.5 9B1007372483565.6%
Gemini 3 Flash (Preview, Reasoning)1001008342165.3%
Nemotron 3 Super10010045423364.0%
Gemini 3.5 Flash (Reasoning, Minimal)10010064421263.8%
Gemini 3.5 Flash (Reasoning)100837655163.1%
DeepSeek V3.21008650413462.3%
Mistral Large 3656565655362.3%
GPT-5 Nano1001006837562.0%
Llama 3.1 70B1007264472761.9%
Mistral Large 2868665472261.1%
Claude Opus 51001001001160.5%
GPT-4o Mini (temp=0)828262383660.0%
Gemma 4 31B1008558322559.8%
Z.AI GLM 4.7 Flash856867591558.7%
DeepSeek V3 (2024-12-26)1007169292358.4%
Mistral Large 4.0 (Reasoning)838175351357.6%
DeepSeek V3 (2025-03-24)10010041232357.4%
GPT-4.11001006113856.4%
Ministral 3 8B1007751451056.3%
Z.AI GLM 4.71006951381655.1%
Gemini 2.5 Flash Lite (Reasoning)1001004323955.0%
GPT-4.1 Mini1006961222054.6%
GPT-6 Luna1008832292254.1%
Laguna S 2.1856152482353.9%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100528853.8%
GPT-5.4 Nano (Reasoning, Low)857443391250.6%
Qwen 3 235B A22B Instruct 2507746953352150.5%
Ministral 8B87714827647.9%
Gemini 3.6 Flash (Reasoning, Minimal)8376761147.6%
Gemini 3.5 Flash Lite (Reasoning)100100218747.3%
WizardLM 2 8x22b100774310446.9%
ByteDance Seed 1.6 Flash10073446645.8%
MiniMax M2.7100633515944.4%
GPT-5.4 Mini744943302243.8%
GPT-4o, Aug. 6th (temp=1)10066431041.9%
Mistral Medium 3.51003325252541.4%
Gemini 2.5 Flash Lite10010030040.7%
Mistral Medium 3.5 (Reasoning)1003325251439.2%
Arcee AI: Trinity Mini10057246438.3%
GPT-5.6 Luna745023231837.7%
Claude Opus 5 (Reasoning)1007681137.5%
Z.AI GLM 4.680462625736.6%
Writer: Palmyra X5613737291034.8%
Hermes 3 405B100292112032.7%
Ministral 3 14B594033191332.5%
Grok 4.20513528261631.3%
Mistral Small 3.2 24B1002793228.5%
Mistral Medium 3.161461313828.2%
MiniMax M2.5393833171127.5%
Cydonia 24B V4.110016146127.5%
GPT-4.1 Nano513820101025.8%
GPT-5.4 Nano362624231625.0%
Mistral Large 4.0361176312.5%
Ministral 3 3B1817118211.1%
Ministral 3B28884210.1%
Mistral NeMO1254104.6%
Gemma 3 4B1054114.1%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Muse Spark 1.2 (Reasoning, Medium)1001001001009498.8%
Claude Haiku 5.5 (Reasoning, Low)1001001001009398.6%
Claude Opus 41001001001008897.6%
Gemma 4 26B (Reasoning)1001001001008797.4%
Muse Spark 1.1 (Reasoning, Minimal)100100100939397.2%
Qwen 3.6 35B1001001001008496.8%
GPT-4o, Aug. 6th (temp=0)1001001001008296.5%
Gemini 2.5 Flash1001001001008196.3%
Gemini 3.1 Flash Lite1001001001008196.1%
Claude Haiku 5.5 (Reasoning, Medium)10010094949296.0%
Claude Haiku 5.5 (Adaptive)10010095919095.3%
GPT-5 Mini100100100948094.7%
Claude Sonnet 41001001001007394.5%
Qwen 3.6 Flash100100100888394.2%
Mistral Large 310010091919094.2%
GPT-5.4 (Reasoning, Low)100100100967494.0%
Z.AI GLM 4.5 Air100100100937493.4%
GPT-5.6 Terra10010094947893.3%
Gemma 4 26B10010091918493.1%
Muse Spark 1.1 (Reasoning, Medium)1009595918192.1%
Gemini 3 Flash (Preview)100100100936792.1%
Muse Glimmer 30B (Reasoning, Medium)1001001001005791.4%
Gemma 4 31B929191919191.2%
GPT-5.4 Mini (Reasoning)10010095907191.2%
Nemotron 3 Nano1001001001005490.8%
ByteDance Seed 2.0 Mini100100100886690.7%
Kimi K3 (Reasoning, Low)100100100787590.7%
Claude Sonnet 4.510010089877790.5%
Qwen 3.6 Max Preview10010088828089.9%
Aion 3.5 (Reasoning, High)10010091787889.4%
Qwen 3.8 Flash (Reasoning)10010093856889.3%
GPT-5.210010095856589.1%
Aion 3.0100100100786488.4%
Qwen 3.5 122B10010093796988.1%
Claude Opus 4.51009594906288.1%
DeepSeek V4 Pro 0813 (Reasoning, High)100100100786287.9%
o4 Mini High1009391797287.2%
Thinking Machines Inkling (Reasoning)100100100845186.9%
Muse Spark 1.3 (Reasoning, Medium)1009287846986.3%
DeepSeek V4 Pro (Reasoning)10010089727086.2%
Gemma 4 31B (Reasoning)10010092914786.1%
GPT-5.4 Nano (Reasoning)959087857085.5%
Claude Opus 4.6919084807984.8%
Kimi K3 (Reasoning, High)1009090756984.8%
DeepSeek V3.210010087716684.7%
Qwen 3.6 27B10010094943684.7%
Qwen 3.7 Flash (Reasoning)100100100615482.9%
Gemini 3.5 Flash (Reasoning)1008482796882.6%
Z.AI GLM 5.3 (Reasoning, Max)10010074716782.4%
Z.AI GLM 5.11009684715881.8%
Claude Opus 4.71009584794781.1%
Gemini 3.5 Flash Lite (Reasoning, Minimal)100100100100681.1%
DeepSeek V3 (2025-03-24)100100100100581.1%
GPT-5.4 Mini (Reasoning, Low)1008482815780.8%
Claude Sonnet 5 (Reasoning)1009281686480.8%
Z.AI GLM 510010092644880.8%
Qwen 3.5 Plus (2026-04-20)10010076676080.6%
Thinking Machines Inkling Small (Reasoning, High)928888736280.6%
GPT-6 Luna1009380715980.5%
GPT-5.5 (Reasoning, Low)1008374746979.9%
Claude Sonnet 5 (Reasoning, Low)1008875736379.7%
Z.AI GLM 5.2 (Reasoning, High)959082725979.6%
Claude Sonnet 4.6 (Reasoning)929183745879.5%
Gemini 2.5 Flash (Reasoning)100100100524479.2%
Mistral Large 210010091624479.2%
Muse Wonder (Reasoning, Medium)968381775878.9%
Xiaomi MIMO v2.5 Pro1008876755378.7%
Mistral Medium 3.5 (Reasoning)928473737278.7%
DeepSeek V4 Flash10010082565478.5%
ByteDance Seed 2.0 Lite10010010084778.3%
Claude Sonnet 4.6949081685778.2%
Mistral Large 4.01009393871477.5%
GPT-5.41008870636377.0%
Xiaomi MIMO v2.51008178705476.7%
Claude Opus 4.8 (Reasoning, Low)928581735176.1%
GPT-5.6 Luna (Reasoning, Medium)10010071584975.8%
GPT-4o, Aug. 6th (temp=1)1008978624975.6%
Grok 4.31009181723475.4%
Z.AI GLM 5 Turbo1009676624275.3%
Qwen 3.5 Plus (2026-02-15)938784813275.3%
GPT-5.6 Terra (Reasoning, Medium)878073706475.0%
Aion 3.0 Mini100100100542074.8%
Qwen 3.5 35B1008684663774.7%
Gemini 3.6 Flash (Reasoning)827473737274.6%
Grok 4.5 (Reasoning, Low)948582694174.5%
DeepSeek V4 Pro1009083484873.9%
Qwen 3.5 Flash938273695373.9%
Aion 2.01007472714873.0%
GPT-OSS 120B858467626071.8%
Z.AI GLM 4.510010091402771.6%
Xiaomi MIMO v2.6 Pro927967645571.5%
DeepSeek V4.1 Flash 1017 (Reasoning, High)1008370554871.2%
Gemini 3.5 Flash Lite (Reasoning)10010010051471.0%
Ember-1 (Reasoning, Max)1007672604770.9%
o4 Mini1009267534270.8%
Z.AI GLM 5.3 Flash (Reasoning, Max)887466656170.8%
Grok 4.20 (Reasoning)898574654070.7%
Claude Opus 4.8 (Reasoning)927165626270.3%
Gemini 3 Flash (Preview, Reasoning)959494363069.7%
Claude Opus 4.7 (Reasoning)1009286393069.4%
Grok 4.3 (Reasoning)10010080561169.2%
Nemotron 3 Super10010055454569.0%
Qwen 3.8 Max (Reasoning, XHigh)767474704667.9%
GPT-5.4 Nano (Reasoning, Low)1007869603267.8%
Claude Sonnet 5936866614767.1%
Aion 3.5 Mini (Reasoning, High)1007165574066.7%
Qwen 3.5 397B A17B1008371641266.1%
Claude Haiku 4.51005957565465.2%
Claude Opus 4.6 (Reasoning)936563555065.1%
GPT-5 Nano878068622664.7%
Inception Mercury 21006762433861.8%
GPT-5.6 Sol816867464561.5%
Thinking Machines Inkling906859573261.3%
Claude Opus 5 (Reasoning)85727169961.2%
GPT-5.51005754494661.2%
Gemini 3.5 Flash (Reasoning, Minimal)1009191121161.1%
Llama 3.1 70B1007771382061.0%
GPT-4o Mini (temp=1)836860474260.0%
DeepSeek-V2 Chat1001008214359.9%
Qwen 3 32B1008845323058.9%
GPT-4.11007368421058.7%
Claude Sonnet 5.5 (Reasoning)736453525058.3%
Hy4 Preview (Reasoning, High)756560433856.2%
Claude Opus 51007669241156.1%
Kimi K2.6875847424155.2%
Mistral Medium 3.5777148433554.9%
Gemini 2.5 Pro91765049153.5%
Z.AI GLM 4.61007647271753.3%
ByteDance Seed 1.6836655491153.0%
GPT-6 Luna (Reasoning, Medium)736546443552.7%
Kimi K2.5686446433851.8%
Hermes 3 70B100100486151.1%
Gemini 3.8 Flash (Reasoning, Medium)626057383850.9%
Qwen 3.5 27B885148363150.8%
GPT-4.1 Mini898642211250.3%
Qwen 3.7 Max100714826650.3%
GPT-5.6 Luna1004640372750.2%
Z.AI GLM 5.3 Flash (Reasoning, Low)82635843349.8%
DeepSeek V4 Flash (Reasoning)726453342449.4%
GPT-5.4 (Reasoning)866036332949.1%
Mistral Large 4.0 (Reasoning)735344423249.0%
Writer: Palmyra X59285624248.8%
Cohere Command R+ (Aug. 2024)1001001616046.3%
GPT-5.5 (Reasoning, Medium)594945423546.1%
Xiaomi MIMO v2.6 Flash605147403045.8%
DeepSeek V4 Flash 0731 (Reasoning, High)575144413745.8%
Qwen 3.5 9B1006626251045.7%
Hermes 3 405B100693212443.3%
WizardLM 2 8x22b100831312542.5%
GPT-5.4 Mini884038271842.4%
DeepSeek V3.1100811310742.2%
DeepSeek V4.1 Flash (Reasoning, High)514242373541.4%
Gemini 3.6 Flash (Reasoning, Minimal)100711911541.2%
MiniMax M2.789682515740.6%
Qwen 3.8 27B (Reasoning, XHigh)585743321240.5%
Claude Opus 5.5 (Reasoning)414141413740.1%
DeepSeek V3 (2024-12-26)100592411439.6%
Z.AI GLM 4.769474331739.5%
Laguna XS 2.1715332222039.4%
GPT-6 Luna (Reasoning, High)483939393139.1%
GPT-6 Sol543634332837.0%
GPT-6 Sol (Reasoning, Medium)463737353037.0%
GPT-6.1 Sol (Reasoning, Medium)373737373736.6%
GPT-5.6 Sol (Reasoning, Medium)373737373536.4%
Gemini 3.7 Flash (Reasoning, Medium)433835343136.1%
GPT-5.1934121131035.4%
Claude Opus 5 (Reasoning, Low)8272115234.5%
Grok 4.5 (Reasoning, High)443632303034.4%
Qwen 3 235B A22B Instruct 250710048104333.0%
Grok 4.6 (Reasoning, High)373430303032.3%
Gemini 4 Argon (Reasoning, Medium)373131303031.9%
Z.AI GLM 4.7 Flash65542211231.0%
Grok 4.7 (Reasoning, High)313131313030.7%
MiniMax M3393938181429.8%
Grok 4.20755894229.7%
Arcee AI: Trinity Mini10023120027.0%
MiniMax M2.5523817161126.6%
Gemma 3 27B39343225326.3%
Cydonia 24B V4.110017111025.8%
Mistral Small 4 (Reasoning)413421151024.0%
Mistral Small 441262113821.7%
Gemini 2.5 Flash Lite (Reasoning)572685420.2%
GPT-4.1 Nano362713121119.8%
GPT-5.4 Nano291816151418.7%
Laguna S 2.134242111018.2%
ByteDance Seed 1.6 Flash16 – – – – 16.1%
Gemini 3.1 Pro (Preview)3228101114.5%
Ministral 3 8B1816158512.7%
Qwen 2.5 72B19161312212.4%
Ministral 8B2110108510.6%
Mistral Small 3.2 24B2365428.1%
Mistral Medium 3.12294428.0%
Gemini 2.5 Flash Lite1097616.5%
Ministral 3 14B15114106.0%
Ministral 3B1064314.8%
Mistral NeMO1143214.2%
Gemma 3 4B622112.2%
Ministral 3 3B532112.1%