Red-herring resistance

Test: Relationship tree

Avg. Score
99.4%
Scenarios
2

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00333.2s100%
2Gemini 3.1 Flash Lite100.0%$0.00313.3s100%
3Gemini 2.5 Flash Lite100.0%$0.00234.8s100%
4GPT-4.1 Nano100.0%$0.00096.9s100%
5Gemini 3.1 Flash Lite (Preview)100.0%$0.00463.2s100%
6GPT-5.4 Nano100.0%$0.002611.2s100%
7Gemini 2.5 Flash100.0%$0.00756.1s100%
8Mistral Small 3.2 24B100.0%$0.001713.8s100%
9Gemini 3 Flash (Preview)100.0%$0.00877.1s100%
10Mistral NeMO100.0%$0.002415.4s100%
11GPT-5.4 Nano (Reasoning, Low)100.0%$0.003813.8s100%
12GPT-5.4 Mini100.0%$0.00877.9s100%
13Grok 4.3100.0%$0.00947.8s100%
14GPT-4o Mini (temp=0)100.0%$0.001920.7s100%
15GPT-5.6 Luna100.0%$0.0128.7s100%
16Inception Mercury 2100.0%$0.009612.8s100%
17DeepSeek V4 Pro100.0%$0.008317.3s100%
18Gemma 3 4B100.0%$0.000727.5s100%
19Mistral Large 3100.0%$0.009117.5s100%
20Ministral 3 14B100.0%$0.003125.4s100%
21MiniMax M2.7100.0%$0.006321.4s100%
22Gemma 4 26B100.0%$0.001827.2s100%
23Grok 4.3 (Reasoning)100.0%$0.01313.9s100%
24Gemma 3 27B100.0%$0.001627.5s100%
25Mistral Small 4 (Reasoning)100.0%$0.005124.7s100%
26GPT-5.4 Mini (Reasoning, Low)100.0%$0.01414.4s100%
27GPT-4.1 Mini100.0%$0.004626.0s100%
28Grok 4.20100.0%$0.0207.5s100%
29Gemma 3 12B100.0%$0.001430.4s100%
30Mistral Medium 3.1100.0%$0.01021.2s100%
31Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.0246.3s100%
32GPT-4o Mini (temp=1)100.0%$0.002633.4s100%
33ByteDance Seed 1.6 Flash100.0%$0.002034.2s100%
34GPT-4.1100.0%$0.0248.5s100%
35Claude Haiku 4.5100.0%$0.0248.2s100%
36Writer: Palmyra X5100.0%$0.01618.4s100%
37DeepSeek V3.2100.0%$0.004633.9s100%
38DeepSeek-V2 Chat100.0%$0.004934.0s100%
39Llama 3.1 70B100.0%$0.006434.0s100%
40GPT-4o, Aug. 6th (temp=1)100.0%$0.0299.1s100%
41DeepSeek V3 (2024-12-26)100.0%$0.004540.2s100%
42GPT-4o, Aug. 6th (temp=0)100.0%$0.0328.4s100%
43GPT-5.1100.0%$0.02517.7s100%
44MiniMax M2.5100.0%$0.003645.0s100%
45GPT-5.6 Terra100.0%$0.0349.4s100%
46GPT-5.6 Luna (Reasoning)100.0%$0.02718.6s100%
47GPT-5.4 Nano (Reasoning)100.0%$0.008841.7s100%
48DeepSeek V4 Flash100.0%$0.002051.4s100%
49DeepSeek V3 (2025-03-24)100.0%$0.003750.3s100%
50Z.AI GLM 4.5100.0%$0.007548.1s100%
51GPT-5.4100.0%$0.03317.4s100%
52DeepSeek V3.1100.0%$0.005552.0s100%
53Cydonia 24B V4.1100.0%$0.00401.0m100%
54Mistral Large 2100.0%$0.03720.5s100%
55Gemini 2.5 Flash (Reasoning)100.0%$0.02337.3s100%
56Gemini 2.5 Flash Lite (Reasoning)100.0%$0.00731.0m100%
57Qwen 3.6 Flash100.0%$0.01551.7s100%
58Xiaomi MIMO v2.5100.0%$0.00271.1m100%
59Grok 4.20 (Reasoning)100.0%$0.02740.0s100%
60Qwen 2.5 72B100.0%$0.00561.2m100%
61Gemini 3 Flash (Preview, Reasoning)100.0%$0.03040.3s100%
62Hermes 3 405B100.0%$0.0151.0m100%
63Qwen 3.6 35B100.0%$0.0141.1m100%
64ByteDance Seed 1.6100.0%$0.0141.2m100%
65o4 Mini100.0%$0.03745.7s100%
66Grok 4.5 (Reasoning, Low)100.0%$0.04049.7s100%
67GPT-5.6 Terra (Reasoning)100.0%$0.06024.2s100%
68GPT-5.4 (Reasoning, Low)100.0%$0.05335.5s100%
69Claude Sonnet 5100.0%$0.06817.1s100%
70Claude Sonnet 4100.0%$0.07217.5s100%
71Claude Sonnet 4.5100.0%$0.07718.6s100%
72Gemma 4 31B100.0%$0.00281.9m100%
73Arcee AI: Trinity Mini100.0%$0.00371.9m100%
74Claude Sonnet 4.6100.0%$0.08123.3s100%
75Xiaomi MIMO v2.5 Pro100.0%$0.00761.9m100%
76Cohere Command R+ (Aug. 2024)100.0%$0.05756.5s100%
77GPT-5.2100.0%$0.06250.7s100%
78GPT-5.6 Sol100.0%$0.09618.1s100%
79GPT-OSS 120B100.0%$0.00402.2m100%
80Qwen 3.5 35B100.0%$0.0152.0m100%
81GPT-5 Mini100.0%$0.0192.0m100%
82o4 Mini High100.0%$0.0591.3m100%
83WizardLM 2 8x22b100.0%$0.00982.3m100%
84Z.AI GLM 5.2 (Reasoning, High)100.0%$0.0391.8m100%
85GPT-5.5 (Reasoning, Low)100.0%$0.09742.6s100%
86DeepSeek V4 Pro (Reasoning)100.0%$0.0202.3m100%
87GPT-5.5100.0%$0.10537.1s100%
88Nemotron 3 Nano100.0%$0.00392.8m100%
89Qwen 3 32B100.0%$0.00422.9m100%
90Gemini 2.5 Pro100.0%$0.09958.2s100%
91Claude Opus 4.5100.0%$0.13119.8s100%
92Gemini 3.5 Flash (Reasoning)100.0%$0.11349.4s100%
93Gemma 4 26B (Reasoning)100.0%$0.00413.1m100%
94Qwen 3.6 27B100.0%$0.0342.7m100%
95Z.AI GLM 4.5 Air100.0%$0.00713.2m100%
96Z.AI GLM 4.6100.0%$0.0183.0m100%
97Aion 2.0100.0%$0.0243.0m100%
98Qwen 3.5 397B A17B100.0%$0.0452.6m100%
99Qwen 3.5 Plus (2026-04-20)100.0%$0.0233.1m100%
100DeepSeek V4 Flash (Reasoning)100.0%$0.00413.5m100%
101Grok 4.5 (Reasoning, High)100.0%$0.0802.0m100%
102Claude Opus 4.6100.0%$0.15431.4s100%
103Qwen 3.5 Flash100.0%$0.00403.8m100%
104ByteDance Seed 2.0 Lite100.0%$0.0143.6m100%
105Claude Opus 4.7100.0%$0.18224.3s100%
106Z.AI GLM 4.7100.0%$0.0253.7m100%
107GPT-5100.0%$0.0922.3m100%
108Claude Opus 4.7 (Reasoning)100.0%$0.18425.0s100%
109Qwen 3.5 27B100.0%$0.0293.7m100%
110Qwen 3.5 Plus (2026-02-15)100.0%$0.0213.9m100%
111Z.AI GLM 5 Turbo100.0%$0.0443.6m100%
112Qwen3.7 Max100.0%$0.0453.5m100%
113Qwen 3.5 122B100.0%$0.0354.0m100%
114GPT-5.6 Sol (Reasoning)100.0%$0.18659.0s100%
115Gemini 3.1 Pro (Preview)100.0%$0.1721.5m100%
116GPT-5.4 Mini (Reasoning)100.0%$0.1172.8m100%
117Claude Sonnet 5 (Reasoning)100.0%$0.1721.7m100%
118Claude Sonnet 5 (Reasoning, Low)100.0%$0.1751.7m100%
119Z.AI GLM 5100.0%$0.0374.6m100%
120Qwen3.6 Max Preview100.0%$0.0843.7m100%
121Aion 3.0 Mini100.0%$0.0304.9m100%
122Nemotron 3 Super100.0%$0.00005.5m100%
123Gemma 4 31B (Reasoning)100.0%$0.00435.8m100%
124MoonshotAI: Kimi K2.5100.0%$0.0315.4m100%
125GPT-5.4 (Reasoning)100.0%$0.1752.6m100%
126MoonshotAI: Kimi K2.6100.0%$0.0825.0m100%
127GPT-5.5 (Reasoning)100.0%$0.2512.0m100%
128Aion 3.0100.0%$0.0745.8m100%
129Qwen 3.5 9B100.0%$0.00407.8m100%
130Ministral 8B93.2%$0.001615.6s59%
131Ministral 3 8B93.2%$0.002217.0s59%
132ByteDance Seed 2.0 Mini100.0%$0.00628.7m100%
133Z.AI GLM 5.1100.0%$0.0817.3m100%
134Qwen3 235B A22B Instruct 250793.2%$0.00171.0m59%
135Claude Opus 4.8 (Reasoning, Low)100.0%$0.3831.9m100%
136Claude Opus 4.8 (Reasoning)100.0%$0.3811.9m100%
137Claude Opus 4.6 (Reasoning)100.0%$0.3562.6m100%
138Claude Opus 4100.0%$0.3682.4m100%
139MiniMax M3100.0%$0.0369.3m100%
140Z.AI GLM 4.7 Flash93.2%$0.00502.8m59%
141Ministral 3 3B90.6%$0.00079.9s44%
142Mistral Small 490.6%$0.00307.4s44%
143GPT-5 Nano90.6%$0.00802.2m44%
144Hermes 3 70B86.3%$0.004542.7s45%
145Claude Sonnet 4.6 (Reasoning)100.0%$0.4485.9m100%
146Ministral 3B81.3%$0.00079.8s25%
99.40%

Individual Scenarios

Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
Z.AI GLM 4.7 Flash100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Qwen3 235B A22B Instruct 2507100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100100100100100.0%
Ministral 3 14B100100100100100100.0%
Ministral 3 8B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Hermes 3 70B100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 8B100100100100100100.0%
GPT-5 Nano100100100100681.3%
Mistral Small 4100100100100681.3%
Ministral 3 3B100100100100681.3%
Ministral 3B1001001006662.5%
Model # 1 # 2 # 3 # 4 # 5 Avg ▼
GPT-5.6 Sol (Reasoning)100100100100100100.0%
Claude Opus 4.6 (Reasoning)100100100100100100.0%
Qwen3.7 Max100100100100100100.0%
Grok 4.5 (Reasoning, High)100100100100100100.0%
Gemini 3.1 Pro (Preview)100100100100100100.0%
GPT-5.4 (Reasoning)100100100100100100.0%
Z.AI GLM 5.1100100100100100100.0%
Qwen3.6 Max Preview100100100100100100.0%
GPT-5.5 (Reasoning)100100100100100100.0%
Claude Sonnet 4.6 (Reasoning)100100100100100100.0%
Z.AI GLM 5.2 (Reasoning, High)100100100100100100.0%
Gemini 3.5 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 5 Turbo100100100100100100.0%
MoonshotAI: Kimi K2.6100100100100100100.0%
Claude Opus 4.7 (Reasoning)100100100100100100.0%
GPT-5.5 (Reasoning, Low)100100100100100100.0%
GPT-5.6 Terra (Reasoning)100100100100100100.0%
Claude Opus 4.8 (Reasoning)100100100100100100.0%
Claude Opus 4.6100100100100100100.0%
Claude Opus 4.8 (Reasoning, Low)100100100100100100.0%
GPT-5100100100100100100.0%
GPT-5 Mini100100100100100100.0%
Qwen 3.5 397B A17B100100100100100100.0%
Grok 4.3 (Reasoning)100100100100100100.0%
Grok 4.5 (Reasoning, Low)100100100100100100.0%
GPT-5.4 (Reasoning, Low)100100100100100100.0%
Grok 4.20 (Reasoning)100100100100100100.0%
MoonshotAI: Kimi K2.5100100100100100100.0%
GPT-5.6 Sol100100100100100100.0%
GPT-5.1100100100100100100.0%
Claude Sonnet 4.6100100100100100100.0%
GPT-5.6 Luna (Reasoning)100100100100100100.0%
MiniMax M3100100100100100100.0%
Claude Sonnet 5 (Reasoning)100100100100100100.0%
Qwen 3.5 122B100100100100100100.0%
Claude Sonnet 5 (Reasoning, Low)100100100100100100.0%
Qwen 3.5 27B100100100100100100.0%
Gemini 3 Flash (Preview, Reasoning)100100100100100100.0%
Claude Opus 4.7100100100100100100.0%
GPT-5.4 Mini (Reasoning)100100100100100100.0%
Qwen 3.5 Plus (2026-04-20)100100100100100100.0%
Gemma 4 31B (Reasoning)100100100100100100.0%
Claude Opus 4.5100100100100100100.0%
Z.AI GLM 5100100100100100100.0%
ByteDance Seed 1.6100100100100100100.0%
GPT-5.2100100100100100100.0%
GPT-5.5100100100100100100.0%
Qwen 3.6 Flash100100100100100100.0%
DeepSeek V4 Pro (Reasoning)100100100100100100.0%
Gemma 4 26B (Reasoning)100100100100100100.0%
Aion 3.0100100100100100100.0%
o4 Mini High100100100100100100.0%
Gemini 2.5 Pro100100100100100100.0%
Qwen 3.6 27B100100100100100100.0%
GPT-5.6 Terra100100100100100100.0%
DeepSeek V4 Flash (Reasoning)100100100100100100.0%
Z.AI GLM 4.7100100100100100100.0%
Qwen 3.6 35B100100100100100100.0%
Z.AI GLM 4.6100100100100100100.0%
Claude Sonnet 4100100100100100100.0%
Claude Sonnet 4.5100100100100100100.0%
Claude Sonnet 5100100100100100100.0%
Claude Opus 4100100100100100100.0%
Qwen 3.5 35B100100100100100100.0%
GPT-4.1100100100100100100.0%
MiniMax M2.5100100100100100100.0%
Aion 2.0100100100100100100.0%
o4 Mini100100100100100100.0%
MiniMax M2.7100100100100100100.0%
Qwen 3.5 Plus (2026-02-15)100100100100100100.0%
Xiaomi MIMO v2.5 Pro100100100100100100.0%
Gemini 3.1 Flash Lite (Reasoning)100100100100100100.0%
Gemini 3.5 Flash (Reasoning, Minimal)100100100100100100.0%
ByteDance Seed 2.0 Mini100100100100100100.0%
Qwen 3.5 Flash100100100100100100.0%
Gemini 3 Flash (Preview)100100100100100100.0%
Gemini 3.1 Flash Lite (Preview)100100100100100100.0%
Gemma 4 31B100100100100100100.0%
Gemini 3.1 Flash Lite100100100100100100.0%
GPT-5.6 Luna100100100100100100.0%
Z.AI GLM 4.5100100100100100100.0%
Gemma 4 26B100100100100100100.0%
GPT-OSS 120B100100100100100100.0%
GPT-5.4100100100100100100.0%
Mistral Large 3100100100100100100.0%
ByteDance Seed 2.0 Lite100100100100100100.0%
Gemini 2.5 Flash (Reasoning)100100100100100100.0%
DeepSeek-V2 Chat100100100100100100.0%
Qwen 3.5 9B100100100100100100.0%
Xiaomi MIMO v2.5100100100100100100.0%
Aion 3.0 Mini100100100100100100.0%
GPT-5.4 Mini (Reasoning, Low)100100100100100100.0%
Claude Haiku 4.5100100100100100100.0%
Gemini 2.5 Flash Lite (Reasoning)100100100100100100.0%
DeepSeek V3 (2024-12-26)100100100100100100.0%
DeepSeek V3.1100100100100100100.0%
DeepSeek V3.2100100100100100100.0%
GPT-4o, Aug. 6th (temp=0)100100100100100100.0%
DeepSeek V4 Pro100100100100100100.0%
DeepSeek V4 Flash100100100100100100.0%
Inception Mercury 2100100100100100100.0%
Nemotron 3 Super100100100100100100.0%
Mistral Large 2100100100100100100.0%
GPT-4.1 Mini100100100100100100.0%
GPT-4o, Aug. 6th (temp=1)100100100100100100.0%
Grok 4.20100100100100100100.0%
Hermes 3 405B100100100100100100.0%
Z.AI GLM 4.5 Air100100100100100100.0%
Gemini 2.5 Flash100100100100100100.0%
GPT-5.4 Mini100100100100100100.0%
GPT-5 Nano100100100100100100.0%
GPT-5.4 Nano (Reasoning)100100100100100100.0%
DeepSeek V3 (2025-03-24)100100100100100100.0%
Gemini 2.5 Flash Lite100100100100100100.0%
Mistral Small 4 (Reasoning)100100100100100100.0%
Qwen 3 32B100100100100100100.0%
Writer: Palmyra X5100100100100100100.0%
Grok 4.3100100100100100100.0%
GPT-4o Mini (temp=1)100100100100100100.0%
GPT-5.4 Nano (Reasoning, Low)100100100100100100.0%
Llama 3.1 70B100100100100100100.0%
Mistral Small 3.2 24B100100100100100100.0%
GPT-4o Mini (temp=0)100100100100100100.0%
Mistral Medium 3.1100100100100100100.0%
Gemma 3 12B100100100100100100.0%
Gemma 3 27B100100100100100100.0%
Mistral Small 4100100100100100100.0%
Nemotron 3 Nano100100100100100100.0%
Qwen 2.5 72B100100100100100100.0%
Cydonia 24B V4.1100100100100100100.0%
GPT-5.4 Nano100100100100100100.0%
WizardLM 2 8x22b100100100100100100.0%
ByteDance Seed 1.6 Flash100100.0%
Ministral 3 14B100100100100100100.0%
GPT-4.1 Nano100100100100100100.0%
Arcee AI: Trinity Mini100100100100100100.0%
Cohere Command R+ (Aug. 2024)100100100100100100.0%
Gemma 3 4B100100100100100100.0%
Ministral 3 3B100100100100100100.0%
Mistral NeMO100100100100100100.0%
Ministral 3B100100100100100100.0%
Z.AI GLM 4.7 Flash1001001001003286.3%
Qwen3 235B A22B Instruct 25071001001001003286.3%
Ministral 3 8B1001001001003286.3%
Ministral 8B1001001001003286.3%
Hermes 3 70B100100100323272.7%