Non-name text preserved

Test: Text Replacement

Avg. Score
98.7%
Scenarios
16

Overall Performance

Rank ▲ Model Score Avg. Cost Avg. Time Stability
1Gemini 2.5 Flash Lite100.0%$0.00031.6s100%
2Gemini 3.1 Flash Lite (Preview)100.0%$0.00091.7s100%
3Gemini 3.1 Flash Lite (Reasoning)100.0%$0.00092.5s100%
4Gemini 3.1 Flash Lite100.0%$0.00092.8s100%
5Gemini 3.5 Flash Lite (Reasoning, Minimal)100.0%$0.00141.4s100%
6Gemini 3.5 Flash Lite (Reasoning)100.0%$0.00141.5s100%
7GPT-5.4 Nano (Reasoning, Low)100.0%$0.00073.7s100%
8Gemini 2.5 Flash100.0%$0.00142.1s100%
9GPT-5.4 Nano100.0%$0.00073.1s99%
10Gemini 3 Flash (Preview)100.0%$0.00183.3s100%
11Gemma 3 12B100.0%$0.00018.6s100%
12Mistral Medium 3.1100.0%$0.00125.9s100%
13GPT-5.4 Mini100.0%$0.00272.1s100%
14GPT-4.1 Mini100.0%$0.00106.5s100%
15Mistral Large 3100.0%$0.00117.4s100%
16GPT-4o Mini (temp=1)100.0%$0.00049.2s100%
17GPT-4o Mini (temp=0)100.0%$0.00049.2s100%
18Qwen 3.5 Plus (2026-02-15)100.0%$0.00156.8s100%
19Qwen 2.5 72B100.0%$0.000310.2s100%
20GPT-5.4 Mini (Reasoning, Low)100.0%$0.00293.3s100%
21Claude Haiku 4.5100.0%$0.00342.8s100%
22GPT-5.6 Luna100.0%$0.00362.7s100%
23Laguna S 2.1100.0%$0.000213.5s100%
24Gemini 3.6 Flash (Reasoning, Minimal)100.0%$0.00472.2s100%
25Z.AI GLM 5.3 Flash (Reasoning, Low)99.9%$0.00029.0s97%
26DeepSeek V4 Flash99.7%$0.00027.7s96%
27GPT-5.6 Luna (Reasoning)100.0%$0.00454.3s100%
28Gemma 4 26B100.0%$0.000215.9s100%
29Gemini 3.5 Flash (Reasoning, Minimal)100.0%$0.00542.5s100%
30Mistral Large 2100.0%$0.00427.2s100%
31DeepSeek-V2 Chat100.0%$0.000816.4s100%
32Inception Mercury 299.5%$0.00152.1s94%
33GPT-5.4 Nano (Reasoning)99.5%$0.00115.0s94%
34GPT-4o, Aug. 6th (temp=0)100.0%$0.00642.6s100%
35Gemma 3 27B99.8%$0.000216.0s97%
36GPT-4o, Aug. 6th (temp=1)99.9%$0.00642.6s99%
37DeepSeek V4 Pro100.0%$0.001221.0s100%
38Gemini 2.5 Flash (Reasoning)100.0%$0.005310.3s100%
39Muse Spark 1.1 (Reasoning, Minimal)100.0%$0.00637.9s100%
40Grok 4.2099.1%$0.00194.2s93%
41Xiaomi MIMO v2.5 Pro100.0%$0.003616.3s100%
42GPT-4.199.6%$0.00524.1s96%
43GPT-5.6 Terra100.0%$0.00893.2s100%
44Laguna XS 2.199.3%$0.000212.4s93%
45Xiaomi MIMO v2.599.9%$0.003413.4s97%
46Qwen 3.7 Flash (Reasoning)99.9%$0.000624.0s98%
47GPT-5.2100.0%$0.00866.0s100%
48Thinking Machines Inkling99.8%$0.002516.2s97%
49GPT-5.4100.0%$0.00895.5s100%
50Gemma 4 31B100.0%$0.000328.5s100%
51Grok 4.399.0%$0.00204.6s90%
52GPT-5.4 (Reasoning, Low)100.0%$0.00945.6s100%
53GPT-5.6 Terra (Reasoning)100.0%$0.0104.2s100%
54Claude Sonnet 4.6100.0%$0.0104.4s100%
55Claude Sonnet 4.5100.0%$0.0104.6s100%
56Claude Sonnet 4100.0%$0.0105.6s100%
57Claude Sonnet 5100.0%$0.00928.4s100%
58Gemini 3.7 Flash (Reasoning, Medium)100.0%$0.00918.6s100%
59Z.AI GLM 5.2 (Reasoning, High)100.0%$0.006018.0s100%
60Cydonia 24B V4.198.8%$0.000411.9s90%
61Gemma 3 4B98.0%$0.00016.0s88%
62Muse Spark 1.1 (Reasoning, Medium)100.0%$0.009210.9s100%
63DeepSeek V4.1 Flash (Reasoning, High)100.0%$0.002729.4s100%
64GPT-4.1 Nano97.6%$0.00033.6s87%
65Claude Sonnet 5 (Reasoning, Low)100.0%$0.0119.7s100%
66Claude Sonnet 5 (Reasoning)100.0%$0.0119.8s100%
67Mistral Small 3.2 24B99.1%$0.00024.8s81%
68Z.AI GLM 5 Turbo100.0%$0.008018.2s100%
69Grok 4.20 (Reasoning)100.0%$0.006622.3s100%
70Qwen 3 235B A22B Instruct 250798.2%$0.000314.7s90%
71Muse Spark 1.2 (Reasoning, Medium)100.0%$0.01110.0s100%
72Llama 3.1 70B99.1%$0.000524.8s94%
73Muse Glimmer 30B (Reasoning, Medium)99.5%$0.002423.5s94%
74Z.AI GLM 4.5 Air99.7%$0.001429.2s95%
75GPT-5.4 Mini (Reasoning)99.5%$0.00567.5s89%
76Z.AI GLM 4.599.7%$0.003025.5s95%
77Qwen 3.6 35B100.0%$0.005529.6s100%
78Z.AI GLM 5.3 Flash (Reasoning, Max)100.0%$0.000642.9s100%
79Gemini 3 Flash (Preview, Reasoning)100.0%$0.01018.0s100%
80DeepSeek V3.2100.0%$0.000444.6s100%
81GPT-5.1100.0%$0.01313.0s100%
82Gemini 3.8 Flash (Reasoning, Medium)100.0%$0.01410.5s100%
83Mistral Small 497.7%$0.00043.2s79%
84Writer: Palmyra X597.5%$0.003410.7s89%
85Claude Opus 4.5100.0%$0.0175.2s100%
86Grok 4.5 (Reasoning, Low)100.0%$0.009425.1s100%
87Claude Opus 4.6100.0%$0.0175.6s100%
88GPT-5.6 Sol100.0%$0.0184.5s100%
89GPT-5.5100.0%$0.0184.7s100%
90GPT-5 Mini99.8%$0.005132.4s96%
91ByteDance Seed 1.6100.0%$0.003942.8s100%
92GPT-5.4 (Reasoning)100.0%$0.01513.1s100%
93Thinking Machines Inkling Small (Reasoning, High)99.6%$0.004932.6s95%
94Ministral 3 14B95.8%$0.00023.9s80%
95ByteDance Seed 2.0 Lite100.0%$0.004146.4s100%
96ByteDance Seed 1.6 Flash97.6%$0.000712.2s80%
97Gemini 2.5 Flash Lite (Reasoning)98.8%$0.001715.5s80%
98GPT-5 Nano99.9%$0.002350.4s99%
99Hermes 3 405B99.0%$0.001222.4s81%
100Grok 4.3 (Reasoning)100.0%$0.008338.3s100%
101Mistral Small 4 (Reasoning)97.8%$0.001715.7s81%
102GPT-5.5 (Reasoning, Low)100.0%$0.0216.6s100%
103GPT-OSS 120B99.3%$0.000745.5s93%
104MiniMax M3100.0%$0.002955.0s100%
105Z.AI GLM 4.699.6%$0.004541.5s95%
106Qwen 3.8 Flash (Reasoning)100.0%$0.001959.2s100%
107Muse Spark 1.3 (Reasoning, Medium)100.0%$0.01328.9s100%
108Qwen 3.5 Flash99.7%$0.002748.6s95%
109Grok 4.5 (Reasoning, High)100.0%$0.01524.0s100%
110Kimi K3 (Reasoning, Low)100.0%$0.01525.9s100%
111Claude Opus 4.7100.0%$0.0234.3s100%
112GPT-5.6 Sol (Reasoning)100.0%$0.0227.2s100%
113DeepSeek V3 (2024-12-26)98.2%$0.000715.1s74%
114Claude Opus 4.8 (Reasoning, Low)100.0%$0.0237.2s100%
115Claude Opus 5100.0%$0.0237.9s100%
116MiniMax M2.599.6%$0.001756.6s96%
117Claude Opus 4.7 (Reasoning)100.0%$0.0254.6s100%
118Claude Opus 4.8 (Reasoning)100.0%$0.0247.7s100%
119Gemini 3.6 Flash (Reasoning)100.0%$0.02311.2s100%
120WizardLM 2 8x22b98.6%$0.000737.1s80%
121Aion 2.099.6%$0.003949.4s91%
122Qwen 3.5 35B100.0%$0.01342.7s100%
123GPT-5.5 (Reasoning)100.0%$0.0269.4s100%
124Z.AI GLM 5100.0%$0.00841.0m100%
125o4 Mini99.1%$0.01321.2s83%
126Nemotron 3 Super98.4%$0.000049.3s81%
127Qwen 3.6 Flash98.2%$0.007421.9s77%
128Claude Opus 5 (Reasoning)100.0%$0.02910.2s100%
129Grok 4.6 (Reasoning, High)100.0%$0.01840.6s100%
130Claude Opus 5 (Reasoning, Low)100.0%$0.02910.3s100%
131Gemini 3.5 Flash (Reasoning)100.0%$0.02912.1s100%
132DeepSeek V4 Flash (Reasoning)97.6%$0.000535.4s74%
133Claude Opus 4.6 (Reasoning)100.0%$0.02912.1s100%
134 Kimi K3 (Reasoning, High)100.0%$0.02137.5s100%
135Gemini 2.5 Pro100.0%$0.02820.8s100%
136o4 Mini High99.8%$0.02133.1s96%
137Z.AI GLM 5.1100.0%$0.0121.1m100%
138Claude Sonnet 4.6 (Reasoning)100.0%$0.03118.4s100%
139Qwen 3.5 Plus (2026-04-20)100.0%$0.0111.2m100%
140Qwen 3 32B95.3%$0.000832.6s72%
141Qwen 3.5 27B100.0%$0.0151.1m100%
142Z.AI GLM 5.3 (Reasoning, Max)100.0%$0.0151.1m100%
143Mistral NeMO89.9%$0.00022.6s65%
144Z.AI GLM 4.7100.0%$0.00701.5m100%
145DeepSeek V3 (2025-03-24)95.6%$0.000636.1s66%
146GPT-5100.0%$0.02842.3s100%
147MiniMax M2.798.5%$0.00551.2m83%
148Qwen 3.8 27B (Reasoning, XHigh)99.1%$0.009858.2s81%
149Gemma 4 31B (Reasoning)100.0%$0.00111.9m100%
150Aion 3.099.1%$0.01546.5s81%
151Qwen 3.6 27B98.8%$0.01457.8s87%
152Ministral 3 8B88.3%$0.00023.2s62%
153Z.AI GLM 4.7 Flash97.7%$0.00151.2m78%
154Ministral 8B88.1%$0.00013.3s61%
155Gemma 4 26B (Reasoning)100.0%$0.00142.0m100%
156Qwen 3.5 122B99.7%$0.02457.9s96%
157DeepSeek V4 Pro (Reasoning)99.8%$0.00681.8m96%
158Qwen 3.7 Max100.0%$0.03154.4s100%
159DeepSeek V4 Pro 0813 (Reasoning, High)98.2%$0.01653.2s77%
160Claude Opus 4100.0%$0.0517.7s100%
161Ministral 3 3B84.6%$0.00012.0s59%
162Qwen 3.5 9B98.5%$0.00131.8m83%
163Thinking Machines Inkling (Reasoning)100.0%$0.0131.9m100%
164Qwen 3.8 Max (Reasoning, XHigh)100.0%$0.0251.4m100%
165Kimi K2.5100.0%$0.0112.1m100%
166Ministral 3B83.5%$0.00002.0s56%
167ByteDance Seed 2.0 Mini97.7%$0.00181.8m81%
168DeepSeek V3.191.3%$0.000634.5s50%
169DeepSeek V4 Flash 0731 (Reasoning, High)95.5%$0.00081.5m72%
170Qwen 3.5 397B A17B100.0%$0.00892.3m100%
171Kimi K2.6100.0%$0.0171.9m100%
172Aion 3.0 Mini95.4%$0.00411.1m60%
173Gemini 3.1 Pro (Preview)99.5%$0.04340.8s89%
174Hy4 Preview (Reasoning, High)100.0%$0.0222.0m100%
175Arcee AI: Trinity Mini83.6%$0.000310.1s43%
176Qwen 3.6 Max Preview100.0%$0.0331.8m100%
177Nemotron 3 Nano86.8%$0.00151.9m55%
178Cohere Command R+ (Aug. 2024)74.2%$0.006728.0s34%
179Hermes 3 70B73.2%$0.00141.8m12%
98.70%

Individual Scenarios