Contains a list of texts

Test: Data extraction

Avg. Score

98.3%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Gemini 2.5 Flash Lite	100.0%	$0.0000	383ms	100%
2	Mistral Small Creative	100.0%	$0.0000	428ms	100%
3	Ministral 3 8B	100.0%	$0.0000	452ms	100%
4	Gemma 3 4B	100.0%	$0.0000	537ms	100%
5	Ministral 3 14B	100.0%	$0.0000	609ms	100%
6	Ministral 3 3B	100.0%	$0.0000	694ms	100%
7	Mistral Small 4	100.0%	$0.0000	601ms	100%
8	Gemini 3.1 Flash Lite	100.0%	$0.0001	705ms	100%
9	Gemini 3.1 Flash Lite (Preview)	100.0%	$0.0001	732ms	100%
10	Gemma 3 12B	100.0%	$0.0000	1.0s	100%
11	Mistral Large 3	100.0%	$0.0001	723ms	100%
12	Mistral Medium 3.1	100.0%	$0.0001	761ms	100%
13	GPT-5.4 Nano	100.0%	$0.0000	1.0s	100%
14	Inception Mercury 2	100.0%	$0.0002	422ms	100%
15	Gemma 3 27B	100.0%	$0.0000	1.3s	100%
16	Mistral Small 3.2 24B	100.0%	$0.0000	1.3s	100%
17	Llama 3.1 70B	100.0%	$0.0001	721ms	100%
18	Gemini 3.1 Flash Lite (Reasoning)	100.0%	$0.0001	1.1s	100%
19	Qwen 2.5 72B	100.0%	$0.0000	1.2s	100%
20	Gemma 4 26B	100.0%	$0.0000	1.4s	100%
21	Gemini 3 Flash (Preview)	100.0%	$0.0001	877ms	100%
22	Grok 4.20	100.0%	$0.0002	604ms	100%
23	GPT-5.4 Mini	100.0%	$0.0002	698ms	100%
24	GPT-4.1 Mini	100.0%	$0.0001	1.4s	100%
25	DeepSeek V3 (2024-12-26)	100.0%	$0.0001	1.5s	100%
26	Llama 3.1 Nemotron 70B	100.0%	$0.0000	1.7s	100%
27	Qwen3 235B A22B Instruct 2507	100.0%	$0.0000	1.9s	100%
28	LFM2 24B	100.0%	$0.0000	2.0s	100%
29	Hermes 3 70B	100.0%	$0.0001	1.8s	100%
30	Qwen 3.5 Plus (2026-02-15)	100.0%	$0.0001	1.9s	100%
31	GPT-5.4 Nano (Reasoning, Low)	100.0%	$0.0001	2.0s	100%
32	Stealth: Aurora Alpha	100.0%	—	2.0s	100%
33	DeepSeek V3.1	100.0%	$0.0000	2.3s	100%
34	DeepSeek V4 Flash	100.0%	$0.0000	2.5s	100%
35	DeepSeek-V2 Chat	100.0%	$0.0000	2.5s	100%
36	Z.AI GLM 4.5	100.0%	$0.0001	2.4s	100%
37	Gemini 2.5 Flash Lite (Reasoning)	100.0%	$0.0001	2.0s	100%
38	Claude Haiku 4.5	100.0%	$0.0002	1.5s	100%
39	Grok 4 Fast	100.0%	$0.0002	2.0s	100%
40	Gemini 3.5 Flash (Reasoning, Minimal)	100.0%	$0.0003	980ms	100%
41	DeepSeek V4 Flash (Reasoning)	100.0%	$0.0000	3.0s	100%
42	Mistral NeMO	100.0%	$0.0000	3.1s	100%
43	Mistral Large 2	100.0%	$0.0004	997ms	100%
44	Arcee AI: Trinity Mini	100.0%	$0.0001	3.0s	100%
45	GPT-4.1	100.0%	$0.0003	1.4s	100%
46	DeepSeek V3 (2025-03-24)	100.0%	$0.0001	3.1s	100%
47	GPT-4o, Aug. 6th (temp=0)	100.0%	$0.0004	1.1s	100%
48	GPT-4o, Aug. 6th (temp=1)	100.0%	$0.0004	1.1s	100%
49	Mistral Small 4 (Reasoning)	100.0%	$0.0002	2.5s	100%
50	Grok 4.1 Fast	100.0%	$0.0002	2.8s	100%
51	Nemotron 3 Super	100.0%	$0.0000	4.3s	100%
52	GPT-5.4	100.0%	$0.0006	876ms	100%
53	ByteDance Seed 1.6 Flash	100.0%	$0.0002	3.7s	100%
54	GPT-5.4 Mini (Reasoning, Low)	100.0%	$0.0003	3.0s	100%
55	Claude 3 Haiku	100.0%	$0.0001	5.1s	100%
56	Gemma 4 31B	100.0%	$0.0000	5.5s	100%
57	WizardLM 2 8x22b	100.0%	$0.0001	5.4s	100%
58	Claude Sonnet 4	100.0%	$0.0007	1.8s	100%
59	Claude Sonnet 4.5	100.0%	$0.0007	2.1s	100%
60	Claude 3.7 Sonnet	100.0%	$0.0008	2.0s	100%
61	DeepSeek V3.2	100.0%	$0.0001	6.5s	100%
62	GPT-5.4 Mini (Reasoning)	100.0%	$0.0006	3.3s	100%
63	GPT-OSS 120B	100.0%	$0.0001	6.7s	100%
64	GPT-5.5	100.0%	$0.0012	1.1s	100%
65	GPT-5 Mini	100.0%	$0.0005	5.3s	100%
66	GPT-5.4 (Reasoning, Low)	100.0%	$0.0010	2.3s	100%
67	Stealth: Hunter Alpha	100.0%	$0.0000	9.0s	100%
68	ByteDance Seed 2.0 Lite	100.0%	$0.0005	6.0s	100%
69	Gemini 3 Flash (Preview, Reasoning)	100.0%	$0.0010	2.9s	100%
70	Nemotron 3 Nano	100.0%	$0.0001	8.8s	100%
71	Claude Sonnet 4.6	100.0%	$0.0013	1.6s	100%
72	Qwen 3 32B	100.0%	$0.0002	8.5s	100%
73	Writer: Palmyra X5	100.0%	$0.0003	7.9s	100%
74	Claude Opus 4.6	100.0%	$0.0012	2.4s	100%
75	GPT-5.2	100.0%	$0.0011	3.1s	100%
76	GPT-4o, May 13th (temp=1)	100.0%	$0.0007	5.7s	100%
77	GPT-4o, May 13th (temp=0)	100.0%	$0.0007	5.7s	100%
78	ByteDance Seed 2.0 Mini	100.0%	$0.0001	9.5s	100%
79	GPT-5.1	100.0%	$0.0011	3.9s	100%
80	o4 Mini	100.0%	$0.0012	3.4s	100%
81	DeepSeek V4 Pro	100.0%	$0.0001	10.1s	100%
82	Claude Opus 4.7	100.0%	$0.0016	1.1s	100%
83	Claude Opus 4.5	100.0%	$0.0015	2.3s	100%
84	o4 Mini High	100.0%	$0.0013	3.7s	100%
85	Claude Opus 4.7 (Reasoning)	100.0%	$0.0016	1.4s	100%
86	Claude 3.5 Sonnet	100.0%	$0.0011	5.1s	100%
87	ByteDance Seed 1.6	100.0%	$0.0006	8.0s	100%
88	Xiaomi MIMO v2.5	100.0%	$0.0010	5.4s	100%
89	GPT-5 Nano	100.0%	$0.0003	10.6s	100%
90	GPT-4o Mini (temp=0)	100.0%	$0.0000	12.9s	100%
91	Qwen 3.5 9B	100.0%	$0.0001	12.7s	100%
92	Qwen 3.5 Flash	100.0%	$0.0004	11.2s	100%
93	MiniMax M2.7	100.0%	$0.0008	9.2s	100%
94	GPT-5.4 (Reasoning)	100.0%	$0.0016	3.8s	100%
95	MiniMax M2.5	100.0%	$0.0008	9.4s	100%
96	Gemma 4 26B (Reasoning)	100.0%	$0.0001	13.9s	100%
97	Mistral Large	100.0%	$0.0015	5.7s	100%
98	Qwen 3.6 Flash	100.0%	$0.0016	5.2s	100%
99	Grok 4.20 (Reasoning)	100.0%	$0.0016	6.2s	100%
100	Xiaomi MIMO v2.5 Pro	100.0%	$0.0014	7.6s	100%
101	Aion 2.0	100.0%	$0.0008	11.7s	100%
102	GPT-5.5 (Reasoning, Low)	100.0%	$0.0023	3.1s	100%
103	Gemma 4 31B (Reasoning)	100.0%	$0.0001	17.8s	100%
104	Qwen 3.6 35B	100.0%	$0.0016	8.6s	100%
105	Qwen 3.5 35B	100.0%	$0.0020	6.6s	100%
106	Qwen 3.5 27B	100.0%	$0.0017	8.7s	100%
107	MoonshotAI: Kimi K2.5	100.0%	$0.0014	11.4s	100%
108	Claude Sonnet 4.6 (Reasoning)	100.0%	$0.0029	3.2s	100%
109	Qwen 3.5 122B	100.0%	$0.0026	6.3s	100%
110	MoonshotAI: Kimi K2.6	100.0%	$0.0015	13.0s	100%
111	GPT-5.5 (Reasoning)	100.0%	$0.0030	4.2s	100%
112	Grok 4.20 (Beta, Reasoning)	100.0%	$0.0033	2.1s	100%
113	Z.AI GLM 5.1	100.0%	$0.0020	12.1s	100%
114	Z.AI GLM 4.7	100.0%	$0.0011	19.2s	100%
115	Grok 4.3 (Reasoning)	100.0%	$0.0019	16.0s	100%
116	Llama 3.1 8B	95.0%	$0.0000	508ms	56%
117	Inception Mercury	95.0%	$0.0000	522ms	56%
118	Z.AI GLM 5	100.0%	$0.0018	17.3s	100%
119	Grok 4.20 (Beta)	95.0%	$0.0002	472ms	56%
120	Grok 4.3	95.0%	$0.0002	758ms	56%
121	GPT-5.4 Nano (Reasoning)	95.0%	$0.0001	2.5s	56%
122	Claude Opus 4.6 (Reasoning)	100.0%	$0.0043	3.3s	100%
123	Rocinante 12B	95.0%	$0.0000	3.8s	56%
124	Stealth: Healer Alpha	95.0%	$0.0000	5.4s	56%
125	Gemini 3.5 Flash (Reasoning)	100.0%	$0.0048	2.7s	100%
126	Z.AI GLM 4.6	100.0%	$0.0016	23.6s	100%
127	Qwen 3.5 397B A17B	100.0%	$0.0025	19.5s	100%
128	Qwen 3.5 Plus (2026-04-20)	100.0%	$0.0028	18.1s	100%
129	Z.AI GLM 4.7 Flash	95.0%	$0.0002	10.5s	56%
130	GPT-4o Mini (temp=1)	100.0%	$0.0000	40.9s	100%
131	Gemini 3.1 Pro (Preview)	100.0%	$0.0057	8.2s	100%
132	Claude Opus 4	100.0%	$0.0063	7.5s	100%
133	Hermes 3 405B	90.0%	$0.0000	7.6s	40%
134	Grok 4	100.0%	$0.0063	9.2s	100%
135	Gemini 3 Pro (Preview)	100.0%	$0.0068	6.5s	100%
136	Gemini 2.5 Flash (Reasoning)	90.0%	$0.0010	2.6s	40%
137	DeepSeek V4 Pro (Reasoning)	100.0%	$0.0031	32.0s	100%
138	Ministral 3B	85.0%	$0.0000	362ms	29%
139	Ministral 8B	85.0%	$0.0000	462ms	29%
140	Qwen3.7 Max	100.0%	$0.0063	12.8s	100%
141	Arcee AI: Trinity Large (Preview)	85.0%	$0.0000	1.3s	29%
142	Qwen3.6 Max Preview	100.0%	$0.0054	18.9s	100%
143	Z.AI GLM 5 Turbo	90.0%	$0.0014	5.1s	40%
144	Qwen 3.6 27B	95.0%	$0.0030	14.3s	56%
145	GPT-5	95.0%	$0.0042	9.5s	56%
146	Z.AI GLM 4.5 Air	100.0%	$0.0026	51.6s	100%
147	Cohere Command R+ (Aug. 2024)	70.0%	$0.0005	930ms	8%
148	Gemini 2.5 Pro	95.0%	$0.0081	7.1s	56%
149	Gemini 2.5 Flash	50.0%	$0.0001	510ms	0%
150	GPT-4.1 Nano	50.0%	$0.0000	1.4s	0%
98.27%

Individual Scenarios

▼

All valid emails

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Qwen3.7 Max	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3.6 Max Preview	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5.1	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.3 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.7 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.6	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 31B (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-04-20)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 26B (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Pro (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.6 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.6 35B	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100	100	100	100	100	100.0%
Xiaomi MIMO v2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 31B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.5 Flash (Reasoning, Minimal)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-OSS 120B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 26B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Xiaomi MIMO v2.5	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta)	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5 Air	100	100	100	100	100	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 2	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.1	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3 32B	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.3	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 4	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100	100	100	100	100	100.0%
Hermes 3 70B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 8B	100	100	100	100	100	100	100	100	100	100	100.0%
LFM2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
Rocinante 12B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100	100	100	0	0	80.0%
Ministral 3B	100	100	100	100	100	100	100	100	0	0	80.0%

▼

Fruits excluding citrus

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Qwen3.7 Max	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3.6 Max Preview	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5.1	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.3 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.7 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.6	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 31B (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-04-20)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 26B (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Pro (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.6 35B	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100	100	100	100	100	100.0%
Xiaomi MIMO v2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 31B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.5 Flash (Reasoning, Minimal)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-OSS 120B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 4 26B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Xiaomi MIMO v2.5	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5 Air	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 2	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.1	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3 32B	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V4 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	100	100	100	100.0%
Nemotron 3 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 4	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100	100	100	100	100	100.0%
Hermes 3 70B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100	100	100	100	100	100.0%
LFM2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	0	90.0%
Qwen 3.6 27B	100	100	100	100	100	100	100	100	100	0	90.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	0	90.0%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	100	0	90.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	0	90.0%
Grok 4.20 (Beta)	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	0	90.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	0	90.0%
Grok 4.3	100	100	100	100	100	100	100	100	100	0	90.0%
Ministral 8B	100	100	100	100	100	100	100	100	100	0	90.0%
Llama 3.1 8B	100	100	100	100	100	100	100	100	100	0	90.0%
Ministral 3B	100	100	100	100	100	100	100	100	100	0	90.0%
Rocinante 12B	100	100	100	100	100	100	100	100	100	0	90.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	0	0	80.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	0	0	80.0%
Hermes 3 405B	100	100	100	100	100	100	100	100	0	0	80.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	0	0	0	70.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	0	0	0	0	0	0	40.0%
Gemini 2.5 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
GPT-4.1 Nano	0	0	0	0	0	0	0	0	0	0	0.0%

Contains a list of texts

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

All valid emails

Fruits excluding citrus