What instrument does Lucy play?

Data extraction

Extract key details from a given block of text.

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

	Score
Claude Opus 4.6 (Reasoning)	100%
Gemini 3.1 Pro (Preview)	100%
Z.AI GLM 5 Turbo	100%
Claude Sonnet 4.6 (Reasoning)	100%
GPT-5.4 (Reasoning)	100%
GPT-5 Mini	100%
GPT-5.1	100%
GPT-5	100%
Qwen 3.5 397B A17B	100%
Qwen 3.5 122B	100%
GPT-5.4 (Reasoning, Low)	100%
Z.AI GLM 5	100%
Claude Sonnet 4.6	100%
MoonshotAI: Kimi K2.5	100%
Qwen 3.5 27B	100%
ByteDance Seed 1.6	100%
GPT-5.4 Mini (Reasoning)	100%
Gemini 3 Flash (Preview, Reasoning)	100%
o4 Mini High	100%
GPT-5.2	100%

	Score	Cost	Time
Arcee AI: Trinity Large (Preview)	100%	$0.0000	430ms
Gemma 3 4B	100%	$0.0000	217ms
Mistral Small Creative	100%	$0.0000	269ms
Mistral NeMO	100%	$0.0000	577ms
Mistral Small 3.2 24B	100%	$0.0000	335ms
Gemini 2.5 Flash Lite	100%	$0.0000	335ms
Ministral 3 14B	100%	$0.0000	515ms
Gemma 3 12B	100%	$0.0000	362ms
Llama 3.1 8B	90%	$0.0000	382ms
Mistral Small 4	100%	$0.0000	543ms
Gemma 3 27B	100%	$0.0000	621ms
Inception Mercury	100%	$0.0000	523ms
Stealth: Aurora Alpha	100%	—	809ms
Mistral Medium 3.1	100%	$0.0000	350ms
DeepSeek V3 (2024-12-26)	100%	$0.0000	547ms
Gemini 2.5 Flash	100%	$0.0000	499ms
Llama 3.1 Nemotron 70B	95%	$0.0000	465ms
GPT-5.4 Nano	90%	$0.0000	550ms
Hermes 3 70B	100%	$0.0000	507ms
Mistral Large 3	100%	$0.0000	547ms

	Score	Cost	Speed	Stability
Gemma 3 4B	100%	$0.0000	217ms	100%
Mistral Small Creative	100%	$0.0000	269ms	100%
Gemini 2.5 Flash Lite	100%	$0.0000	335ms	100%
Mistral Small 3.2 24B	100%	$0.0000	335ms	100%
Gemma 3 12B	100%	$0.0000	362ms	100%
Arcee AI: Trinity Large (Preview)	100%	$0.0000	430ms	100%
Mistral Medium 3.1	100%	$0.0000	350ms	100%
Inception Mercury	100%	$0.0000	523ms	100%
Ministral 3 14B	100%	$0.0000	515ms	100%
Gemini 2.5 Flash	100%	$0.0000	499ms	100%
Mistral Small 4	100%	$0.0000	543ms	100%
Mistral NeMO	100%	$0.0000	577ms	100%
Hermes 3 70B	100%	$0.0000	507ms	100%
DeepSeek V3 (2024-12-26)	100%	$0.0000	547ms	100%
Gemma 3 27B	100%	$0.0000	621ms	100%
Mistral Large 3	100%	$0.0000	547ms	100%
Gemini 3.1 Flash Lite (Preview)	100%	$0.0000	680ms	100%
Inception Mercury 2	100%	$0.0001	390ms	100%
Qwen 2.5 72B	100%	$0.0000	729ms	100%
GPT-5.4 Mini	100%	$0.0001	621ms	100%

Median	Evaluator	Top 3	Flop 3
100.0%	Matches Regex	100Nemotron 3 Super 100GPT-4.1 Mini 100Mistral Large 3	0Ministral 3 8B 0LFM2 24B 0Ministral 3 3B
100.0%	Matches text	100Stealth: Hunter Alpha 100MoonshotAI: Kimi K2.5 100Writer: Palmyra X5	0Ministral 3 8B 0Ministral 3 3B 0LFM2 24B

Data extraction

What instrument does Lucy play?

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Rank	Model	Avg. Cost	Avg. Time	Stability	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Total
85	Claude Opus 4.6 (Reasoning)	$0.0018	2.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
99	Gemini 3.1 Pro (Preview)	$0.0033	6.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
73	Z.AI GLM 5 Turbo	$0.0009	3.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
76	Claude Sonnet 4.6 (Reasoning)	$0.0015	2.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
80	GPT-5.4 (Reasoning)	$0.0012	3.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
60	GPT-5 Mini	$0.0003	4.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
65	GPT-5.1	$0.0007	3.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
95	GPT-5	$0.0023	6.9s	100%	100	100	100	100	100	100	100	100	100	100	100%
98	Qwen 3.5 397B A17B	$0.0016	12.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
93	Qwen 3.5 122B	$0.0020	5.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
42	GPT-5.4 (Reasoning, Low)	$0.0004	1.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
100	Z.AI GLM 5	$0.0015	13.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
38	Claude Sonnet 4.6	$0.0003	928ms	100%	100	100	100	100	100	100	100	100	100	100	100%
90	MoonshotAI: Kimi K2.5	$0.0010	8.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
91	Qwen 3.5 27B	$0.0014	7.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
57	ByteDance Seed 1.6	$0.0002	3.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
56	GPT-5.4 Mini (Reasoning)	$0.0004	2.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
62	Gemini 3 Flash (Preview, Reasoning)	$0.0008	2.6s	100%	100	100	100	100	100	100	100	100	100	100	100%
64	o4 Mini High	$0.0008	2.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
71	GPT-5.2	$0.0009	3.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
54	Claude Opus 4.5	$0.0005	2.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
46	Grok 4.1 Fast	$0.0001	2.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
86	Aion 2.0	$0.0006	8.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
104	Z.AI GLM 4.6	$0.0011	19.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
79	MiniMax M2.7	$0.0004	7.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
110	Gemini 3 Pro (Preview)	$0.0063	6.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
40	Claude Sonnet 4	$0.0003	1.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
81	MiniMax M2.5	$0.0004	7.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
108	Z.AI GLM 4.7	$0.0010	26.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
34	GPT-4.1	$0.0002	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
106	Gemini 2.5 Pro	$0.0050	5.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
67	o4 Mini	$0.0009	3.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
107	Grok 4	$0.0046	7.6s	100%	100	100	100	100	100	100	100	100	100	100	100%
41	Claude Sonnet 4.5	$0.0003	1.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
82	Qwen 3.5 35B	$0.0011	4.9s	100%	100	100	100	100	100	100	100	100	100	100	100%
89	Claude Opus 4	$0.0014	6.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
70	Stealth: Hunter Alpha	$0.0000	7.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
58	ByteDance Seed 2.0 Mini	$0.0001	4.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
59	Gemini 2.5 Flash (Reasoning)	$0.0007	2.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
61	Qwen 3.5 Flash	$0.0002	4.6s	100%	100	100	100	100	100	100	100	100	100	100	100%
35	Z.AI GLM 4.5	$0.0000	1.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
39	Grok 4 Fast	$0.0001	1.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
105	Qwen 3.5 9B	$0.0002	23.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
27	Qwen 3.5 Plus (2026-02-15)	$0.0000	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
52	Stealth: Healer Alpha	$0.0000	3.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
17	Gemini 3.1 Flash Lite (Preview)	$0.0000	680ms	100%	100	100	100	100	100	100	100	100	100	100	100%
51	GPT-5.4 Mini (Reasoning, Low)	$0.0002	2.6s	100%	100	100	100	100	100	100	100	100	100	100	100%
49	Gemini 2.5 Flash Lite (Reasoning)	$0.0002	2.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
16	Mistral Large 3	$0.0000	547ms	100%	100	100	100	100	100	100	100	100	100	100	100%
78	GPT-4o, May 13th (temp=0)	$0.0004	7.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
24	Gemini 3 Flash (Preview)	$0.0000	1.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
29	Claude Haiku 4.5	$0.0001	1.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
25	DeepSeek-V2 Chat	$0.0000	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
88	Z.AI GLM 4.7 Flash	$0.0002	11.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
66	ByteDance Seed 2.0 Lite	$0.0004	5.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
48	Nemotron 3 Super	$0.0000	3.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
30	GPT-5.4	$0.0002	609ms	100%	100	100	100	100	100	100	100	100	100	100	100%
69	Claude 3.5 Sonnet	$0.0003	5.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
18	Inception Mercury 2	$0.0001	390ms	100%	100	100	100	100	100	100	100	100	100	100	100%
75	GPT-4o, May 13th (temp=1)	$0.0004	6.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
23	Stealth: Aurora Alpha	—	809ms	100%	100	100	100	100	100	100	100	100	100	100	100%
32	Claude 3.5 Haiku	$0.0001	1.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
14	DeepSeek V3 (2024-12-26)	$0.0000	547ms	100%	100	100	100	100	100	100	100	100	100	100	100%
43	Claude 3.7 Sonnet	$0.0003	1.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
28	GPT-4.1 Mini	$0.0000	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
68	Hermes 3 405B	$0.0000	6.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
31	GPT-4o, Aug. 6th (temp=1)	$0.0002	871ms	100%	100	100	100	100	100	100	100	100	100	100	100%
72	GPT-5 Nano	$0.0002	6.8s	100%	100	100	100	100	100	100	100	100	100	100	100%
36	GPT-4o, Aug. 6th (temp=0)	$0.0002	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
20	GPT-5.4 Mini	$0.0001	621ms	100%	100	100	100	100	100	100	100	100	100	100	100%
21	Mistral Large 2	$0.0001	321ms	100%	100	100	100	100	100	100	100	100	100	100	100%
44	Mistral Small 4 (Reasoning)	$0.0002	2.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
47	DeepSeek V3.2	$0.0000	3.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
74	Qwen 3 32B	$0.0001	7.3s	100%	100	100	100	100	100	100	100	100	100	100	100%
26	DeepSeek V3 (2025-03-24)	$0.0000	1.2s	100%	100	100	100	100	100	100	100	100	100	100	100%
50	GPT-5.4 Nano (Reasoning)	$0.0001	3.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
3	Gemini 2.5 Flash Lite	$0.0000	335ms	100%	100	100	100	100	100	100	100	100	100	100	100%
10	Gemini 2.5 Flash	$0.0000	499ms	100%	100	100	100	100	100	100	100	100	100	100	100%
37	Qwen3 235B A22B Instruct 2507	$0.0000	2.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
53	Writer: Palmyra X5	$0.0002	3.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
8	Inception Mercury	$0.0000	523ms	100%	100	100	100	100	100	100	100	100	100	100	100%
33	GPT-5.4 Nano (Reasoning, Low)	$0.0001	1.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
87	GPT-4o Mini (temp=1)	$0.0000	11.4s	100%	100	100	100	100	100	100	100	100	100	100	100%
4	Mistral Small 3.2 24B	$0.0000	335ms	100%	100	100	100	100	100	100	100	100	100	100	100%
5	Gemma 3 12B	$0.0000	362ms	100%	100	100	100	100	100	100	100	100	100	100	100%
45	GPT-4o Mini (temp=0)	$0.0000	3.1s	100%	100	100	100	100	100	100	100	100	100	100	100%
15	Gemma 3 27B	$0.0000	621ms	100%	100	100	100	100	100	100	100	100	100	100	100%
7	Mistral Medium 3.1	$0.0000	350ms	100%	100	100	100	100	100	100	100	100	100	100	100%
77	Nemotron 3 Nano	$0.0001	8.0s	100%	100	100	100	100	100	100	100	100	100	100	100%
11	Mistral Small 4	$0.0000	543ms	100%	100	100	100	100	100	100	100	100	100	100	100%
19	Qwen 2.5 72B	$0.0000	729ms	100%	100	100	100	100	100	100	100	100	100	100	100%
6	Arcee AI: Trinity Large (Preview)	$0.0000	430ms	100%	100	100	100	100	100	100	100	100	100	100	100%
2	Mistral Small Creative	$0.0000	269ms	100%	100	100	100	100	100	100	100	100	100	100	100%
13	Hermes 3 70B	$0.0000	507ms	100%	100	100	100	100	100	100	100	100	100	100	100%
9	Ministral 3 14B	$0.0000	515ms	100%	100	100	100	100	100	100	100	100	100	100	100%
22	GPT-4.1 Nano	$0.0000	928ms	100%	100	100	100	100	100	100	100	100	100	100	100%
63	Claude 3 Haiku	$0.0000	5.7s	100%	100	100	100	100	100	100	100	100	100	100	100%
55	Arcee AI: Trinity Mini	$0.0001	3.5s	100%	100	100	100	100	100	100	100	100	100	100	100%
1	Gemma 3 4B	$0.0000	217ms	100%	100	100	100	100	100	100	100	100	100	100	100%
12	Mistral NeMO	$0.0000	577ms	100%	100	100	100	100	100	100	100	100	100	100	100%
92	Claude Opus 4.6	$0.0005	2.0s	70%	100	100	100	100	100	100	100	100	100	50	95%
84	Llama 3.1 70B	$0.0001	394ms	70%	100	100	100	100	100	100	100	100	100	50	95%
83	Llama 3.1 Nemotron 70B	$0.0000	465ms	70%	100	100	100	100	100	100	100	100	100	50	95%
97	GPT-5.4 Nano	$0.0000	550ms	40%	100	100	100	100	100	100	100	100	100	0	90%
94	ByteDance Seed 1.6 Flash	$0.0001	2.4s	60%	100	100	100	100	100	100	100	100	50	50	90%
96	Llama 3.1 8B	$0.0000	382ms	40%	100	100	100	100	100	100	100	100	100	0	90%
101	Grok 4.20 (Beta)	$0.0002	464ms	36%	100	100	100	100	100	100	100	100	50	0	85%
102	DeepSeek V3.1	$0.0000	3.0s	36%	100	100	100	100	100	100	100	100	50	0	85%
103	Cohere Command R+ (Aug. 2024)	$0.0002	332ms	38%	100	100	100	100	100	50	50	50	50	50	75%
112	Mistral Large	$0.0008	6.6s	27%	100	100	100	50	50	50	50	50	50	50	65%
111	WizardLM 2 8x22b	$0.0001	6.6s	27%	100	100	100	50	50	50	50	50	50	50	65%
109	Rocinante 12B	$0.0000	3.3s	27%	100	100	100	50	50	50	50	50	50	50	65%
114	Grok 4.20 (Beta, Reasoning)	$0.0040	3.0s	30%	100	100	50	50	50	50	50	50	50	50	60%
113	Ministral 8B	$0.0000	279ms	0%	100	100	100	100	100	0	0	0	0	0	50%
115	Ministral 3B	$0.0000	252ms	0%	100	50	0	0	0	0	0	0	0	0	15%
117	Ministral 3 8B	$0.0000	338ms	0%	0	0	0	0	0	0	0	0	0	0	0%
116	Ministral 3 3B	$0.0000	327ms	0%	0	0	0	0	0	0	0	0	0	0	0%
118	LFM2 24B	$0.0000	436ms	0%	0	0	0	0	0	0	0	0	0	0	0%
94.24%