Possessive traps preserved

Test: Text Replacement

Avg. Score

96.7%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Gemini 2.5 Flash Lite	100.0%	$0.0002	1.3s	100%
2	Mistral NeMO	100.0%	$0.0001	2.2s	100%
3	Ministral 8B	100.0%	$0.0001	2.4s	100%
4	Mistral Small Creative	100.0%	$0.0002	2.3s	100%
5	Ministral 3 8B	100.0%	$0.0001	3.1s	100%
6	GPT-4.1 Nano	100.0%	$0.0002	3.0s	100%
7	Mistral Small 4	100.0%	$0.0003	2.5s	100%
8	Ministral 3 14B	100.0%	$0.0002	3.2s	100%
9	Mistral Small 3.2 24B	100.0%	$0.0002	3.6s	100%
10	Gemini 3.1 Flash Lite (Preview)	100.0%	$0.0007	1.6s	100%
11	GPT-5.4 Nano (Reasoning, Low)	100.0%	$0.0006	2.4s	100%
12	GPT-5.4 Nano	100.0%	$0.0006	2.7s	100%
13	Gemma 3 4B	100.0%	$0.0001	5.4s	100%
14	GPT-5.4 Nano (Reasoning)	100.0%	$0.0007	3.1s	100%
15	Llama 3.1 8B	100.0%	$0.0000	6.9s	100%
16	Gemma 3 12B	100.0%	$0.0001	6.6s	100%
17	Gemini 2.5 Flash	100.0%	$0.0012	1.7s	100%
18	GPT-4o Mini (temp=1)	100.0%	$0.0003	7.3s	100%
19	GPT-4.1 Mini	100.0%	$0.0008	4.9s	100%
20	Qwen 2.5 72B	100.0%	$0.0002	8.1s	100%
21	GPT-4o Mini (temp=0)	100.0%	$0.0003	7.7s	100%
22	Grok 4 Fast	100.0%	$0.0007	6.0s	100%
23	Inception Mercury	100.0%	$0.0003	8.1s	100%
24	Mistral Medium 3.1	100.0%	$0.0010	4.9s	100%
25	Gemini 3 Flash (Preview)	100.0%	$0.0015	2.7s	100%
26	Arcee AI: Trinity Mini	100.0%	$0.0002	8.7s	100%
27	Mistral Large 3	100.0%	$0.0009	5.8s	100%
28	Stealth: Healer Alpha	100.0%	$0.0000	10.6s	100%
29	Qwen 3.5 Plus (2026-02-15)	100.0%	$0.0012	5.4s	100%
30	GPT-5.4 Mini	100.0%	$0.0021	1.9s	100%
31	Qwen3 235B A22B Instruct 2507	100.0%	$0.0003	10.9s	100%
32	Gemini 2.5 Flash Lite (Reasoning)	100.0%	$0.0011	7.2s	100%
33	Llama 3.1 70B	100.0%	$0.0004	12.3s	100%
34	Gemma 3 27B	100.0%	$0.0001	14.0s	100%
35	ByteDance Seed 1.6 Flash	100.0%	$0.0006	12.0s	100%
36	Stealth: Hunter Alpha	100.0%	$0.0000	15.2s	100%
37	Claude Haiku 4.5	100.0%	$0.0027	2.2s	100%
38	Llama 3.1 Nemotron 70B	100.0%	$0.0011	10.9s	100%
39	DeepSeek-V2 Chat	100.0%	$0.0006	13.3s	100%
40	DeepSeek V3 (2024-12-26)	100.0%	$0.0006	13.5s	100%
41	Arcee AI: Trinity Large (Preview)	100.0%	$0.0000	19.6s	100%
42	Hermes 3 405B	100.0%	$0.0009	16.2s	100%
43	DeepSeek V3 (2025-03-24)	100.0%	$0.0005	18.8s	100%
44	Mistral Large 2	100.0%	$0.0034	5.8s	100%
45	Mistral Large	100.0%	$0.0034	6.0s	100%
46	GPT-4.1	100.0%	$0.0041	3.4s	100%
47	GPT-5.4 Mini (Reasoning)	100.0%	$0.0037	5.7s	100%
48	GPT-4o, Aug. 6th (temp=1)	100.0%	$0.0051	2.2s	100%
49	GPT-4o, Aug. 6th (temp=0)	100.0%	$0.0051	2.3s	100%
50	Writer: Palmyra X5	100.0%	$0.0027	14.3s	100%
51	WizardLM 2 8x22b	100.0%	$0.0006	33.4s	100%
52	Gemini 2.5 Flash (Reasoning)	100.0%	$0.0045	15.2s	100%
53	GPT-5.4	100.0%	$0.0071	4.5s	100%
54	DeepSeek V3.2	100.0%	$0.0003	37.5s	100%
55	Nemotron 3 Super	100.0%	$0.0000	39.1s	100%
56	GPT-5.4 (Reasoning, Low)	100.0%	$0.0074	4.6s	100%
57	GPT-4o, May 13th (temp=1)	100.0%	$0.0083	2.3s	100%
58	GPT-5.2	100.0%	$0.0076	5.6s	100%
59	Claude Sonnet 4.6	100.0%	$0.0081	3.6s	100%
60	GPT-4o, May 13th (temp=0)	100.0%	$0.0083	3.0s	100%
61	Claude Sonnet 4.5	100.0%	$0.0081	4.0s	100%
62	Claude 3.7 Sonnet	100.0%	$0.0081	4.6s	100%
63	Claude Sonnet 4	100.0%	$0.0081	4.9s	100%
64	GPT-5 Mini	100.0%	$0.0042	30.5s	100%
65	MiniMax M2.5	100.0%	$0.0015	45.7s	100%
66	Z.AI GLM 4.6	100.0%	$0.0038	38.3s	100%
67	ByteDance Seed 1.6	100.0%	$0.0038	39.9s	100%
68	ByteDance Seed 2.0 Lite	100.0%	$0.0038	43.6s	100%
69	Gemini 3 Flash (Preview, Reasoning)	100.0%	$0.0096	15.6s	100%
70	Z.AI GLM 5 Turbo	100.0%	$0.0088	20.0s	100%
71	Aion 2.0	100.0%	$0.0036	45.3s	100%
72	GPT-5 Nano	100.0%	$0.0024	54.7s	100%
73	Grok 4.20 (Beta, Reasoning)	100.0%	$0.012	7.3s	100%
74	GPT-5.1	100.0%	$0.012	11.2s	100%
75	o4 Mini	100.0%	$0.011	17.5s	100%
76	Claude Opus 4.5	100.0%	$0.014	4.7s	100%
77	Claude Opus 4.6	100.0%	$0.014	4.9s	100%
78	Inception Mercury 2	96.4%	$0.0015	2.1s	74%
79	Z.AI GLM 4.7 Flash	100.0%	$0.0014	1.1m	100%
80	MiniMax M2.7	100.0%	$0.0045	56.4s	100%
81	GPT-5.4 (Reasoning)	100.0%	$0.014	13.0s	100%
82	GPT-5.4 Mini (Reasoning, Low)	96.4%	$0.0026	3.4s	74%
83	ByteDance Seed 2.0 Mini	100.0%	$0.0014	1.3m	100%
84	Claude 3.5 Sonnet	100.0%	$0.016	7.1s	100%
85	Mistral Small 4 (Reasoning)	96.4%	$0.0016	13.6s	74%
86	Z.AI GLM 5	100.0%	$0.0077	56.2s	100%
87	Z.AI GLM 4.7	100.0%	$0.0055	1.1m	100%
88	Qwen 3.5 27B	100.0%	$0.011	46.8s	100%
89	o4 Mini High	100.0%	$0.016	26.9s	100%
90	Grok 4	100.0%	$0.019	23.4s	100%
91	Claude Opus 4.6 (Reasoning)	100.0%	$0.022	9.5s	100%
92	Qwen 3.5 122B	100.0%	$0.018	41.8s	100%
93	Gemini 2.5 Pro	100.0%	$0.025	17.5s	100%
94	Qwen 3.5 Flash	96.4%	$0.0030	1.0m	74%
95	Grok 4.20 (Beta)	92.9%	$0.0027	1.6s	48%
96	Grok 4.1 Fast	92.9%	$0.0007	11.8s	48%
97	MoonshotAI: Kimi K2.5	100.0%	$0.011	1.6m	100%
98	GPT-5	100.0%	$0.025	41.3s	100%
99	Ministral 3B	82.1%	$0.0000	1.5s	52%
100	Gemini 3 Pro (Preview)	100.0%	$0.031	20.3s	100%
101	Claude Sonnet 4.6 (Reasoning)	100.0%	$0.031	20.5s	100%
102	Qwen 3.5 397B A17B	100.0%	$0.0095	2.4m	100%
103	Gemini 3.1 Pro (Preview)	100.0%	$0.034	31.5s	100%
104	Claude Opus 4	100.0%	$0.041	6.4s	100%
105	Qwen 3.5 35B	92.9%	$0.012	51.3s	65%
106	Qwen 3 32B	85.7%	$0.0005	25.5s	30%
107	Ministral 3 3B	75.0%	$0.0001	1.5s	38%
108	DeepSeek V3.1	82.1%	$0.0005	33.2s	28%
109	Qwen 3.5 9B	92.9%	$0.0013	1.9m	48%
110	Rocinante 12B	78.6%	$0.0003	6.5s	18%
111	Claude 3 Haiku	64.3%	$0.0007	3.6s	4%
112	Cohere Command R+ (Aug. 2024)	64.3%	$0.0054	14.3s	15%
113	Z.AI GLM 4.5	57.1%	$0.0019	20.2s	1%
114	LFM2 24B	50.0%	$0.0001	9.0s	0%
115	Nemotron 3 Nano	67.9%	$0.0017	2.2m	19%
116	Hermes 3 70B	57.1%	$0.0023	3.3m	1%
96.74%

Individual Scenarios

Generic Prompt

▼

Expand all contractions

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100.0%
MiniMax M2.5	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100	100	100.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100.0%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100.0%
GPT-5.4	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100.0%
Mistral Large 2	100	100	100	100	100	100	100	100.0%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100.0%
DeepSeek V3.1	100	100	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash	100	100	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	100.0%
Mistral Small 4	100	100	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100	100	100.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100	100	100.0%
Hermes 3 70B	100	100	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100	100	100.0%
GPT-4.1 Nano	100	100	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100	100	100.0%
Llama 3.1 8B	100	100	100	100	100	100	100	100.0%
Rocinante 12B	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	50	92.9%
Inception Mercury 2	100	100	100	100	100	100	50	92.9%
Grok 4.1 Fast	100	100	100	100	100	100	0	85.7%
Qwen 3.5 35B	100	100	100	100	100	50	50	85.7%
Qwen 3.5 9B	100	100	100	100	100	100	0	85.7%
Grok 4.20 (Beta)	100	100	100	100	100	100	0	85.7%
Qwen 3 32B	100	100	100	100	100	0	0	71.4%
Nemotron 3 Nano	100	100	100	100	50	0	0	64.3%
Ministral 3B	100	100	50	50	50	50	50	64.3%
Ministral 3 3B	50	50	50	50	50	50	50	50.0%
Claude 3 Haiku	100	100	0	0	0	0	0	28.6%
Cohere Command R+ (Aug. 2024)	50	50	50	50	0	0	0	28.6%
Z.AI GLM 4.5	100	0	0	0	0	0	0	14.3%
LFM2 24B	0	0	0	0	0	0	0	0.0%

Specific Prompt

▼

Expand all contractions

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100.0%
GPT-5.1	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100.0%
MiniMax M2.5	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100	100	100.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100.0%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100.0%
Nemotron 3 Super	100	100	100	100	100	100	100	100.0%
GPT-5.4	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta)	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100.0%
GPT-4.1 Mini	100	100	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100.0%
Mistral Large 2	100	100	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100	100	100.0%
Qwen 3 32B	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash	100	100	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100.0%
Inception Mercury	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100	100	100.0%
Llama 3.1 70B	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100	100	100.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	100.0%
Mistral Small 4	100	100	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100	100	100.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	100.0%
ByteDance Seed 1.6 Flash	100	100	100	100	100	100	100	100.0%
Mistral Small Creative	100	100	100	100	100	100	100	100.0%
Ministral 3 14B	100	100	100	100	100	100	100	100.0%
GPT-4.1 Nano	100	100	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100	100	100.0%
WizardLM 2 8x22b	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100	100	100.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100	100	100.0%
Ministral 3 3B	100	100	100	100	100	100	100	100.0%
Mistral NeMO	100	100	100	100	100	100	100	100.0%
Ministral 8B	100	100	100	100	100	100	100	100.0%
Llama 3.1 8B	100	100	100	100	100	100	100	100.0%
Ministral 3B	100	100	100	100	100	100	100	100.0%
LFM2 24B	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	50	92.9%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	50	92.9%
Nemotron 3 Nano	100	100	100	100	50	50	0	71.4%
DeepSeek V3.1	100	100	100	100	50	0	0	64.3%
Rocinante 12B	100	100	100	100	0	0	0	57.1%
Hermes 3 70B	100	0	0	0	0	0	0	14.3%

Possessive traps preserved

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Generic Prompt

Expand all contractions

Specific Prompt

Expand all contractions