Expand all contractions

Text Replacement

Tests deterministic text transformations: renaming characters/locations, expanding contractions, tense rewriting, POV shifts, gender swaps, combined transformations, and word avoidance. Scored by checking each expected change independently.

Text Editing

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

	Score
GPT-5.6 Sol (Reasoning)	100%
Claude Opus 4.6 (Reasoning)	100%
Gemini 3.6 Flash (Reasoning)	100%
Qwen3.7 Max	100%
Grok 4.5 (Reasoning, High)	100%
Gemini 3.1 Pro (Preview)	100%
GPT-5.4 (Reasoning)	100%
Muse Spark 1.1 (Reasoning, Medium)	100%
Z.AI GLM 5.1	100%
Qwen3.6 Max Preview	100%
GPT-5.5 (Reasoning)	100%
Claude Sonnet 4.6 (Reasoning)	100%
Z.AI GLM 5.2 (Reasoning, High)	100%
Gemini 3.5 Flash (Reasoning)	100%
Z.AI GLM 5 Turbo	100%
MoonshotAI: Kimi K3 (Reasoning, High)	100%
MoonshotAI: Kimi K2.6	100%
Claude Opus 4.7 (Reasoning)	100%
GPT-5.5 (Reasoning, Low)	100%
Claude Opus 4.8 (Reasoning)	100%

	Score	Cost	Time
Ministral 8B	100%	$0.0001	2.4s
Ministral 3 8B	100%	$0.0001	3.0s
Gemini 2.5 Flash Lite	100%	$0.0002	1.3s
Mistral Small 3.2 24B	100%	$0.0002	3.5s
Mistral Small 4	100%	$0.0003	2.6s
Gemma 3 12B	100%	$0.0001	5.9s
DeepSeek V4 Flash	100%	$0.0001	7.1s
Mistral NeMO	98%	$0.0001	1.8s
Laguna S 2.1	100%	$0.0001	6.9s
Qwen 2.5 72B	100%	$0.0002	8.5s
GPT-4o Mini (temp=0)	100%	$0.0003	7.1s
Gemini 3.1 Flash Lite	100%	$0.0008	1.9s
Gemini 3.1 Flash Lite (Preview)	100%	$0.0008	1.6s
Gemini 3.1 Flash Lite (Reasoning)	100%	$0.0008	1.7s
Arcee AI: Trinity Mini	99%	$0.0002	4.6s
GPT-4o Mini (temp=1)	100%	$0.0003	7.6s
Z.AI GLM 4.5 Air	100%	$0.0012	28.2s
GPT-4.1 Nano	99%	$0.0002	3.1s
Qwen3 235B A22B Instruct 2507	100%	$0.0003	9.9s
GPT-4.1 Mini	100%	$0.0008	4.7s

	Score	Cost	Speed	Stability
Ministral 8B	100%	$0.0001	2.4s	100%
Gemini 2.5 Flash Lite	100%	$0.0002	1.3s	100%
Ministral 3 8B	100%	$0.0001	3.0s	100%
Mistral Small 3.2 24B	100%	$0.0002	3.5s	100%
Mistral Small 4	100%	$0.0003	2.6s	100%
Laguna S 2.1	100%	$0.0001	6.9s	100%
DeepSeek V4 Flash	100%	$0.0001	7.1s	100%
Gemini 3.1 Flash Lite (Reasoning)	100%	$0.0008	1.7s	100%
Gemini 3.1 Flash Lite	100%	$0.0008	1.9s	100%
Gemma 3 12B	100%	$0.0001	5.9s	99%
GPT-4o Mini (temp=0)	100%	$0.0003	7.1s	100%
GPT-4o Mini (temp=1)	100%	$0.0003	7.6s	100%
Qwen 2.5 72B	100%	$0.0002	8.5s	100%
Gemini 3.1 Flash Lite (Preview)	100%	$0.0008	1.6s	99%
Gemini 3.5 Flash Lite (Reasoning, Minimal)	100%	$0.0012	1.2s	100%
Gemini 3.5 Flash Lite (Reasoning)	100%	$0.0012	1.3s	100%
Qwen3 235B A22B Instruct 2507	100%	$0.0003	9.9s	100%
GPT-4.1 Mini	100%	$0.0008	4.7s	100%
Gemini 2.5 Flash	100%	$0.0012	1.7s	100%
Mistral Medium 3.1	100%	$0.0010	4.3s	100%

Median	Evaluator	Top 3	Flop 3
100.0%	Contraction expansion accuracy	100GPT-5.6 Sol (Reasoning) 100ByteDance Seed 1.6 100DeepSeek V3 (2024-12-26)	14Hermes 3 70B 16Gemma 3 4B 66DeepSeek V3.1
100.0%	Non-contraction text preserved	100Qwen 3.5 9B 100Grok 4.5 (Reasoning, High) 100Xiaomi MIMO v2.5 Pro	14Hermes 3 70B 63DeepSeek V3.1 86Nemotron 3 Nano
100.0%	Possessive traps preserved	100ByteDance Seed 1.6 100Mistral Small 3.2 24B 100GPT-4.1	14Hermes 3 70B 64DeepSeek V3.1 71Nemotron 3 Nano

Text Replacement

Expand all contractions

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Rank	Model	Avg. Cost	Avg. Time	Stability	# 1	# 2	# 3	# 4	# 5	# 6	# 7	Total
139	GPT-5.6 Sol (Reasoning)	$0.020	6.3s	100%	100	100	100	100	100	100	100	100%
149	Claude Opus 4.6 (Reasoning)	$0.030	13.9s	100%	100	100	100	100	100	100	100	100%
145	Gemini 3.6 Flash (Reasoning)	$0.023	11.1s	100%	100	100	100	100	100	100	100	100%
151	Qwen3.7 Max	$0.029	49.4s	100%	100	100	100	100	100	100	100	100%
105	Grok 4.5 (Reasoning, High)	$0.012	16.7s	100%	100	100	100	100	100	100	100	100%
156	Gemini 3.1 Pro (Preview)	$0.036	33.8s	100%	100	100	100	100	100	100	100	100%
118	GPT-5.4 (Reasoning)	$0.015	14.6s	100%	100	100	100	100	100	100	100	100%
90	Muse Spark 1.1 (Reasoning, Medium)	$0.0088	9.6s	100%	100	100	100	100	100	100	100	100%
131	Z.AI GLM 5.1	$0.014	1.0m	100%	100	100	100	100	100	100	100	100%
157	Qwen3.6 Max Preview	$0.031	1.6m	100%	100	100	100	100	100	100	100	100%
146	GPT-5.5 (Reasoning)	$0.024	8.8s	100%	100	100	100	100	100	100	100	100%
155	Claude Sonnet 4.6 (Reasoning)	$0.034	20.6s	100%	100	100	100	100	100	100	100	100%
97	Z.AI GLM 5.2 (Reasoning, High)	$0.0087	24.9s	100%	100	100	100	100	100	100	100	100%
154	Gemini 3.5 Flash (Reasoning)	$0.034	14.2s	100%	100	100	100	100	100	100	100	100%
98	Z.AI GLM 5 Turbo	$0.0094	20.8s	100%	100	100	100	100	100	100	100	100%
150	MoonshotAI: Kimi K3 (Reasoning, High)	$0.027	46.0s	100%	100	100	100	100	100	100	100	100%
153	MoonshotAI: Kimi K2.6	$0.018	2.7m	100%	100	100	100	100	100	100	100	100%
120	Claude Opus 4.7 (Reasoning)	$0.017	3.2s	100%	100	100	100	100	100	100	100	100%
136	GPT-5.5 (Reasoning, Low)	$0.020	7.6s	100%	100	100	100	100	100	100	100	100%
126	Claude Opus 4.8 (Reasoning)	$0.017	5.7s	100%	100	100	100	100	100	100	100	100%
107	Claude Opus 4.6	$0.014	5.0s	100%	100	100	100	100	100	100	100	100%
132	MoonshotAI: Kimi K3 (Reasoning, Low)	$0.017	30.6s	100%	100	100	100	100	100	100	100	100%
133	Claude Opus 5 (Reasoning, Low)	$0.020	7.7s	100%	100	100	100	100	100	100	100	100%
125	Claude Opus 4.8 (Reasoning, Low)	$0.017	5.2s	100%	100	100	100	100	100	100	100	100%
152	GPT-5	$0.029	49.9s	100%	100	100	100	100	100	100	100	100%
66	Muse Spark 1.1 (Reasoning, Minimal)	$0.0059	6.7s	100%	100	100	100	100	100	100	100	100%
144	Claude Opus 5 (Reasoning)	$0.024	9.6s	100%	100	100	100	100	100	100	100	100%
148	Qwen 3.5 397B A17B	$0.0095	2.5m	100%	100	100	100	100	100	100	100	100%
92	Grok 4.5 (Reasoning, Low)	$0.0077	26.6s	100%	100	100	100	100	100	100	100	100%
67	Grok 4.20 (Reasoning)	$0.0051	17.0s	100%	100	100	100	100	100	100	100	100%
127	MoonshotAI: Kimi K2.5	$0.011	1.0m	100%	100	100	100	100	100	100	100	100%
111	GPT-5.6 Sol	$0.014	4.1s	100%	100	100	100	100	100	100	100	100%
119	GPT-5.1	$0.015	15.5s	100%	100	100	100	100	100	100	100	100%
78	Claude Sonnet 4.6	$0.0082	3.7s	100%	100	100	100	100	100	100	100	100%
141	Qwen 3.5 122B	$0.018	43.0s	100%	100	100	100	100	100	100	100	100%
124	Claude Opus 5	$0.017	6.4s	100%	100	100	100	100	100	100	100	100%
99	Gemini 3 Flash (Preview, Reasoning)	$0.010	16.3s	100%	100	100	100	100	100	100	100	100%
122	Claude Opus 4.7	$0.017	3.3s	100%	100	100	100	100	100	100	100	100%
129	Qwen 3.5 Plus (2026-04-20)	$0.011	1.2m	100%	100	100	100	100	100	100	100	100%
109	Gemma 4 31B (Reasoning)	$0.0011	2.1m	100%	100	100	100	100	100	100	100	100%
106	Claude Opus 4.5	$0.014	4.8s	100%	100	100	100	100	100	100	100	100%
137	Z.AI GLM 5	$0.011	1.5m	100%	100	100	100	100	100	100	100	100%
73	ByteDance Seed 1.6	$0.0038	38.3s	100%	100	100	100	100	100	100	100	100%
89	GPT-5.2	$0.0090	6.9s	100%	100	100	100	100	100	100	100	100%
110	GPT-5.5	$0.014	4.0s	100%	100	100	100	100	100	100	100	100%
60	DeepSeek V4 Pro (Reasoning)	$0.0014	37.7s	100%	100	100	100	100	100	100	100	100%
108	Gemma 4 26B (Reasoning)	$0.0013	2.0m	100%	100	100	100	100	100	100	100	100%
142	o4 Mini High	$0.020	32.3s	100%	100	100	100	100	100	100	100	100%
143	Gemini 2.5 Pro	$0.022	15.9s	100%	100	100	100	100	100	100	100	100%
140	Qwen 3.6 27B	$0.015	1.0m	100%	100	100	100	100	100	100	100	100%
68	GPT-5.6 Terra	$0.0072	2.5s	100%	100	100	100	100	100	100	100	100%
45	DeepSeek V4 Flash (Reasoning)	$0.0007	29.8s	100%	100	100	100	100	100	100	100	100%
102	Z.AI GLM 4.7	$0.0056	1.1m	100%	100	100	100	100	100	100	100	100%
85	Qwen 3.6 35B	$0.0058	31.6s	100%	100	100	100	100	100	100	100	100%
82	Claude Sonnet 4	$0.0082	4.7s	100%	100	100	100	100	100	100	100	100%
81	Claude Sonnet 4.5	$0.0082	4.1s	100%	100	100	100	100	100	100	100	100%
158	Claude Opus 4	$0.041	6.3s	100%	100	100	100	100	100	100	100	100%
52	GPT-4.1	$0.0042	3.6s	100%	100	100	100	100	100	100	100	100%
47	Gemini 3.6 Flash (Reasoning, Minimal)	$0.0039	1.9s	100%	100	100	100	100	100	100	100	100%
84	Aion 2.0	$0.0038	47.5s	100%	100	100	100	100	100	100	100	100%
26	Qwen 3.5 Plus (2026-02-15)	$0.0012	5.3s	100%	100	100	100	100	100	100	100	100%
8	Gemini 3.1 Flash Lite (Reasoning)	$0.0008	1.7s	100%	100	100	100	100	100	100	100	100%
53	Gemini 3.5 Flash (Reasoning, Minimal)	$0.0045	2.1s	100%	100	100	100	100	100	100	100	100%
96	ByteDance Seed 2.0 Mini	$0.0015	1.5m	100%	100	100	100	100	100	100	100	100%
27	Gemini 3 Flash (Preview)	$0.0015	2.8s	100%	100	100	100	100	100	100	100	100%
37	Gemma 4 31B	$0.0002	25.5s	100%	100	100	100	100	100	100	100	100%
9	Gemini 3.1 Flash Lite	$0.0008	1.9s	100%	100	100	100	100	100	100	100	100%
38	GPT-5.6 Luna	$0.0029	2.4s	100%	100	100	100	100	100	100	100	100%
62	Z.AI GLM 4.5	$0.0026	29.0s	100%	100	100	100	100	100	100	100	100%
34	Gemma 4 26B	$0.0002	22.5s	100%	100	100	100	100	100	100	100	100%
15	Gemini 3.5 Flash Lite (Reasoning, Minimal)	$0.0012	1.2s	100%	100	100	100	100	100	100	100	100%
16	Gemini 3.5 Flash Lite (Reasoning)	$0.0012	1.3s	100%	100	100	100	100	100	100	100	100%
21	Mistral Large 3	$0.0009	5.9s	100%	100	100	100	100	100	100	100	100%
88	ByteDance Seed 2.0 Lite	$0.0042	49.1s	100%	100	100	100	100	100	100	100	100%
77	Gemini 2.5 Flash (Reasoning)	$0.0054	25.3s	100%	100	100	100	100	100	100	100	100%
115	Aion 3.0 Mini	$0.0055	1.5m	100%	100	100	100	100	100	100	100	100%
36	Claude Haiku 4.5	$0.0027	2.2s	100%	100	100	100	100	100	100	100	100%
29	DeepSeek V3 (2024-12-26)	$0.0006	13.2s	100%	100	100	100	100	100	100	100	100%
64	DeepSeek V3.2	$0.0003	56.0s	100%	100	100	100	100	100	100	100	100%
59	GPT-4o, Aug. 6th (temp=0)	$0.0052	2.3s	100%	100	100	100	100	100	100	100	100%
7	DeepSeek V4 Flash	$0.0001	7.1s	100%	100	100	100	100	100	100	100	100%
48	Mistral Large 2	$0.0035	5.8s	100%	100	100	100	100	100	100	100	100%
18	GPT-4.1 Mini	$0.0008	4.7s	100%	100	100	100	100	100	100	100	100%
58	GPT-4o, Aug. 6th (temp=1)	$0.0052	2.0s	100%	100	100	100	100	100	100	100	100%
28	Grok 4.20	$0.0016	3.3s	100%	100	100	100	100	100	100	100	100%
35	Hermes 3 405B	$0.0010	16.7s	100%	100	100	100	100	100	100	100	100%
49	Z.AI GLM 4.5 Air	$0.0012	28.2s	100%	100	100	100	100	100	100	100	100%
19	Gemini 2.5 Flash	$0.0012	1.7s	100%	100	100	100	100	100	100	100	100%
6	Laguna S 2.1	$0.0001	6.9s	100%	100	100	100	100	100	100	100	100%
2	Gemini 2.5 Flash Lite	$0.0002	1.3s	100%	100	100	100	100	100	100	100	100%
50	Writer: Palmyra X5	$0.0028	13.9s	100%	100	100	100	100	100	100	100	100%
17	Qwen3 235B A22B Instruct 2507	$0.0003	9.9s	100%	100	100	100	100	100	100	100	100%
12	GPT-4o Mini (temp=1)	$0.0003	7.6s	100%	100	100	100	100	100	100	100	100%
4	Mistral Small 3.2 24B	$0.0002	3.5s	100%	100	100	100	100	100	100	100	100%
11	GPT-4o Mini (temp=0)	$0.0003	7.1s	100%	100	100	100	100	100	100	100	100%
20	Mistral Medium 3.1	$0.0010	4.3s	100%	100	100	100	100	100	100	100	100%
25	Gemma 3 27B	$0.0001	14.6s	100%	100	100	100	100	100	100	100	100%
5	Mistral Small 4	$0.0003	2.6s	100%	100	100	100	100	100	100	100	100%
44	Thinking Machines Inkling	$0.0020	15.2s	100%	100	100	100	100	100	100	100	100%
13	Qwen 2.5 72B	$0.0002	8.5s	100%	100	100	100	100	100	100	100	100%
55	WizardLM 2 8x22b	$0.0007	41.6s	100%	100	100	100	100	100	100	100	100%
3	Ministral 3 8B	$0.0001	3.0s	100%	100	100	100	100	100	100	100	100%
1	Ministral 8B	$0.0001	2.4s	100%	100	100	100	100	100	100	100	100%
94	GPT-5.6 Terra (Reasoning)	$0.010	4.6s	99%	100	100	100	100	100	100	99	100%
76	GPT-5 Mini	$0.0043	31.7s	99%	100	100	100	100	100	100	99	100%
113	Claude Sonnet 5 (Reasoning)	$0.014	12.7s	99%	100	100	100	100	100	100	99	100%
112	Claude Sonnet 5 (Reasoning, Low)	$0.014	11.5s	99%	100	100	100	100	100	100	99	100%
121	Qwen 3.5 27B	$0.011	50.7s	99%	100	100	100	100	100	100	99	100%
95	Qwen 3.6 Flash	$0.0082	24.1s	99%	100	100	100	100	100	100	99	100%
134	Aion 3.0	$0.015	46.1s	99%	100	100	100	100	100	100	99	100%
46	Z.AI GLM 4.6	$0.0024	11.6s	99%	100	100	100	100	100	100	99	100%
71	Claude Sonnet 5	$0.0066	6.2s	99%	100	100	100	100	100	100	99	100%
114	o4 Mini	$0.013	20.4s	99%	100	100	100	100	100	100	99	100%
128	MiniMax M2.7	$0.0074	1.6m	99%	100	100	100	100	100	100	99	100%
93	Xiaomi MIMO v2.5 Pro	$0.0072	31.0s	99%	100	100	100	100	100	100	99	100%
14	Gemini 3.1 Flash Lite (Preview)	$0.0008	1.6s	99%	100	100	100	100	100	100	99	100%
74	GPT-OSS 120B	$0.0011	1.0m	99%	100	100	100	100	100	100	99	100%
75	GPT-5.4	$0.0072	4.5s	99%	100	100	100	100	100	100	99	100%
31	DeepSeek-V2 Chat	$0.0007	12.8s	99%	100	100	100	100	100	100	99	100%
56	DeepSeek V4 Pro	$0.0015	33.0s	99%	100	100	100	100	100	100	99	100%
23	Llama 3.1 70B	$0.0005	7.8s	99%	100	100	100	100	100	100	99	100%
10	Gemma 3 12B	$0.0001	5.9s	99%	100	100	100	100	100	100	99	100%
57	GPT-5.6 Luna (Reasoning)	$0.0044	4.8s	99%	100	100	100	100	100	99	99	100%
103	Qwen 3.5 9B	$0.0013	1.7m	99%	100	100	100	100	100	99	99	100%
32	Inception Mercury 2	$0.0019	2.7s	99%	100	100	100	100	100	99	99	100%
65	Nemotron 3 Super	$0.0000	55.5s	99%	100	100	100	100	100	99	99	100%
80	GPT-5.4 (Reasoning, Low)	$0.0077	4.7s	99%	100	100	100	100	99	99	99	100%
69	Xiaomi MIMO v2.5	$0.0050	18.6s	99%	100	100	100	100	99	99	99	100%
33	DeepSeek V3 (2025-03-24)	$0.0005	14.0s	99%	100	100	100	100	100	99	98	100%
51	MiniMax M2.5	$0.0017	19.9s	99%	100	100	100	100	99	99	98	100%
101	GPT-5 Nano	$0.0033	1.3m	99%	100	100	100	100	99	99	98	100%
83	Z.AI GLM 4.7 Flash	$0.0015	1.0m	99%	100	100	99	99	99	99	99	99%
54	Qwen 3 32B	$0.0007	30.6s	98%	100	100	100	99	99	99	98	99%
22	Arcee AI: Trinity Mini	$0.0002	4.6s	99%	100	100	99	99	99	99	99	99%
72	Cohere Command R+ (Aug. 2024)	$0.0055	9.9s	98%	100	100	100	99	99	99	98	99%
91	Grok 4.3 (Reasoning)	$0.0068	26.7s	99%	100	99	99	99	99	99	99	99%
130	Thinking Machines Inkling (Reasoning)	$0.012	1.2m	98%	100	100	100	100	98	98	98	99%
39	Gemini 2.5 Flash Lite (Reasoning)	$0.0014	9.7s	99%	100	99	99	99	99	99	99	99%
43	GPT-5.4 Mini	$0.0022	2.1s	98%	100	100	100	100	99	99	97	99%
135	Qwen 3.5 35B	$0.013	59.8s	98%	100	100	99	99	99	99	98	99%
30	Ministral 3 14B	$0.0002	3.3s	97%	100	100	98	98	98	98	98	99%
24	GPT-4.1 Nano	$0.0002	3.1s	98%	99	99	99	99	98	98	98	99%
100	Qwen 3.5 Flash	$0.0033	51.7s	94%	100	100	100	100	100	100	91	99%
40	Mistral NeMO	$0.0001	1.8s	95%	99	99	99	99	99	96	94	98%
87	GPT-5.4 Mini (Reasoning, Low)	$0.0030	3.9s	89%	100	100	100	100	99	98	83	97%
70	ByteDance Seed 1.6 Flash	$0.0008	15.6s	91%	100	99	98	98	98	96	88	97%
42	Ministral 3 3B	$0.0001	1.5s	96%	98	97	97	97	97	97	96	97%
61	GPT-5.4 Nano (Reasoning)	$0.0008	3.8s	93%	99	98	98	98	97	97	91	97%
41	Ministral 3B	$0.0000	1.5s	96%	97	97	97	97	96	96	96	97%
123	MiniMax M3	$0.0026	44.3s	81%	100	100	100	100	100	100	73	96%
104	GPT-5.4 Mini (Reasoning)	$0.0044	7.8s	86%	100	100	100	98	97	95	82	96%
79	Grok 4.3	$0.0016	4.1s	89%	100	100	100	99	90	90	89	95%
63	GPT-5.4 Nano	$0.0006	2.8s	93%	98	97	96	96	95	95	91	95%
116	Mistral Small 4 (Reasoning)	$0.0021	18.9s	78%	100	99	99	99	99	98	69	95%
117	Cydonia 24B V4.1	$0.0004	8.3s	72%	100	100	100	100	99	96	59	93%
86	GPT-5.4 Nano (Reasoning, Low)	$0.0006	2.4s	88%	95	94	92	91	91	91	91	92%
138	Laguna XS 2.1	$0.0002	11.7s	66%	100	99	98	98	98	63	62	89%
160	Nemotron 3 Nano	$0.0029	3.8m	47%	100	99	99	98	69	64	26	79%
147	Gemma 3 4B	$0.0001	6.1s	72%	72	72	72	72	72	72	72	72%
159	DeepSeek V3.1	$0.0004	36.2s	15%	100	100	100	100	38	9	3	64%
161	Hermes 3 70B	$0.0044	6.3m	0%	100	0	0	0	0	0	0	14%
98.45%