Character rename: Elena->Mirabel, Gregor->Aldric

Text Replacement

Tests deterministic text transformations: renaming characters/locations, expanding contractions, tense rewriting, POV shifts, gender swaps, combined transformations, and word avoidance. Scored by checking each expected change independently.

Text Editing

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

	Score
Claude Opus 4.6 (Reasoning)	100%
Gemini 3.1 Pro (Preview)	100%
Claude Sonnet 4.6 (Reasoning)	100%
GPT-5 Mini	100%
GPT-5.1	100%
Claude Opus 4.6	100%
GPT-5	100%
Qwen 3.5 397B A17B	100%
Z.AI GLM 5	100%
Claude Sonnet 4.6	100%
MoonshotAI: Kimi K2.5	100%
ByteDance Seed 1.6	100%
Gemini 3 Flash (Preview, Reasoning)	100%
o4 Mini High	100%
GPT-5.2	100%
Claude Opus 4.5	100%
Grok 4.1 Fast	100%
Aion 2.0	100%
Z.AI GLM 4.6	100%
Gemini 3 Pro (Preview)	100%

	Score	Cost	Time
Gemini 2.5 Flash Lite	100%	$0.0003	1.6s
Ministral 8B	100%	$0.0001	3.2s
Ministral 3 8B	100%	$0.0002	2.9s
Mistral Small Creative	100%	$0.0002	2.9s
GPT-4.1 Nano	100%	$0.0003	3.7s
Ministral 3 14B	100%	$0.0002	4.0s
Grok 4 Fast	100%	$0.0005	3.3s
Gemma 3 4B	100%	$0.0001	6.1s
Mistral Small 3.2 24B	100%	$0.0002	5.7s
Mistral NeMO	93%	$0.0002	2.3s
Llama 3.1 8B	100%	$0.0000	9.9s
Gemini 2.5 Flash	100%	$0.0014	2.1s
Gemini 2.5 Flash Lite (Reasoning)	100%	$0.0007	4.7s
ByteDance Seed 1.6 Flash	100%	$0.0003	6.6s
Gemma 3 12B	100%	$0.0001	8.6s
Mistral Medium 3.1	100%	$0.0012	4.8s
Rocinante 12B	97%	$0.0004	6.3s
Gemini 3 Flash (Preview)	100%	$0.0018	3.2s
GPT-4o Mini (temp=1)	100%	$0.0004	8.7s
Grok 4.1 Fast	100%	$0.0007	7.7s

	Score	Cost	Speed	Stability
Gemini 2.5 Flash Lite	100%	$0.0003	1.6s	100%
Ministral 3 8B	100%	$0.0002	2.9s	100%
Mistral Small Creative	100%	$0.0002	2.9s	100%
Ministral 8B	100%	$0.0001	3.2s	100%
GPT-4.1 Nano	100%	$0.0003	3.7s	100%
Grok 4 Fast	100%	$0.0005	3.3s	100%
Gemini 2.5 Flash	100%	$0.0014	2.1s	100%
Ministral 3 14B	100%	$0.0002	4.0s	100%
Gemini 2.5 Flash Lite (Reasoning)	100%	$0.0007	4.7s	100%
Gemini 3 Flash (Preview)	100%	$0.0018	3.2s	100%
Mistral Small 3.2 24B	100%	$0.0002	5.7s	100%
Gemma 3 4B	100%	$0.0001	6.1s	100%
Mistral Medium 3.1	100%	$0.0012	4.8s	100%
ByteDance Seed 1.6 Flash	100%	$0.0003	6.6s	100%
Claude Haiku 4.5	100%	$0.0034	2.6s	100%
GPT-4.1 Mini	100%	$0.0010	6.7s	100%
Gemini 2.5 Flash (Reasoning)	100%	$0.0029	4.3s	100%
Grok 4.1 Fast	100%	$0.0007	7.7s	100%
Gemma 3 12B	100%	$0.0001	8.6s	100%
Mistral Large 3	100%	$0.0010	7.4s	100%

Median	Evaluator	Top 3	Flop 3
100.0%	Name replacement accuracy	100Hermes 3 70B 100Mistral Large 100Hermes 3 405B	29Claude 3 Haiku 30Cohere Command R+ (Aug. 2024) 80Arcee AI: Trinity Mini
100.0%	No remaining old names	100Gemini 3 Pro (Preview) 100ByteDance Seed 1.6 Flash 100Claude Opus 4.5	29Claude 3 Haiku
100.0%	Non-name text preserved	100Z.AI GLM 4.7 Flash 100Grok 4.1 Fast 100Claude Opus 4.6	29Claude 3 Haiku 45Cohere Command R+ (Aug. 2024) 81Arcee AI: Trinity Mini

Text Replacement

Character rename: Elena->Mirabel, Gregor->Aldric

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Rank	Model	Avg. Cost	Avg. Time	Stability	# 1	# 2	# 3	# 4	# 5	# 6	# 7	Total
61	Claude Opus 4.6 (Reasoning)	$0.017	5.6s	100%	100	100	100	100	100	100	100	100%
76	Gemini 3.1 Pro (Preview)	$0.024	22.2s	100%	100	100	100	100	100	100	100	100%
51	Claude Sonnet 4.6 (Reasoning)	$0.011	4.9s	100%	100	100	100	100	100	100	100	100%
48	GPT-5 Mini	$0.0023	16.6s	100%	100	100	100	100	100	100	100	100%
30	GPT-5.1	$0.0060	4.2s	100%	100	100	100	100	100	100	100	100%
59	Claude Opus 4.6	$0.017	5.4s	100%	100	100	100	100	100	100	100	100%
75	GPT-5	$0.018	26.6s	100%	100	100	100	100	100	100	100	100%
79	Qwen 3.5 397B A17B	$0.0062	1.2m	100%	100	100	100	100	100	100	100	100%
41	Z.AI GLM 5	$0.0030	14.1s	100%	100	100	100	100	100	100	100	100%
44	Claude Sonnet 4.6	$0.010	4.4s	100%	100	100	100	100	100	100	100	100%
82	MoonshotAI: Kimi K2.5	$0.0055	1.3m	100%	100	100	100	100	100	100	100	100%
62	ByteDance Seed 1.6	$0.0025	26.6s	100%	100	100	100	100	100	100	100	100%
39	Gemini 3 Flash (Preview, Reasoning)	$0.0057	9.0s	100%	100	100	100	100	100	100	100	100%
56	o4 Mini High	$0.0084	12.9s	100%	100	100	100	100	100	100	100	100%
37	GPT-5.2	$0.0079	5.2s	100%	100	100	100	100	100	100	100	100%
60	Claude Opus 4.5	$0.017	5.5s	100%	100	100	100	100	100	100	100	100%
18	Grok 4.1 Fast	$0.0007	7.7s	100%	100	100	100	100	100	100	100	100%
66	Aion 2.0	$0.0025	28.3s	100%	100	100	100	100	100	100	100	100%
78	Z.AI GLM 4.6	$0.0043	1.1m	100%	100	100	100	100	100	100	100	100%
73	Gemini 3 Pro (Preview)	$0.023	15.1s	100%	100	100	100	100	100	100	100	100%
47	Claude Sonnet 4	$0.010	5.3s	100%	100	100	100	100	100	100	100	100%
72	Z.AI GLM 4.7	$0.0041	40.6s	100%	100	100	100	100	100	100	100	100%
25	GPT-4.1	$0.0051	3.8s	100%	100	100	100	100	100	100	100	100%
71	Gemini 2.5 Pro	$0.019	13.7s	100%	100	100	100	100	100	100	100	100%
50	o4 Mini	$0.0066	11.1s	100%	100	100	100	100	100	100	100	100%
68	Grok 4	$0.014	15.3s	100%	100	100	100	100	100	100	100	100%
46	Claude Sonnet 4.5	$0.010	4.6s	100%	100	100	100	100	100	100	100	100%
81	Claude Opus 4	$0.050	8.2s	100%	100	100	100	100	100	100	100	100%
17	Gemini 2.5 Flash (Reasoning)	$0.0029	4.3s	100%	100	100	100	100	100	100	100	100%
58	Z.AI GLM 4.5	$0.0031	25.0s	100%	100	100	100	100	100	100	100	100%
6	Grok 4 Fast	$0.0005	3.3s	100%	100	100	100	100	100	100	100	100%
22	Qwen 3.5 Plus (2026-02-15)	$0.0015	7.4s	100%	100	100	100	100	100	100	100	100%
9	Gemini 2.5 Flash Lite (Reasoning)	$0.0007	4.7s	100%	100	100	100	100	100	100	100	100%
20	Mistral Large 3	$0.0010	7.4s	100%	100	100	100	100	100	100	100	100%
43	GPT-4o, May 13th (temp=0)	$0.010	4.0s	100%	100	100	100	100	100	100	100	100%
10	Gemini 3 Flash (Preview)	$0.0018	3.2s	100%	100	100	100	100	100	100	100	100%
15	Claude Haiku 4.5	$0.0034	2.6s	100%	100	100	100	100	100	100	100	100%
40	DeepSeek-V2 Chat	$0.0008	17.2s	100%	100	100	100	100	100	100	100	100%
64	Z.AI GLM 4.7 Flash	$0.0009	29.2s	100%	100	100	100	100	100	100	100	100%
70	Claude 3.5 Sonnet	$0.020	8.9s	100%	100	100	100	100	100	100	100	100%
42	GPT-4o, May 13th (temp=1)	$0.010	3.7s	100%	100	100	100	100	100	100	100	100%
34	DeepSeek V3 (2024-12-26)	$0.0007	14.6s	100%	100	100	100	100	100	100	100	100%
49	Claude 3.7 Sonnet	$0.010	5.5s	100%	100	100	100	100	100	100	100	100%
16	GPT-4.1 Mini	$0.0010	6.7s	100%	100	100	100	100	100	100	100	100%
55	Hermes 3 405B	$0.0011	23.0s	100%	100	100	100	100	100	100	100	100%
27	GPT-4o, Aug. 6th (temp=1)	$0.0064	2.4s	100%	100	100	100	100	100	100	100	100%
45	GPT-5 Nano	$0.0009	18.0s	100%	100	100	100	100	100	100	100	100%
29	GPT-4o, Aug. 6th (temp=0)	$0.0064	3.0s	100%	100	100	100	100	100	100	100	100%
32	Mistral Large 2	$0.0042	7.2s	100%	100	100	100	100	100	100	100	100%
65	DeepSeek V3.2	$0.0003	30.9s	100%	100	100	100	100	100	100	100	100%
1	Gemini 2.5 Flash Lite	$0.0003	1.6s	100%	100	100	100	100	100	100	100	100%
7	Gemini 2.5 Flash	$0.0014	2.1s	100%	100	100	100	100	100	100	100	100%
31	Mistral Large	$0.0042	7.1s	100%	100	100	100	100	100	100	100	100%
35	Writer: Palmyra X5	$0.0033	10.9s	100%	100	100	100	100	100	100	100	100%
21	GPT-4o Mini (temp=1)	$0.0004	8.7s	100%	100	100	100	100	100	100	100	100%
11	Mistral Small 3.2 24B	$0.0002	5.7s	100%	100	100	100	100	100	100	100	100%
19	Gemma 3 12B	$0.0001	8.6s	100%	100	100	100	100	100	100	100	100%
54	Llama 3.1 70B	$0.0004	22.3s	100%	100	100	100	100	100	100	100	100%
24	GPT-4o Mini (temp=0)	$0.0004	10.2s	100%	100	100	100	100	100	100	100	100%
52	Gemma 3 27B	$0.0002	21.0s	100%	100	100	100	100	100	100	100	100%
13	Mistral Medium 3.1	$0.0012	4.8s	100%	100	100	100	100	100	100	100	100%
28	Qwen 2.5 72B	$0.0003	11.8s	100%	100	100	100	100	100	100	100	100%
33	Llama 3.1 Nemotron 70B	$0.0013	13.5s	100%	100	100	100	100	100	100	100	100%
57	Arcee AI: Trinity Large (Preview)	$0.0000	25.2s	100%	100	100	100	100	100	100	100	100%
14	ByteDance Seed 1.6 Flash	$0.0003	6.6s	100%	100	100	100	100	100	100	100	100%
3	Mistral Small Creative	$0.0002	2.9s	100%	100	100	100	100	100	100	100	100%
36	Hermes 3 70B	$0.0003	15.5s	100%	100	100	100	100	100	100	100	100%
8	Ministral 3 14B	$0.0002	4.0s	100%	100	100	100	100	100	100	100	100%
5	GPT-4.1 Nano	$0.0003	3.7s	100%	100	100	100	100	100	100	100	100%
2	Ministral 3 8B	$0.0002	2.9s	100%	100	100	100	100	100	100	100	100%
67	WizardLM 2 8x22b	$0.0007	34.6s	100%	100	100	100	100	100	100	100	100%
12	Gemma 3 4B	$0.0001	6.1s	100%	100	100	100	100	100	100	100	100%
4	Ministral 8B	$0.0001	3.2s	100%	100	100	100	100	100	100	100	100%
23	Llama 3.1 8B	$0.0000	9.9s	100%	100	100	100	100	100	100	100	100%
69	Minimax M2.5	$0.0011	33.5s	98%	100	100	100	100	100	100	98	100%
77	DeepSeek V3 (2025-03-24)	$0.0006	54.8s	90%	100	100	100	100	100	100	85	98%
38	Rocinante 12B	$0.0004	6.3s	91%	100	100	100	100	95	94	87	97%
26	Ministral 3 3B	$0.0001	2.2s	95%	95	95	95	95	95	95	95	95%
53	Ministral 3B	$0.0000	1.9s	81%	100	100	95	95	95	95	77	94%
63	Mistral NeMO	$0.0002	2.3s	71%	100	100	100	100	98	98	58	93%
80	DeepSeek V3.1	$0.0005	41.1s	59%	100	100	100	100	100	95	41	91%
74	Arcee AI: Trinity Mini	$0.0002	4.9s	55%	100	98	95	95	95	90	36	87%
83	Cohere Command R+ (Aug. 2024)	$0.0068	22.4s	22%	100	100	49	47	40	38	33	58%
84	Claude 3 Haiku	$0.0009	4.3s	0%	100	100	0	0	0	0	0	29%
98.11%