Match blue prose section

Test: Tool usage within Novelcrafter

Avg. Score

93.7%

Scenarios

Overall Performance

Performance Score Distribution (Top 20)

Click a model name to view its detail page.

Rank ▲	Model	Score	Avg. Cost	Avg. Time	Stability
1	Inception Mercury 2	100.0%	$0.0004	1.1s	100%
2	Gemini 2.5 Flash Lite	100.0%	$0.0002	1.5s	100%
3	Gemini 3.1 Flash Lite (Preview)	100.0%	$0.0008	2.6s	100%
4	Gemini 2.5 Flash	100.0%	$0.0010	2.4s	100%
5	Stealth: Aurora Alpha	100.0%	—	3.3s	100%
6	Mistral Small 3.2 24B	100.0%	$0.0001	4.9s	100%
7	Claude 3 Haiku	100.0%	$0.0007	4.2s	100%
8	GPT-4o Mini (temp=0)	100.0%	$0.0003	5.5s	100%
9	Gemini 2.5 Flash (Reasoning)	100.0%	$0.0017	3.7s	100%
10	Grok 4.20 (Beta)	100.0%	$0.0026	2.5s	100%
11	Stealth: Healer Alpha	100.0%	$0.0000	6.7s	100%
12	Arcee AI: Trinity Mini	100.0%	$0.0002	6.4s	100%
13	GPT-5.4 Mini	100.0%	$0.0024	3.2s	100%
14	Ministral 3 8B	100.0%	$0.0002	6.6s	100%
15	Gemini 2.5 Flash Lite (Reasoning)	100.0%	$0.0007	6.0s	100%
16	GPT-5.4 Mini (Reasoning, Low)	100.0%	$0.0025	3.2s	100%
17	GPT-5.4 Nano	100.0%	$0.0014	5.1s	100%
18	Grok 4 Fast	100.0%	$0.0004	6.6s	100%
19	GPT-5.4 Nano (Reasoning)	100.0%	$0.0013	5.5s	100%
20	Gemma 3 4B	100.0%	$0.0001	8.0s	100%
21	GPT-5.4 Mini (Reasoning)	100.0%	$0.0029	3.8s	100%
22	GPT-4o Mini (temp=1)	100.0%	$0.0003	8.0s	100%
23	Mistral Small 4 (Reasoning)	100.0%	$0.0006	7.7s	100%
24	Grok 4.1 Fast	100.0%	$0.0005	8.4s	100%
25	Claude 3.5 Haiku	100.0%	$0.0018	6.4s	100%
26	Claude Haiku 4.5	100.0%	$0.0031	5.9s	100%
27	Mistral Large	100.0%	$0.0026	7.0s	100%
28	Qwen 2.5 72B	100.0%	$0.0003	10.8s	100%
29	GPT-4o, Aug. 6th (temp=1)	100.0%	$0.0048	4.8s	100%
30	GPT-4.1	100.0%	$0.0039	6.3s	100%
31	GPT-4o, Aug. 6th (temp=0)	100.0%	$0.0046	5.3s	100%
32	Gemini 3 Flash (Preview, Reasoning)	100.0%	$0.0033	7.8s	100%
33	DeepSeek V3 (2024-12-26)	100.0%	$0.0004	12.7s	100%
34	Qwen3 235B A22B Instruct 2507	100.0%	$0.0003	13.2s	100%
35	GPT-5.4 Nano (Reasoning, Low)	100.0%	$0.0014	12.8s	100%
36	Gemma 3 12B	100.0%	$0.0002	15.4s	100%
37	DeepSeek-V2 Chat	100.0%	$0.0001	15.5s	100%
38	Hermes 3 70B	100.0%	$0.0003	15.3s	100%
39	GPT-5 Mini	100.0%	$0.0023	12.2s	100%
40	Llama 3.1 Nemotron 70B	100.0%	$0.0003	15.6s	100%
41	Mistral Large 2	100.0%	$0.0029	11.7s	100%
42	Z.AI GLM 4.5	100.0%	$0.0015	14.7s	100%
43	Stealth: Hunter Alpha	100.0%	$0.0000	17.4s	100%
44	MiniMax M2.7	100.0%	$0.0012	15.6s	100%
45	Mistral Large 3	100.0%	$0.0012	16.3s	100%
46	Writer: Palmyra X5	100.0%	$0.0037	13.0s	100%
47	GPT-4o, May 13th (temp=0)	100.0%	$0.0084	8.7s	100%
48	o4 Mini	100.0%	$0.0053	13.5s	100%
49	GPT-4o, May 13th (temp=1)	100.0%	$0.0085	8.6s	100%
50	Qwen 3.5 122B	100.0%	$0.0055	14.2s	100%
51	Qwen 3.5 Plus (2026-02-15)	100.0%	$0.0014	21.3s	100%
52	DeepSeek V3.1	100.0%	$0.0005	22.7s	100%
53	o4 Mini High	100.0%	$0.0059	14.9s	100%
54	Qwen 3.5 27B	100.0%	$0.0040	19.2s	100%
55	Gemma 3 27B	100.0%	$0.0002	25.3s	100%
56	Claude Sonnet 4	100.0%	$0.0094	11.4s	100%
57	Claude Sonnet 4.6	100.0%	$0.0096	11.3s	100%
58	Hermes 3 405B	100.0%	$0.0000	26.6s	100%
59	Aion 2.0	100.0%	$0.0018	23.9s	100%
60	Claude Sonnet 4.5	100.0%	$0.010	12.4s	100%
61	Claude 3.7 Sonnet	100.0%	$0.011	12.5s	100%
62	DeepSeek V3.2	100.0%	$0.0003	28.8s	100%
63	Z.AI GLM 5	100.0%	$0.0023	25.8s	100%
64	Gemini 2.5 Pro	100.0%	$0.012	11.2s	100%
65	Claude Sonnet 4.6 (Reasoning)	100.0%	$0.011	13.1s	100%
66	Claude 3.5 Sonnet	100.0%	$0.0094	16.7s	100%
67	Grok 4.20 (Beta, Reasoning)	100.0%	$0.014	11.4s	100%
68	Claude Opus 4.5	100.0%	$0.016	12.8s	100%
69	MoonshotAI: Kimi K2.5	100.0%	$0.0039	31.8s	100%
70	Gemini 3 Pro (Preview)	100.0%	$0.017	14.8s	100%
71	Grok 4	100.0%	$0.012	22.9s	100%
72	GPT-5 Nano	100.0%	$0.0016	42.4s	100%
73	Gemini 3.1 Pro (Preview)	100.0%	$0.018	18.9s	100%
74	Z.AI GLM 4.7	100.0%	$0.0028	41.8s	100%
75	GPT-5.4 (Reasoning, Low)	100.0%	$0.016	23.6s	100%
76	Inception Mercury	90.0%	$0.0003	1.3s	40%
77	Mistral NeMO	90.0%	$0.0001	3.2s	40%
78	Ministral 3 3B	90.0%	$0.0001	3.6s	40%
79	GPT-4.1 Mini	90.0%	$0.0006	4.3s	40%
80	Mistral Small 4	90.0%	$0.0004	6.2s	40%
81	Gemini 3 Flash (Preview)	90.0%	$0.0015	4.6s	40%
82	Ministral 3 14B	90.0%	$0.0003	9.7s	40%
83	ByteDance Seed 2.0 Lite	100.0%	$0.0044	50.6s	100%
84	Z.AI GLM 5 Turbo	90.0%	$0.0023	9.4s	40%
85	GPT-5.4 (Reasoning)	100.0%	$0.018	31.7s	100%
86	DeepSeek V3 (2025-03-24)	90.0%	$0.0005	13.1s	40%
87	WizardLM 2 8x22b	90.0%	$0.0008	13.8s	40%
88	Claude Opus 4.6	100.0%	$0.026	23.1s	100%
89	Mistral Medium 3.1	90.0%	$0.0014	14.3s	40%
90	Qwen 3.5 397B A17B	100.0%	$0.0066	54.0s	100%
91	Qwen 3 32B	90.0%	$0.0005	17.2s	40%
92	Cohere Command R+ (Aug. 2024)	90.0%	$0.0051	10.5s	40%
93	Qwen 3.5 35B	90.0%	$0.0040	14.6s	40%
94	Ministral 3B	80.0%	$0.0000	2.1s	20%
95	ByteDance Seed 2.0 Mini	100.0%	$0.0011	1.1m	100%
96	Z.AI GLM 4.7 Flash	90.0%	$0.0005	23.1s	40%
97	GPT-4.1 Nano	80.0%	$0.0001	4.0s	20%
98	MiniMax M2.5	90.0%	$0.0012	23.7s	40%
99	Claude Opus 4.6 (Reasoning)	100.0%	$0.029	27.5s	100%
100	Z.AI GLM 4.6	100.0%	$0.0038	1.1m	100%
101	Ministral 8B	80.0%	$0.0001	6.9s	20%
102	Mistral Small Creative	80.0%	$0.0004	6.5s	20%
103	Llama 3.1 70B	80.0%	$0.0005	8.3s	20%
104	Arcee AI: Trinity Large (Preview)	80.0%	$0.0000	10.9s	20%
105	GPT-5	100.0%	$0.022	45.8s	100%
106	Qwen 3.5 9B	90.0%	$0.0004	33.1s	40%
107	Claude Opus 4	100.0%	$0.043	20.4s	100%
108	Nemotron 3 Super	70.0%	$0.0000	10.3s	8%
109	Qwen 3.5 Flash	80.0%	$0.0010	25.2s	20%
110	GPT-5.2	100.0%	$0.028	50.8s	100%
111	ByteDance Seed 1.6	90.0%	$0.0033	43.2s	40%
112	Llama 3.1 8B	60.0%	$0.0001	4.1s	2%
113	GPT-5.4	90.0%	$0.017	26.6s	40%
114	Nemotron 3 Nano	60.0%	$0.0001	7.3s	2%
115	GPT-5.1	90.0%	$0.020	43.1s	40%
116	Rocinante 12B	10.0%	$0.0002	12.4s	0%
117	LFM2 24B	0.0%	$0.0001	8.7s	0%
118	ByteDance Seed 1.6 Flash	0.0%	$0.0006	13.5s	0%
93.73%

Individual Scenarios

▼

Create alternate prose sections

Model	# 1	# 2	# 3	# 4	# 5	# 6	# 7	# 8	# 9	# 10	Avg ▼
Claude Opus 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 397B A17B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 122B	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MoonshotAI: Kimi K2.5	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 27B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Flash (Preview, Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini High	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.2	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.1 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Aion 2.0	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.6	100	100	100	100	100	100	100	100	100	100	100.0%
MiniMax M2.7	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3 Pro (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.7	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4.1	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Pro	100	100	100	100	100	100	100	100	100	100	100.0%
o4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Sonnet 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Opus 4	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Hunter Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4 Fast	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 3.5 Plus (2026-02-15)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Healer Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 3.1 Flash Lite (Preview)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 3	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude Haiku 4.5	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek-V2 Chat	100	100	100	100	100	100	100	100	100	100	100.0%
ByteDance Seed 2.0 Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
Grok 4.20 (Beta)	100	100	100	100	100	100	100	100	100	100	100.0%
Inception Mercury 2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, May 13th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Stealth: Aurora Alpha	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.5 Haiku	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3 (2024-12-26)	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3.7 Sonnet	100	100	100	100	100	100	100	100	100	100	100.0%
Hermes 3 405B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o, Aug. 6th (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large 2	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 4 (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.1	100	100	100	100	100	100	100	100	100	100	100.0%
DeepSeek V3.2	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash Lite	100	100	100	100	100	100	100	100	100	100	100.0%
Gemini 2.5 Flash	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Large	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen3 235B A22B Instruct 2507	100	100	100	100	100	100	100	100	100	100	100.0%
Writer: Palmyra X5	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano (Reasoning, Low)	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=1)	100	100	100	100	100	100	100	100	100	100	100.0%
Mistral Small 3.2 24B	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 12B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-4o Mini (temp=0)	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 27B	100	100	100	100	100	100	100	100	100	100	100.0%
Qwen 2.5 72B	100	100	100	100	100	100	100	100	100	100	100.0%
Llama 3.1 Nemotron 70B	100	100	100	100	100	100	100	100	100	100	100.0%
GPT-5.4 Nano	100	100	100	100	100	100	100	100	100	100	100.0%
Hermes 3 70B	100	100	100	100	100	100	100	100	100	100	100.0%
Ministral 3 8B	100	100	100	100	100	100	100	100	100	100	100.0%
Claude 3 Haiku	100	100	100	100	100	100	100	100	100	100	100.0%
Arcee AI: Trinity Mini	100	100	100	100	100	100	100	100	100	100	100.0%
Gemma 3 4B	100	100	100	100	100	100	100	100	100	100	100.0%
Z.AI GLM 5 Turbo	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-5.1	100	100	100	100	100	100	100	100	100	0	90.0%
ByteDance Seed 1.6	100	100	100	100	100	100	100	100	100	0	90.0%
MiniMax M2.5	100	100	100	100	100	100	100	100	100	0	90.0%
Qwen 3.5 35B	100	100	100	100	100	100	100	100	100	0	90.0%
Qwen 3.5 9B	100	100	100	100	100	100	100	100	100	0	90.0%
Gemini 3 Flash (Preview)	100	100	100	100	100	100	100	100	100	0	90.0%
Z.AI GLM 4.7 Flash	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-5.4	100	100	100	100	100	100	100	100	100	0	90.0%
GPT-4.1 Mini	100	100	100	100	100	100	100	100	100	0	90.0%
Qwen 3 32B	100	100	100	100	100	100	100	100	100	0	90.0%
DeepSeek V3 (2025-03-24)	100	100	100	100	100	100	100	100	100	0	90.0%
Inception Mercury	100	100	100	100	100	100	100	100	100	0	90.0%
Mistral Medium 3.1	100	100	100	100	100	100	100	100	100	0	90.0%
Mistral Small 4	100	100	100	100	100	100	100	100	100	0	90.0%
Ministral 3 14B	100	100	100	100	100	100	100	100	100	0	90.0%
WizardLM 2 8x22b	100	100	100	100	100	100	100	100	100	0	90.0%
Cohere Command R+ (Aug. 2024)	100	100	100	100	100	100	100	100	100	0	90.0%
Ministral 3 3B	100	100	100	100	100	100	100	100	100	0	90.0%
Mistral NeMO	100	100	100	100	100	100	100	100	100	0	90.0%
Qwen 3.5 Flash	100	100	100	100	100	100	100	100	0	0	80.0%
Llama 3.1 70B	100	100	100	100	100	100	100	100	0	0	80.0%
Arcee AI: Trinity Large (Preview)	100	100	100	100	100	100	100	100	0	0	80.0%
Mistral Small Creative	100	100	100	100	100	100	100	100	0	0	80.0%
GPT-4.1 Nano	100	100	100	100	100	100	100	100	0	0	80.0%
Ministral 8B	100	100	100	100	100	100	100	100	0	0	80.0%
Ministral 3B	100	100	100	100	100	100	100	100	0	0	80.0%
Nemotron 3 Super	100	100	100	100	100	100	100	0	0	0	70.0%
Nemotron 3 Nano	100	100	100	100	100	100	0	0	0	0	60.0%
Llama 3.1 8B	100	100	100	100	100	100	0	0	0	0	60.0%
Rocinante 12B	100	0	0	0	0	0	0	0	0	0	10.0%
ByteDance Seed 1.6 Flash	0	0	0	0	0	0	0	0	0	0	0.0%
LFM2 24B	0	0	0	0	0	0	0	0	0	0	0.0%

Match blue prose section

Overall Performance

Performance Score Distribution (Top 20)

Price-Performance Score Distribution (Top 20)

Most Stable Models (Top 20)

Top Overall Models (Top 20)

Individual Scenarios

Create alternate prose sections