NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM08GCTDHP9ZZP63C3A1Q149
Run Details
Model:
GPT-5.4 Mini (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.9s
Cost:
$0.003408
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick had barely stepped into the stable yard when a tall knight in polished mail strode out from between the rows of horses. “You there,” he called, his voice warm but commanding. “You must be Frederick. I am Sir Roland.” Frederick straightened at once and bowed as best he could. Sir Roland’s gaze flicked over the young squire, then softened with a hint of approval. “A castle is not only stone and banners,” he said, glancing toward the restless horses. “It is work, discipline, and patience. If you wish to serve here, you will begin by learning to listen to what the stable hands and steeds can teach you.” Frederick nodded, eager and nervous all at once, as Sir Roland led him deeper into the yard. </nc-section> <nc-section data-title="Version 2" data-color="green"> Near the stables, Frederick was surprised when a knight with a scar across one cheek dismounted and approached him. The man’s armor was worn from years of use, yet he carried himself with easy confidence. “Frederick, I presume,” he said. “Sir Roland, at your service.” Frederick swallowed and managed a quick bow. Sir Roland chuckled. “No need for fear, lad. The stables are a fine place to begin. A squire who cannot calm a horse will never be trusted with a warhorse, and a knight who ignores the labor of the stable is a fool.” He gestured toward a broad-shouldered groom carrying a feed bucket. “Come. I’ll show you where you’ll be working, and perhaps teach you the first lesson of castle life: every rank depends on the one below it.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> As Frederick approached the stables, the smell of hay and leather mingled with the sharp scent of horses. A knight in a blue-trimmed surcoat emerged from the shadowed archway, wiping dust from his gloves. “You must be the new squire,” he said, smiling. “Sir Roland.” Frederick bowed quickly. “Yes, my lord.” Sir Roland laughed. “Just Sir Roland will do for now. I have found that the stables reveal more truth than the great hall ever does. Here, a man cannot hide behind ceremony.” He clapped Frederick lightly on the shoulder and pointed toward a restless mare pawing at the straw. “Start by learning the names of the horses and the temper of the men who care for them. That is the beginning of service.” Frederick looked from the knight to the mare, sensing that his life at the castle had begun in earnest. </nc-section>
created_at
"2026-03-18T10:40:19.29Z"
3/18/2026, 10:40:19 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3611
moderation_latency
(null)
generation_time
4541
tokens_prompt
318
tokens_completion
808
native_tokens_prompt
302
native_tokens_completion
707
native_tokens_completion_images
0
native_tokens_reasoning
124
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.003408
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_0a7598b9cbc151360169ba811359c88194a9ecb6b5b06fafd8"
is_byok
false
latency
195
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773830419-BASsoivHoG02Ru9gp08w"
upstream_id
"resp_0a7598b9cbc151360169ba811359c88194a9ecb6b5b06fafd8"
total_cost
0.003408
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval