NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-09-01KKACDFPFG6Q6VVD1HAMN9ETY
Run Details
Model:
GPT-5.4 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
22.3s
Cost:
$0.015110
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, the smells of hay, leather, and warm horseflesh wrapped around Frederick as he swung down from Thunder’s back. Stable boys hurried past with pails and brushes, glancing curiously at the new arrival. Before Frederick could gather his pack, a tall knight in a dark surcoat stepped from the shadows of the stable arch. “Frederick, I presume,” the knight said, his voice deep and steady. Frederick straightened at once. “Yes, sir.” The man removed one gauntlet and offered his hand. “I am Sir Roland, master of the yard and keeper of discipline within these walls. If you mean to serve here, you will rise early, work hard, and complain never.” Frederick clasped the knight’s hand, surprised by the firmness of it. Sir Roland’s stern expression softened, if only a little, as his gaze fell upon Thunder. “A fine mount,” he said. “You rode far to reach us. That shows grit.” He nodded toward the stable doors. “Come. Your horse will be cared for, and after that, I will show you where squires sleep. By dawn, your training begins.” Frederick followed him into the deep golden light of the stables, his heart pounding with equal parts fear and excitement. </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had barely reached the stables when a knight emerged between the rows of horses, his spurs ringing softly against the stone. He was broad-shouldered and weathered, with a scar crossing one cheek and kind, sharp eyes that missed nothing. “So,” the knight said, folding his arms, “you are the new squire they sent from the north.” Frederick bowed awkwardly. “Frederick, sir.” “Sir Roland,” the man replied. “And if you are wise, you will remember that name when the drills grow cold and your arms begin to shake.” There was a hint of humor beneath the sternness, and Frederick dared a small smile. Sir Roland noticed and gave a short nod, as if approving the courage it took. He reached for Thunder’s reins and handed them to a waiting stable hand. “Your horse will be fed before you are. That is the rule here. A careless rider blames his mount. A good one sees to it first.” Frederick glanced at Thunder, then back to the knight. “Yes, Sir Roland.” “Good,” said Roland. “You may yet learn something in this place. Come with me. The castle is larger than it looks, and less forgiving than it seems.” With that, Sir Roland turned and strode toward the inner yard, leaving Frederick to hurry after him beneath the lengthening evening shadows. </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables stood just within the castle wall, lit by lanterns that glimmered like fallen stars in the dusk. Frederick was loosening Thunder’s saddle when he became aware of someone watching him. He turned to find a knight leaning against a post, clad in chain and a faded crimson cloak. “You handle the horse well,” the knight said. Frederick quickly lowered his eyes. “Thank you, sir.” The knight stepped forward, and the lantern light revealed a strong, lined face beneath iron-gray hair. “I am Sir Roland. The captain said a new squire would arrive before nightfall. I had expected someone taller.” Frederick flushed, uncertain whether it was mockery. Then Sir Roland’s mouth twitched with the barest sign of a smile. “I have also learned,” Roland continued, “that height is among the least important measures of a man.” Frederick let out the breath he had been holding. “I will do my best, sir.” “That,” said Sir Roland, “is what every squire says on his first night. We shall see what you say after your first week.” He took one end of the saddle and lifted it down with practiced ease. “Come inside. There is supper in the hall, and after that, I will show you the armory. A boy who wishes to become a knight should know the smell of steel as well as the smell of horses.” Frederick nodded and followed Sir Roland into the stable’s warm lantern glow, feeling that he had just crossed the first true threshold of his new life. </nc-section>
created_at
"2026-03-09T22:45:20.73Z"
3/9/2026, 10:45:20 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
928
moderation_latency
(null)
generation_time
22139
tokens_prompt
318
tokens_completion
1103
native_tokens_prompt
302
native_tokens_completion
957
native_tokens_completion_images
0
native_tokens_reasoning
20
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.01511
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_06d989ce54a647570169af4d80cd848193a4bbe61c53a962c7"
is_byok
false
latency
217
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773096320-H2Cu09tEzPlEgDv69OrN"
upstream_id
"resp_06d989ce54a647570169af4d80cd848193a4bbe61c53a962c7"
total_cost
0.01511
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval