NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-06-01KK1GHTBJ8Y146PPN545FKKQ3
Run Details
Model:
GPT-5.4 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
43.5s
Cost:
$0.022115
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, the air was rich with the scent of hay, leather, and horse sweat. Frederick slid from Thunder's back, his boots striking the packed earth with more confidence than he felt. Stable hands moved around him with practiced ease, leading mares to their stalls and carrying buckets that sloshed with water from the well. “Easy there,” came a deep voice. Frederick turned to see a broad-shouldered knight approaching through the golden light of evening. His surcoat bore the castle’s crest, and the silver at his wrists and collar was scratched from long use rather than polished for show. A scar crossed one cheek, though his expression was calm. “You must be Frederick,” the knight said. “I am Sir Roland.” Frederick straightened at once and bowed as best he could. “Yes, my lord.” Sir Roland’s gaze shifted to Thunder, who tossed his head impatiently. “Fine horse. Spirited. If he throws you before dawn, I’ll know the road has not humbled you enough.” For a heartbeat Frederick could not tell whether the knight was mocking him, but then Sir Roland’s mouth curved into the faintest smile. “I will do my best not to be thrown,” Frederick said. “A sensible answer,” Sir Roland replied. He stepped closer and lowered his voice. “This castle makes men out of boys, if they let it. You’ll rise early, work hard, and learn quickly. If you fail, fail honestly. I have no use for excuses.” Frederick swallowed and nodded. “I understand.” Sir Roland clapped a heavy hand to his shoulder, not unkindly. “Good. Then begin by seeing your horse settled. After that, report to the lower yard at first light. Training starts with the sun, whether you are ready or not.” As the knight turned away, the stable lanterns were being lit one by one, their glow warming the shadows. Frederick watched Sir Roland go and felt, for the first time since arriving, that the life ahead of him had truly begun. </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had barely taken three steps from the saddle before the stable doors opened and a knight emerged, ducking beneath the low beam. He was tall, though age had begun to silver his beard, and he carried himself with the kind of quiet strength that made the bustling stable yard seem to hush around him. “So,” the knight said, studying Frederick with sharp gray eyes, “the new squire has arrived.” Frederick brushed dust from his tunic and bowed. “Frederick, sir.” “Sir Roland,” the man answered. He reached for Thunder’s reins with an ease that calmed the horse at once. “A good mount knows much about his rider. This one is tired, wary, and still obedient. Better qualities than many men bring through these gates.” Frederick was unsure how to reply, so he settled for, “Thank you, sir.” Sir Roland gave a small grunt that might have been approval. Around them, the stable yard glowed with the last amber light of day. Sparrows darted along the rafters, and somewhere deeper inside, a horse stamped and snorted in its stall. “You’ve come to learn steel and discipline,” Sir Roland said. “But here you will first learn smaller things—how to saddle without wasting motion, how to clean mud from tack, how to listen before you speak. Any fool can swing a sword. Few can master themselves.” Frederick lifted his chin. “I want to learn, sir.” “Wanting is the easiest part.” Sir Roland handed the reins to a waiting stable boy, then looked back at Frederick. “Still, I have seen enough to know whether a lad has courage in him. The rest we will discover.” That answer warmed Frederick more than the evening air. He glanced toward the towering castle beyond the yard, its windows catching the final light like embers. “Come,” said Sir Roland. “I’ll show you where you sleep, and tomorrow I’ll show you how quickly pride can be knocked into the dirt.” This time Frederick caught the glint of humor in the knight’s eye, and despite his nerves, he smiled as he followed. </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stable yard was alive with motion when Frederick arrived—horses shifting in their stalls, boys hurrying with feed sacks, lantern hooks creaking as dusk settled over the castle. Frederick dismounted carefully, trying to hide the stiffness in his legs after the long ride. “Well enough done,” said a voice beside him. “At least you stayed in the saddle.” Frederick turned so quickly he nearly dropped the reins. The speaker was a knight in a dark training cloak, his mail visible at the throat and sleeves. He stood with arms folded, watching Frederick with a level, measuring stare. “I beg your pardon, sir?” Frederick said. The knight’s stern expression broke into a brief smile. “If that startles you, the practice yard will be a cruel place indeed. Sir Roland.” Frederick bowed at once. “Frederick, sir. I am honored.” “We shall see whether honor survives your first week,” Sir Roland replied. He nodded toward the stables. “Bring your horse in. A squire who neglects his mount is no squire worth naming.” Frederick led Thunder forward, feeling Sir Roland fall into step beside him. Inside, the stable was warm and shadowed, lit by hanging lamps and alive with the rustle of straw. Thunder snorted softly as a groom came to take him. Sir Roland watched the exchange, then said, “You hold yourself too tightly. Nerves?” “A little, sir.” “Good. Overconfidence is harder to cure.” Frederick looked up, uncertain whether he was being scolded. Sir Roland rested one hand on the wooden stall door. “Listen carefully. The castle is full of men who boast about what they will become. I care only for what you do tomorrow, and the day after that, and the day after that again. Service first. Skill second. Glory last.” The words settled heavily in Frederick’s mind. “At dawn, report to the training yard,” Sir Roland continued. “Not a moment late. If you impress me, I may spare you my disappointment. If not, you will become very familiar with the ground.” Frederick let out a breath he had not realized he was holding. “Yes, Sir Roland.” The knight gave a single nod and turned toward the darkening yard, where the first stars were beginning to appear above the battlements. Frederick watched him go, already knowing that whatever trials awaited him here, Sir Roland would stand at the center of them. </nc-section>
created_at
"2026-03-06T12:04:27.13Z"
3/6/2026, 12:04:27 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
382
moderation_latency
(null)
generation_time
43420
tokens_prompt
318
tokens_completion
1733
native_tokens_prompt
302
native_tokens_completion
1424
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.022115
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_0048208ae1b247360169aac2cb359c8196952dba22365d04f7"
is_byok
false
latency
171
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1772798667-Ugi6qe2TwVXACWj8vhNw"
upstream_id
"resp_0048208ae1b247360169aac2cb359c8196952dba22365d04f7"
total_cost
0.022115
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval