NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-09-01KKAC5BH1JJ9TXP4H6PQX8DPE
Run Details
Model:
GPT-5.4 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
28.2s
Cost:
$0.019340
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, where the air smelled of hay, leather, and warm horses, a broad-shouldered knight stepped from the lengthening shadows. His mail glimmered faintly beneath a dark surcoat marked with the crest of the castle. A trimmed beard framed his weathered face, and though there was sternness in his bearing, his eyes were kind. “You must be Frederick,” he said, resting a gauntleted hand on the fence rail. “I am Sir Roland, master of the yard while you are under this roof.” Frederick slid from his horse a little too quickly, nearly stumbling as his boots struck the ground. He straightened at once, cheeks warming, and bowed his head. “Yes, sir. I arrived only moments ago.” Sir Roland’s mouth twitched with the hint of a smile. “So I saw. The horses noticed you before I did. They can tell when someone is nervous.” Frederick glanced toward the stalls, where several heads peered over their doors, ears flicking in the dim gold light. “I did not mean to cause trouble, sir.” “Good,” Sir Roland replied. “Because there will be enough trouble for you in training without you borrowing more.” He stepped closer, studying the boy with a soldier’s practiced eye. “You are young, but not soft-handed. That is something. Bring your mount in, see him rubbed down, and then report to the yard at dawn. If you mean to serve here, the castle will know your measure soon enough.” Frederick nodded, his heart thudding with equal parts fear and excitement. As Sir Roland turned toward the stable doors, he added over one shoulder, “And Frederick—welcome to the castle. Try not to embarrass yourself before breakfast.” </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had scarcely handed the reins to a stable boy when he heard the measured clink of armor approaching through the straw-strewn yard. He turned to see a knight emerging from beside the stable doors, tall and straight-backed, with silver at his temples and a green cloak clasped over polished mail. “So,” the knight said, his voice low and even, “the new squire has finally arrived.” Frederick swallowed and bowed. “Frederick, sir.” “Sir Roland,” the knight answered. “I oversee the squires, the horses, and, when necessary, the foolishness of boys who think knighthood is won with a sword and a smile.” There was no cruelty in the words, only iron certainty. Frederick lifted his head carefully. Sir Roland’s gaze was sharp, but not unwelcoming; it was the gaze of a man who had seen many youths arrive full of hope and fear. “You rode well enough into the yard,” Sir Roland said, glancing at Frederick’s horse. “At least, you did not fall off. That places you above some.” Frederick dared a small smile. “I will do my best, sir.” “That,” said Sir Roland, “is the least that will be expected of you.” He took the reins himself and gave the horse an approving pat on the neck. “You will rise before sunrise. You will learn to groom, to clean tack, to muck stalls, and to obey before you ever think of glory. If you cannot respect a stable, you will never be worthy of a battlefield.” Frederick felt the weight of those words settle in him. He looked past Sir Roland into the dim stable, where lantern light flickered over beams blackened by age. This was no longer a dream told by hearthfire. It was real. Sir Roland nodded toward the open doors. “Come along, then. Your first lesson begins here.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stable yard was alive with evening sounds—the soft stamp of hooves, the creak of harness leather, the murmur of grooms at their work. Frederick stood uncertainly beside his horse, still taking in the vastness of the castle, when a shadow fell across the straw before him. He looked up to find a knight regarding him with calm attention. The man wore a blue-trimmed surcoat over chain mail, and a scar ran from the corner of his brow into his hairline, pale against sun-browned skin. He carried his helmet beneath one arm. “You’ve the look of someone wondering whether to be proud or terrified,” the knight said. Frederick blinked, then lowered his gaze. “Perhaps both, sir.” A quiet chuckle escaped the man. “An honest answer. Good. I am Sir Roland.” At once Frederick bowed more deeply. “It is an honor, sir.” “We shall see if you still think so after a week in my training yard,” Sir Roland replied. Yet his expression softened. He reached to check the horse’s bridle with quick, practiced fingers. “A squire’s life begins here, not in the great hall and not in the songs. Here among sweat, straw, and sore muscles.” Frederick watched him, struck by the ease with which the knight moved, as if the stable were as much his domain as any battlefield. “I am ready to learn,” he said, hoping it was true. Sir Roland met his eyes for a long moment, measuring him. “Readiness is rare. Willingness is enough to start.” He handed the reins back and gestured toward the row of stalls. “See your horse cared for, then eat while the kitchens still have mercy. At dawn, report to me. We begin with discipline.” As Sir Roland strode away through the lantern glow, Frederick drew a steadying breath. The castle no longer seemed merely grand. It felt watchful, demanding—and full of promise. </nc-section>
created_at
"2026-03-09T22:40:54.315Z"
3/9/2026, 10:40:54 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2276
moderation_latency
(null)
generation_time
27894
tokens_prompt
318
tokens_completion
1536
native_tokens_prompt
302
native_tokens_completion
1239
native_tokens_completion_images
0
native_tokens_reasoning
14
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.01934
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_0778a4b933f5c4930169af4c766158819086e3b1c5e8457ffa"
is_byok
false
latency
216
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773096054-2kK0uUERV5arWcUHASaO"
upstream_id
"resp_0778a4b933f5c4930169af4c766158819086e3b1c5e8457ffa"
total_cost
0.01934
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval