NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-09-01KKAC6G8FASRV55YE22170ST3
Run Details
Model:
GPT-5.4 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
27.1s
Cost:
$0.018665
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, where the air was warm with the scent of hay and leather, a broad-shouldered knight waited with his hands clasped behind his back. His armor was plain but well kept, its steel dulled by use rather than neglect, and a faded crimson cloak hung from his shoulders. As Frederick swung down from his horse, the knight gave him a measured look, stern at first, then softened by the hint of a smile. “You must be Frederick,” he said, his voice deep and steady. “I am Sir Roland, master of arms to half the fools in this yard and keeper of the other half from breaking their necks.” Frederick straightened at once, brushing dust from his tunic. “Yes, sir.” Sir Roland stepped forward and took the reins with practiced ease, calming the restless horse with a touch to its neck. “The ride was long, I expect. You’ve arrived at a good hour. Supper has not yet been served, and the stablemaster is in a forgiving mood.” His eyes narrowed slightly, studying the boy. “You look tired, but not weak. That will serve you well here.” Behind them, the stable doors stood open, lantern light spilling across the yard while grooms hurried between stalls. Frederick glanced toward the towering keep, feeling suddenly smaller beneath its shadow. Sir Roland seemed to notice. “Do not stare too long at the castle,” he said. “Stone walls impress boys. What matters is what sort of man walks within them.” He gestured for Frederick to follow. “Come. I’ll show you where you’ll sleep—and tomorrow, we’ll see whether you’ve come here to serve, or to become something greater.” </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had barely reached the stables when a knight emerged from within, ducking beneath the low beam of the doorway. He was taller than Frederick had expected, with silver at his temples and a face lined by weather, training, and long campaigns. A surcoat bearing the castle’s sigil lay over his mail, and his gaze was sharp enough to make Frederick instinctively stand straighter. “So,” the knight said, stopping before him, “the new squire has arrived.” Frederick bowed his head. “Frederick, sir.” The knight nodded once. “Sir Roland.” His tone was not unkind, but it carried the weight of command. He glanced at Frederick’s road-worn boots, the dust on his cloak, and the calluses on his hands. “Good. You’ve ridden hard to get here. Better that than arriving soft and pampered.” A stable boy rushed forward to take the horse, but Sir Roland lifted a hand, stopping him. Instead, he watched Frederick carefully. “Well? Don’t just stand there. A squire tends his own mount before he thinks of resting.” Flushing, Frederick moved quickly to loosen the saddle straps. Sir Roland observed in silence for a moment, then gave a quiet grunt of approval. “At least you know that much. There may be hope for you yet.” Frederick dared a small smile. Sir Roland turned toward the inner yard, where torchlight flickered against the old stone walls. “This castle has no use for lazy hands or proud hearts. Learn quickly, obey well, and keep your blade clean. Do that, and you may survive your first winter here.” Then, with the faintest glimmer of amusement in his eyes, he added, “Come along, Frederick. Let us see what sort of trouble you are likely to become.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables were alive with evening sounds—the stamping of hooves, the rustle of straw, the low murmur of stablehands finishing their work before nightfall. Frederick had just dismounted when a knight stepped out from the shadows beside the stable doors. He wore no helmet, and the last light of sunset caught along the scar that traced one cheek to his jaw. “Frederick?” the knight asked. “Yes, sir,” Frederick replied, trying not to let his voice waver. The man inclined his head. “I am Sir Roland. The captain said to expect you before dusk. You are late—but only by a little, so I will call that improvement rather than failure.” Frederick blinked, uncertain whether he was being scolded or welcomed. Sir Roland spared him the trouble of answering. He rested one gauntleted hand on a fence post and looked Frederick over with the calm attention of a man judging a sword’s balance. “You’re younger than I was told. But young is not the same as useless.” He gave a short nod toward the horse. “You handled your ride well enough. The beast trusts you. That matters.” A breeze stirred the straw at their feet as lanterns were lit one by one along the stable wall. Frederick felt the ache of the road in his shoulders, but also a spark of relief. He was here. Truly here. Sir Roland’s expression eased, though only slightly. “Listen well. In this castle, you’ll rise before dawn, work before breakfast, and earn every scrap of praise given to you. If that frightens you, say so now.” Frederick swallowed and lifted his chin. “It doesn’t, sir.” For the first time, Sir Roland smiled. It was brief, but real. “Good. Then welcome to the castle, Frederick.” He turned and motioned him inside. “Let us get your horse settled. Tomorrow, your life begins in earnest.” </nc-section>
created_at
"2026-03-09T22:41:31.929Z"
3/9/2026, 10:41:31 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
907
moderation_latency
(null)
generation_time
27019
tokens_prompt
318
tokens_completion
1394
native_tokens_prompt
302
native_tokens_completion
1194
native_tokens_completion_images
0
native_tokens_reasoning
11
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.018665
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_090fddbbd4bc24c30169af4c9c04248190a7d928ad1882190d"
is_byok
false
latency
209
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773096091-kpUpP640mOi3ZzEwM0mI"
upstream_id
"resp_090fddbbd4bc24c30169af4c9c04248190a7d928ad1882190d"
total_cost
0.018665
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval