NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-06-01KK1HY0WRT0KZK2CQCWA2AJAC
Run Details
Model:
GPT-5.4
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
31.5s
Cost:
$0.019490
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, the air smelled of hay, leather, and the lingering sweat of travel-worn horses. Frederick slid from Thunder’s back, his boots striking the packed earth with a nervous heaviness. Before he could gather his reins, a broad-shouldered knight stepped from the stable doors, his spurs chiming softly with each measured stride. Sir Roland was older than Frederick had imagined any true knight would be, with iron-gray at his temples and a face weathered by sun, wind, and years of command. Yet there was nothing tired in the way he held himself. His gaze was steady, sharp as a honed blade, and it settled on Frederick at once. “So,” Sir Roland said, voice deep and even, “you are the new squire.” Frederick straightened at once. “Yes, sir. Frederick of Dunmere.” The knight’s eyes flicked to Thunder, then back to the boy. “You sit a horse well enough. That is something. But a castle asks more of a lad than a straight back in the saddle.” Frederick swallowed and nodded. “I understand, sir.” For a moment, Sir Roland said nothing. Then, to Frederick’s surprise, the sternness in his expression gave way to the smallest hint of approval. He took the reins from Frederick’s hand with practiced ease and passed them to a waiting stable boy. “You will learn quickly here,” Sir Roland said. “Or you will wish you had. Come. The master-at-arms will want your name before the evening bell, and I would see whether you’ve brought courage with you, or only ambition.” Frederick hurried after him, heart pounding, as the shadows of the stables stretched long across the yard. </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had barely dismounted when a knight in a dark surcoat emerged from the stable yard, brushing straw from his gauntlets. The last light of dusk caught on the silver of his pauldrons and the lion crest fastened at his shoulder. He moved with an easy confidence that made the stable hands step aside without being told. “You must be Frederick,” he said. His tone was not unkind, but it carried the weight of someone accustomed to obedience. Frederick bowed his head quickly. “Yes, my lord.” The knight gave a short laugh. “Sir Roland will do. ‘My lord’ is for men with softer hands and larger halls.” Frederick looked up then, uncertain whether he was being mocked, but found a pair of clear, steady eyes studying him with interest rather than cruelty. Sir Roland was a powerful man, thick through the chest and arms, though age had begun to line his brow. A scar crossed his chin, pale against his weathered skin. “You came a long road?” Sir Roland asked. “Yes, sir. Two days from Dunmere.” “And still holding the reins properly. Good. I have seen boys arrive at these gates looking more fit to milk goats than serve in armor.” Frederick flushed, unsure whether he had been praised or tested. Sir Roland seemed to notice, for he gave the faintest smile and clapped him once on the shoulder. “Do not fear. Every squire begins as an awkward thing. The trick is surviving long enough to become useful.” A stable boy came running to take Thunder, and Frederick hesitated before letting go. Sir Roland noticed that too. “He will be cared for,” the knight said. “No beast goes hungry in my yard. Come with me. There is stew in the hall, and tomorrow there will be work enough to cure you of any grand ideas about knighthood.” Frederick followed him across the yard, both anxious and strangely comforted by the knight’s rough honesty. </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables stood along the inner wall of the castle, warm with lanternlight and alive with the shifting sounds of horses in their stalls. Frederick drew Thunder to a halt and swung down, stiff from the ride. As he reached to soothe the stallion’s neck, a shadow fell across the straw-strewn ground. “Well met,” said a man’s voice. Frederick turned and saw a knight standing a few paces away. He wore no helm, and the fading light revealed a square face, a neatly trimmed beard, and eyes that missed little. His cloak was travel-stained, but the sword at his hip and the sigil on his breast marked him plainly: a knight of the castle. “I am Sir Roland,” the man said. “And if rumor has not lied to me for once, you are Frederick, the new squire.” Frederick bowed awkwardly. “Yes, Sir Roland.” Sir Roland stepped closer and laid a hand against Thunder’s flank, calm and assured. The stallion, who had never taken quickly to strangers, merely snorted and lowered his head. That alone impressed Frederick. “A fine horse,” Sir Roland said. “Though I suspect he has more discipline than most boys your age.” Frederick dared a small smile. “He has had better training, sir.” At that, Sir Roland let out a brief chuckle, low and genuine. “Good. Wit is lighter to carry than fear, and often more useful.” He glanced toward the stable entrance, where a lantern swayed in the gathering dark. “You’ve arrived at a busy hour. The castle is never truly still, but tonight less so than usual. Still, you’ll have your welcome, such as we offer here.” He gestured for Frederick to follow. “Hand your mount over to the grooms and come along. A squire’s life begins quickly, and it rarely begins gently.” Frederick gave Thunder’s reins to a waiting groom, then followed Sir Roland into the firelit yard, where his new life seemed already to be unfolding faster than he could catch his breath. </nc-section>
created_at
"2026-03-06T12:28:35.615Z"
3/6/2026, 12:28:35 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
513
moderation_latency
(null)
generation_time
31422
tokens_prompt
318
tokens_completion
1486
native_tokens_prompt
302
native_tokens_completion
1249
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.01949
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_081744278ae8a3720169aac873aca88190b2b5b18dd0ac7d5b"
is_byok
false
latency
159
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1772800115-jXsGtp6BVQSkeGpX49CS"
upstream_id
"resp_081744278ae8a3720169aac873aca88190b2b5b18dd0ac7d5b"
total_cost
0.01949
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval