NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-06-01KK1HV20S4QYQX2E9EM4PS3NS
Run Details
Model:
GPT-5.4 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
27.0s
Cost:
$0.016355
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, the smell of hay and leather hung thick in the evening air. Frederick had barely swung down from Thunder’s back when a tall knight in a weather-worn surcoat stepped from the shadows of the stable doors. His hair was touched with gray, and a long scar traced one side of his jaw, but his eyes were steady and not unkind. “You must be Frederick,” the knight said, resting one gloved hand on the horse’s neck. “I am Sir Roland, master of arms to this castle. We have been expecting you.” Frederick straightened at once, suddenly aware of the dust on his boots and the stiffness in his shoulders from the ride. “Yes, sir. I arrived as quickly as I could.” Sir Roland gave a small nod, as though weighing the boy with a single glance. “Quickly is well enough. Safely is better. A squire who cannot care for his mount rarely proves useful to a knight.” He looked to Thunder again. “Fine animal. See him brushed, watered, and fed before you think of your own supper.” Frederick flushed, but he bowed his head. “Yes, Sir Roland.” For the first time, the old knight’s stern expression softened. “Good. If you learn that lesson early, you may yet do well here. Come—when your horse is settled, I will show you where you are to sleep.” </nc-section> <nc-section data-title="Version 2" data-color="green"> The stable yard was alive with small sounds: the stamping of hooves, the clink of harness rings, the low murmur of stable hands finishing the day’s work. Frederick led Thunder toward an open stall when he heard the measured tread of armored boots behind him. He turned to find a broad-shouldered knight approaching, cloak gathered over one arm, his mail glimmering dimly in the last light. “Frederick, I presume,” the man said. His voice was deep, carrying the calm authority of someone long obeyed. “I am Sir Roland, sworn knight of these lands.” Frederick quickly bowed. “It is an honor, sir.” Sir Roland studied him for a moment, then glanced at the road beyond the gate. “You made good time from the outer villages. Not every boy arrives before dark on his first journey.” He folded his arms. “Tell me—did you keep your courage when the forest road narrowed?” Frederick hesitated, remembering the shadows beneath the trees and every tale he had ever heard of wolves and worse. “I did my best, sir.” A faint smile touched Sir Roland’s mouth. “That is often the only answer worth giving.” He reached for Thunder’s reins and handed them back with deliberate care. “This castle will demand the same. Tend your horse. Then report to the training yard at dawn. We shall see what sort of squire you mean to be.” As Sir Roland turned away, Frederick felt his weariness sharpen into determination. Whatever waited for him inside those walls, his life as a boy on the road had ended here, beside the stables in the fading light. </nc-section> <nc-section data-title="Version 3" data-color="blue"> Frederick had just loosened Thunder’s saddle straps when a voice rose from the stable entrance. “Easy there. A long ride makes even a good horse temperamental.” He looked up to see a knight standing beneath the lantern glow, his polished breastplate marked by travel and use rather than ceremony. The man descended the short step into the straw-strewn yard and removed one leather glove. “Sir Roland,” he said, offering his hand with surprising plainness for so formidable a figure. “Welcome to Castle Darrow, Frederick.” Frederick took the hand awkwardly, unsure whether to bow first or speak. “Thank you, sir. I am grateful to be here.” Sir Roland released his grip and circled Thunder with an expert eye. “Strong legs. Clear eyes. You chose your mount well—or someone chose well for you.” He looked back at Frederick. “A castle judges a newcomer by many things. The first is often how he treats the creature that carried him to its gates.” “I understand, sir,” Frederick replied, and this time he meant it with all his heart. “Good.” Sir Roland gestured toward the rows of stalls, where warm lamplight spilled across the floorboards. “Settle him in, then find the west hall. A meal will still be waiting if the kitchen has not been entirely conquered by the guards.” The corner of his mouth twitched, almost a smile. “After that, rest. Tomorrow, your real welcome begins.” Frederick watched the knight go, feeling both relieved and unsettled. Sir Roland had not spoken harshly, yet there had been a weight in his words that made the castle seem less like a refuge and more like the threshold of a trial. </nc-section>
created_at
"2026-03-06T12:26:58.465Z"
3/6/2026, 12:26:58 PM
model
"openai/gpt-5.4-20260305"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
383
moderation_latency
(null)
generation_time
26943
tokens_prompt
318
tokens_completion
1227
native_tokens_prompt
302
native_tokens_completion
1040
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.016355
router
(null)
provider_responses
0
endpoint_id
"9ff5625c-403f-4d7f-b895-58ac7295062c"
id
"resp_031c43b5dc068c080169aac812866c8197822d0a3552421baf"
is_byok
false
latency
136
model_permaslug
"openai/gpt-5.4-20260305"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1772800018-GsRZwbEHhvqIaHcOxmHm"
upstream_id
"resp_031c43b5dc068c080169aac812866c8197822d0a3552421baf"
total_cost
0.016355
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval