NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM08P2TA9TC13TKNT6XP904Q
Run Details
Model:
GPT-5.4 Nano
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.7s
Cost:
$0.001287
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland’s Welcome" data-color="red"> Near the stables, the air smelled of straw and iron, and the horses stamped in impatient rhythm as Frederick dismounted. A tall man in weather-darkened mail stepped from the shadow of a hay loft, his crest catching the last light like a promise. “Frederick,” Sir Roland said, as if the name had been waiting on his tongue all day. His voice was stern, but not unkind, and the reins in his gloved hands looked almost unnecessary—like he could have commanded the world to stand still. “So you made it. Good.” Frederick straightened, bowing awkwardly before he could stop himself. “Yes, sir. I’m ready to—” Sir Roland lifted a hand. “Ready is cheap. Learn is dear. Come—before the stablemaster decides you’ll sleep in the muck and call it training.” He nodded toward a narrow path between the stalls. “Your first lesson is how to move without being in the way.” Frederick glanced at the horses, at the long lashes of their ears and the gleam of tack. He swallowed, then followed the knight’s brisk steps, trying to match the quiet certainty of a man who had survived every battlefield he’d ever walked into. </nc-section> <nc-section data-title="Version 2: The Test at the Stables" data-color="green"> Frederick found Sir Roland by the stables not by rumor, but by instinct—because trouble always seemed to smell like steel. The local knight stood with one boot braced on a stone trough, inspecting a strap as though it had personally offended him. When Frederick approached, Sir Roland straightened. “You’re the new squire,” he said, eyes flicking over Frederick’s traveling cloak, his boots, the dust still clinging to his hems. “Not much padding for someone who’s supposed to learn under a hard man.” Frederick’s cheeks warmed. “I will do better, sir.” Sir Roland’s mouth twitched—almost a smile, quickly denied. “Not ‘better.’ Correct. This is a stable, not a yard sale. Watch.” He gestured to a horse that kept throwing its head, and to the small knot of rope tangled at its manger. “Untie that without making it panic. If it panics, you’ve already failed.” Frederick hesitated only a heartbeat before he stepped in. He kept his hands slow, his breathing even, speaking softly to the animal as he worked the knot free. The horse steadied, then leaned into the touch. Sir Roland exhaled once, sharply satisfied. “Good. You listen with your hands. That’s rarer than a sword with no scars.” He turned toward the yard gate. “Now come. Training begins when you stop thinking you deserve it.” </nc-section> <nc-section data-title="Version 3: A Knight with Watchful Eyes" data-color="blue"> The stables were quieter than Frederick expected—horses murmured to one another, tack clinked like distant bells, and somewhere a bucket splashed with the casual impatience of routine. A man in polished armor stood near the feed barrels, though he didn’t look like he was waiting for anyone. Then he turned, and Frederick felt the weight of being seen. Sir Roland’s armor was scuffed in places that mattered, polished where it counted, and his gaze moved the way a hawk’s did—always searching for what might bolt. “So,” Sir Roland said, stepping closer, “Frederick of the road. You ride in at dusk and expect a castle to be kind.” “I didn’t expect—” Frederick began, but the knight lifted a finger, silencing his excuses as neatly as he would a blade’s edge. Sir Roland circled him once, slow and deliberate. “A squire’s first duty is not to swing steel. It’s to know where it is safe to stand.” He pointed toward a line of trampled straw near the stable door. “That’s where the colt kicks when startled. You’ll learn that before you learn to fence.” Frederick nodded, unsure whether to be offended or relieved. The knight’s expression softened by a fraction. “You have the look of someone who has carried fear a long way. Don’t set it down yet—use it. Fear makes you careful. Careful makes you live.” With that, Sir Roland motioned toward the saddle racks and the shadowed tack room. “Walk with me. If you’re truly ready, you’ll follow instructions without being asked twice.” </nc-section>
created_at
"2026-03-18T10:43:25.657Z"
3/18/2026, 10:43:25 AM
model
"openai/gpt-5.4-nano-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
401
moderation_latency
(null)
generation_time
4200
tokens_prompt
318
tokens_completion
1138
native_tokens_prompt
302
native_tokens_completion
981
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.00128665
router
(null)
provider_responses
0
endpoint_id
"0c835f2e-c18d-4e8c-b245-e1e3bd08b97f"
id
"resp_0a139e8e690f466a0169ba81cdbdb481979ebb6efa61a5b63b"
is_byok
false
latency
210
model_permaslug
"openai/gpt-5.4-nano-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773830605-uTyd5azwexQr7jNCcd14"
upstream_id
"resp_0a139e8e690f466a0169ba81cdbdb481979ebb6efa61a5b63b"
total_cost
0.00128665
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval