NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM0AP7A2NQT7B5Q6Q9FJCNVA
Run Details
Model:
GPT-5.4 Nano (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
5.6s
Cost:
$0.001522
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Iron-Browed Welcome" data-color="red"> Thunder stamped in the straw as I dismounted near the stables, my boots scraping grit from the cobbles. Before I could steady the reins, a heavy tread approached—measured, unhurried, certain. “Frederick,” said a voice like a hammer finding its mark. Sir Roland stood by the stable door in a coat of burnished steel that looked too bright for a place meant for hay and sweat. His helmet hung at his side, but his gaze was fixed like it was still under crown and plume. One gloved hand rested on the hilt of his sword without drawing it. “So you’re the new squire,” he continued, stepping closer until I could smell leather oil and horse-sweat. “Good. I was beginning to think the messengers had taken ill on their roads.” He circled me once, slow as a siege engineer assessing walls, and then nodded at my kit. “You’ll learn quickly here. The castle doesn’t reward hesitation.” A stableboy lingered at the edge of the yard, eyes wide, and I realized I was being studied by more than one set of attention. Sir Roland’s mouth tightened—not unkindly, but like a man testing the edge of a blade. “Come,” he said. “Let’s see what you do with your hands before you ask what the world expects from your heart.” </nc-section> <nc-section data-title="Version 2: A Knight’s Counting" data-color="green"> The stables rang with small sounds—brush strokes, the soft clink of tack, the low, conversational snort of horses who knew every familiar face. I guided Thunder into a stall and brushed the saddle blanket from my arms, still buzzing with the sting of travel. That was when Sir Roland appeared, as if he’d been carved from the stable shadows themselves. No trumpets. No flourish. Just presence. He greeted me with a brief, practical bow. “Frederick,” he said, the name spoken like a task assigned and already being measured. “You’re late.” My chest tightened. “Late by—” “By minutes,” he corrected, holding up one finger. “And in this place, minutes become mistakes. Mistakes become injuries. Injuries become funerals. Understand?” I swallowed. “Yes, sir.” Sir Roland’s eyes flicked to my hands—whether they shook, whether I gripped too tight, whether I fumbled at buckles and straps. “Good. No wasted motion.” His tone softened by half a degree, the way a winter wind might ease when it chooses a different direction. He nodded toward the training yard beyond the stable roofline. “You’ll start with the mounts. Not the grand warhorses—those are for display and pride. You’ll work with the ones that need patience.” A horse in the adjacent stall laid its ears back, then settled as Sir Roland passed. He spoke again, quieter now. “A squire who can calm a frightened animal can calm a frightened man. That will matter, someday.” I didn’t know whether he meant today or later. Either way, his certainty made me stand straighter. </nc-section> <nc-section data-title="Version 3: Steel and Oaths" data-color="blue"> Thunder’s breath steamed in the cool air as I led him toward the tack room. The castle around me seemed louder now that I stood closer to it—the distant ring of hammer on anvil, the murmur of servants, the wind worrying at banners overhead. Sir Roland found me between stall doors, where lanternlight pooled on the ground like spilled gold. He wore his armor as if it had become part of his body, not merely worn on it—each piece set with discipline, each strap tightened to the last. “You’re Frederick,” he said, voice steady and warm at once, the way a forge sounds when it’s finally ready. I turned, brushing straw from my sleeve. “Yes, sir. I—thank you for meeting me.” He smiled, brief but real. “I don’t meet boys. I meet tools that might someday cut into the world.” His gaze flicked to Thunder, then back to me. “How is your mount?” “Strong,” I said, though I wasn’t sure whether I meant Thunder or myself. Sir Roland reached out and set a hand on Thunder’s shoulder—not to calm him, but to acknowledge him, as knights acknowledge equals. The horse lowered its head, trusting. “Then you’ll do,” Sir Roland said. “That’s all any oath ever says at the start.” He drew nearer, and the shadow of his armor fell over the straw. “Listen carefully, Frederick. Training begins with small obedience: clean tack, straight posture, a mind that pays attention. Everything else is simply what grows from those things.” A stableboy watched us with fascination. Sir Roland didn’t look at him; he looked through the boy, as if seeing the future where Frederick would either fail or flourish. “Now,” he added, tapping the edge of my leather glove with one knuckle, “show me how you remove a bridle without frightening the horse. We’ll see whether you’re learning already.” </nc-section>
created_at
"2026-03-18T11:18:27.408Z"
3/18/2026, 11:18:27 AM
model
"openai/gpt-5.4-nano-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2783
moderation_latency
(null)
generation_time
5048
tokens_prompt
318
tokens_completion
1429
native_tokens_prompt
302
native_tokens_completion
1169
native_tokens_completion_images
0
native_tokens_reasoning
47
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.00152165
router
(null)
provider_responses
0
endpoint_id
"0c835f2e-c18d-4e8c-b245-e1e3bd08b97f"
id
"resp_01dd1636871c8f0a0169ba8a03793481949bdab52ad9a00cd9"
is_byok
false
latency
191
model_permaslug
"openai/gpt-5.4-nano-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773832707-nwL6iljOPfXX8k9racAF"
upstream_id
"resp_01dd1636871c8f0a0169ba8a03793481949bdab52ad9a00cd9"
total_cost
0.00152165
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval