NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM0824A2H5C6KB4Z2R6SDB6Z
Run Details
Model:
GPT-5.4 Nano
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
3.7s
Cost:
$0.000975
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight by the Stables" data-color="red"> Frederick reined Thunder in beside the stables, where the air smelled of straw, sweat, and the sharp tang of oiled leather. Before he could dismount, a tall figure stepped from the shadows of the overhang—armor polished to a bright, unforgiving gleam. “Frederick,” Sir Roland said, as though the name had been stamped into the day’s schedule. His voice carried the calm of a man accustomed to danger. “You’re late by a breath. The castle hates lateness.” Frederick swallowed, trying not to look at the knight’s sword. “I—my horse spooked when the wind shifted, sir.” “Mm.” Sir Roland’s gaze flicked to Thunder, then back to Frederick. “Horses blame weather. Men blame themselves. You’ll learn the difference.” He gestured toward the tack room. “Clean this, then stand ready. Training starts before your muscles remember they have a choice.” </nc-section> <nc-section data-title="Version 2: Sir Roland’s Rules" data-color="green"> The stables bustled with quiet purpose—grooms moving like shadows, horses stamping impatiently. Frederick guided Thunder into an open stall, loosening the reins with careful fingers. He was still deciding how to introduce himself when Sir Roland appeared at his shoulder. The local knight didn’t announce himself with grandeur; he simply arrived, boots landing with measured certainty on the packed earth. His cloak was damp at the edges, as if he’d been walking through mist. “You’re Frederick,” Sir Roland said. He sounded less like he was greeting and more like he was confirming a fact in a ledger. “Good.” Frederick straightened, wiping a smear of stable dirt from his palm. “Yes, sir. Thank you for—” “For nothing yet.” Sir Roland reached into a canvas pouch and tossed Frederick a small whetstone. “You’ll start with what you can’t ignore: your blade. If you dull it, you don’t get to blame the world.” He pointed down a narrow training lane between the stables. “Come. Let’s see how you hold yourself when you think no one’s watching.” </nc-section> <nc-section data-title="Version 3: Steel and Oath" data-color="blue"> Thunder exhaled a warm plume as Frederick finished tacking on a fresh blanket. The castle loomed behind the walls like a promise—beautiful, and heavy with consequence. Frederick felt it in his ribs. A cold shadow moved across the stall door. Sir Roland’s silhouette filled the opening, framed by the amber glow of lanterns. When the knight stepped fully in, Frederick realized the man was taller than he’d seemed from a distance, and far more watchful. “So,” Sir Roland said, letting the word stretch like a test. “You’ve come to learn.” Frederick managed a bow that felt steadier than his nerves. “Yes, sir. I’ll work hard. I’ll—” “You’ll listen.” Sir Roland’s gauntlet rested briefly on Frederick’s shoulder, not crushing, just anchoring. “Hard work without listening is how boys become scrap.” He nodded toward the training yard beyond the stables, where the ground was marked with old scuffs and chalk circles. “Today we begin with basics. Footwork. Timing. Then the question you won’t like: what you fear enough to avoid.” </nc-section>
created_at
"2026-03-18T10:32:31.824Z"
3/18/2026, 10:32:31 AM
model
"openai/gpt-5.4-nano-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
491
moderation_latency
(null)
generation_time
3355
tokens_prompt
318
tokens_completion
876
native_tokens_prompt
302
native_tokens_completion
732
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.0009754
router
(null)
provider_responses
0
endpoint_id
"0c835f2e-c18d-4e8c-b245-e1e3bd08b97f"
id
"resp_04996dd46b8c857b0169ba7f3fe5cc819495f59537e2d388d9"
is_byok
false
latency
216
model_permaslug
"openai/gpt-5.4-nano-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773829951-HfHIcikaDLq7DYvqp6lw"
upstream_id
"resp_04996dd46b8c857b0169ba7f3fe5cc819495f59537e2d388d9"
total_cost
0.0009754
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval