NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM09DHPF56KGQC3YV7VVQGZV
Run Details
Model:
GPT-5.4 Mini (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
3.6s
Cost:
$0.003282
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick had scarcely dismounted when a broad-shouldered knight in polished mail emerged from the shadow of the stables. “You must be Frederick,” he said, his voice carrying the easy authority of long practice. “I am Sir Roland, keeper of this yard and, for the next few weeks, your sternest inconvenience.” Frederick straightened at once. “It’s an honor, sir.” Sir Roland’s stern expression softened into the hint of a smile as he glanced toward the horses shifting in their stalls. “Honor is earned here, boy. You’ll begin by learning the names of the stablehands, the temper of the mounts, and the difference between a hasty movement and a foolish one. Come—if you can keep pace, I’ll show you where a squire starts.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, he was met by the ring of iron-shod boots on cobblestone. A knight with a weathered face and a scar across one cheek stood by the open doors, brushing hay from his gauntlets. “Frederick, is it?” the man asked. “I’m Sir Roland. Word reached me you’ve come to learn the making of a knight.” Frederick bowed quickly. “Yes, my lord.” Sir Roland chuckled. “Not my lord—just Sir Roland, and if you call me that one more time before supper, I’ll have the stablemaster put you to work mucking stalls until your hands forget how to bow.” He gestured toward the horses inside. “You’ll earn your place from the ground up. Begin by saddling the chestnut stallion, and let’s see whether you’ve brought more courage than clumsiness.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The scent of straw and warm leather drifted from the stables as Frederick neared them, only to find a knight waiting beside the doorway, one hand resting on the hilt of his sword. Sir Roland’s armor was scuffed from years of service, but his gaze was sharp and steady. “So,” he said, studying Frederick with a single quick look, “the castle finally has its newest squire.” Frederick swallowed and nodded. “I’m ready to learn, sir.” “Good. Readiness is a fine beginning.” Sir Roland turned and led him past the stalls, where horses stamped softly in the dim light. “You’ll learn the horses first, then the armor, then the manners of men who think themselves important. If you survive all three, perhaps I’ll teach you something useful.” His mouth curved faintly. “Follow me, Frederick. Your training starts now.” </nc-section>
created_at
"2026-03-18T10:56:14.555Z"
3/18/2026, 10:56:14 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2515
moderation_latency
(null)
generation_time
3366
tokens_prompt
318
tokens_completion
806
native_tokens_prompt
302
native_tokens_completion
679
native_tokens_completion_images
0
native_tokens_reasoning
79
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.003282
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_06f58f01787143d80169ba84ce9a1c81908727fc04ab318900"
is_byok
false
latency
195
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773831374-rDdncKmnzXsJSbN12RJE"
upstream_id
"resp_06f58f01787143d80169ba84ce9a1c81908727fc04ab318900"
total_cost
0.003282
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval