NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM08M0FDR4NTFRBZ48APDFWJ
Run Details
Model:
GPT-5.4 Mini (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.2s
Cost:
$0.003746
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, Frederick drew rein and slid from the saddle, the dust of the road clinging to his boots. A broad-shouldered knight in polished mail stepped from the shadows between the hay carts, his expression stern but not unkind. “Frederick, I presume,” said Sir Roland, inclining his head. “You’ve arrived sooner than I expected.” Frederick swallowed and straightened at once. “Yes, sir. I’ve come to serve and to learn.” Sir Roland’s mouth twitched as if amused. “Good. Then learn this first: a castle is no place for a timid heart. If you mean to stand in my order, you will need steadier hands than that.” Frederick glanced down, realizing he still clutched the reins too tightly. He loosened his grip and nodded. “I won’t fail you, sir.” Sir Roland regarded him for a long moment, then turned toward the stable doors. “We shall see. Come—your horse must be tended, and you must be introduced to the life you’re about to inherit.” </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had barely dismounted when a knight emerged from the stable yard, his armor marked with the scratches of old battles and a white mantle draped over one shoulder. He removed his glove with deliberate calm and offered Frederick a firm, weathered hand. “Sir Roland,” he said, “warden of these walls and master of the stables when duty allows.” Frederick bowed quickly, nearly stumbling over his own feet. “It is an honor, my lord.” Roland’s laugh was low and warm. “Save the ‘my lord’ for the king. I’d rather be called sir, and only if I’ve earned it.” He glanced at Thunder, who stamped and snorted at the scent of the straw. “A fine beast. He’ll need oats, water, and a patient groom. As for you, lad, you’ll need breakfast, a lesson in bearing yourself, and perhaps a stronger spine.” Frederick managed a nervous smile. “I’ll do my best.” “That,” said Roland, guiding him toward the stableyard gate, “is exactly what I came to hear.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables stood warm and dim against the coming night, and Frederick was leading Thunder toward the nearest stall when a knight’s voice called out from the lantern-lit archway. “Well ridden, boy.” Frederick turned to see Sir Roland approaching at an easy stride, his cloak brushing the packed earth. The knight’s face was lined with age and sun, but his eyes were bright and sharp beneath a brow worn by years of watchfulness. “You must be Frederick,” Roland said. “The castle has spoken of your arrival all afternoon.” Frederick bowed, trying and failing to hide his nervousness. “I hope I am not late, sir.” “Late? No.” Roland glanced at the stable boys hurrying to open a stall. “A little frightened, perhaps. But that can be useful, if you don’t let it rule you.” He stepped closer and studied Frederick with the frankness of a man weighing steel. “You’ll begin with chores, drills, and discipline. If you endure those, you may yet become a knight worth naming.” Frederick lifted his chin. “I will endure, sir.” Sir Roland nodded once, approving. “Good. Then let us begin before the night grows darker than your doubts.” </nc-section>
created_at
"2026-03-18T10:42:17.723Z"
3/18/2026, 10:42:17 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
610
moderation_latency
(null)
generation_time
4015
tokens_prompt
318
tokens_completion
894
native_tokens_prompt
302
native_tokens_completion
782
native_tokens_completion_images
0
native_tokens_reasoning
11
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.0037455
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_0858543f9027511a0169ba8189ca948190aa48f01be30a954a"
is_byok
false
latency
207
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773830537-borQXhelj7OKTgkibmJx"
upstream_id
"resp_0858543f9027511a0169ba8189ca948190aa48f01be30a954a"
total_cost
0.0037455
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval