NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM093VWA2WCEWA4TT8F1YFCY
Run Details
Model:
GPT-5.4 Mini
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.1s
Cost:
$0.002945
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick had scarcely dismounted before a broad-shouldered knight emerged from the shadows beside the stables. Sir Roland’s polished mail caught the dying light, and his expression was stern until he saw the young squire’s uncertain posture. Then his mouth softened into the faintest hint of a smile. “You must be Frederick,” he said, his voice deep and steady. “I am Sir Roland. If you’ve come to serve at this castle, then you’ll learn quickly that the horses here are as proud as the men who ride them.” Frederick straightened at once, clutching his pack a little tighter. The stables behind them rang with the low nickers of restless mounts and the scent of hay and leather. Sir Roland stepped aside and gestured toward the open doors. “Come,” he said. “Before the sun is gone, I’ll show you where you’ll begin.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, a knight in a weathered cloak came striding out, wiping dust from his gloves. Sir Roland’s armor bore the marks of many campaigns, but his eyes were sharp and welcoming when they fell upon the boy. “You’ve arrived at last,” Sir Roland said. “The castle can be a hard place for one so young, but the stables will teach you patience if nothing else.” Frederick bowed as best he could, feeling the heat rise in his cheeks. Behind Sir Roland, horses shuffled in their stalls, their reins jingling softly in the evening air. Roland inclined his head toward the nearest doorway. “First, we see to your quarters,” he said. “Then I’ll introduce you to the beasts you’ll be tending. If you’re to serve here, you’ll need to know their temper as well as any knight knows his sword.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> Near the stable yard, Frederick nearly collided with a knight leading a pair of warhorses by their reins. The man stopped at once, turning with a grin beneath his helm as he recognized the nervous newcomer. Sir Roland, the local knight, removed one gauntlet and extended a hand. “So you’re the castle’s new squire,” he said warmly. “I had heard rumors a lad was coming from the village, but rumors rarely do justice to the real thing.” Frederick shook the offered hand, surprised by the knight’s easy manner. The stables stood behind Sir Roland like a living fortress of timber and stone, filled with the smell of horse sweat and straw. Roland nodded toward the animals. “Best you get acquainted with this place quickly,” he said. “The horses here are wiser than most courtiers, and they remember everything.” </nc-section>
created_at
"2026-03-18T10:50:57.303Z"
3/18/2026, 10:50:57 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
418
moderation_latency
(null)
generation_time
3788
tokens_prompt
318
tokens_completion
713
native_tokens_prompt
302
native_tokens_completion
604
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.0029445
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_0d7e203f7a5ff05b0169ba83915f9c8190a4530e10b9ad950a"
is_byok
false
latency
191
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773831057-21gutbgwUX40fdQFGBzF"
upstream_id
"resp_0d7e203f7a5ff05b0169ba83915f9c8190a4530e10b9ad950a"
total_cost
0.0029445
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval