NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM07S3BVWQP7QFHCJCD683SR
Run Details
Model:
GPT-5.4 Mini
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
2.8s
Cost:
$0.002027
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, Frederick was met by Sir Roland, a broad-shouldered knight with a weathered face and a voice like iron. “You must be the new squire,” he said, giving Frederick a measured look. The scent of hay and horses drifted through the open yard as men moved about with buckets and saddles. Sir Roland reached out and clasped Frederick’s forearm in greeting, firm and steady. “If you are to serve at this castle, you will learn quickly that discipline is as important as courage.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, Sir Roland stepped out from beneath the wooden eaves, his armor dulled by travel but his posture straight as a spear. He smiled in a way that softened his stern features. “So, you’re the lad they’ve sent to us,” he said. Behind him, horses stamped and snorted in their stalls, impatient for evening feed. Roland motioned toward the stable yard. “Come, then. Before the light fades, I’ll show you where a squire begins his duties.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables were busy with the clatter of hooves and the murmur of grooms when Sir Roland found Frederick lingering near the gate. The knight’s cape was dusted with road dirt, but his gaze was keen and friendly. “You’ve arrived at the right place,” he said, stopping before the boy with a grin. He offered Frederick a hand, then nodded toward the horses lined in their stalls. “A castle is judged not only by its hall, but by the strength of the hands that tend its beasts. Let us see what sort of hand you have.” </nc-section>
created_at
"2026-03-18T10:27:35.946Z"
3/18/2026, 10:27:35 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
911
moderation_latency
(null)
generation_time
2529
tokens_prompt
318
tokens_completion
440
native_tokens_prompt
302
native_tokens_completion
400
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.0020265
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_078f876221697a590169ba7e1806088190ae1f125dbf0a57c4"
is_byok
false
latency
195
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773829655-kG4tDkOdVC4Gyj3AGBpS"
upstream_id
"resp_078f876221697a590169ba7e1806088190ae1f125dbf0a57c4"
total_cost
0.0020265
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval