NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-18-01KM08RS4VTJAJ5JB3J1NGQNYH
Run Details
Model:
GPT-5.4 Mini (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.0s
Cost:
$0.003021
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick had scarcely dismounted when a broad-shouldered knight stepped out from the shadow of the stables. Sir Roland wore a weathered cloak over polished mail, and his face was stern until his gaze settled on the young squire. Then, to Frederick’s surprise, a faint smile softened the hard line of his mouth. “You must be Frederick,” Sir Roland said, extending a gloved hand. “The castle has been expecting you. Come—before the horses decide they like you better than I do.” Frederick laughed nervously and straightened his satchel. Sir Roland’s easy manner eased the tightness in his chest, and together they walked past the stable hands and the restless horses toward the heart of the keep. </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, a knight in silvered armor was waiting beside the hay bales, one hand resting on the hilt of his sword. Sir Roland’s red cloak was marked by road dust, but his eyes were keen and bright as he studied the young squire. “So,” he said, voice calm and even, “you are the boy sent to serve here.” Frederick bowed quickly. “Yes, my lord. Frederick, at your service.” Sir Roland nodded once, then glanced toward the stable doors where warm light spilled across the stones. “Good. We begin with the horses, because a knight who cannot listen to a horse will never listen to the world. Come inside. Your training starts now.” Frederick followed him, feeling the weight of those words settle over him like the first true measure of his new life. </nc-section> <nc-section data-title="Version 3" data-color="blue"> Near the stables, Frederick found a knight speaking with the stablemaster in a low, steady voice. When the man turned, Frederick saw the faint scar along his jaw and the tired strength in his posture. This was Sir Roland, the local knight the servants had whispered about since morning. “You’re late,” Sir Roland said, though his tone carried more amusement than reproach. Frederick blinked. “I—I came as quickly as I could, sir.” Sir Roland chuckled and clapped him lightly on the shoulder. “Then you’ve already learned the first lesson: never arrive at a castle without expecting someone to test your nerves. Come, boy. I’ve a place to show you, and if you can keep pace, I’ll tell you what kind of squire you’re meant to be.” Frederick glanced back at the stables, where the horses shifted and snorted in the dusk, then hurried after the knight, wondering what trials awaited him beyond the lantern-lit yard. </nc-section>
created_at
"2026-03-18T10:44:54.055Z"
3/18/2026, 10:44:54 AM
model
"openai/gpt-5.4-mini-20260317"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2186
moderation_latency
(null)
generation_time
3374
tokens_prompt
318
tokens_completion
798
native_tokens_prompt
302
native_tokens_completion
621
native_tokens_completion_images
0
native_tokens_reasoning
33
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.003021
router
(null)
provider_responses
0
endpoint_id
"9ee065b2-3d1c-43bc-bdd7-28af3b148282"
id
"resp_0337d75d6a4a6d130169ba82261d6c819093ec3301ac96d08b"
is_byok
false
latency
209
model_permaslug
"openai/gpt-5.4-mini-20260317"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773830694-9ORVcL3fpO1V7TCdyF3t"
upstream_id
"resp_0337d75d6a4a6d130169ba82261d6c819093ec3301ac96d08b"
total_cost
0.003021
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval