NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ0MYT7DF1WAM5W12C7A2ZQT
Run Details
Model:
GPT-5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
20.7s
Cost:
$0.023410
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick reined Thunder to a halt before the castle stables, where the scent of hay, leather, and warm horses drifted out beneath the wide wooden doors. Stable boys hurried to and fro with buckets and brushes, but one figure stood still amid the bustle—a tall knight in a dark blue surcoat, his silver hair tied neatly behind his head. “You ride well for one so young,” the knight said, stepping forward. Frederick dismounted quickly and bowed. “Sir Frederick, squire of the western road,” he said, then flushed. “I mean—Frederick, my lord. I am no knight.” The man’s stern mouth softened into a smile. “Not yet, perhaps. I am Sir Roland, sworn knight of this castle. Your training begins soon enough, but first, your horse deserves rest.” At the sound of his name, Thunder tossed his mane proudly. Sir Roland gave the stallion an appraising look. “A fine beast,” he said. “Let us hope his rider proves half as brave.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, the castle seemed less a distant dream and more a living beast—snorting horses, shouting grooms, clattering hooves, and the steady creak of harness and wheel. He slid from Thunder’s saddle, stiff from the long ride, and reached up to pat the stallion’s neck. Before he could call for a stable hand, a voice rang out behind him. “Easy there. A horse that carried you through dusk deserves gentler hands than tired ones.” Frederick turned to see a broad-shouldered knight leaning against the stable door. His armor was plain but well cared for, and a scar crossed one cheek like a pale thread. “Sir Roland?” Frederick asked, recognizing the crest stitched on the knight’s cloak. The knight inclined his head. “And you must be Frederick.” Frederick bowed low. “I have come to serve and learn.” Sir Roland’s gaze measured him from muddy boots to travel-worn cloak. “Then we shall see whether the road has brought us a squire—or merely a boy with a brave horse.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> Thunder’s hooves struck sparks from the cobbles as Frederick rode beneath the shadow of the stable arch. Lanterns had begun to glow along the walls, and somewhere within, a mare whickered softly in welcome. Frederick drew up, heart pounding harder than it had on the road. A man waited by the hitching post, arms folded across his chest. He wore no helm, but everything about him spoke of knighthood: the straightness of his back, the calm watchfulness in his eyes, the sword at his side that seemed less worn than trusted. “You are late,” the man said. Frederick swallowed. “The ford was flooded, sir.” “So you crossed it?” “Yes, sir.” The knight’s expression did not change, though a glimmer of approval touched his eyes. “Good. A squire who turns back at water will drown at war.” Frederick climbed down and bowed. “You must be Sir Roland.” “I am.” The knight stepped closer and took Thunder’s reins. “Welcome to the castle, Frederick. Tend your horse well tonight. Tomorrow, we learn what sort of steel lies in you.” </nc-section>
created_at
"2026-04-24T21:05:00.149Z"
4/24/2026, 9:05:00 PM
model
"openai/gpt-5.5-20260423"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1519
moderation_latency
(null)
generation_time
20615
tokens_prompt
318
tokens_completion
866
native_tokens_prompt
302
native_tokens_completion
730
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
usage
0.02341
router
(null)
provider_responses
0
endpoint_id
"58e5b336-423e-430b-a2ab-8bc353f0c51b"
id
"resp_0992195fb18d0c5a0169ebdafc4a148190842fc2a66b947091"
is_byok
false
latency
636
model_permaslug
"openai/gpt-5.5-20260423"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777064700-RSwzkNPb6VVpXJFF4x4h"
session_id
(null)
api_type
"completions"
id
"gen-1777064700-E14DqypkHzjqJI3AMOgu"
upstream_id
"resp_0992195fb18d0c5a0169ebdafc4a148190842fc2a66b947091"
total_cost
0.02341
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval