NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-09-01KX418PS2H45347MGV66XEW7S
Run Details
Model:
GPT-5.6 Sol
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.6s
Cost:
$0.017290
Provider:
OpenAI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick reined Thunder to a halt beside the stables, where the air smelled of hay, leather, and warm horseflesh. A broad-shouldered knight waited beneath the lanterns, one gauntleted hand resting on the pommel of his sword. “You ride as though the king’s enemies are at your heels,” he said, his stern expression softening into a smile. “I am Sir Roland. Welcome to the castle, Frederick.” Frederick dismounted quickly and bowed. “It is an honor, sir.” “We shall see whether you still think so after dawn’s training.” Sir Roland took Thunder’s reins and gestured toward the bustling stable yard. “Come. Your life as a squire begins tonight.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick approached the stables, a gray-haired knight emerged from the shadows carrying a lantern. His weathered cloak bore the silver hawk of the castle guard, and an old scar crossed his left cheek. “You must be Frederick,” the man said. His keen eyes passed over the young squire and then settled approvingly on Thunder. “A fine horse. Let us hope his rider proves equally worthy.” Frederick swallowed his nervousness and bowed from the saddle. “Sir Roland?” “The same.” The knight raised the lantern, illuminating the open stable doors. “Leave your horse with the grooms. There is much you must learn—and less time than I would like to teach it.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> Thunder shied as they entered the stable yard, disturbed by a sudden clang of steel. Frederick tightened the reins—and saw a knight step from between two rows of stalls, sheathing a gleaming sword. “Well held,” the stranger said. He was tall and lean, with dark hair streaked by silver. “Many new squires would have landed in the mud.” Frederick steadied Thunder. “Are you Sir Roland?” “I am.” The knight offered him a calloused hand as he dismounted. His grip was firm, his gaze sharper still. “And you are either very brave or very foolish to have crossed the western road after sunset.” Before Frederick could answer, a distant, unearthly roar rolled over the castle walls. Every horse in the stable began to tremble. Sir Roland looked toward the darkening hills. “We should speak inside.” </nc-section>
created_at
"2026-07-09T18:12:01.45Z"
7/9/2026, 6:12:01 PM
model
"openai/gpt-5.6-sol-20260709"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
495
moderation_latency
(null)
generation_time
10475
tokens_prompt
318
tokens_completion
629
native_tokens_prompt
302
native_tokens_completion
526
native_tokens_completion_images
0
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"completed"
service_tier
"default"
usage
0.01729
router
(null)
provider_responses
0
endpoint_id
"a54c5de0-89bf-4ad7-a212-cf977eed918a"
id
"resp_0e3a294c1aff9718016a4fe471868081979442f026b0f4ae98"
is_byok
false
latency
322
model_permaslug
"openai/gpt-5.6-sol-20260709"
provider_name
"OpenAI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1783620721-0HnP4q2NLvkTYDlPAZlB"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1783620721-5TEXFWHyfLRSsuEzn3xo"
upstream_id
"resp_0e3a294c1aff9718016a4fe471868081979442f026b0f4ae98"
total_cost
0.01729
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenAI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval