NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8W03CWABCFN8WFNQD4TNFN
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.3s
Cost:
$0.009624
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Knight" data-color="red"> As I dismounted Thunder near the stables, a broad-shouldered knight stepped forward from the shadows. His armor was battle-worn, etched with the scars of a hundred conflicts. "You must be Frederick," he said, his voice like gravel grinding beneath a boot. Sir Roland crossed his arms and studied me with sharp, gray eyes. "I've trained dozens of squires. Most of them quit before the first frost." He gestured toward the stables with a gauntleted hand. "Tend to your horse. Then find me at the training yard. We begin at dawn — and I do not wait for stragglers." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> A hearty laugh rang out across the courtyard as I led Thunder toward the stables. Sir Roland strode toward me with a wide grin beneath his graying beard, his hand outstretched in welcome. "Ha! You made it before nightfall — a good sign already!" He clapped me firmly on the shoulder, nearly knocking me sideways. "I knew your father, boy. A finer swordsman never lived." His warm brown eyes softened for just a moment before he winked. "No pressure, of course. Come, let's get your horse settled and find you some supper. Training can wait until morning." </nc-section> <nc-section data-title="Version 3: The Mysterious Greeting" data-color="blue"> The stables were quiet, save for the soft nickering of horses, when a figure detached itself from the darkness between the stalls. Sir Roland moved with an unsettling silence for a man in full armor. He said nothing at first, simply watching me with an unreadable expression as I tethered Thunder to the post. "I had a dream about you last night," he finally said, his voice barely above a whisper. "A boy on a black horse, riding toward a dragon made of shadow." He tilted his head slowly. "Tell me, Frederick — do you believe in fate?" The lantern light flickered between us, and somewhere deep in the castle, a bell began to toll. </nc-section>
created_at
"2026-02-24T22:23:28.678Z"
2/24/2026, 10:23:28 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
914
moderation_latency
(null)
generation_time
12203
tokens_prompt
318
tokens_completion
557
native_tokens_prompt
353
native_tokens_completion
571
native_tokens_completion_images
(null)
native_tokens_reasoning
42
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.009624
router
(null)
provider_responses
0
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
id
"msg_01FTp1z2QGGdi29CUiHy7Wgu"
is_byok
false
latency
907
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Anthropic"
status
200
api_type
"completions"
id
"gen-1771971808-E8S8ouKWpyxI0aHPGdsc"
upstream_id
"msg_01FTp1z2QGGdi29CUiHy7Wgu"
total_cost
0.009624
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval