NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8X7ZXCEQP9CRYYWZ6JP1K1
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
14.9s
Cost:
$0.010914
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a towering figure emerged from the shadows of the great wooden doors. Sir Roland was a broad-shouldered knight, his armor bearing the scars of a hundred battles. His eyes were sharp as a hawk's, yet a warmth flickered behind them as he approached me with heavy, deliberate strides. "You must be the new squire," he said, his voice like gravel rolling down a hillside. He extended a gauntleted hand, gripping mine with crushing force. "I am Sir Roland. I have broken better men than you, boy — and made legends of the rest." He studied me for a long moment, then allowed himself a thin smile. "We shall see which you become." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables smelled of hay and leather and something wilder — the scent of adventure, I thought foolishly. A man was there already, brushing down a pale grey destrier with long, careful strokes. He was older than I expected, grey at the temples, with kind lines etched around his eyes. He turned as I approached and set down his brush without any great ceremony. "Frederick," he said simply, as though he had been expecting me for years. "I am Sir Roland." He looked me over slowly, not unkindly. "You've had a long ride. See to your horse first. A knight who neglects his animal neglects his own soul." He handed me a brush. "Then we will talk." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder's reins to the post when I heard the laughter — a great, booming sound that rolled out from behind the stable wall like a thunderclap. Around the corner came Sir Roland, red-faced and grinning, trading jests with one of the stable hands. He was nothing like the solemn warrior I had imagined on the long road here. "Ha! The squire arrives at last!" he bellowed, clapping me on the back so hard I nearly stumbled into the hay. "I lost a silver coin betting you'd arrive tomorrow, lad. You owe me for that." He winked broadly and gestured toward the castle with a sweep of his arm. "Come, come — there is hot food, cold ale, and about a thousand things I need to teach you before sunrise. We waste not a moment here." </nc-section>
created_at
"2026-02-24T22:45:15.83Z"
2/24/2026, 10:45:15 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
862
moderation_latency
(null)
generation_time
14820
tokens_prompt
318
tokens_completion
651
native_tokens_prompt
353
native_tokens_completion
657
native_tokens_completion_images
(null)
native_tokens_reasoning
52
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010914
router
(null)
provider_responses
0
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
id
"msg_01DKz1surEFqpS9F36ZJJWjQ"
is_byok
false
latency
756
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Anthropic"
status
200
api_type
"completions"
id
"gen-1771973115-Um2t1iUB1s29Gxm38oo9"
upstream_id
"msg_01DKz1surEFqpS9F36ZJJWjQ"
total_cost
0.010914
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval