NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8TPAHTX3ZFWM8TBP8H0GCD
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.0s
Cost:
$0.012519
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a gruff voice cut through the evening air. "You there! Boy!" I turned to see a broad-shouldered knight striding toward me, his armor catching the last dying rays of the sun. Sir Roland was everything the rumors had promised — a jaw like a cliff face, a scar running from his left eye to his chin, and eyes that seemed to weigh your worth in a single glance. "You must be Frederick," he said, stopping just short of me, arms crossed over his chest. "I expected someone... larger." He let the insult hang in the air like smoke before a rare, wolfish grin cracked his stern face. "No matter. Small men have surprised me before. See to your horse, then meet me in the yard. Your training begins at dawn — if you survive the night's chores." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables smelled of hay and warm leather as I led Thunder inside, my legs still trembling from the long ride. I was reaching for a brush when a gentle hand landed on my shoulder, startling me nearly out of my boots. "Easy, lad." The voice was calm and deep, like the rumble of a distant river. Sir Roland stepped into the lantern light, and I was struck immediately by his kindness — a broad smile beneath a neatly trimmed silver beard, laugh lines etched deep around his eyes. He was older than I had imagined, softer somehow than a knight ought to look. "You've ridden hard today," he said, taking the brush from my hand and beginning to tend to Thunder himself. "A knight who cares for his horse will find his horse cares for him in return." He winked at me over Thunder's broad back. "Welcome to the castle, Frederick. I think you and I are going to get along just fine." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder's reins to the post when I heard the measured, deliberate footsteps of someone who had spent a lifetime in armor. Sir Roland emerged from the shadow of the stable archway, helmet tucked beneath one arm, his expression unreadable as carved stone. He said nothing at first — only studied me with pale grey eyes that moved slowly from my dusty boots to the top of my wind-tangled hair. The silence stretched long enough to make me fidget. "Frederick of Ashvale," he said at last, his voice barely above a murmur. "I knew your father." The words landed between us like stones dropped into still water. He glanced away, toward the darkening horizon beyond the castle walls, something flickering briefly across his face — grief, perhaps, or guilt. "He was a good man," he added quietly. Then, as if a door had been shut inside him, his gaze snapped back to mine, sharp and businesslike. "Come. There is much to discuss, and very little time." </nc-section>
created_at
"2026-02-24T22:00:39.75Z"
2/24/2026, 10:00:39 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
560
moderation_latency
(null)
generation_time
16863
tokens_prompt
318
tokens_completion
775
native_tokens_prompt
353
native_tokens_completion
764
native_tokens_completion_images
(null)
native_tokens_reasoning
40
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.012519
router
(null)
provider_responses
0
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
id
"msg_01FKCqqtHi61Q2uXyAffxSr2"
is_byok
false
latency
518
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Anthropic"
status
200
api_type
"completions"
id
"gen-1771970439-X1Yo0clsBK2TLA9W9sNc"
upstream_id
"msg_01FKCqqtHi61Q2uXyAffxSr2"
total_cost
0.012519
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval