NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ91P7GMRQCWPG5KBP0V0KW
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.9s
Cost:
$0.010008
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Greeting (Version 1)" data-color="red"> As I dismounted Thunder near the stables, a gruff voice called out from the shadows. Sir Roland emerged, his armor catching the last rays of the dying sun. He was a broad-shouldered man, his face weathered by years of battle, a deep scar running from his left temple to his jaw. He looked me up and down with sharp, appraising eyes, as if measuring my worth in a single glance. "So, you're the boy they've sent me," he said, his voice like gravel. "You look too soft for this life, squire. Too soft by half." He crossed his arms and leaned against the stable door, a humorless smile playing on his lips. "But I've made knights out of worse. Barely." </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 2)" data-color="green"> The stables smelled of hay and horses as I led Thunder through the great wooden gates of the courtyard. A warm laugh echoed across the cobblestones, and I turned to see Sir Roland striding toward me with open arms and a wide, welcoming smile. He was older than I had imagined from the stories, his auburn hair streaked with silver, but his eyes were kind and bright with intelligence. "Frederick! At last!" he said, clasping my hand firmly in both of his. "I knew your father well, boy. A finer man never drew a sword. Come, let us get your horse settled and find you a warm meal. Tomorrow, the real work begins, and you will need every ounce of strength you have." </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 3)" data-color="blue"> I had barely tied Thunder to the post when I noticed the figure standing silently at the corner of the stables, half-hidden in shadow. Sir Roland said nothing at first, simply watching me with an unreadable expression, his gauntleted hands clasped behind his back. The silence stretched between us like a drawn bowstring. "Do you know why they call this place the Last Hold, boy?" he finally asked, his voice low and measured. I shook my head. He stepped forward into the fading light, and I saw something in his eyes I had not expected — not cruelty, nor warmth, but something deeper. Fear, perhaps. "Because something is coming," he said quietly, glancing toward the darkening horizon. "And you may be the only one who can stop it." </nc-section>
created_at
"2026-02-18T02:25:26.91701+00:00"
2/18/2026, 2:25:26 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1372
moderation_latency
(null)
generation_time
13782
tokens_prompt
318
tokens_completion
597
native_tokens_prompt
336
native_tokens_completion
600
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010008
router
(null)
provider_responses
0
id
"msg_016HZaPba8YpLBrShqZU2BEZ"
status
200
is_byok
false
latency
1372
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
provider_name
"Anthropic"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381512-YMZVfyvmCeKhFhyZMiUX"
upstream_id
"msg_016HZaPba8YpLBrShqZU2BEZ"
total_cost
0.010008
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval