NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8V9EJN1P1FHAW27S34XTM6
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.8s
Cost:
$0.009369
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a gruff voice cut through the evening air. "You must be the new squire." Sir Roland emerged from the shadows, his armor catching the last rays of sunlight. He was a broad-shouldered man with a scar running down his left cheek — a mark of countless battles. He looked me up and down with sharp, scrutinizing eyes. "You're smaller than I expected," he said flatly. "But size matters little. It's what burns in your chest that makes a knight." He thrust a bucket into my hands. "Now then — tend to your horse. We begin at dawn." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables smelled of hay and leather as I led Thunder through the gates. A warm laugh startled me from behind. "Ah, Frederick! At last you arrive!" Sir Roland strode toward me with an outstretched hand and a wide, genuine smile beneath his silver beard. He was older than I had imagined, but his grip was iron-firm. "Your father was my dearest friend and the finest knight I ever knew," he said, placing a steady hand on my shoulder. "I intend to honor his memory by making you even greater. Welcome, boy. Welcome home." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder's reins to the post when I sensed someone watching me. Sir Roland stood at the stable entrance, arms crossed, his expression unreadable beneath the torchlight. He said nothing for a long moment — only studied me as though searching for something hidden beneath my features. Finally, he spoke in a low, measured tone. "Do you know why you were truly sent here, boy?" I shook my head slowly. A strange glint passed through his eyes. "You will," he whispered. "When the dragon comes, you will understand everything." He turned and disappeared into the dark corridor, leaving me alone with the wind and the distant sound of wings. </nc-section>
created_at
"2026-02-24T22:11:06.462Z"
2/24/2026, 10:11:06 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
495
moderation_latency
(null)
generation_time
10751
tokens_prompt
318
tokens_completion
553
native_tokens_prompt
353
native_tokens_completion
554
native_tokens_completion_images
(null)
native_tokens_reasoning
38
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.009369
router
(null)
provider_responses
0
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
id
"msg_018FxSmqYDqPASeUH6oe9pyb"
is_byok
false
latency
448
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Anthropic"
status
200
api_type
"completions"
id
"gen-1771971066-xqt0KErD0SVC3hFBL6kF"
upstream_id
"msg_018FxSmqYDqPASeUH6oe9pyb"
total_cost
0.009369
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval