NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ94Q796MJK2FQFWNK21JTF
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.3s
Cost:
$0.008568
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a broad-shouldered knight strode towards me, his armor gleaming in the fading sunlight. Sir Roland was an imposing figure, his face weathered by years of battle, a scar running from his left eye to his jaw. He crossed his arms and looked me up and down with a stern, appraising gaze. "So you're the new squire," he said, his voice deep and gravelly. "You're smaller than I expected." He reached out and grabbed my shoulder with an iron grip. "But size matters little if the heart is strong. Come, boy. There is much work to be done before nightfall." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables smelled of hay and leather as I led Thunder inside. A knight appeared from one of the stalls, brushing straw from his silver-streaked beard and smiling warmly. Sir Roland had kind eyes, the sort that crinkled at the corners when he laughed, and he laughed often. "Welcome, Frederick!" he boomed, clasping my hand in a firm shake. "I have heard great things about you from your father. Come, let us get your horse settled, and then I shall show you to your quarters. Tonight, we feast — your training begins in earnest tomorrow!" </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder to the post outside the stables when a shadow fell over me. Sir Roland stood in the doorway, silent as a ghost, watching me with pale, unreadable eyes. He was not as large as I had imagined a knight to be, but there was something about the way he carried himself — still and coiled, like a serpent ready to strike — that made me instinctively step back. "You are late," he said quietly, turning back into the darkness of the stable without another word. "Follow me. And do not touch anything unless I tell you to." </nc-section>
created_at
"2026-02-18T02:27:02.513018+00:00"
2/18/2026, 2:27:02 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
686
moderation_latency
(null)
generation_time
10293
tokens_prompt
318
tokens_completion
503
native_tokens_prompt
336
native_tokens_completion
504
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.008568
router
(null)
provider_responses
0
id
"msg_01TCCWAL87PEegVS25YvbYpn"
status
200
is_byok
false
latency
685
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
provider_name
"Anthropic"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381611-DlhakVNFl3Jm3BmfoOaH"
upstream_id
"msg_01TCCWAL87PEegVS25YvbYpn"
total_cost
0.008568
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval