NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ93TQ6B1NS1XQTWTVBWW88
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.1s
Cost:
$0.009093
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a broad-shouldered knight strode towards me with the confidence of a man who had seen a hundred battles. His armor bore the crest of the kingdom — a silver wolf on a field of midnight blue — and his greying beard was neatly trimmed beneath a weathered face. "You must be Frederick," he said, his voice like gravel rolling in a barrel. "I am Sir Roland. I have trained more squires than I care to count, and I have buried more than a few of them." He let the words hang in the air like smoke before cracking a wolfish grin. "Try not to end up in the latter group, boy." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables smelled of hay and horses, and it was there that I first laid eyes on Sir Roland. He was not what I had expected. Tall and lean, with kind eyes the color of autumn leaves, he moved with a quiet grace that seemed at odds with his fearsome reputation. He took Thunder's reins from my hands without a word, stroking the stallion's mane with a gentleness that surprised me. "A good horse reflects a good rider," he said softly, finally turning to meet my gaze. "And a good rider makes a worthy squire. Welcome to the castle, Frederick. I hope you are ready to learn." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder to the post when I heard the clanking of heavy armor behind me. I spun around to find Sir Roland looming over me like a tower of iron and steel, his arms crossed and his expression unreadable. For a long, uncomfortable moment he simply studied me, his sharp grey eyes moving from my dusty boots to my windswept hair as though he were appraising a horse at market. "Smaller than I expected," he finally muttered, almost to himself. Then he thrust out a gauntleted hand. "Sir Roland. Your mentor, your tormentor, and the closest thing to a father you will have within these walls. Drop your bags. Training begins at dawn." </nc-section>
created_at
"2026-02-18T02:26:34.351247+00:00"
2/18/2026, 2:26:34 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
511
moderation_latency
(null)
generation_time
11086
tokens_prompt
318
tokens_completion
536
native_tokens_prompt
336
native_tokens_completion
539
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.009093
router
(null)
provider_responses
0
id
"msg_01SAxAKKCeBZYVVA1n4d7a39"
status
200
is_byok
false
latency
510
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
provider_name
"Anthropic"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381582-QhlDcWI919kIHac4dlQ1"
upstream_id
"msg_01SAxAKKCeBZYVVA1n4d7a39"
total_cost
0.009093
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval