NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ94A08TNAYSJ484F90EVVF
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.6s
Cost:
$0.011793
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are 3 alternate prose sections that continue the story: <nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a towering figure emerged from the shadows. Sir Roland, the local knight, was a broad-shouldered man with a salt-and-pepper beard and eyes that seemed to have seen a thousand battles. He crossed his arms over his chest, studying me with a piercing gaze that made my knees tremble. "So, you are the young squire they sent me," he said, his voice a low rumble like distant thunder. "You look barely old enough to lift a sword, boy." He circled me slowly, his boots crunching on the hay-strewn ground. "But I have made knights out of worse." He stopped in front of me and extended a gauntleted hand. "Welcome to Castle Aldenmere, Frederick. Your training begins at dawn — and I promise you, it will not be pleasant." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stable hands rushed to take Thunder's reins as I swung down from the saddle, my legs aching from the long ride. Before I could gather my senses, a warm laugh rang out across the courtyard. Sir Roland strode toward me with an easy smile, his armor catching the last rays of the dying sun. He was younger than I had imagined — perhaps forty — with kind eyes and a genuine warmth that instantly put me at ease. "Frederick! By the stars, you look just like your father did when he first came to these walls." He clasped my hand firmly and shook it with enthusiasm. "I rode with him once, you know. A finer man I never met." He draped a friendly arm around my shoulders and steered me toward the castle entrance. "Come, let's get you fed and settled. The horses can wait — you, however, look like you might collapse at any moment." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder to the post outside the stables when I heard the measured, deliberate clink of armor approaching. Sir Roland emerged from the stable doors, wiping grease from his hands with a worn cloth — apparently having tended to his own horse himself, with no help from the stable hands who stood awkwardly to the side. He was a lean, weathered man, quieter in presence than I had expected of a knight of his reputation. He said nothing at first, simply looking me over with an unreadable expression. The silence stretched long enough that I felt compelled to speak. "Sir Roland, I am Frederick. I have been sent to—" He raised a single hand to silence me. "I know who you are," he said quietly. "What I do not yet know is what you are made of." He tucked the cloth into his belt and nodded toward the castle. "Follow me. And listen more than you speak — that is the first lesson I will give you, and it may be the most important one." </nc-section>
created_at
"2026-02-18T02:26:54.587471+00:00"
2/18/2026, 2:26:54 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1322
moderation_latency
(null)
generation_time
15519
tokens_prompt
318
tokens_completion
738
native_tokens_prompt
336
native_tokens_completion
719
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.011793
router
(null)
provider_responses
0
id
"msg_01JefuxnBKtY9yASeszJntQF"
status
200
is_byok
false
latency
1260
endpoint_id
"6d408764-7dd7-4626-bb87-a6cc1589bc86"
provider_name
"Anthropic"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381598-yLsNeLNZ7LdCN3IeH37h"
upstream_id
"msg_01JefuxnBKtY9yASeszJntQF"
total_cost
0.011793
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval