NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-29-01M3P2B5HPN4ZHJ3CRXY96RE1N
Run Details
Model:
Claude Sonnet 5.5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.4s
Cost:
$0.012474
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Knight's Welcome" data-color="red"> The gates groaned open as I reined Thunder to a walk. The courtyard smelled of hay, woodsmoke, and horses. I followed the scent to the stables, where a broad-shouldered man in a dented breastplate was leaning against a post, watching me with folded arms. "You'll be the new squire," he said. His voice was gravel, but there was warmth beneath it. "Sir Roland. I've been watching that horse of yours cross the field for the past quarter hour. You ride like a man who's afraid the ground will run out." I slid from the saddle, my legs unsteady after the long journey. "Frederick, sir. I didn't want to arrive after dark." Roland laughed and clapped a hand on my shoulder hard enough to make me stagger. "Then you're already wiser than the last three. Come, lad. See to your horse first. A knight who neglects his mount will soon be a knight on foot." </nc-section> <nc-section data-title="Version 2: The Weight of Scrutiny" data-color="green"> I had barely dismounted when a shadow fell across me. A tall knight stood at the stable door, his gray cloak pinned with a silver wolf's head. He said nothing at first. He simply studied Thunder, then my dusty boots, then my face. "Frederick of Aldermere," he said at last. It was not a question. "I am Sir Roland. Your father wrote to me about you." My throat tightened. "I hope he wrote kindly, sir." "He wrote honestly." A faint smile creased his weathered face. "He said you were stubborn, quick to learn, and far too curious for your own good. In my experience, those are the best qualities in a squire and the most dangerous." He took Thunder's bridle and ran a gentle hand along the stallion's neck. "Come. Rooms and rules can wait until morning. Tonight you'll learn the first lesson of this castle: we tend our horses before we tend ourselves." </nc-section> <nc-section data-title="Version 3: Whispers in the Stable Yard" data-color="blue"> Dusk had turned the stable yard the color of old bronze when I heard someone humming off-key. Around the corner of the stalls came a knight with a bucket in each hand and a streak of mud across his cheek, hardly the grand figure I had imagined. He stopped when he saw me and set the buckets down. "Ah! You must be the boy from Aldermere. Sir Roland, at your service, though mostly at the service of these ungrateful beasts." He jerked his chin toward the stalls, where a chorus of whickers had begun. "Frederick," I managed, unsure whether to bow. "I'm to begin my training." "So you are." His eyes lingered on the horizon, where the last light was fading behind the distant mountains. He lowered his voice. "Fine night to arrive. The old folk say the mountains have been restless lately, and that something in them is stirring. But that's a tale for another evening. Now, grab a bucket. The best way to learn a castle is through its stables." </nc-section>
created_at
"2026-09-29T07:51:21.404Z"
9/29/2026, 7:51:21 AM
model
"anthropic/claude-sonnet-5.5-20260928"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2910
moderation_latency
(null)
generation_time
11424
tokens_prompt
303
tokens_completion
800
native_tokens_prompt
437
native_tokens_completion
1160
native_tokens_completion_images
(null)
native_tokens_reasoning
121
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.012474
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790668281-GYCmvrwuNiuRVKZjuPC2"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790668281-wE3lwPMAfPbUPR58kHmU"
upstream_id
"msg_011CfXND435W51639AUVnt3S"
provider_responses
0
endpoint_id
"99aaad94-923b-4fc1-b763-271ed5486f7a"
id
"msg_011CfXND435W51639AUVnt3S"
is_byok
false
latency
680
model_permaslug
"anthropic/claude-sonnet-5.5-20260928"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.012474
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval