NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8TKBSHWGXY0YQ5CTSY5BMV
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.6s
Cost:
$0.013449
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Greeting (Version 1)" data-color="red"> The stable doors swung open with a groan as I dismounted Thunder, my boots crunching against the dry hay scattered across the cobblestones. A towering figure emerged from the shadows — Sir Roland, his scarlet cloak billowing behind him like a war banner. His eyes were sharp, two cold grey stones that seemed to measure me in an instant and find me wanting. "So," he said, his voice a low rumble like distant thunder, "you are the boy they sent me." He circled me slowly, arms folded across his broad chest. "Small. Underfed. Soft hands." He stopped in front of me and leaned close. "I have broken stronger men than you, squire. The question is whether you are worth the effort of breaking." I met his gaze and refused to look away. Something flickered behind those stone-grey eyes — not warmth, but perhaps the faintest ember of respect. </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 2)" data-color="green"> The smell of hay and horses filled my lungs as I led Thunder toward the stables. The evening air was cooling quickly, and lanterns had begun to glow along the castle walls. It was then that I heard a warm, booming laugh echoing from inside the stable doors. Sir Roland stepped out, wiping his hands on a cloth, a wide grin splitting his weathered face. He was older than I had imagined — silver threading through his dark beard — but he moved with the easy grace of a man who had spent a lifetime in armor. "Frederick! At last, lad!" He clasped my hand firmly and shook it with genuine enthusiasm. "I was beginning to think you'd gotten lost in the Whisperwood." He took Thunder's reins and ran a practiced hand along the stallion's flank, nodding approvingly. "Fine horse. Good sign — a squire who knows his mount knows himself." He winked. "Come, we'll get the beast settled and then I'll show you your quarters. We begin at dawn." </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 3)" data-color="blue"> I had barely tethered Thunder to the post when I sensed someone watching me. I turned to find Sir Roland leaning quietly against the stable wall, arms crossed, studying me with an expression I could not quite read. He was neither old nor young — a man caught somewhere in the long middle of a difficult life, his face a map of old scars and older thoughts. He pushed off from the wall and approached slowly, stopping a few feet away. For a long moment, neither of us spoke. Only the soft shuffling of horses and the distant cry of a night bird broke the silence. "You have your father's eyes," he said at last, his voice quieter than I expected. Something passed across his face — grief, perhaps, or guilt. He extended his hand. "I am Sir Roland. I trained your father, once, a long time ago." His grip was firm but careful. "I made him a knight. I intend to do the same for you." He glanced up at the rising moon. "Though I suspect the road ahead will ask more of you than it ever asked of him." </nc-section>
created_at
"2026-02-24T21:59:03.031Z"
2/24/2026, 9:59:03 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
719
moderation_latency
401
generation_time
15778
tokens_prompt
318
tokens_completion
837
native_tokens_prompt
353
native_tokens_completion
826
native_tokens_completion_images
(null)
native_tokens_reasoning
50
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.013449
router
(null)
provider_responses
0
endpoint_id
"83d802cb-44f2-45a0-a9d5-cb9bf79777c8"
id
"c850982b-839a-45b8-9c3d-9bf0aa9902d7"
is_byok
false
latency
719
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Amazon Bedrock"
status
200
api_type
"completions"
id
"gen-1771970343-XtUtGRFQU3RVAl8uHpWZ"
upstream_id
"c850982b-839a-45b8-9c3d-9bf0aa9902d7"
total_cost
0.013449
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval