NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8VET15855QSWBT5KHSBPBR
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.1s
Cost:
$0.010059
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> The heavy iron gates groaned open as Thunder clattered across the cobblestones into the courtyard. Before I could even dismount, a broad-shouldered knight with a salt-and-pepper beard strode out from the stables, his armor catching the last embers of the dying sun. "You must be Frederick," he said, his voice like gravel rolling in a barrel. "I am Sir Roland. You're late, boy." He grabbed Thunder's reins with a firm, scarred hand and fixed me with a steely gaze that made my stomach drop. "In this castle, the sun does not wait for squires — and neither do I." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> I had barely guided Thunder through the gate when I heard a warm, booming laugh echo across the courtyard. A knight leaned against the stable door, arms crossed, a wide grin splitting his weathered face. "Ha! You actually made it, lad!" He pushed off the wall and extended a massive hand as I slid from the saddle. "Sir Roland — knight of the realm and, as of today, your worst nightmare." But his eyes were kind, crinkling at the corners, and I felt the knot in my chest loosen just slightly as he clapped me hard on the shoulder. "Welcome to the castle, Frederick. Let's get your horse settled and get you fed. Training begins at dawn." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> The stables were quiet save for the soft snorting of horses as I led Thunder inside, unsure of where to go or who to find. Then a shadow fell across the stable entrance — a tall knight, his dark cloak sweeping the hay-strewn floor, his expression unreadable beneath a furrowed brow. "Frederick of the Eastern Vale?" His voice was measured, almost cautious. I nodded. He studied me for a long moment, as though searching my face for something he had long been looking for. "I am Sir Roland," he said at last, quietly. "I knew your father." The words hung in the cool stable air between us like smoke, and something ancient and unspoken seemed to settle over us both. </nc-section>
created_at
"2026-02-24T22:14:02.033Z"
2/24/2026, 10:14:02 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
693
moderation_latency
233
generation_time
10802
tokens_prompt
318
tokens_completion
583
native_tokens_prompt
353
native_tokens_completion
600
native_tokens_completion_images
(null)
native_tokens_reasoning
37
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010059
router
(null)
provider_responses
0
endpoint_id
"83d802cb-44f2-45a0-a9d5-cb9bf79777c8"
id
"fa19dcc0-45f7-4f40-bf8e-bac18863b93c"
is_byok
false
latency
691
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Amazon Bedrock"
status
200
api_type
"completions"
id
"gen-1771971242-Kprm4Cjm0oJs4VzzUMqR"
upstream_id
"fa19dcc0-45f7-4f40-bf8e-bac18863b93c"
total_cost
0.010059
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval