NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ92Z5BGPH0NJ90KJGJ17EB
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.5s
Cost:
$0.010233
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are 3 alternate prose sections that continue the story: <nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a broad-shouldered knight strode towards me, his armor gleaming in the dying light of the sun. His face was weathered, marked by years of battle, yet his eyes held a warmth that put me at ease. "You must be Frederick," he said, his voice deep and commanding. "I am Sir Roland, knight of the realm." He extended a gauntleted hand, and I shook it firmly, trying not to betray my nervousness. "I've heard good things about you, boy. Let us hope they are true." He turned on his heel and gestured for me to follow, leading me into the dimly lit stables where the smell of hay and horse filled my lungs. </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stables were alive with the sounds of horses when a gruff voice called out from the shadows. "Oi! You there — you Frederick?" A stout knight emerged, wiping his hands on a rough cloth, his armor half-buckled and his grey beard unkempt. He looked nothing like the heroic knights of the stories my mother used to tell me. "I am, Sir Roland," I replied cautiously. He squinted at me for a long moment, then broke into a wide, gap-toothed grin. "Good. You're late, but you're here." He clapped me hard on the back, nearly sending me sprawling into the mud. "Come, lad. There's much work to be done before you even think about touching a sword." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder to the post when I felt a presence behind me — silent, deliberate, like a shadow given form. I turned to find a tall, lean knight watching me with sharp, calculating eyes. A long scar ran from his left temple to his jaw, a pale reminder of battles long past. "Frederick," he said. It was not a question. "I am Sir Roland." His gaze swept over me slowly, assessing every inch of me with unsettling precision. "You are younger than I expected," he murmured, almost to himself. Then his eyes met mine, cold and serious. "The dragon has been seen again, boy. In the eastern mountains." He paused, letting the words sink into the cool evening air. "Your training begins at dawn. Do not be late." </nc-section>
created_at
"2026-02-18T02:26:05.286546+00:00"
2/18/2026, 2:26:05 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
600
moderation_latency
190
generation_time
10202
tokens_prompt
318
tokens_completion
601
native_tokens_prompt
336
native_tokens_completion
615
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010233
router
(null)
provider_responses
0
id
"a016aea3-ab35-4edf-8067-04db48b4d06f"
status
200
is_byok
false
latency
599
endpoint_id
"83d802cb-44f2-45a0-a9d5-cb9bf79777c8"
provider_name
"Amazon Bedrock"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381554-x0SwIy1N0UdrgF0y04at"
upstream_id
"a016aea3-ab35-4edf-8067-04db48b4d06f"
total_cost
0.010233
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval