NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA4GN43MBEND8MFD3YGT85
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.3s
Cost:
$0.011720
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (Version 1)" data-color="red"> Thunder's hooves clattered against the cobblestones as I drew him to a halt near the stables. A tall figure emerged from the shadow of the archway—broad-shouldered, clad in weathered chainmail that had clearly seen its share of battles. The insignia of a silver lion gleamed faintly on his breastplate. "You must be the new squire," the man said, his voice deep and steady as a drumbeat. "I am Sir Roland. I was told to expect you before nightfall." He extended a calloused hand, his eyes—sharp and gray as storm clouds—studying me with an appraising look that made me straighten my posture despite my exhaustion. "Frederick, sir," I managed, dismounting quickly and nearly stumbling on legs stiff from the long ride. Sir Roland's mouth twitched into something like a smile. "Well met, Frederick. Let's get that horse of yours settled. We've much to discuss before your training begins." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 2)" data-color="green"> As Thunder slowed to a trot near the stable yard, a hearty laugh echoed across the courtyard. "That's quite an entrance!" called a voice. I turned to see a knight striding toward me, his armor catching the last light of the sun, a easy grin spread across his weathered face. "Sir Roland, at your service," he said, clapping a firm hand on my shoulder as I slid down from the saddle. "You ride like a boy trying to outrun the devil himself. Or perhaps just eager to arrive?" "A bit of both, sir," I admitted, feeling my cheeks warm. He chuckled, taking Thunder's reins from my grip with practiced ease. "Good. Eagerness is the first ingredient of a fine knight. The second is knowing when to rest your horse—this one looks like he could use some water and a good brushing." He winked. "Come, let's get you both settled. Tomorrow, the real work begins." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 3)" data-color="blue"> The stable boy hurried out first, but it was the man behind him who commanded my attention. Sir Roland moved with the quiet confidence of someone who had spent decades in service to the crown, his very presence somehow both effortless and imposing. Age had touched him—streaks of silver ran through his dark hair—but his frame remained solid, unbowed by the years. "Frederick," he said before I'd even spoken my name, and I wondered how he knew. He must have seen the question in my eyes, for he added, "The captain sent word of your arrival days ago. We've been expecting you." I slid off Thunder, my legs trembling slightly from the long journey. Sir Roland studied me for a long moment, his gaze neither harsh nor overly kind—simply measuring. "You've the look of your father about you," he said quietly. "Let's hope you've inherited more than his face." He turned toward the stables, gesturing for me to follow. "Come. There will be time enough for talk of the past. Tonight, you rest. Tomorrow, we begin." </nc-section>
created_at
"2026-07-01T07:43:43.791Z"
7/1/2026, 7:43:43 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2232
moderation_latency
(null)
generation_time
17238
tokens_prompt
318
tokens_completion
787
native_tokens_prompt
435
native_tokens_completion
1085
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01172
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01Y4PiGYmrFq26LmkzVy47mX"
is_byok
false
latency
2232
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891823-Pq11gCyHBN4oFlpfMca9"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891823-YMGZjhlreBX3TBfQ4wNz"
upstream_id
"msg_01Y4PiGYmrFq26LmkzVy47mX"
total_cost
0.01172
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval