NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA32KNXDEJNKKH2JC6K1QF
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.7s
Cost:
$0.011870
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight's Welcome" data-color="red"> As Thunder's hooves clattered onto the cobblestones of the castle courtyard, a broad-shouldered man in gleaming armor stepped out from the shadow of the stables. His beard was streaked with gray, and a long scar traced his jaw, yet his eyes held a warmth that put Frederick at ease. "You must be the new squire," the knight said, his voice deep and steady. "I am Sir Roland. Welcome to Castle Ashenmoor." Frederick dismounted quickly, nearly stumbling in his haste to bow. "Yes, sir. Frederick, son of Aldric the blacksmith." Sir Roland's lips curved into a faint smile as he clasped Frederick's shoulder with a firm, callused hand. "Aldric's boy, eh? Then you've got good steel in your blood. Come, let's get that horse settled before the stable master scolds us both." </nc-section> <nc-section data-title="Chapter 1: Stable Introductions" data-color="green"> The scent of hay and horse mingled with the cool evening air as Frederick led Thunder toward the stables. A tall figure emerged from between the wooden stalls, his armor catching the last rays of sunlight. "Easy there, lad," the man called out, raising a hand in greeting. "That's a fine horse you've got. Not every squire arrives on a mount like that." Frederick straightened, recognizing the crest upon the man's breastplate. "Sir Roland? I was told to seek you out upon arrival." "Indeed you were." Roland stepped closer, studying Frederick with a knight's practiced eye. "You've traveled far, I can tell. Dust on your boots, weariness in your eyes. But there's something else there too—determination, perhaps." He nodded approvingly. "Good. You'll need it here. Now, let's see to your horse. Tales can wait until after supper." </nc-section> <nc-section data-title="Chapter 1: The Stable Yard" data-color="blue"> The stable yard was quieter than Frederick expected, save for the soft whinnies of horses settling in for the night. As he led Thunder toward an empty stall, a voice called out from behind a stack of hay bales. "You're late, squire—though I suppose the roads from the eastern villages aren't kind to travelers this time of year." Frederick turned to find a knight approaching, his armor dented from what looked like years of service, yet polished with evident pride. "Sir Roland, I presume?" "You presume correctly." The knight extended a hand, and Frederick clasped it firmly. "I've trained many squires in my time, but few arrive with a horse as spirited as yours. Thunder, is it? A fitting name." "How did you—" "The stable master sent word ahead. Little happens in this castle that escapes notice for long." Roland chuckled, gesturing toward the stable doors. "Come, let's get you both settled. Morning will bring your first lesson, and I daresay you'll want your rest before then." </nc-section>
created_at
"2026-07-01T07:42:56.64Z"
7/1/2026, 7:42:56 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3217
moderation_latency
(null)
generation_time
15622
tokens_prompt
318
tokens_completion
797
native_tokens_prompt
435
native_tokens_completion
1100
native_tokens_completion_images
(null)
native_tokens_reasoning
54
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01187
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01HUAhhz5inTyVrQEuZf2m2T"
is_byok
false
latency
1693
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891776-1D5mg8u8pyzCljZ81kg4"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891776-4KXitWCYsouByIDSEikN"
upstream_id
"msg_01HUAhhz5inTyVrQEuZf2m2T"
total_cost
0.01187
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval