NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA9ZVA9DYH46RY0869YYS9
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.4s
Cost:
$0.010670
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight's Welcome" data-color="red"> As Thunder's hooves clattered onto the cobblestones near the stables, a broad-shouldered figure emerged from the shadows of the hayloft. His armor bore the deep crimson insignia of the castle guard, and a scar ran across his weathered cheek like a badge of countless battles. "You must be the new squire," the man said, his voice carrying the weight of authority. "I am Sir Roland. I've been expecting you, though I confess I didn't think you'd arrive so late in the day." He extended a calloused hand toward Thunder's reins, studying Frederick with sharp, assessing eyes. "Come now, boy. Dismount. We have much to discuss before the sun fully sets, and even more to do before dawn breaks." </nc-section> <nc-section data-title="Chapter 1: A Knight's Welcome" data-color="green"> The stables smelled of hay and leather as Frederick brought Thunder to a slow trot. A tall knight stood near the entrance, polishing his sword with meticulous care, the blade catching the last rays of sunlight. "Ah, you've finally arrived," the knight said without looking up, though a faint smile touched his lips. "Sir Roland, at your service—or rather, you'll soon be at mine, if the rumors of your training prove true." He sheathed his sword and walked toward Frederick with an easy, confident stride. "Word travels fast in these halls. They say you have promise, young squire. Let's see if the stories hold water, shall we?" He gestured toward the stable doors. "First lesson: a good knight always tends to his horse before himself. Come, I'll show you where to settle him for the night." </nc-section> <nc-section data-title="Chapter 1: A Knight's Welcome" data-color="blue"> Frederick had barely swung his leg over Thunder's saddle when a hearty laugh echoed across the stable yard. "Careful there! You'll want to land on your feet, not your face, if you hope to survive training here!" Sir Roland strode forward, his chainmail glinting silver in the fading light. Unlike the stern knights of Frederick's imagination, this one wore an easy grin and kind eyes that crinkled at the corners. "Welcome, welcome! I'm Sir Roland, and you, if I'm not mistaken, are the squire everyone's been chattering about." He clapped a friendly hand on Frederick's shoulder as the young man dismounted. "Don't look so nervous, lad. We'll get you settled in, fed, and rested before I start putting you through your paces. That horse of yours—Thunder, is it? Fine name for a fine animal. Let's get him some water and oats, and then you and I shall talk about what lies ahead." </nc-section>
created_at
"2026-07-01T07:46:43.191Z"
7/1/2026, 7:46:43 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3126
moderation_latency
(null)
generation_time
15341
tokens_prompt
318
tokens_completion
712
native_tokens_prompt
435
native_tokens_completion
980
native_tokens_completion_images
(null)
native_tokens_reasoning
34
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01067
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01PUFwVrvwN2aWjtPMdSz1VW"
is_byok
false
latency
1773
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782892003-rVKweYAhcaTr8kYYcR9b"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782892003-9kADypB9NGlqHJftZWGI"
upstream_id
"msg_01PUFwVrvwN2aWjtPMdSz1VW"
total_cost
0.01067
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval