NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA7DH4J8S6CMPV4SVRBCSM
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.5s
Cost:
$0.012360
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (Version 1)" data-color="red"> Thunder's hooves clattered against the cobblestones as I drew him to a halt near the stables, dust and the scent of hay swirling around us. A broad-shouldered man in gleaming armor stepped forward from the shadows of the stable door, his hand resting casually on the pommel of his sword. "You must be the new squire," he said, his voice deep and steady as a drumbeat. "I am Sir Roland. I've been expecting you." I slid down from the saddle, my legs stiff from the long ride, and bowed as best I could manage. "Frederick, sir. I was told to report here." Sir Roland's eyes, sharp as a hawk's, studied me for a long moment. Then the corners of his mouth twitched into something like a smile. "Well then, Frederick. Let's see if you're made of sterner stuff than the last boy they sent me. Stable your horse, and be quick about it. The castle doesn't wait for anyone." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 2)" data-color="green"> As Thunder slowed to a trot near the stables, a warm laugh rang out across the yard. "That's quite an entrance," a voice called. I turned to see a knight leaning against the stable fence, arms crossed, a friendly grin spread across his weathered face. "Sir Roland, at your service," he said, pushing off the fence and walking toward me with an easy stride. "And you'd be young Frederick, unless I'm mistaken. They told me to expect a squire with more enthusiasm than sense, riding like the kingdom itself was on fire." I felt my cheeks flush as I dismounted. "Was I really that obvious, sir?" "Obvious as a comet in a clear sky," Roland chuckled, clapping a hand on my shoulder. "Don't worry, lad. Enthusiasm can be trained. Come, let's get Thunder here settled in, and then I'll show you around. You've got a long road ahead of you, but something tells me you'll do just fine." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 3)" data-color="blue"> The stable boys scattered as Thunder thundered to a stop, his breath heavy and his flanks glistening with sweat. I hadn't even caught my breath before a stern voice cut through the evening air. "You ride that horse like you're trying to kill him." I spun around to find a tall knight standing with his arms folded, his expression unreadable beneath a scar that ran along his jaw. His armor bore the sigil of the castle guard, polished but worn from years of use. "Sir Roland," he said simply, by way of introduction. "And you must be the squire everyone's been talking about. Frederick, is it?" "Yes, sir," I managed, still trying to steady my breathing. He walked toward Thunder, running a practiced hand along the horse's neck, checking for injury. "A good horse deserves a good rider. That's something you'll learn here, if you learn nothing else." He turned back to me, his gaze piercing. "Training starts at dawn. Don't be late, and for the love of the gods, learn to pace your mount before you kill him showing off." He turned on his heel and walked away, leaving me standing there, unsure whether I'd just made an enemy or earned a strange kind of respect. </nc-section>
created_at
"2026-07-01T07:45:18.896Z"
7/1/2026, 7:45:18 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1732
moderation_latency
(null)
generation_time
16484
tokens_prompt
318
tokens_completion
826
native_tokens_prompt
435
native_tokens_completion
1149
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01236
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01T6c9pXQKS4Nh62Cz8TW1Dv"
is_byok
false
latency
1732
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891918-dRnhneg7SsMzOz4CKqn8"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891918-8BsUB81fRI5btDcR4Egk"
upstream_id
"msg_01T6c9pXQKS4Nh62Cz8TW1Dv"
total_cost
0.01236
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval