NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9ZGFNRPNCMQRXYMPJBVMZ
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.8s
Cost:
$0.012860
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: A Knight's Welcome (Version 1)" data-color="red"> Thunder's hooves clattered against the cobblestones as I slowed him to a trot, guiding him toward the stables. A tall figure emerged from the shadows of the stable doors, clad in polished armor that caught the last rays of sunlight. His weathered face broke into a warm smile as he approached. "You must be young Frederick," he said, his voice deep and steady as a mountain. "I am Sir Roland. I've been expecting you." I dismounted quickly, nearly stumbling in my haste to show proper respect. "Sir Roland, it's an honor, sir." "The honor will come later, boy, once you've earned it." He clasped a firm hand on my shoulder, his grip strong from decades of swordwork. "For now, let's get that horse of yours settled. You've had a long journey, and tomorrow your training begins in earnest." There was something in his eyes—a flicker of memory, perhaps, of when he himself had been a nervous squire arriving at these very gates. </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome (Version 2)" data-color="green"> As Thunder slowed to a walk near the stables, I noticed a knight leaning against the wooden fence, watching my approach with keen interest. His armor bore the scars of countless battles, dented and scratched but meticulously maintained. A long scar ran across his left cheek, disappearing into a neatly trimmed beard. "That's quite an entrance," he called out, pushing himself off the fence. "Sir Roland, at your service. And you'd be the new squire everyone's been talking about." "Frederick, sir," I replied, sliding off my horse and bowing awkwardly. Sir Roland chuckled, the sound rough like gravel. "No need for such formality with me, lad. Save that for the King's court." He circled Thunder appraisingly. "Fine horse. You'll need to prove yourself worthy of such a steed." He extended a calloused hand, and I shook it, feeling the strength in his grip. "Come, let's get you settled. I have a feeling you and I are going to spend a great deal of time together in the coming months." </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome (Version 3)" data-color="blue"> The stable boy took Thunder's reins as I dismounted, my legs stiff from the long ride. It was then that I heard footsteps approaching—measured, confident, the gait of someone accustomed to command. "Frederick, I presume?" I turned to find a knight studying me with sharp, assessing eyes. Unlike the ceremonial armor I'd imagined knights wearing, his was practical and worn, clearly built for function rather than show. A sword hung at his hip, its hilt smooth from years of use. "Yes, sir. Frederick of Thornwood." "Sir Roland," he introduced himself with a curt nod. "I'll be overseeing your training." He looked me up and down, and I fought the urge to straighten under his scrutiny. "You're smaller than the last squire we had. Let's hope you're quicker." Before I could respond, he turned on his heel. "Well, don't just stand there gawking. The stables need mucking, and then we'll see what you know about holding a sword. The kingdom won't wait for you to find your footing, boy—best you find it quickly." I hurried after him, my heart pounding with a mixture of nervousness and anticipation. My training as a knight had begun. </nc-section>
created_at
"2026-07-01T07:40:59.774Z"
7/1/2026, 7:40:59 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1820
moderation_latency
(null)
generation_time
17721
tokens_prompt
318
tokens_completion
872
native_tokens_prompt
435
native_tokens_completion
1199
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01286
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01FMAjJivehcXiQPys5Vgh7X"
is_byok
false
latency
1809
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891659-4hu85hG9ROfOo1RvEVnQ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891659-yaVUeuMKH26DUNhYnQqC"
upstream_id
"msg_01FMAjJivehcXiQPys5Vgh7X"
total_cost
0.01286
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval