NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE99TYZVJB1HEHAEC3CRYX0
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.7s
Cost:
$0.010580
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival - Version 1" data-color="red"> As I dismounted near the stables, a broad-shouldered man in gleaming armor strode toward me, his boots crunching against the gravel path. His face bore the weathered lines of a man who had seen countless battles, yet his eyes held a warmth that put me at ease. "You must be the new squire," he said, his voice deep and steady as a war drum. "I am Sir Roland. The castle has been expecting you." He extended a calloused hand, gripping mine with the strength of a man who had wielded a sword since boyhood. Thunder nickered softly behind me, and Sir Roland glanced at the stallion with an appraising eye. "A fine horse," he remarked. "Get him settled, then come find me. We have much to discuss before your training begins." </nc-section> <nc-section data-title="Chapter 1: The Arrival - Version 2" data-color="green"> "Well now, what have we here?" The voice boomed across the stable yard, cheerful and rich with amusement. I turned to see a knight approaching, his armor slightly dented but polished to a shine, a easy grin spread across his weathered face. Unlike the stern figures I'd imagined guarding the castle, this man walked with an almost jovial swagger, his cape billowing behind him. "Sir Roland, at your service," he said with an exaggerated bow, though his eyes twinkled with genuine friendliness. "And you'd be young Frederick, unless I'm mistaken? Word travels fast in these halls, lad." He clapped a hand on my shoulder, nearly knocking the wind from me. "Don't look so nervous! We'll get that horse of yours settled, and then I'll show you around. Trust me, the castle looks far more intimidating from outside than it feels once you know your way around." </nc-section> <nc-section data-title="Chapter 1: The Arrival - Version 3" data-color="blue"> A shadow fell across the cobblestones as I led Thunder toward the stable doors. I looked up to find a knight watching me with quiet intensity, his silver armor catching the last rays of sunset like captured flame. "Frederick," he said—not a question, but a statement of fact. "I am Sir Roland. I've been asked to oversee your training." There was no warmth in his greeting, yet no hostility either—only a measured assessment, as if he were already calculating what kind of knight I might become. He studied Thunder for a long moment before speaking again. "You rode hard to get here before nightfall. That shows either dedication or foolishness. Time will tell which." He turned toward the castle, his cape sweeping behind him like a closing curtain. "Settle your horse. Your training starts at dawn, and I do not tolerate lateness." Without another word, he walked away, leaving me alone with Thunder and the weight of what lay ahead. </nc-section>
created_at
"2026-07-01T07:29:09.613Z"
7/1/2026, 7:29:09 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1735
moderation_latency
(null)
generation_time
13628
tokens_prompt
318
tokens_completion
726
native_tokens_prompt
435
native_tokens_completion
971
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01058
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01XU8iqa6dwfR4rr94yrJUpJ"
is_byok
false
latency
1735
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890949-jjND6UHwyPcxCEwJz6qa"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890949-4moGQTnyuc467wJkkpYt"
upstream_id
"msg_01XU8iqa6dwfR4rr94yrJUpJ"
total_cost
0.01058
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval