NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA6T77JFZPCDBKQT38XY8H
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.7s
Cost:
$0.011510
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Warrior's Welcome" data-color="red"> As Thunder's hooves clattered against the cobblestones near the stables, a broad-shouldered figure emerged from the shadows of the archway. His armor bore the deep crimson insignia of the castle guard, and a battle-worn sword hung at his hip. "You must be the new squire," the man said, his voice carrying the gravel of countless years spent shouting orders across training grounds. "I am Sir Roland. Word travels fast in these halls—they say you have a fire in you, boy." He extended a calloused hand to help me dismount, his sharp eyes assessing me from head to toe as if measuring the mettle of steel not yet forged. "We'll see soon enough if the rumors hold true. Come, the stable boys will tend to your horse. We have much to discuss before nightfall." </nc-section> <nc-section data-title="Chapter 1: An Unexpected Meeting" data-color="green"> The stables smelled of fresh hay and horse sweat as I led Thunder through the entrance, my legs still stiff from the long ride. It was there, amidst the quiet nickering of horses, that I first laid eyes on Sir Roland. He was tending to his own mount, a gentle grey mare, speaking to her in soft tones before he noticed my presence. Turning, his weathered face broke into an easy smile, surprising me—I had expected someone more severe. "Ah, so you're Frederick," he said, wiping his hands on a cloth tucked into his belt. "I was told to expect a squire today, though I confess I pictured someone taller." He chuckled warmly at his own joke. "Sir Roland, at your service. Or rather, you'll soon be at mine. Don't worry, lad—I don't bite, unlike some of the horses here." He gestured toward an empty stall beside his mare. "Settle your horse here. Rest well tonight. Tomorrow, your true journey begins." </nc-section> <nc-section data-title="Chapter 1: The Knight's Shadow" data-color="blue"> Twilight settled over the castle grounds as I approached the stables, the flickering torchlight casting long shadows across the stone pathway. A tall figure stood near the entrance, silhouetted against the fading light, watching my approach with quiet patience. "You made good time," the man said as I drew closer, his voice measured and calm. "I am Sir Roland, and I've been tasked with your training." He studied me for a long moment, his expression unreadable in the dim light. "Frederick, wasn't it? I knew your father, once. He was a fine soldier." The mention of my father caught me off guard, but before I could respond, Sir Roland turned toward the stables. "Come, let's get your horse settled. There will be time enough for stories later. Tonight, you rest. Tomorrow, the real test begins—not of your sword arm, but of your resolve." As we walked together into the dimly lit stable, I couldn't help but wonder what other secrets this knight might hold about my past. </nc-section>
created_at
"2026-07-01T07:44:59.123Z"
7/1/2026, 7:44:59 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3652
moderation_latency
(null)
generation_time
16667
tokens_prompt
318
tokens_completion
785
native_tokens_prompt
435
native_tokens_completion
1064
native_tokens_completion_images
(null)
native_tokens_reasoning
34
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01151
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01KKZPbvcasfLUqqakx4tr4P"
is_byok
false
latency
2424
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891899-N2K5XXXxiMbO9Z3KRP1j"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891899-LmgHbhXIbWJGyZ8rxSwo"
upstream_id
"msg_01KKZPbvcasfLUqqakx4tr4P"
total_cost
0.01151
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval