NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9KTB3P09DJF45W446CH1H
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.7s
Cost:
$0.010730
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="red"> Thunder's hooves clattered against the cobblestones as I approached the stables, and a broad-shouldered figure stepped out from the shadows to meet me. His armor bore the dents and scratches of countless battles, and his face, though weathered, carried a warm smile. "You must be the new squire," he said, his voice deep and steady as thunder itself. "I am Sir Roland. The castle has been expecting you, young Frederick." I dismounted quickly, nearly stumbling in my haste to bow properly. "Sir Roland, it's an honor. I've heard tales of your victories since I was a boy." He clasped a firm hand on my shoulder, his grip strong enough to nearly buckle my knees. "Tales grow taller with each telling, lad. Let's get your horse settled, and then we'll see what you're truly made of." </nc-section> <nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="green"> As I led Thunder toward the stables, a tall man emerged, his silver hair catching the last rays of sunlight. He wore the insignia of a knight upon his chest, and his eyes studied me with quiet curiosity. "So you're the boy from the eastern villages," he said, not unkindly. "I am Sir Roland. I trust your journey was uneventful?" "Yes, sir," I replied, trying to keep the nervousness from my voice. "Though I confess, I expected the castle to be... larger." A low chuckle escaped him. "Everyone says that, the first time. Come, let's tend to your horse. There will be time enough for you to marvel at these walls once your duties begin." He took Thunder's reins from me with practiced ease, and I followed him into the stables, unsure of what awaited me but strangely at ease in his presence. </nc-section> <nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="blue"> The stable doors creaked open before I could even dismount, and a knight in gleaming armor stepped into the torchlight. His posture was rigid, disciplined, every inch of him radiating the authority of years spent in service to the crown. "You're late," he said, though there was no real anger in his tone. "I am Sir Roland, master-at-arms of this castle. I was told to expect a squire at midday, not dusk." "My apologies, Sir Roland," I stammered, sliding off Thunder's back. "The roads were longer than I anticipated." He studied me for a long moment, his sharp eyes missing nothing. Then, unexpectedly, his stern expression softened. "The roads always are, for those who've never traveled them before. Come, let's get you settled before nightfall. Tomorrow, your training begins in earnest." I nodded, gripping Thunder's reins tightly, sensing that this stern knight would soon become far more than just my superior. </nc-section>
created_at
"2026-07-01T07:34:36.655Z"
7/1/2026, 7:34:36 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1523
moderation_latency
(null)
generation_time
13594
tokens_prompt
318
tokens_completion
718
native_tokens_prompt
435
native_tokens_completion
986
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01073
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_0113vAcM7VRkXJ2zuR23Fdm4"
is_byok
false
latency
1519
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891276-3UhaDm019oy7Pkp1ctZx"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891276-a8f1Ne6lz3X19D8alz8L"
upstream_id
"msg_0113vAcM7VRkXJ2zuR23Fdm4"
total_cost
0.01073
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval