NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9H233D9BDSJFP6YKM698T
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.7s
Cost:
$0.011650
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight's Welcome" data-color="red"> As Thunder's hooves clattered against the cobblestones near the stables, a broad-shouldered man stepped out from the shadows of the doorway. His armor bore the deep crimson insignia of the royal guard, and a sword hung confidently at his hip. "You must be young Frederick," he called out, his voice carrying the weight of authority tempered with warmth. "I am Sir Roland. Word of your arrival reached me this morning." I dismounted quickly, my legs still stiff from the long ride, and bowed my head respectfully. "Sir Roland, it's an honor. I've heard tales of your victories in the Border Wars." He laughed heartily, clasping a firm hand on my shoulder. "Tales grow taller with each telling, lad. Come, let's get your horse settled. We have much to discuss about your training." </nc-section> <nc-section data-title="Chapter 1: The Stable Meeting" data-color="green"> The stable boy hurried forward to take Thunder's reins, but before I could follow, a voice rang out across the yard. "Steady now—that's a fine animal you've brought." I turned to see a tall knight approaching, his green-trimmed cloak swaying with each measured step. Sir Roland, I would soon learn, though at that moment he was simply an imposing stranger with kind eyes and a weathered face marked by years of service. "Frederick, is it?" he asked, extending a gloved hand. "I've been asked to oversee your first months here. Sir Roland, at your service—though most just call me Roland when the pleasantries wear thin." I shook his hand, surprised by the firmness of his grip despite his easy smile. "Thank you, sir. I'm ready to learn whatever you can teach me." "Good," he said, nodding toward the stable doors. "That's exactly what I like to hear. Now, let's see if you know one end of a sword from the other." </nc-section> <nc-section data-title="Chapter 1: An Unexpected Welcome" data-color="blue"> The stable smelled of hay and horse sweat, a familiar comfort after my long journey. I was busy loosening Thunder's saddle when a shadow fell across the stall door. "That's quite a horse you've got there," a voice remarked, tinged with genuine admiration. "Strong in the legs, good temperament, if I'm any judge." I glanced up to find a knight in blue-accented armor leaning against the stable entrance, his arms crossed and a curious expression on his face. "Sir Roland," he introduced himself, pushing off from the wooden frame. "I take it you're the new squire everyone's been talking about?" "Frederick, sir," I replied, straightening up and offering a respectful nod. "I wasn't aware anyone knew I was coming." "News travels fast in these halls, especially when the captain mentions a promising young recruit." Roland's eyes studied me with quiet assessment. "Finish up here, then meet me by the training yard. We'll see what promise looks like in practice." </nc-section>
created_at
"2026-07-01T07:33:06.289Z"
7/1/2026, 7:33:06 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2686
moderation_latency
(null)
generation_time
15680
tokens_prompt
318
tokens_completion
794
native_tokens_prompt
435
native_tokens_completion
1078
native_tokens_completion_images
(null)
native_tokens_reasoning
34
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01165
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01Jps47uXn7ymbaNkiMA3oPv"
is_byok
false
latency
1446
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891186-4MTunB4ZrkXyE8UOB6bj"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891186-8dMjhv9JtQ9KRxfuE60F"
upstream_id
"msg_01Jps47uXn7ymbaNkiMA3oPv"
total_cost
0.01165
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval