NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9X4T8N8C9WYY8QRCPY1EQ
Run Details
Model:
Claude Sonnet 5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.2s
Cost:
$0.012770
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight's Welcome" data-color="red"> As Thunder's hooves clattered against the cobblestones near the stables, a broad-shouldered figure emerged from the shadows of the archway. His armor caught the last rays of sunlight, and a scar ran along his jaw—a testament to battles long past. "You must be the new squire," the man said, his voice deep and steady as a war drum. "I am Sir Roland. I've been expecting you, boy." Frederick swung down from his horse, nearly stumbling as his travel-weary legs met solid ground. He straightened quickly, trying to muster the composure befitting a future knight. "Yes, sir. Frederick, son of—" "I know whose son you are," Sir Roland interrupted, though not unkindly. A faint smile tugged at the corner of his mouth. "Your father spoke of you often. Come, let's get that horse settled before we discuss what lies ahead." </nc-section> <nc-section data-title="Chapter 1: Stable Encounters" data-color="green"> The stable boys scattered as Frederick approached, whispering amongst themselves. He caught only fragments of their words—"new squire," "Sir Roland," "test of worth." A tall knight stepped out from between the stalls, wiping his hands on a cloth stained with horse liniment. His eyes, sharp and assessing, swept over Frederick from head to toe. "So you're the one Lord Aldric sent for," the knight said. "Sir Roland, at your service—though I suspect you already knew that." Frederick nodded, unsure whether to bow or extend a hand. He settled for an awkward half-bow that made Sir Roland chuckle. "Relax, lad. We'll have plenty of time for formalities later. Right now, I care more about how you handle a horse than how you handle a curtsy." He gestured toward Thunder. "Fine animal. Let's see if you know how to care for him properly—that'll tell me more about your character than any letter of introduction." </nc-section> <nc-section data-title="Chapter 1: The Stern Instructor" data-color="blue"> The scent of hay and horse sweat filled the air as Frederick led Thunder toward the stables. He hadn't expected to be met so soon, but there, leaning against a wooden post with arms crossed, stood a knight whose reputation had clearly preceded him—armor slightly worn, posture unmistakably disciplined. "You're late," Sir Roland said flatly, not bothering with pleasantries. "I expected you before sundown." Frederick's heart sank. "My apologies, sir. The roads were—" "Excuses are for those who don't intend to improve." Sir Roland pushed off from the post and circled Thunder slowly, inspecting the horse with a critical eye. "But you made good time despite the terrain, I'll give you that. Perhaps there's potential in you yet." He finally met Frederick's gaze directly, his expression unreadable. "I am Sir Roland, and for the foreseeable future, your training falls to me. Tomorrow, we begin at dawn—not a moment later. Tonight, see to your horse. A squire who neglects his mount neglects his duty." With that, he turned and walked away, leaving Frederick alone with Thunder and the weight of expectation settling on his shoulders. </nc-section>
created_at
"2026-07-01T07:39:42.294Z"
7/1/2026, 7:39:42 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2870
moderation_latency
(null)
generation_time
17100
tokens_prompt
318
tokens_completion
868
native_tokens_prompt
435
native_tokens_completion
1190
native_tokens_completion_images
(null)
native_tokens_reasoning
48
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01277
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_014UbSuxmkUQh2eRJiK3ANxP"
is_byok
false
latency
1622
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891582-wgsR3XZADhsT9sy0PwAA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891582-7bwQx2BZkY7o9t3HENBb"
upstream_id
"msg_014UbSuxmkUQh2eRJiK3ANxP"
total_cost
0.01277
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval