NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE8WEFASGQXRN9DP850HXJD
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.6s
Cost:
$0.012900
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: A Knight's Welcome (Version 1)" data-color="red"> As Thunder's hooves clattered against the cobblestones near the stables, a broad-shouldered figure emerged from the shadows of the timber archway. His armor caught the last light of dusk, and a scar ran across his weathered cheek like a badge of old battles won. "You must be the new squire," he said, his voice carrying the gravel of a thousand shouted commands on training fields. "I am Sir Roland. Dismount, boy, and let's see if you know how to properly tend a horse before we speak of swords." Frederick swung down from the saddle, his legs unsteady after the long ride. "Yes, ser. Frederick, son of Aldric the smith." Sir Roland's eyes narrowed with sudden interest. "Aldric's boy? I knew your father. Good man. Strong arm, stronger heart." He clapped a heavy gauntlet on Frederick's shoulder, nearly knocking him into the hay. "Let's see if you inherited either." </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome (Version 2)" data-color="green"> The stable boy came running first, but it was the man who followed—tall, silver-haired, with the calm bearing of someone who had faced death and made peace with it—who caught Frederick's attention immediately. "Easy on the reins, lad. Thunder's earned his rest." The man's tone was gentle, though his presence filled the courtyard like a rising tide. "Sir Roland, at your service. I daresay the castellan mentioned you'd be arriving today." Frederick fumbled with the stirrups, nearly stumbling as he dismounted. "F-Frederick, ser. I'm to begin my training." Roland chuckled, a warm sound that eased the knot in Frederick's stomach. "Training starts the moment you arrive, not when the bell tolls for it. Look at your horse—exhausted, lathered in sweat. First lesson: a knight cares for his mount before he cares for himself." He took Thunder's reins with practiced ease. "Come. We'll walk him together, and you can tell me why a boy from the lowlands wants to learn the way of the sword." </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome (Version 3)" data-color="blue"> "You're late," came a voice from beside the stable door, though there was no real edge to it—more amusement than reprimand. Frederick turned to see a knight leaning against the wooden post, arms crossed, watching him with the faint smirk of someone who had seen a hundred nervous squires arrive at these gates before him. His armor was plain but well-kept, the mark of a man who valued function over show. "Sir Roland," the knight said, pushing off from the post and extending a hand. "And you'd be the smith's son from Ashford, unless I'm mistaken." "I—yes, ser. Frederick." He shook the offered hand, surprised by the firmness of the grip. "Good. Thought I'd have to wait till morning." Roland glanced past him toward the darkening horizon, then back to Thunder, who stamped impatiently. "Your horse is a fine one. Get him settled, then find me in the west hall. We start early tomorrow, and I don't tolerate excuses for tardiness twice in one week." He turned to go, then paused, glancing back with something almost like warmth in his eyes. "Welcome to the castle, Frederick. Try to survive your first month—most don't leave so easily after that." </nc-section>
created_at
"2026-07-01T07:21:50.843Z"
7/1/2026, 7:21:50 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1580
moderation_latency
(null)
generation_time
17586
tokens_prompt
318
tokens_completion
860
native_tokens_prompt
435
native_tokens_completion
1203
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0129
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_017HmhXVqUmUzfAsRM4qdfk9"
is_byok
false
latency
1569
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890510-R34Gd61d0iPSovtnCuOn"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890510-jWLFdUnuUOWT1Plya9nE"
upstream_id
"msg_017HmhXVqUmUzfAsRM4qdfk9"
total_cost
0.0129
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval