NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-29-01M3P2JRS0DJHD5DJCZTKHDX1M
Run Details
Model:
Claude Sonnet 5.5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.3s
Cost:
$0.013504
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Iron Welcome" data-color="red"> The gates groaned open, and I guided Thunder through the courtyard toward the stables. The smell of hay and horse sweat greeted me before I saw the low timber building. A figure stood in the doorway, broad as an oak, with a scar running from his brow to his jaw. "You're late, boy," he said. His voice was gravel and thunder. "The sun's nearly down, and a squire who arrives after dark is a squire who can't read a road." I slid from the saddle, my legs trembling from the long ride. "Sir Roland?" "Who else would be waiting in the muck?" He stepped forward and ran a calloused hand along Thunder's neck. The stallion, who let no stranger touch him, stood still as stone. Roland's mouth twitched. "Good horse. Better than you deserve, I'd wager. We'll see if you can earn him." He turned and strode into the stables without another word. After a moment I understood that I was meant to follow. </nc-section> <nc-section data-title="Version 2: A Warm Hearth of a Man" data-color="green"> I had barely dismounted when a cheerful voice rang out from the stable door. "Ah! You must be young Frederick! Come in, come in, before that magnificent beast of yours eats my hay allowance for the week!" Sir Roland was not what I had expected. I had pictured a grim veteran carved from granite, but the man before me was round-cheeked and graying, with laugh lines deep around his eyes. His tabard was stained with something that looked suspiciously like porridge. He clasped my forearm in a warm, firm grip. "Forgive the state of me," he said. "Cook and I had a disagreement about breakfast, and breakfast lost." He leaned close and lowered his voice. "Don't let the others fool you. The castle sounds fearsome, but the bark is worse than the bite. Mostly." Thunder nickered and nudged his shoulder, and Roland laughed. "There, you see? Even the horse approves. Let's get you both fed." For the first time since leaving home, the knot in my chest loosened. </nc-section> <nc-section data-title="Version 3: The Knight in the Shadows" data-color="blue"> The stables were quiet when I arrived, lit only by the last amber light slanting through the open doors. I dismounted slowly, unsure where to go, when a voice spoke from the shadows behind me. "He favors his left foreleg." I spun around. A tall man in a travel-worn cloak leaned against a post, arms folded, as though he had been there for hours. Silver threaded his dark beard, and a sword hung at his hip, its hilt wrapped in old, faded leather. "Thunder?" I looked down and saw it then, a slight hesitation in the stallion's step that I had been too tired to notice. "I didn't realize." "Few would." The man stepped into the light. "I am Sir Roland. I watched you cross the field. You ride well, but you ride like someone running from something." His gaze was steady and unreadable. "Whatever it is, you'll not find it here in the stables. Though in my experience, the castle has a way of finding out everyone's secrets." He crouched beside Thunder's leg, and I wondered, with a chill, what exactly he already knew about me. </nc-section>
created_at
"2026-09-29T07:55:30.47Z"
9/29/2026, 7:55:30 AM
model
"anthropic/claude-sonnet-5.5-20260928"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
13299
moderation_latency
(null)
generation_time
13300
tokens_prompt
303
tokens_completion
866
native_tokens_prompt
437
native_tokens_completion
1263
native_tokens_completion_images
(null)
native_tokens_reasoning
145
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.013504
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790668530-ZdYJpONagdeJAB5jDxM5"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790668530-1shmUlmON5wMXEVPHGrj"
upstream_id
"msg_011CfXNXQqj7PGXZ6taLNGbQ"
provider_responses
0
endpoint_id
"99aaad94-923b-4fc1-b763-271ed5486f7a"
id
"msg_011CfXNXQqj7PGXZ6taLNGbQ"
is_byok
false
latency
635
model_permaslug
"anthropic/claude-sonnet-5.5-20260928"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.013504
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval