NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA7JPHXH3H7PYYF2WVP5FH
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.1s
Cost:
$0.000753
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> I guided Thunder through the castle gates and into the bustling courtyard, where the clatter of hooves and the ring of hammers filled the air. The stables stood along the eastern wall, their wide doors thrown open. Before I could dismount, a broad-shouldered man in dented steel strode toward me, his grey cloak snapping behind him. "You must be Frederick," he said, his voice warm but firm. "I am Sir Roland. I have been expecting you since the morning bell." I slid from the saddle, my legs stiff from the long ride, and bowed as my father had taught me. Sir Roland clasped my forearm with a grip like an iron vise, then glanced at Thunder with an approving nod. "A fine animal. Too fine for a boy who has never held a lance in earnest, I suspect." He grinned. "Do not worry. By the end of your first season, you will either love this place or curse my name every morning. Usually both." He led me past rows of stalls, where grooms were already working by lantern light. "Your training begins at dawn. Tonight, you will eat, rest, and learn where not to step in the stable yard." </nc-section> <nc-section data-title="Chapter 1: A Knight's Measure (Version 2)" data-color="green"> Thunder snorted as we reached the stables, tossing his head at the unfamiliar smells of hay, leather, and horse liniment. I had barely swung my leg over the saddle when a voice rang out across the yard. "Steady, lad. He smells the other horses and thinks he's king of them all." I turned to see a tall knight with silver threading through his dark beard. His surcoat bore a faded bear crest, and a long scar ran from his temple to his jaw. He wore no helmet, and his eyes were sharp and amused as they studied me. "Sir Roland," he said, offering his hand. "Castellan of the training yard, and the man who will decide whether you survive your first month." I took his hand, trying to keep my voice from wavering. "Frederick, my lord. I hope to earn my place here." "Hope is a good start. Skill is better." He took Thunder's reins with practiced ease, and the stallion, to my surprise, went calm at once. "Your horse respects a firm hand. See that you develop one, for the same is true of swords." He gestured toward the open doors. "Get some food and sleep. Tomorrow, I will find out what your father really taught you." </nc-section> <nc-section data-title="Chapter 1: The Knight Beneath the Eaves (Version 3)" data-color="blue"> The stable boys had already lit the lanterns when I led Thunder beneath the wooden eaves, and the warm glow spilled across the cobblestones. I paused, unsure where to tie him, until a deep voice spoke from the shadows. "You will want the third post, near the water trough. He will not kick there." A knight stepped into the light, leaning on a spear as though it were a walking stick. He was older than I had imagined, his hair cropped short and his face weathered by many seasons in the open air. A small silver hawk was pinned to his worn leather jerkin. "Sir Roland, of the castle guard," he said, and his mouth twitched toward a smile. "And you are the squire my lord sent word about. Frederick, is it?" "Yes, sir." I bowed, feeling suddenly very young beside his quiet confidence. "No need for that. Save your bowing for the lords and ladies, and keep your back straight for the training yard." He looked over Thunder with a thoughtful expression. "You rode hard to get here. Tonight, rest. Tomorrow, we see what you are made of." He turned toward the barracks, then paused. "And Frederick? Whatever they told you at home, this castle has a way of teaching a man the truth of himself. Be ready for it." </nc-section>
created_at
"2026-10-08T08:31:44.346Z"
10/8/2026, 8:31:44 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2768
moderation_latency
(null)
generation_time
10092
tokens_prompt
303
tokens_completion
1036
native_tokens_prompt
437
native_tokens_completion
1419
native_tokens_completion_images
(null)
native_tokens_reasoning
106
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0007532
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448304-sSw88BTZRW7m5aIarZxe"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448304-aKo4Cr9aJp9xJCJOIRWy"
upstream_id
"msg_011CfpTZuNAbGVRjohLDQNYX"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTZuNAbGVRjohLDQNYX"
is_byok
false
latency
843
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0007532
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval