NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DAJVJ1X5R7T1BCZRM7H6E2
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.1s
Cost:
$0.000643
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> The stable boy had barely taken Thunder's reins when a broad-shouldered man strode out from the shadows of the stable doors. He wore a dented breastplate over a travel-stained tunic, and his grey-streaked beard was trimmed short. Despite his years, his stride was steady and purposeful. "You must be Frederick," he said, his voice warm but firm. "I am Sir Roland. I have been waiting for you since midday, though I suspect the road was longer than the map suggested." I bowed low, suddenly aware of the dust on my boots. "Yes, sir. Thank you for receiving me." He clapped a heavy hand on my shoulder and steered me away from the stables. "Do not thank me yet. Thunder there is a fine animal, but you will learn that a squire's first lesson is never about the horse. It is about patience. Now, come. The cook will have supper ready, and you will need your strength for tomorrow." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 2)" data-color="green"> Before I could dismount fully, a voice called out from across the yard. "Careful with that saddle, lad! It has seen more miles than either of us!" I turned to find a lean, weathered knight leaning against a fence post, a half-eaten apple in one hand. His eyes were sharp and amused, and a long scar ran from his temple to his jaw. He pushed off the post and ambled toward me. "Sir Roland," he said, offering his hand. "Local knight, sometimes-teacher, and unofficial keeper of the stable boys' gossip. You'll find I am the first to greet every newcomer and the last to let them forget the greeting." I clasped his hand, feeling the calluses of a lifetime of swordwork. "Frederick, sir. I am honored to serve under you." He grinned and tossed the apple core over the fence. "Honored? We'll see about that after your first morning drills. Come, let's get you settled before the bells ring." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 3)" data-color="blue"> The stables were quiet except for the soft snorting of horses and the creak of old timber. I had just begun to loosen Thunder's girth when I noticed a figure standing motionless in the doorway, watching me with an unreadable expression. It was a knight, though he looked more like a statue carved from the grey stone of the castle walls. His armor was plain and well-kept, and he held himself with the quiet confidence of a man who had nothing left to prove. "Frederick," he said at last. "I am Sir Roland. Your father wrote to me of your arrival. He said you ride like a storm and speak like a stone." A faint smile touched his lips. "I hope the first claim is truer than the second. The castle has enough silence already." I straightened, unsure whether I had been insulted or complimented. "I will do my best, sir." "Good. Then we shall begin with the horse. Unsaddle him properly, rub him down, and bring him to the paddock. Only then will I show you where you sleep." </nc-section>
created_at
"2026-10-08T08:37:53.864Z"
10/8/2026, 8:37:53 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2490
moderation_latency
(null)
generation_time
8068
tokens_prompt
303
tokens_completion
870
native_tokens_prompt
437
native_tokens_completion
1198
native_tokens_completion_images
(null)
native_tokens_reasoning
117
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006427
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448673-emTSCAKOH5m1xtEfFOUb"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448673-K4uRMhKvJtsfyPDG6U3w"
upstream_id
"msg_011CfpU39RkxrSXQq2z5qYbJ"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpU39RkxrSXQq2z5qYbJ"
is_byok
false
latency
881
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006427
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval