NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FY50FNYMJ38JZA1X3HKTPV
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.7s
Cost:
$0.000691
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> Thunder slowed to a trot as we passed beneath the iron portcullis, his hooves ringing against the cobblestones. Near the stables, a broad-shouldered man in dented chainmail was leaning against a post, sharpening a short blade with long, unhurried strokes. He looked up, and a grin split his weathered face. "You must be the new squire," he called, sheathing the blade. "Frederick, if the letter was honest. I am Sir Roland. Dismount before that fine beast decides to take the stables for himself." I swung down from the saddle, my legs stiff from the long ride. Sir Roland took Thunder's reins with the ease of a man who had handled a thousand horses, running a calloused hand along the stallion's neck until the animal snorted in approval. "Good stock," he said. "You'll need to earn the right to ride him in the training yard, mind. Pride goes before a fall, and this castle has a long memory for falls." He tossed the reins to a stable boy and turned his keen gaze back to me. "Now, let's see what sort of squire the king has sent me." </nc-section> <nc-section data-title="Chapter 1: A Stranger in the Straw (Version 2)" data-color="green"> The stable yard smelled of hay, leather, and smoke from the forge. I had barely climbed down from Thunder when a voice rumbled from the shadows of the nearest barn. "Careful, lad. Keep your feet clear of the muck, or the stable master will have you shoveling it till midwinter." A knight stepped into the fading light. He was older than I had expected, his grey beard trimmed close, his armor dull with years of use but lovingly oiled. A faded green cloak hung from his shoulders, and a small silver badge in the shape of an oak leaf was pinned at his chest. "Sir Roland," he said, extending a hand. "I command the training of squires here, which means I'll be the first to tell you that you ride like a sack of turnips." He laughed at my expression. "But you sit a horse well enough, so we'll start there. Welcome to Ashmere, Frederick." His grip was firm and warm. Behind him, the last light of the sun slipped behind the castle towers, and somewhere within the walls, a bell began to toll the evening hour. </nc-section> <nc-section data-title="Chapter 1: The Knight at the Stables (Version 3)" data-color="blue"> I had expected a crowd to greet a new squire, but the stable yard was nearly empty. Only a single figure waited by the water trough: a tall knight in plain, well-worn armor, his helm tucked under one arm. Something about his stillness told me he had been watching my approach for some time. "Frederick, I presume," he said, his voice quiet but carrying. "I am Sir Roland, and I will be your first teacher here. Do not look so nervous. Every squire arrives looking as though he expects to be sent home by morning." He studied me for a long moment, then glanced at Thunder, who was tossing his head and pawing at the cobblestones. A faint smile touched Sir Roland's lips. "A fine horse for a young man with much to learn," he observed. "Let us see whether you can care for him as well as you ride him. Tomorrow, you will rise before dawn and begin your duties. Tonight, you will eat, rest, and remember that a knight's first lesson is patience." </nc-section>
created_at
"2026-10-09T08:58:20.538Z"
10/9/2026, 8:58:20 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2288
moderation_latency
(null)
generation_time
8727
tokens_prompt
303
tokens_completion
917
native_tokens_prompt
437
native_tokens_completion
1294
native_tokens_completion_images
(null)
native_tokens_reasoning
129
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006907
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791536300-XVX2E53qsnE8miRCIkCy"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791536300-Ips2rCyMl6O6f5YKFZnJ"
upstream_id
"msg_011CfrPQUx2L2xXnfaPB2JsR"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrPQUx2L2xXnfaPB2JsR"
is_byok
false
latency
805
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006907
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval