NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4E1D9ZC8CDZEDH9G1QE77WG
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Max)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 35s
Cost:
$0.011833
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="A Warm Welcome at the Stables (Version 1)" data-color="red"> Thunder had barely slowed to a trot before a broad-shouldered figure stepped out from the shadow of the stable doors, a lantern swinging from one hand. He was older than I had expected, with iron-grey hair cropped close to his skull and a beard trimmed with a blade rather than any barber's care. A silver hawk was stitched across the chest of his travel-worn tunic, and dust clung to his boots as though the road itself had not wanted to let him go. "You must be Frederick," he said. His voice was a warm rumble that seemed to start somewhere beneath his ribs. "Sir Roland. I'm the local knight charged with turning you into a squire worth the name, so try not to break your neck before the first month is out." Before I could dismount, he reached up and caught Thunder's bridle. The stallion, who had been prancing and tossing his head only moments before, lowered his great head and pressed his nose against the old knight's chest with a soft, contented snort. Sir Roland laughed, a deep and genuine sound that seemed to fill the yard. "Would you look at that," he said. "He's already decided he likes me better than you." I slid from the saddle, my legs stiff from the long ride, and tried not to wobble as my boots struck the packed earth. "He isn't usually so friendly with strangers, sir." "Good. Then he has sense." Roland ran a calloused hand along the stallion's neck, feeling the muscle beneath the coat the way a physician might check a patient's pulse. "Fine animal. Who bred him?" "My father, sir. He always said Thunder was the last foal of the old northern line." For a moment something flickered across Roland's weathered face, surprise perhaps, or something gentler. "Your father was a good man. I knew him once, a long time ago." He cleared his throat, and the moment passed as quickly as it had come. "Come. A stable boy will see to your horse. You'll have time to wash the road from your face before supper, and tomorrow we begin in earnest." A young stable hand scurried forward to take the reins. I watched Thunder being led into the shadows, a small knot of unease tightening in my chest, until Roland clapped me on the shoulder hard enough to nearly send me stumbling. "Don't fret over him," he said. "Every new squire thinks his horse is the most important creature in the kingdom. Here, you'll learn that a horse is only as good as the rider on his back." He grinned, and the expression made him look ten years younger. "Now, let's get some food into you before you fall over." </nc-section> <nc-section data-title="A Hard Welcome at the Stables (Version 2)" data-color="green"> The stable yard was quieter than I had expected. Torches guttered in iron brackets along the wall, and a lone figure stood beside the water trough with his arms folded, watching me ride in with the flat, unblinking patience of a hunter waiting for prey to show itself. He did not smile when I reined Thunder in. He looked at the horse first, then at me, then at the horse again. "You're Frederick," he said at last. "I'm Sir Roland, the local knight they've saddled with you. You're late." "The road was longer than the map suggested, sir," I replied, and immediately regretted the defensiveness in my voice. "Maps lie. Men who trust them lie to themselves." He stepped closer, near enough that I could see the old white scar running from his left ear into the collar of his leather jerkin, the sort a claw might leave. "Get down. Walk him over here. I want to see how you handle that beast on foot before I trust you to sit him." I dismounted with more care than I would have liked and led Thunder across the cobbles. Roland circled us slowly, running his eyes over the stallion's legs, the set of his hooves, the sheen of his coat. Thunder tossed his head and showed the whites of his eyes, but I kept my grip steady and my voice low, and Roland waited until the horse settled before laying a hand on his flank as though he had all the time in the world. "He's been ridden hard," Roland said. "Who taught you to ride?" "My father, sir." "Hm." It was not an approving sound. "Your father taught you to ride for pleasure, I suspect. Here, we ride to survive. You'll unlearn most of what you know." I bristled, but I swallowed the retort. Above the stable door, I noticed for the first time a long, iridescent scale set into an iron frame, its edges catching the last of the sunlight in shades of green and bronze. It was the size of my palm and nothing like the scales of any fish or serpent I had ever seen. A ward, I supposed, though against what, I could not say. Roland followed my gaze, and his jaw tightened. "Don't touch that," he said quietly. "And don't ask about it either. Not tonight." "Sir, I only—" "Tonight you eat, you sleep, and at first light you'll be in the practice yard with a wooden sword in your hand and a bruise blossoming across your ribs." He jerked his chin toward the gate, where a stable boy was already hurrying to take Thunder's reins. "Welcome to Castle Varrow, Frederick. Try not to die before breakfast." </nc-section> <nc-section data-title="The Keeper of the Stables (Version 3)" data-color="blue"> I had expected a welcoming party waiting at the gate. Instead I found Sir Roland seated on an upturned water barrel at the far end of the stable row, a whetstone in one hand and a long knife in the other. The blade flashed in the lantern light as he drew the stone along its edge in slow, patient strokes. He did not look up when Thunder's hooves rang against the cobbles. "Ah," he said, as though he had been expecting me for some time. "Frederick. Sir Roland, of these parts. Get that horse under cover, will you? He's fretting." I led Thunder into the stable proper. The air was thick with the scent of hay and leather, and beneath it lay something sharper, faintly metallic, that prickled the back of my throat. Thunder's ears flattened, then swiveled toward the far end of the building, where the stalls stood dark and empty. "He doesn't like the smell," I said. "No. Most horses don't." Roland rose slowly, his knees cracking like kindling, and laid the blade across his thigh. Up close, his face was lined the way a man's becomes after years of squinting at distant horizons, though his eyes were a clear, pale grey. "Tell me, boy. Did you pass anything on the road? Anything that wasn't a farmer, a merchant, or a carrion bird?" I hesitated. "Only the burned hamlet beside the river, sir. The villagers swore the fire came from the sky." For a long moment Roland said nothing, and I wondered whether he had heard me at all. Then he gave a short, humorless laugh. "Did they, now." He wiped the blade on his trousers and slid it into a sheath at his hip. "Then you'll have questions, and I'll give you none of the answers tonight. Tomorrow, perhaps. Or the day after that." He stepped forward and rested one palm against Thunder's neck. The stallion, who had been stamping and snorting only moments before, went still beneath his hand, his ears softening toward the old knight. "You did right to bring him here," Roland murmured, more to the horse than to me. "He remembers what he is, even if you don't yet." Before I could ask what that meant, he turned and walked toward the castle, his shadow stretching long across the yard as the last light faded from the stone walls. "Come along, Frederick," he called over his shoulder. "The supper bell will ring soon, and I don't intend to explain the rest of this place to you on an empty stomach." </nc-section>
created_at
"2026-10-08T15:16:49.273Z"
10/8/2026, 3:16:49 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2203
moderation_latency
(null)
generation_time
95235
tokens_prompt
303
tokens_completion
5184
native_tokens_prompt
437
native_tokens_completion
23579
native_tokens_completion_images
(null)
native_tokens_reasoning
20977
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0118332
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791472609-09ynn3qVaShdW6X8lKj5"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791472609-uvVVRvkUK4E90oazzSIN"
upstream_id
"msg_011CfpzTXdA8GEjFsrZ8NReV"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpzTXdA8GEjFsrZ8NReV"
is_byok
false
latency
865
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0118332
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval