NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DAAGHE0J2XX0KY1SH0XB97
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.6s
Cost:
$0.000831
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight at the Stables (Version 1)" data-color="red"> Thunder slowed to a trot as we passed beneath the iron portcullis, and the courtyard opened before us in a clatter of hooves and voices. Before I could find the stables, a broad-shouldered man in dented steel strode across the cobblestones toward me, his cloak trailing behind him like a banner. His beard was streaked with grey, but his stride was as firm as any young knight's. "You must be Frederick," he said, looking up at me with a grin. "I am Sir Roland. You rode in faster than the messenger said you would, which tells me either you are eager or your horse is impatient. Judging by the foam on that stallion's neck, I suspect the horse is to blame." I felt my cheeks warm as I slid from the saddle. Thunder snorted and tossed his head, and Sir Roland laughed, reaching out to rest a calloused hand on the stallion's neck. The animal calmed almost at once. "Good beast," Roland murmured. "Come, the grooms will see to him. Your training begins at dawn, but tonight you will eat, rest, and learn where the well is, because the castle's first lesson is always that a squire who cannot find water will not survive long enough to become a knight." </nc-section> <nc-section data-title="Chapter 1: The Welcome of Sir Roland (Version 2)" data-color="green"> Thunder had barely come to a halt when a voice called out from the shadows of the stable doorway. "Easy there, lad! Don't let him drag you into the straw before you've had a chance to unsaddle him." A tall knight emerged into the fading light, pulling off a leather gauntlet as he came. His face was weathered by years of sun and wind, and a faded scar ran from his left ear to the corner of his jaw. He studied me with sharp, thoughtful eyes before offering a hand. "Sir Roland," he said. "I'm the one they've left in charge of squires until the Lord Marshal returns from the border. You're Frederick, I take it?" I clasped his hand, surprised by the strength of his grip. "Yes, sir. I hope I'm not late." "Late? No. Early, if anything, and that's rarer than you'd think." He nodded toward Thunder, who was already nosing hopefully at a water trough. "Your horse is a fine animal, but he's clearly been ridden hard. Take a moment to tend him yourself before the grooms take over. A squire who knows his mount's needs is worth three who only know how to swing a sword." He turned to lead me deeper into the stable yard, his voice softening. "You'll find this place demands a great deal of you, Frederick. But it also gives back, if you're willing to work for it." </nc-section> <nc-section data-title="Chapter 1: Beneath the Stable Lanterns (Version 3)" data-color="blue"> The stable lanterns had just been lit when I heard footsteps on the packed earth behind me. I turned to see a knight leaning against a fence post, arms folded, as if he had been waiting there for hours. His armour was plain and well-worn, and he wore no crest, but there was a quiet confidence about him that made me stand straighter. "Frederick, I assume," he said, pushing himself upright. "I'm Sir Roland. I was told to expect a boy who would arrive covered in dust and too proud to admit he was tired." I opened my mouth to protest, then thought better of it. "I am tired, sir," I admitted. "But I'm not too proud to say it." Roland's eyes crinkled at the corners. "Good. Honesty is the first virtue a squire learns, and the last one most men keep." He gestured toward the stable doors, where a stableboy was already leading Thunder inside. "Your horse will be cared for. You, on the other hand, will be shown to your quarters, given a meal, and then told what your duties are. Tomorrow, you'll discover how much of your pride I can knock out of you before breakfast." He started walking, and after a moment I hurried to follow, Thunder's whinny echoing behind us as the castle bells began to ring the evening hour. </nc-section>
created_at
"2026-10-08T08:33:20.438Z"
10/8/2026, 8:33:20 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1496
moderation_latency
(null)
generation_time
10589
tokens_prompt
303
tokens_completion
1001
native_tokens_prompt
437
native_tokens_completion
1575
native_tokens_completion_images
(null)
native_tokens_reasoning
182
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0008312
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448400-epOFKaoQ4qTp32QTLmGB"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448400-8XJW0b7M3m6rNatcaiLV"
upstream_id
"msg_011CfpTgzMzU4G5bHcdJgev1"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTgzMzU4G5bHcdJgev1"
is_byok
false
latency
686
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0008312
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval