NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FZCC6J3Q5BHEFQ03RJV49Y
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
9.5s
Cost:
$0.000713
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> I had barely swung down from Thunder's saddle when a broad-shouldered man strode out of the stables, wiping his hands on a leather apron. His grey beard was cropped close, and a thin scar ran from his left ear to the corner of his mouth. He studied me for a long moment, his eyes lingering on my dusty boots and the travel-worn cloak on my shoulders. "You must be the new squire," he said, his voice rough as gravel. "Frederick, is it? I am Sir Roland. I hold this keep and every stable boy, horse, and fool who wanders into it." He clapped a hand on Thunder's neck, and the stallion snorted approvingly. "Good animal. Someone has taken care of him on the road. That is more than I can say for most who come through here with fine horses and empty heads." I straightened my back and met his gaze. "I did my best to see him fed and rested, sir." Sir Roland grunted, which I took to be the closest thing to praise I would receive that evening. "Good. Stable him, then report to the armory before the bell. Training begins at dawn, and I do not tolerate tardiness. Here, you will learn to earn your keep, or you will learn to leave." </nc-section> <nc-section data-title="Chapter 1: A Stranger in the Yard (Version 2)" data-color="green"> Near the stables, a cluster of horses shifted and whinnied at the scent of new arrivals. Between them stood a tall knight in weathered plate armor, the metal dulled by years of use rather than neglect. He was watching me with an expression that was not unkind, only measuring. "Frederick of the western marches," he said, and it was not a question. "I received the letter from your mother's cousin. Sir Roland. I will be your first instructor, so you may as well learn my face now." He stepped closer and offered his hand. His grip was firm, and I noticed the calluses across his palm, the kind earned from years of swordplay rather than reins. "Thunder, is it?" His eyes moved to the stallion, and a faint smile touched his lips. "A fine name for a fine beast. You will need to groom him yourself each evening. A squire who cannot care for his own mount will never be trusted with a knight's. Tonight, rest. Tomorrow, we begin, and I warn you now, I expect more than a polite nod from you." </nc-section> <nc-section data-title="Chapter 1: The Knight by the Stables (Version 3)" data-color="blue"> The stable doors creaked open, and a figure emerged into the lantern light. It was Sir Roland, the local knight whose name had been spoken with respect in every village I had passed. He was not what I expected. He wore no polished plate, only a simple tunic and a sword belt, and he carried a bucket of water as though it were the most ordinary thing in the world. "Ah. The boy from the western road," he said, setting the bucket down with a soft thud. "You rode in just as the light failed. Good timing, or poor, depending on how you feel about cold beds and colder porridge." He approached Thunder, running a careful hand along the stallion's flank and checking each hoof with practiced ease. "He is sound. You rode him hard, but not cruelly. I can tell that much from the way he carries himself." Sir Roland turned back to me, and for the first time his expression softened. "Your training will be harder than anything you have faced on the road, Frederick. But I have a feeling you will not run from it. Come. Let us see you settled before the night grows any colder." </nc-section>
created_at
"2026-10-09T09:19:50.49Z"
10/9/2026, 9:19:50 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2392
moderation_latency
(null)
generation_time
9509
tokens_prompt
303
tokens_completion
946
native_tokens_prompt
437
native_tokens_completion
1339
native_tokens_completion_images
(null)
native_tokens_reasoning
136
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0007132
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791537590-LqLubqLQP2TXguEbUHgD"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791537590-MKnStHjoJKy6gqlbUV2I"
upstream_id
"msg_011CfrR3ZrbJorkQRGf8h6Zf"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrR3ZrbJorkQRGf8h6Zf"
is_byok
false
latency
703
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0007132
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval