NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4G00YR08BSXWCDWEA0QB82D
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.1s
Cost:
$0.000615
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight at the Stables" data-color="red"> Thunder had barely slowed to a walk before a broad-shouldered figure stepped out from the stable doorway. He wore dented plate armor polished at the edges, and a grey beard framed a face weathered by years of sun and sparring. He raised a hand in greeting, and the lines around his eyes deepened into a grin. "You must be the new squire," he called. "Frederick, if the message I received was correct. I am Sir Roland. Dismount, lad, before that beast decides to drag you back out the gate." I slid from the saddle, my legs unsteady after the long ride. Sir Roland clapped a heavy hand on my shoulder, nearly knocking me sideways. "Good. Strong shoulders. You'll need them. The stable boys will take Thunder. Come, there's a great deal you need to learn before supper, and I suspect you're hungry enough to eat the banners." </nc-section> <nc-section data-title="Chapter 1: The Measure of a Squire" data-color="green"> Sir Roland was leaning against the stable post, arms folded, watching me with the quiet scrutiny of a man who had judged a thousand horses and a thousand boys. He did not move as I approached. Instead, he tilted his head toward Thunder, who snorted and tossed his mane. "Fine animal," he said at last. "Yours?" "My father's, sir. He gave him to me when I was accepted." "Hm. Then he will expect you to care for him better than you cared for your own boots on the road." Roland pushed off the post and strode toward the stalls, gesturing for me to follow. "Here, a squire's first lesson. A knight is only as good as the creatures and tools he keeps. Brush him down, check his hooves, and then come find me. I'll show you the armory once you've proven you can tell a sound hoof from a cracked one." I felt the weight of his gaze on my back as I led Thunder into the straw-scented dark, determined not to disappoint him. </nc-section> <nc-section data-title="Chapter 1: Words by the Stables" data-color="blue"> The evening air smelled of hay and woodsmoke. As I stood uncertainly beside the stable doors, a tall knight emerged from the shadows, his surcoat bearing a faded silver hawk. He studied me for a long moment before his expression softened into something almost kind. "Sir Roland," he said, extending his hand. "I have trained every squire this castle has seen in the last twenty years, and I can tell you one thing already, Frederick. You rode in here like a man who has never once looked back. That is either the bravest thing or the most foolish, and the castle will decide which." I gripped his hand and felt the calluses of a lifetime of swordwork. "I hope to earn my place, sir." "Hope is a fine start," Roland replied, releasing me. "But hope does not polish armor or muck out stables. Come. Let us see if you can do both before the bells ring." </nc-section>
created_at
"2026-10-09T09:31:04.839Z"
10/9/2026, 9:31:04 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2447
moderation_latency
(null)
generation_time
8069
tokens_prompt
303
tokens_completion
810
native_tokens_prompt
437
native_tokens_completion
1142
native_tokens_completion_images
(null)
native_tokens_reasoning
131
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006147
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791538264-oiMhl0xj676WuoKoIDTX"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791538264-zcn8qLNaFJvFp6QEIgwv"
upstream_id
"msg_011CfrRuH4hHMzHhuvkXPakm"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrRuH4hHMzHhuvkXPakm"
is_byok
false
latency
715
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006147
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval