NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4E08E9WA5F4WKYYNSYH487B
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.1s
Cost:
$0.000521
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> The stable boys were already hurrying toward me when I reached the courtyard, their lanterns bobbing in the dusk. Before I could dismount, a broad-shouldered man in dented steel strode out from the stable doors. His grey beard was trimmed close, and a scar ran white across his left cheek. "You must be Frederick," he said, looking me over the way a blacksmith examines a blade. "I am Sir Roland. I have trained every squire in this castle for twenty years, and I can tell within a day which ones will last." He patted Thunder's neck, and the stallion snorted in approval. "This one, at least, has good taste in horses. Come, put him up. Then we will see whether you have good taste in anything else." </nc-section> <nc-section data-title="Chapter 1: A Stern Greeting (Version 2)" data-color="green"> A lean figure leaned against the stable doorway, arms folded across a faded tabard emblazoned with a silver hawk. He did not move to greet me. Instead, he watched as I swung down from the saddle, his dark eyes missing nothing. "Frederick, I presume," he said at last. "Sir Roland, master of arms here. The last squire who arrived on a horse that fine rode in with his nose in the clouds and was sent home within a month." He stepped forward and took Thunder's reins with surprising gentleness. "Prove me wrong. The stables first. Mucking out teaches humility faster than any sword drill, and humility is where a knight begins." </nc-section> <nc-section data-title="Chapter 1: An Unexpected Kindness (Version 3)" data-color="blue"> Sir Roland was waiting for me near the water trough, a wooden bucket in one hand and a cloth over his shoulder. He was older than I had imagined, with silver threading his dark hair and a warm, creased face that looked more suited to a farmhouse than a battlefield. "Frederick! Good, you made it before the gates closed." He set the bucket down and clasped my forearm in a firm grip. "Your journey was long, I expect. Go on and rest your legs. Thunder will be well cared for, I promise you. Every knight here starts by learning to care for his horse, and you will find that the stables hold more wisdom than you would think." He winked. "Also, the cook saves the best bread for newcomers. Do not tell the others I said so." </nc-section>
created_at
"2026-10-08T14:56:41.289Z"
10/8/2026, 2:56:41 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2492
moderation_latency
(null)
generation_time
7033
tokens_prompt
303
tokens_completion
644
native_tokens_prompt
437
native_tokens_completion
955
native_tokens_completion_images
(null)
native_tokens_reasoning
126
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0005212
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791471401-LABm0Td9ex1clFtoDnP1"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791471401-6LCmTKk8iVJrHlbd51fI"
upstream_id
"msg_011CfpxvUxBtbYMWDkwU3Yv2"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpxvUxBtbYMWDkwU3Yv2"
is_byok
false
latency
881
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0005212
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval