NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FZ6FBQNM9DJWA2S8GMFRDR
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.0s
Cost:
$0.000625
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland (Version 1)" data-color="red"> I reined Thunder in near the stables, where the air smelled of hay and leather. Before I could dismount, a tall man in dented chainmail strode out from the stable doors, his cloak swept back over one shoulder. His grey beard was trimmed close, and a long scar ran from his temple to his jaw. "You must be the new squire," he said, his voice deep and steady. "I am Sir Roland. I have trained every squire in this keep for twenty years, and most of them survived the first month." I swallowed and slid from the saddle, my legs unsteady after the long ride. "I am Frederick, sir. I am ready to learn." Sir Roland studied me for a long moment, then gave a short nod. "Good. Eagerness is a fine start. Discipline is what will keep you alive. Put your horse in the third stall, rub him down, and then we will see what you are made of." </nc-section> <nc-section data-title="Chapter 1: Sir Roland (Version 2)" data-color="green"> Thunder snorted and tossed his head as we approached the stables, sensing the unfamiliar scents of the keep. A figure stepped from the shadows of the stable doorway, and I felt my pulse quicken. He was an older knight with silver threading through his dark hair, a faded green surcoat over his armor, and a warm, crooked smile. "Easy, lad, he won't bite. Not yet, anyway," the knight said, reaching up to steady Thunder's bridle with practiced ease. "I'm Sir Roland. I've been keeping this stable and the squires who serve in it in order for longer than I care to admit." "Frederick, sir," I replied, climbing down with more grace than I felt. "I'm honored to be here." "Honor is cheap in a castle. Hard work is what earns respect." He patted Thunder's neck, and the stallion calmed beneath his hand. "Your horse has good bones. Let's get him fed, and then you can tell me why a boy your age would ride all this way to take orders from an old man like me." </nc-section> <nc-section data-title="Chapter 1: Sir Roland (Version 3)" data-color="blue"> The stable yard was quieter than I expected. Only the clink of a bucket and the soft nickering of horses broke the evening hush. As I dismounted, a broad-shouldered knight emerged from the stables, wiping his hands on a rag. He wore plain armor, its edges worn smooth by years of use, and he regarded me with sharp, appraising eyes. "Sir Roland," he said, offering a hand. His grip was firm and calloused. "Captain of the household guard, and until the lord says otherwise, your master in all things. You're late." "I'm sorry, sir. The road from the village was longer than I had thought." "Roads are always longer than you think." He glanced at Thunder, then back at me, and something in his expression softened just slightly. "Stable your horse, then come find me by the armory. The first lesson of a squire is that a knight's horse is always cared for before his own belly is filled. Remember that, and we'll get along." </nc-section>
created_at
"2026-10-09T09:16:37.118Z"
10/9/2026, 9:16:37 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2556
moderation_latency
(null)
generation_time
7979
tokens_prompt
303
tokens_completion
809
native_tokens_prompt
437
native_tokens_completion
1163
native_tokens_completion_images
(null)
native_tokens_reasoning
103
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006252
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791537397-e3hMBEczvgYkMoWVrsXs"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791537397-6S7QohVq7B2o1UlQ3SkT"
upstream_id
"msg_011CfrQoKEdH2BzjAF7ZJPnT"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrQoKEdH2BzjAF7ZJPnT"
is_byok
false
latency
744
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006252
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval