NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4G0WM5HB9B1TC6NQ53HQ3RX
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.3s
Cost:
$0.000688
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Welcome at the Stables" data-color="red"> I had barely dismounted when a broad-shouldered man stepped out from the shadow of the stable doors, wiping his gloved hands on a rag. His grey beard was trimmed close, and a scar ran white across his left cheek. Behind him, a stable boy scrambled to take Thunder's reins, and the great stallion snorted, tossing his head as if he approved of the new hands. "You must be Frederick," the man said, his voice rough but not unkind. "I am Sir Roland. I have trained every squire in this castle for twenty years, and I can tell you in one glance that you have ridden hard to get here. Did the road from the north treat you poorly?" I straightened my shoulders and bowed as my father had taught me. "It did, Sir Roland. But I am glad to be here." He studied me for a long moment, his eyes sharp beneath heavy brows. "Good. Gladness is a start. Pride will get you a bruise, but gladness will get you through the first winter. Come, leave your saddlebags with the boy. Your training begins at dawn, and I would have you see the armory before the lamps are lit." </nc-section> <nc-section data-title="Chapter 1: The Hard Judgment" data-color="green"> Sir Roland did not smile as he approached. He walked a slow circle around me, the way a farmer inspects a horse at market, his boots crunching on the gravel. Finally he stopped before me and tapped my chest with two fingers. "Frederick, son of Alric. Your letter spoke of courage. It did not mention that you ride like a sack of grain." His mouth twitched, though his eyes stayed serious. "I jest, lad. Thunder carried you well, and I can see he trusts you. A horse knows its rider's heart. Now, the stables are your first lesson. Every squire in this castle begins by mucking stalls, grooming mounts, and learning that a knight who will not care for his own steed is no knight at all." I glanced toward the stable boy, who was already leading Thunder away with a gentleness that surprised me. "I understand, sir." "We shall see whether you understand or merely obey," Sir Roland replied. "Understanding comes later, when you are tired, cold, and wondering why you ever left home. Come. Supper is in the great hall, and you will meet the others who have survived my training before you." </nc-section> <nc-section data-title="Chapter 1: The Knight's Secret" data-color="blue"> When I reached the stables, Sir Roland was already waiting, leaning against a post with his arms folded. He did not greet me with words at first. Instead, his gaze drifted past my shoulder toward the distant mountains, where the last light of the sun clung to the snowy peaks. "Do you see those peaks, Frederick?" he asked quietly. "Beyond them lies the old dragon road. No one has traveled it in eighty years, and no one speaks of what waits there." I felt a shiver run down my spine. "Dragons are only tales, sir." "So said my own master, once." Roland finally turned to face me, and in the fading light his expression seemed heavier than before. "Welcome to the castle. You will learn the sword, the shield, and the lance. But there are other lessons here, older ones, and you will be asked to carry them one day. For now, rest. Tomorrow, I will show you what they mean." </nc-section>
created_at
"2026-10-09T09:46:11.513Z"
10/9/2026, 9:46:11 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3433
moderation_latency
(null)
generation_time
8313
tokens_prompt
303
tokens_completion
923
native_tokens_prompt
437
native_tokens_completion
1289
native_tokens_completion_images
(null)
native_tokens_reasoning
147
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006882
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791539171-6hah3aWFt0W03t6RvWwa"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791539171-mmsqcJX7F8GlPW7gjPAo"
upstream_id
"msg_011CfrT47V6c8EQnSJggDr4x"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrT47V6c8EQnSJggDr4x"
is_byok
false
latency
769
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006882
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval