NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DAK1RF10PEBQQ4FC8GCEC2
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
9.5s
Cost:
$0.000768
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight at the Stables (Version 1)" data-color="red"> The stable boys took Thunder's reins before I had fully dismounted, and I nearly stumbled onto the cobblestones. Recovering my balance, I looked up to find a broad-shouldered man leaning against the stable door, arms folded across his chest. His grey beard was trimmed close, and a dented shield bearing a silver stag hung on the wall behind him. "You ride like someone who has never once been told to slow down," he said, a grin tugging at his mouth. "I am Sir Roland. I trained the last three squires who came through that gate, and I have buried two sets of boots in the mud trying to keep up with them. Consider yourself warned." I straightened my tunic and bowed as my father had taught me. "I am Frederick, sir. I am honored to serve under you." "Honored, is it?" Sir Roland pushed off the doorframe and clapped a heavy hand on my shoulder. "We will see how honored you feel after a week of sunrise drills. Come. The horse is in good hands, and you look as though you could use a hot meal before you fall over." </nc-section> <nc-section data-title="Chapter 1: The Quiet Welcome (Version 2)" data-color="green"> Thunder snorted and tossed his head as a stable boy led him away, and I found myself alone in the yard with my saddlebags and a rapidly sinking feeling in my stomach. Then a voice spoke from the shadows beside the stables. "He's a fine animal. Nervous of strangers, but fine." A tall knight stepped into the fading light. He was older than I had imagined, his face lined like weathered leather, yet he moved with an easy grace that made me think of a cat on a fence. His cloak was patched at the shoulders, and the sword at his hip was plain, but well oiled. "Sir Roland," he said, offering his hand. "I keep the young ones in line around here. You are Frederick, I assume? You have the look of a boy who has been traveling for days and has not yet decided whether he is glad of it." I clasped his hand, surprised by the firmness of his grip. "I am glad to be here, sir. I think." Sir Roland's eyes crinkled. "Honesty. That will serve you better than you know. Leave your bags for now. Tomorrow you will learn what the castle expects. Tonight, you will learn where the kitchens are." </nc-section> <nc-section data-title="Chapter 1: The Challenge at the Stables (Version 3)" data-color="blue"> I had barely lifted my saddlebags from Thunder's back when I heard the clang of a practice sword striking a wooden post. I turned toward the sound and saw a man standing near the stable wall, a training blade resting easily on his shoulder. He was lean and sharp-eyed, and the scar running from his temple to his jaw told me he had seen more than a few battles. "Frederick, is it?" he called, striding toward me. "Sir Roland. Your father wrote that you were eager. I see he was not exaggerating." I hastily set down my bags and bowed. "Thank you, sir. I hope to prove worthy of the training." Sir Roland tapped the flat of his blade against his palm and studied me with open appraisal. "Hope is a fine start, but it will not hold a shield. Here is what we will do. Put your gear in the barracks, eat, and sleep. At first light, you and I will see exactly what you can do with a sword in your hand. Do not worry. I will not expect miracles, only effort." He turned back toward the yard, then glanced over his shoulder with a faint smile. "Oh, and Frederick? Do not bring that horse into my practice ring. He looked far too proud to take orders from anyone." </nc-section>
created_at
"2026-10-08T08:38:00.216Z"
10/8/2026, 8:38:00 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1670
moderation_latency
(null)
generation_time
9445
tokens_prompt
303
tokens_completion
905
native_tokens_prompt
437
native_tokens_completion
1448
native_tokens_completion_images
(null)
native_tokens_reasoning
180
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0007677
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448680-YkqiJo9ZOexp9wJfDMsc"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448680-SX2OpUEnQE8lQi2Mv8EV"
upstream_id
"msg_011CfpU3cUCe5JGqbnVX2DhH"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpU3cUCe5JGqbnVX2DhH"
is_byok
false
latency
644
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0007677
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval