NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DAHXM86X1MYDXSSHDZTVFJ
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.3s
Cost:
$0.000631
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> Before I could dismount, a tall man in dented chainmail stepped out from the shadow of the stable doors. His grey beard was trimmed short, and a scar ran white across his left cheek. He did not smile. "You are late, squire," he said. "The gates close at dusk, and you arrived with the last of the light." I slid from Thunder's back and bowed as my father had taught me. "I am Frederick, sir. I came as soon as the road allowed." "Sir Roland," he replied, folding his arms. "Knight of this keep, and the man who will decide whether you are worth the bread you eat here." He studied me for a long moment, his gaze moving from my dusty boots to the sword strapped awkwardly at my hip. "Your horse is better than you are, I think. Groom him. Then we will see what you can do with a blade." </nc-section> <nc-section data-title="Version 2: The Hand of Friendship" data-color="green"> A voice called out from the stable yard. "You must be the new squire! Careful with that gate, it sticks." A broad-shouldered knight strode toward me, pulling off a leather gauntlet as he came. He had a warm, weathered face and a grin that seemed to come easily to him. Behind him, a stable boy was already leading a tired mare into her stall, whistling. "I am Sir Roland," he said, clasping my forearm firmly. "Welcome to Ashford Keep. You've ridden hard, I can see it in your face. Let the stable lads see to your stallion. He's a fine animal, and he deserves a proper rest." He nodded toward Thunder, who was snorting and shaking his mane as though he, too, were glad to be off the road. "Come, Frederick. Supper will be waiting, and I have a feeling you'll need more than one bowl after that ride." </nc-section> <nc-section data-title="Version 3: Shadows in the Stable Yard" data-color="blue"> The stable yard was quiet, lit only by a single lantern hanging from a hook beside the door. As I led Thunder toward the water trough, a figure stepped into the lantern's pale circle. He moved so quietly that I had not heard him approach. "Frederick, is it?" The knight's voice was low and measured. He wore a plain cloak over his armor, and his hood was pulled back just enough to show dark, watchful eyes. "I am Sir Roland. I was told to expect you yesterday." "I was delayed on the northern road, sir," I said. "There were riders near the river crossing." Sir Roland's gaze flicked toward the dark gate for the briefest moment before returning to me. "Riders," he repeated thoughtfully. "Then you have already seen more of this kingdom than most squires see in a year." He gave a faint, unreadable smile. "Tell me about them tomorrow. Tonight, see your horse settled. Then get some sleep. You will need it, because the king's men do not take kindly to questions asked in the dark." </nc-section>
created_at
"2026-10-08T08:37:23.307Z"
10/8/2026, 8:37:23 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1530
moderation_latency
(null)
generation_time
8143
tokens_prompt
303
tokens_completion
721
native_tokens_prompt
437
native_tokens_completion
1174
native_tokens_completion_images
(null)
native_tokens_reasoning
157
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006307
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448643-tt38zq1Gvq5Tjz8AzfEB"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448643-SDk1LMAcgJnTyBAhXtk5"
upstream_id
"msg_011CfpTztgSVcpntBPPHx8m7"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTztgSVcpntBPPHx8m7"
is_byok
false
latency
798
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006307
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval