NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4E0FA7C6BRPESS9MEJ9MSK7
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.3s
Cost:
$0.000659
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> I had barely swung down from Thunder's saddle when a broad-shouldered figure strode out from the stables, his boots crunching over the straw. He wore a dented breastplate polished to a dull shine, and a grey beard framed a face weathered by years of sun and battle. Behind him, a stable boy scrambled to take the reins. "You must be Frederick," the man said, his voice warm despite its gravel. "I am Sir Roland. I have been expecting you since the morning bells. Your horse has a fine temper, I see. Thunder, is it?" I nodded, suddenly aware of the dust on my travel cloak. "Yes, sir. He's been restless since the river crossing." Sir Roland laughed and clapped a heavy hand on my shoulder. "Then you two will get along well. Come, let the lad see to him. There is a bed waiting for you in the barracks, and I suspect you have not eaten since dawn." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 2)" data-color="green"> Thunder snorted and tossed his head as I dismounted, and I had to steady myself against the saddle to keep from stumbling. Before I could regain my footing, a tall knight emerged from the shadows of the stable doorway. He moved with a surprising ease for a man so armored, and his eyes, sharp and grey, took in my dusty boots and travel-worn face in a single glance. "Frederick, I presume," he said. "I am Sir Roland, and I will be overseeing your training. Do not look so alarmed. You have ridden hard, and it shows, but you have also arrived before the rain, which is more than some of my previous squires managed." I bowed as best I could with the reins still in hand. "Thank you, Sir Roland. I hope to prove worthy of the honor." "Hope is a fine place to begin," he replied, nodding toward the stable hand who was hurrying forward. "Tomorrow we will see what you are made of. Tonight, rest, and do not let that stallion of yours eat the stable boy's supper." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 3)" data-color="blue"> The clatter of hooves had barely faded when I heard a voice call out from beside the stables. An old knight leaned against a wooden post, a half-eaten apple in one hand and a whetstone in the other. His surcoat bore the faded emblem of a silver stag, and his hair was as white as the morning frost. "Ah, the new squire," he said, pushing himself upright with a groan. "Sir Roland, at your service, though I confess I am more service than knight these days. Your father wrote to me. He said you had courage enough for ten men and patience enough for none." My cheeks warmed. "He is not wrong, sir." Sir Roland chuckled and tossed the apple core toward a nearby cart. "Good. Courage I can teach you. Patience usually comes with age, and you have plenty of time for that. Now, dismount properly, let the groom take that fine beast, and come inside. The cook has been grumbling about your arrival all afternoon, and I would hate for you to face her hungry." </nc-section>
created_at
"2026-10-08T15:00:26.487Z"
10/8/2026, 3:00:26 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2443
moderation_latency
(null)
generation_time
8212
tokens_prompt
303
tokens_completion
846
native_tokens_prompt
437
native_tokens_completion
1230
native_tokens_completion_images
(null)
native_tokens_reasoning
119
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006587
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791471626-ymcv3Z38Ir3KXDboS4gS"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791471626-sM53DxtwLaQoY0nRw03a"
upstream_id
"msg_011CfpyD5iv8iHsuT8j4JkNK"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpyD5iv8iHsuT8j4JkNK"
is_byok
false
latency
838
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006587
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval