NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-09-01M4FZRA4JVFZ4TW63YDABPXTX
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.6s
Cost:
$0.000649
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Warm Welcome" data-color="red"> I guided Thunder through the castle gates and into the bustling courtyard, where stable hands called out to one another over the clatter of hooves and rattling carts. Before I could dismount, a broad-shouldered man in dented steel strode toward me, his cloak swirling behind him. His graying beard was trimmed close, and a white scar ran across the bridge of his nose. "You must be Frederick," he said, his voice rumbling like distant thunder. "I am Sir Roland. The master of this castle sent word that a new squire would arrive at dusk. You made good time." I slid from the saddle, my legs stiff from the long ride, and bowed as deeply as my aching back allowed. "Sir Roland. It is an honor to be here. I will work as hard as you require." He studied me for a long moment, then clapped a heavy hand on my shoulder. "Good. Hard work is the only thing this castle values more than loyalty. Come, let us see Thunder settled. Then I will show you where you will sleep, and where your training begins at first light." </nc-section> <nc-section data-title="Chapter 1: The Knight of the Stables" data-color="green"> Thunder snorted and tossed his head as I led him through the wide archway of the stables. The air inside smelled of hay, leather, and oil. A figure emerged from the shadows of an empty stall, wiping his hands on a rag. It was a tall knight with silver-streaked hair tied back at the nape of his neck, and a sword belted at his hip that had seen many battles. "Easy, boy," the knight said, reaching out to stroke Thunder's neck before I could stop him. The horse calmed at once. "I am Sir Roland, and I keep watch over this stable as much as I keep watch over the men who ride from it. You are the new squire?" "I am, sir," I replied, straightening my tunic. "Frederick, of the northern hills." Sir Roland's gaze moved over me, weighing my posture, my hands, my boots. "The northern hills breed stubborn people and fine horses. I hope you are both. Unhitch your saddle and I will show you how we care for mounts here. A squire who neglects his horse will never be trusted with a knight's." He handed me a brush, and I got to work, feeling his eyes on me the whole time. </nc-section> <nc-section data-title="Chapter 1: Steel and Welcome" data-color="blue"> The stable doors groaned open, and out strode a knight whose armor gleamed despite the dusk, every plate polished to a soft silver shine. He carried a practice helm under one arm and grinned as though he had been waiting all day for someone new to arrive. "Frederick! Sir Roland, at your service," he announced, sweeping a short bow that nearly knocked the helm from his arm. His hair was dark and unruly, and a thin scar cut through one eyebrow, giving him a perpetually amused look. "Don't let the fancy armor fool you. I only polish it when the lord's steward is watching." I laughed despite my weariness and dismounted, handing Thunder's reins to a nearby stable boy. "It is good to meet you, Sir Roland. I was told the castle keeps its knights to a high standard." "Standards are for the knights who have nothing better to do," he said, clapping me on the back so hard I stumbled. "You will learn quickly that the real work happens in the yard, in the mud, and over a bad supper. Come on. Thunder has a stall waiting, and I want to see whether you can handle a sword as well as you handle a horse." </nc-section>
created_at
"2026-10-09T09:26:21.592Z"
10/9/2026, 9:26:21 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
8619
moderation_latency
(null)
generation_time
8619
tokens_prompt
303
tokens_completion
874
native_tokens_prompt
437
native_tokens_completion
1211
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006492
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791537981-IJXRxqpGLhRsn4ChsYfZ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791537981-COFeYqo5DGr0iJS6gaSu"
upstream_id
"msg_011CfrRYQ9zjFJc3xLzxJQdp"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfrRYQ9zjFJc3xLzxJQdp"
is_byok
false
latency
767
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006492
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval