NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DAB2G5M2RTKR2QXX9KX9EX
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.7s
Cost:
$0.000582
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Stables (Version 1)" data-color="red"> I had barely swung down from Thunder's saddle when a broad-shouldered man strode out from the stable doors, wiping his hands on a leather apron. His grey beard was trimmed close, and a scar ran white across his left cheek. Behind him, the stable boys scattered like startled sparrows. "You must be Frederick," he said, his voice deep and steady. "I am Sir Roland. I have been expecting you since the morning bell." I straightened my tunic, suddenly aware of the dust clinging to my boots. "Yes, sir. I come to begin my squireship." Sir Roland's gaze moved over Thunder, lingering on the stallion's flanks, and then returned to me with a faint smile. "A fine horse. Too fine to be ridden as hard as you've ridden him. We will see whether you are as careful with your own discipline as you are with his." He gestured toward the courtyard. "Come. Leave your horse with Tomas. Your real training begins now." </nc-section> <nc-section data-title="Chapter 1: The Stables (Version 2)" data-color="green"> The stable doors creaked open, and the smell of hay and leather washed over me. A tall knight stepped into the fading light, his plain brown cloak snapping at his heels. He moved with the unhurried ease of a man who had long since stopped needing to prove himself. "Frederick, is it?" he asked. "Sir Roland. I keep the stables and the lists in this castle, and I'm the one who will decide whether you are worth the bread you'll eat here." I opened my mouth to answer, but he had already turned his attention to Thunder, running a calloused hand down the stallion's neck. The horse snorted and leaned into his touch, which surprised me; Thunder rarely trusted strangers. "He likes you," I said. "He likes that I don't shout at him." Sir Roland glanced at my dusty boots and then at my face. "Shouting is for those who have nothing else to offer. Let's see what you have to offer, squire. Tomas will see to your horse. You and I will talk before the evening meal." </nc-section> <nc-section data-title="Chapter 1: The Stables (Version 3)" data-color="blue"> A figure emerged from the shadows beside the stables, lantern in one hand and a worn practice sword in the other. It was Sir Roland, the local knight whose name I had heard spoken with equal parts respect and wariness on the road. He was older than I had imagined, with iron-grey hair tied back at the nape of his neck and eyes that missed nothing. "Frederick of Ashford," he said, not as a question. "You ride like a man running from something." My cheeks warmed. "I was eager to arrive, sir." "Eagerness is a fine thing in a squire, so long as it does not outrun his good sense." He lifted the lantern, studying me in its golden light. Then he nodded toward the stable yard. "The master of the stables will tend your horse. Walk with me. I want to know what your father taught you before I decide what I must unteach." Somewhere behind the walls, a bell began to toll, marking the end of the day. </nc-section>
created_at
"2026-10-08T08:33:38.83Z"
10/8/2026, 8:33:38 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
841
moderation_latency
(null)
generation_time
7628
tokens_prompt
303
tokens_completion
773
native_tokens_prompt
437
native_tokens_completion
1076
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0005817
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448418-8RFvtRBDjMT3nmVxeGTk"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448418-D2u2GAod7cUdgpZaIzFj"
upstream_id
"msg_011CfpTiM4U7yBURiGKdww5A"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTiM4U7yBURiGKdww5A"
is_byok
false
latency
841
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0005817
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval