NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA104DTPAF23EAW472FRFX
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.7s
Cost:
$0.000722
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Warm Welcome" data-color="red"> I had barely swung down from Thunder's saddle when a broad-shouldered man in weathered chainmail strode out from the stables, wiping his hands on a rag. His grey beard was trimmed close, and a long scar ran from his left ear to his jaw. He looked me up and down with a critical eye, then broke into a grin. "You must be the new squire. Frederick, is it?" He clapped me on the shoulder hard enough to rock me forward. "I'm Sir Roland. I'll be overseeing your training, so you'd better get used to my face. Your horse looks like he's run half the kingdom to get here. Stable boy! Give this stallion a good rubdown and a bucket of oats." A lanky boy scrambled forward and took Thunder's reins. Sir Roland turned back to me, his voice lowering. "The journey was long, I expect. Tomorrow you'll wish it had been longer, because the real work starts at dawn. But tonight, you'll eat, and you'll sleep. That's an order." </nc-section> <nc-section data-title="Chapter 1: The Stable Master's Test" data-color="green"> Sir Roland was waiting for me beside the stable doors, leaning casually against the post with his arms folded. He did not look like a man who had come to welcome anyone. His eyes were sharp and gray, and they moved from my dusty boots to the travel pack on my shoulder before settling on my face. "Frederick of Ashford," he said. "Your letter said you could ride. Let's see if it was true." Before I could answer, he nodded toward Thunder, who was snorting and stamping in the courtyard. "That horse has a temper. Most of the lads would have it cleaned and stalled by now. Show me you can handle him without losing your nerve." I took a breath, stepped forward, and reached for the reins. Thunder tossed his head, but I spoke softly to him, the way my father had taught me, and after a moment he quieted. Sir Roland watched in silence, then gave a short, approving grunt. "Good. Patience is worth more than courage here, boy. Remember that." He pushed away from the post. "Now, come inside. The cook will have something hot for you, and then you'll meet the others." </nc-section> <nc-section data-title="Chapter 1: The Knight Beside the Stables" data-color="blue"> The stables smelled of hay and leather, and as I led Thunder toward them, a figure detached itself from the shadows of the doorway. He was tall and lean, dressed in a plain tunic and a faded cloak, but there was no mistaking the bearing of a knight. A silver emblem gleamed on his chest. "Frederick?" he asked, his voice warm and steady. "I am Sir Roland. I was told to expect you at sunset, and I see the road has not been kind to you." I bowed quickly, suddenly aware of the dust caking my clothes. "Sir Roland, I'm honored to be here." He smiled, a few lines crinkling at the corners of his eyes. "Honor will come later, once you have earned it. For now, let us see to your horse. He has carried you a long way, and he deserves better than to stand in the yard while we talk." He reached out and rested a hand on Thunder's neck. The stallion, who had been restless all afternoon, let out a long breath and lowered his head, as if he had known this man his whole life. "You have a good companion there," Sir Roland said quietly. "Take care of him, and he will take care of you." </nc-section>
created_at
"2026-10-08T08:28:08.726Z"
10/8/2026, 8:28:08 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
8644
moderation_latency
(null)
generation_time
8644
tokens_prompt
303
tokens_completion
845
native_tokens_prompt
437
native_tokens_completion
1357
native_tokens_completion_images
(null)
native_tokens_reasoning
169
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0007222
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448088-XKyO0Yfbhk7ZGYmmrOwp"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448088-dlajR4LS5ViCcay0YSLM"
upstream_id
"msg_011CfpTJ1SbQLVNPQuSTymYo"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTJ1SbQLVNPQuSTymYo"
is_byok
false
latency
758
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0007222
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval