NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4D9W8MGJH0Q6N5W0YQTKPHZ
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
6.5s
Cost:
$0.000515
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> I guided Thunder through the gates and into the bustling courtyard, where the clatter of hooves and the smell of hay filled the air. Before I could dismount, a broad-shouldered knight strode toward me from the stables, his plate armor dulled by years of hard use. His grey beard was trimmed close, and his eyes were sharp beneath heavy brows. "You must be Frederick," he said, offering a gauntleted hand. "I am Sir Roland. I trained half the squires in this keep, and I expect the same effort from you that I demanded from them. Give your horse to the stable boy and come with me. There is much to learn before the sun rises tomorrow." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 2)" data-color="green"> As I swung down from Thunder's saddle, my legs nearly buckled from the long ride. A tall knight was leaning against the stable doorframe, a half-eaten apple in one hand. He straightened with an easy grin and tossed the core into a nearby bucket. "Frederick, I presume? Sir Roland, at your service, though you'll find I'm less formal than most of the lords here," he said, clapping me on the shoulder hard enough to rattle my teeth. "Your horse looks like he's run half the realm. Let the grooms tend to him. Walk with me, and I'll show you where you'll be sleeping. Trust me, the cot is more comfortable than it looks." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 3)" data-color="blue"> Thunder snorted and tossed his head as I brought him to a halt beside the stables. Before I could find my footing on the cobblestones, a figure emerged from the shadows of the stable doors. It was a knight in worn leather and chainmail, his face lined with old scars, his hand resting on the pommel of a sword that had clearly seen many battles. "Easy, lad. He's not the only one who has traveled far today," the knight said, his voice low and steady. "I am Sir Roland. The king's letter named you as my new squire. I have served this castle for thirty years, and I have buried more friends than I care to count. So I will not waste your time or mine. Stable your horse, then meet me by the training yard. We begin with the truth about what it means to wear a knight's spurs." </nc-section>
created_at
"2026-10-08T08:25:33.793Z"
10/8/2026, 8:25:33 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2506
moderation_latency
(null)
generation_time
6254
tokens_prompt
303
tokens_completion
664
native_tokens_prompt
437
native_tokens_completion
942
native_tokens_completion_images
(null)
native_tokens_reasoning
110
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0005147
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791447933-nHewa1KjqxVKeRk9JqGW"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791447933-fhRPZi5Gx4j3hD2tBH84"
upstream_id
"msg_011CfpT6bRR3FPRWiGDoqqJW"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpT6bRR3FPRWiGDoqqJW"
is_byok
false
latency
849
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0005147
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval