NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4D9ZS4A41MKZV1E2JR79BF4
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
6.7s
Cost:
$0.000541
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> Frederick dismounted before Thunder had fully stopped, his boots striking the cobblestones with a jolt that rattled his teeth. Near the stables, a broad-shouldered man in dented plate stood with his arms folded, watching the young squire with the patience of a hawk. His grey beard was trimmed close, and a long scar ran from his left temple to his jaw. "You're late," the knight said, not unkindly. "The gate bell rang an hour ago. I am Sir Roland, and until the master-at-arms decides otherwise, you are mine to train." He nodded toward the stalls. "Brush down that stallion first. A good knight's horse is cared for before he is. Then we'll see what you're made of." </nc-section> <nc-section data-title="Version 2: The Knight in the Straw" data-color="green"> A sudden clatter came from the stables, followed by a burst of laughter. Frederick looked up to see a tall man in a leather apron emerge, wiping his hands on a rag. Only when he came closer did Frederick recognize the faded crest on the man's tabard and the easy grin beneath his silver-streaked hair. "Sir Roland, at your service," the knight said, offering a calloused hand. "Don't let the straw fool you. I was mucking out Gareth's stall because he bet me I couldn't do it without complaint, and I've already lost that wager." He clapped Frederick on the shoulder and steered him toward the water trough. "Now, you've ridden a long way. Let's get that dust off you, and then I'll tell you everything you need to know about surviving your first month here." </nc-section> <nc-section data-title="Version 3: The Weight of a Name" data-color="blue"> The stable doors creaked open, and a figure stepped into the fading light. Sir Roland was older than Frederick had imagined from the stories told in his village, his shoulders bent slightly beneath a worn cloak, yet his eyes were sharp and unhurried as they swept over the young squire and the sweat-darkened stallion. "Frederick of Ashford," he said quietly, as though testing the name. "Your letter spoke of courage. Courage is common in a boy your age. What is rare is the restraint to stay humble once it has been tested." He gestured toward the stalls. "Thunder is a fine horse, but he is not yours yet. Tend him, and then join me by the well. There is a matter of your oath I wish to discuss before the sun is gone." </nc-section>
created_at
"2026-10-08T08:27:28.785Z"
10/8/2026, 8:27:28 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1481
moderation_latency
(null)
generation_time
6650
tokens_prompt
303
tokens_completion
611
native_tokens_prompt
437
native_tokens_completion
995
native_tokens_completion_images
(null)
native_tokens_reasoning
147
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0005412
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448048-M79Bu6ASMjM88EmSGSvi"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448048-A77fp4hN1q2YuPqqicoO"
upstream_id
"msg_011CfpTF4kh78Eq2j64Ex25e"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTF4kh78Eq2j64Ex25e"
is_byok
false
latency
723
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0005412
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval