NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA1DVENFRNY1YKYEJKNY3K
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.3s
Cost:
$0.000550
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Welcome at the Stables" data-color="red"> I had barely drawn Thunder to a halt before the stable boy rushed forward to take the reins. Before I could dismount, a tall figure stepped out from the shadow of the timber archway. He wore a dented breastplate polished at the edges, and a grey cloak hung from his shoulders. His beard was streaked with silver, but his stride was as firm as any young man's. "You must be Frederick," he said, his voice warm and carrying. "I am Sir Roland. I have been expecting you since the bells rang at noon." I swung down from the saddle, my legs stiff from the long ride, and bowed as my father had taught me. "Sir Roland. It is an honor to be taken in by your household." He laughed, a deep sound that startled a nearby pigeon into flight. "Honor is a fine word, lad, but let us see whether you still think so after a month of my drills. Come, leave your horse to Tobin here. He is the best groom in the kingdom, though he will swear otherwise." </nc-section> <nc-section data-title="Chapter 1: The Knight's Measure" data-color="green"> Sir Roland's eyes travelled over me slowly, from my dusty boots to the travel-worn satchel on my shoulder, and I felt suddenly aware of every patch and mended seam in my clothing. He said nothing for a long moment, then nodded once, as though he had reached a private verdict. "Your father wrote to me that you can ride better than any boy in your village," he said. "He did not mention whether you can listen." "I can listen, sir," I replied, though my voice came out smaller than I intended. "We shall see." He gestured toward the stables, where the scent of hay and leather drifted into the evening air. "Tobin will tend your stallion. Then you will eat, sleep, and at first light you will meet the others. Do not be late. Lateness is the one sin I do not forgive." </nc-section> <nc-section data-title="Chapter 1: Steel and Silence" data-color="blue"> A figure emerged from the stables just as Thunder snorted and tossed his head. It was Sir Roland, a knight of middle years with close-cropped hair and a face weathered by sun and sword. He carried a worn leather gauntlet in one hand and wore no ornament of rank, only a plain tunic belted at the waist. "Easy, old friend," he murmured, and to my surprise the great stallion quieted at once beneath his touch. Then the knight turned his gaze to me. "Frederick, I presume. You rode in hard and fast. Good. Speed is useful. But a squire who arrives at dusk with a lathered horse has learned nothing about patience." He offered his hand, and I took it. His grip was firm, calloused, and brief. "Welcome to Ashford Keep. Put your things in the loft above the tack room. Tomorrow, you will learn what a squire's duty truly means, and I promise it will not be what the songs tell you." </nc-section>
created_at
"2026-10-08T08:28:22.774Z"
10/8/2026, 8:28:22 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
7232
moderation_latency
(null)
generation_time
7232
tokens_prompt
303
tokens_completion
723
native_tokens_prompt
437
native_tokens_completion
1012
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0005497
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448102-8QtAKShsflsNmEs0MAfs"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448102-4lb2q1d4dixIe1nGINZC"
upstream_id
"msg_011CfpTK3SvHhirjQSZsVLQv"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTK3SvHhirjQSZsVLQv"
is_byok
false
latency
690
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0005497
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval