NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DYPTH3YY2XF9ASPMB5MS57
Run Details
Model:
Claude Haiku 5.5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
6.0s
Cost:
$0.000454
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 1)" data-color="red"> The stable boy had barely taken Thunder's reins before a broad-shouldered figure strode out from the shadow of the barn. He wore dented plate armor that had clearly seen many seasons, and a grey beard framed a face weathered by sun and battle. "You must be Frederick," he said, his voice rumbling like distant thunder. "I am Sir Roland. You rode in faster than I expected, lad. Either you are eager, or you are fleeing something." He grinned, clapped me hard on the shoulder, and nodded toward the training yard. "Either way, you will find no rest here until you have earned it." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 2)" data-color="green"> Near the stables, a tall knight was brushing down a chestnut mare with slow, patient strokes. He turned as I dismounted, and I saw that his armor was plain and well kept, its surface polished to a soft gleam. "Frederick, I presume," he said with a gentle smile. "I am Sir Roland, and I will be your first teacher. Your father's letter spoke highly of your courage, though it said little of your patience." He offered his hand. "Put Thunder in the third stall, then come and find me. We have much to discuss before the bell sounds for supper." </nc-section> <nc-section data-title="Chapter 1: Sir Roland's Welcome (Version 3)" data-color="blue"> I had hardly swung down from the saddle when a voice called out from beside the stables. "Ah, the new squire at last!" Sir Roland stood with arms folded, a scarred knight whose eyes missed nothing. He studied me from boots to brow, then gave a short, approving nod. "Your horse is blown and so are you, by the look of it. Rest a moment. Tomorrow you will learn that a squire's first duty is to his mount, and his second is to keep his mouth shut and his ears open. Let us see which of those you already know." </nc-section>
created_at
"2026-10-08T14:29:35.408Z"
10/8/2026, 2:29:35 PM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2407
moderation_latency
(null)
generation_time
5943
tokens_prompt
303
tokens_completion
565
native_tokens_prompt
437
native_tokens_completion
820
native_tokens_completion_images
(null)
native_tokens_reasoning
122
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0004537
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791469775-px3gXFlEO01OMgIVbl7R"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791469775-yhA97k5lDcOX2WzGdjP3"
upstream_id
"msg_011CfpvrdXnBo7AEbNd5cEHf"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpvrdXnBo7AEbNd5cEHf"
is_byok
false
latency
798
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0004537
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval