NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA31C5J04G7P2VGZDSA4TF
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.7s
Cost:
$0.000617
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Stern Welcome" data-color="red"> I had barely swung down from Thunder's saddle when a broad-shouldered man strode out from the stable doors, wiping his hands on a leather apron. His beard was grey at the chin, and a long scar ran from his left ear to the corner of his mouth. "You must be the new squire," he said, looking me over from boots to bridle. "Frederick, is it? I am Sir Roland. I trained half the knights in this kingdom, and I expect you to be better than the last one who rode through those gates." I straightened my shoulders and offered a bow. "I'll do my best, Sir." "Your best." He snorted and took Thunder's reins from my hand, running an appraising palm along the stallion's neck. "A fine beast, but he has been ridden hard. Training starts at dawn. Until then, you will muck out every stall in this stable. Do you understand?" I glanced at the long row of stalls and swallowed. "Yes, Sir Roland." </nc-section> <nc-section data-title="Chapter 1: The Friendly Knight" data-color="green"> The stable doors swung open, and a warm laugh rang out across the courtyard. A tall knight with sun-browned skin and a crooked smile jogged toward me, his armor clanking with every step. "Ah, you made it before the supper bell! Sir Roland's been pacing since noon, pretending he wasn't waiting for you." He clapped a hand on my shoulder and grinned. "I am Roland, and I'm glad to meet you, Frederick. Come, let's get Thunder settled. He looks like he's carried you a long way." He led the stallion gently toward a clean stall, murmuring softly to the horse as though they were old friends. I watched in surprise as Thunder's ears relaxed and his restless snorting faded to a calm breath. "You have a gift with horses," Roland said, glancing back at me. "That's a good start. The rest of the castle will be easier to learn, I promise you." </nc-section> <nc-section data-title="Chapter 1: The Knight's Measure" data-color="blue"> A figure stepped out of the shadows beside the stables, so still that I had not noticed him at all. He was a knight in dented steel, his cloak faded from crimson to rust, and he regarded me with eyes as grey and unreadable as a winter sky. "Frederick," he said. It was not a question. "I am Sir Roland. The king sent word that you would arrive at sundown. You are later than I expected." "I was delayed by the road, Sir," I replied, keeping my voice steady. Roland studied me for a long moment. Then he nodded once, almost imperceptibly. "Roads delay everyone. What matters is what a man does once he arrives. Leave your saddlebags in the tack room, then meet me in the training yard. I want to see how you handle a blade before supper." He turned away without another word, and I realized I had been holding my breath. </nc-section>
created_at
"2026-10-08T08:29:15.535Z"
10/8/2026, 8:29:15 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1480
moderation_latency
(null)
generation_time
7682
tokens_prompt
303
tokens_completion
713
native_tokens_prompt
437
native_tokens_completion
1146
native_tokens_completion_images
(null)
native_tokens_reasoning
145
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0006167
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448155-L0PkdjM63jTiuf2Wauc5"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448155-VwCQ1sAeA4kwzzG7o0C6"
upstream_id
"msg_011CfpTNwB16hBgTGnqfMgyE"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTNwB16hBgTGnqfMgyE"
is_byok
false
latency
746
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0006167
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval