NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-29-01M3P2H31AED5G4DKWF8AB7ZM0
Run Details
Model:
Claude Sonnet 5.5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.9s
Cost:
$0.017474
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Knight's Measure" data-color="red"> The stable yard smelled of hay and horse sweat, and after the long ride I found the smell more welcome than any feast. I slid from Thunder's back, my legs unsteady beneath me, and had barely found my footing when a shadow fell across the cobblestones. "You ride hard, boy. Your horse is lathered to the fetlocks." The man who spoke was broad as a barn door, his gray-shot beard braided in the northern fashion. A scar ran from his left temple to his jaw, pale against weathered skin. He wore no armor, only a plain leather jerkin, but he carried himself the way a sword carries itself in its sheath, quiet and certain. "Sir Roland?" I asked, my voice cracking on the second word. "The very same." His eyes moved over me, then over Thunder, then back to me. "You'll be Frederick. Your letter said you were eager. It did not say you were reckless." Heat rose in my cheeks. "I wanted to arrive before dark, sir." "Wanting is a fine thing." He took Thunder's bridle and ran a calloused hand down the stallion's trembling neck. "But a knight who ruins his horse to keep an appointment arrives on foot to his next one. Walk him until he cools. Then we'll see what else you have to learn." He turned and strode away, and only then did I realize I had been holding my breath. Whatever training awaited me, it had already begun. </nc-section> <nc-section data-title="Version 2: The Man with the Apple" data-color="green"> I had expected many things of the castle stables: shouting grooms, clanging farriers, perhaps a snorting warhorse or two. I had not expected to find a grown knight sitting on an overturned bucket, humming off-key and feeding an apple to a swaybacked mule. "Ah!" He brightened when he saw me and stood, brushing straw from his knees. "You must be the new squire. Frederick, is it? I'm Sir Roland. Don't look so alarmed, I'm not always found in such distinguished company." He nodded at the mule. "This is Bishop. He has opinions about everything and respects nothing." Bishop flicked an ear at me as though to confirm it. "I'm honored, Sir Roland," I said, remembering my lessons and attempting a bow while still holding Thunder's reins. The stallion chose that moment to shove his nose into my back, and I stumbled forward. Sir Roland caught me by the elbow, laughing warmly. "Good. You've already learned the first rule of knighthood." "What is that, sir?" "That the horse is always in charge." He winked and took Thunder's bridle. "Come. Let's get this fine fellow settled, and then I'll show you where the kitchen keeps its best pies. A squire who trains on an empty stomach is a squire who trains badly." For the first time since leaving home, my shoulders loosened. Perhaps this place would not be so frightening after all. </nc-section> <nc-section data-title="Version 3: Whispers at Dusk" data-color="blue"> The last light bled from the sky as I led Thunder into the stable yard, and the torches along the wall were only just being lit. Their flames threw long, restless shadows across the stones. Somewhere a door creaked, and I felt, absurdly, that I was being watched. "You're late." The voice came from the darkness beside the stalls. My hand went to the small dagger at my belt before I could think better of it. A tall figure stepped into the torchlight, gray-cloaked, his face lined and grave. The silver hawk stitched upon his shoulder marked him as a knight of the realm. "Sir Roland?" I said. "Put the blade away, lad. If I wished you harm, you would not have seen me at all." There was no cruelty in it, only weary honesty. He glanced past me at the gate, then at the darkening hills beyond. "Did anyone follow you on the road?" "Follow me? No, sir. I saw no one." "Hm." He was silent a moment, listening to something I could not hear. "Perhaps not. Yet the old ones say the mountains have been restless of late. Strange lights. Livestock gone missing." He looked at me again, and his expression softened by a degree. "Forgive me. You've come a long way to be greeted with riddles. Welcome to the castle, Frederick. Stable your horse, eat, and sleep well. Tomorrow I will tell you why I asked for you by name." He vanished into the dark as quietly as he had come, leaving me with more questions than I had brought along the road. </nc-section>
created_at
"2026-09-29T07:54:35.443Z"
9/29/2026, 7:54:35 AM
model
"anthropic/claude-sonnet-5.5-20260928"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3826
moderation_latency
(null)
generation_time
17894
tokens_prompt
303
tokens_completion
1155
native_tokens_prompt
437
native_tokens_completion
1660
native_tokens_completion_images
(null)
native_tokens_reasoning
113
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.017474
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790668475-yYQPudDJFfNuQU2SzHmm"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790668475-TjZPFEPWZDXMdm9NzfOy"
upstream_id
"msg_011CfXNTMfckcyGpm8WGiHns"
provider_responses
0
endpoint_id
"99aaad94-923b-4fc1-b763-271ed5486f7a"
id
"msg_011CfXNTMfckcyGpm8WGiHns"
is_byok
false
latency
631
model_permaslug
"anthropic/claude-sonnet-5.5-20260928"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.017474
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval