NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-25-01KYCQXQR2YBS9S8A1B3D8W9B6
Run Details
Model:
Claude Opus 5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
35.8s
Cost:
$0.046575
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1, Version 1: The Iron Handshake" data-color="red"> The stables smelled of hay and warm leather, and I had barely swung down from Thunder's back when a shadow fell across the straw. "So you're the one." The voice was gravel dragged over stone. I turned and found a man built like a siege engine, his grey-streaked beard cropped close, a scar running from his left ear down beneath his collar. He wore no armor, only a padded gambeson stained dark at the shoulders where a breastplate had rested for too many years. "Frederick, sir. Of Aldemere." I bowed, and immediately felt foolish for it. "Sir Roland." He did not bow. He took my hand instead and crushed it in a grip that made my knuckles sing, and he watched my face the whole while to see what I would do with the pain. I did nothing. That seemed to satisfy him. "You brought a good horse. Better than you deserve, I'd wager. Did your father buy him?" "My uncle." "Hm." He ran a palm down Thunder's neck, and Thunder—who bit strangers as a matter of principle—leaned into it like a lamb. "Then your uncle has an eye. Come. You'll muck out three stalls before supper, and if you do it well, I'll tell you what happened to the last squire who arrived at sunset." He walked away without waiting. I looked at Thunder. Thunder looked at me, entirely unhelpful, and I picked up the shovel. </nc-section> <nc-section data-title="Chapter 1, Version 2: The Man Who Was Waiting" data-color="green"> He was waiting for me, and that unsettled me more than any greeting could have. The stable yard was empty of grooms, the buckets stacked, the doors already barred for the evening—except one, and in its lantern-light stood a knight with his arms folded, as though he had been standing there since noon and intended to stand there until I explained myself. "You're late by two days," Sir Roland said. "There was flooding on the Merrow road, sir. The bridge at—" "The bridge at Corran held. I had a rider through it yesterday morning." He tilted his head. He was younger than I had expected, perhaps forty, with a long, weathered face and eyes the pale colour of a winter sky. "Try again." My mouth went dry. Thunder shifted beneath me, sensing the change in my breathing the way he always did. "I stopped at Greywater," I admitted. "My mother is buried there. I hadn't seen the stone." Something in the knight's face moved—not softened, exactly, but shifted, like a door unlatching without opening. He stepped forward and took Thunder's bridle in one scarred hand. "Then you're late by two days," he said, "and I'll not hear of it again. Down you come, boy. There's stew, and there's a bed, and tomorrow there's the yard at dawn, and after that I doubt you'll have breath left for grieving." I dismounted. My legs nearly folded under me. "Frederick," he added, as we walked the horse in together. "I knew her. Your mother. Ask me another time." </nc-section> <nc-section data-title="Chapter 1, Version 3: A Bad Evening for Arrivals" data-color="blue"> Something was wrong in the stable yard. I knew it before I understood it—the way the men moved, quick and quiet, the way a hound whined somewhere behind the smithy and no one hushed it. Three horses stood lathered and blowing, still saddled, their reins looped hastily over a rail. Nobody had come to take them. A knight strode out of the dark of the stable doorway, pulling a gauntlet from his hand with his teeth. He stopped when he saw me, and for a moment he simply stared, as if I were a piece of furniture that had wandered into the wrong room. "Squire," he said at last. "Aldemere's boy." "Frederick, sir." "Roland." He spat the gauntlet into his palm. There was blood dried brown in the creases of his knuckles, and it was not, I thought, his own. "You have arrived on a poor evening, Frederick of Aldemere. I'd send you back down the road if the road were safe, and it is not." "What's happened?" He looked past me, out through the gate to the darkening fields, to the long line of the eastern ridge where the last light was bleeding away. "Something came down out of the hills," he said. "Took forty sheep from Halloran's fold and left the bones stacked. Stacked, boy. Like a man builds a cairn." He turned and clapped a hand on my shoulder, hard enough to buckle my knees. "Stable your horse. Eat. Sleep if you can manage it. And in the morning, you and I will ride out and look at what has come to our country, and you will keep your mouth shut and your eyes open, and you will not tell a soul what you see. Agreed?" I did not agree. I did not do anything at all. But he had already walked away, and Thunder was pulling at the reins, and above us the first stars were coming out over a kingdom that suddenly seemed much smaller than it had at noon. </nc-section>
created_at
"2026-07-25T13:37:36.525Z"
7/25/2026, 1:37:36 PM
model
"anthropic/claude-opus-5-20260723"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
5218
moderation_latency
(null)
generation_time
35688
tokens_prompt
303
tokens_completion
1293
native_tokens_prompt
435
native_tokens_completion
1776
native_tokens_completion_images
(null)
native_tokens_reasoning
66
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.046575
router
(null)
provider_responses
0
endpoint_id
"76cb4608-f48c-483d-8da8-9957fb44244e"
id
"msg_011CdNsE78HuSS5KmRmbikRZ"
is_byok
false
latency
3317
model_permaslug
"anthropic/claude-opus-5-20260723"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1784986656-HjGjzt9BpSpCM6jtEW9q"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1784986656-BsIAeZSndtCw3xnPQ9K2"
upstream_id
"msg_011CdNsE78HuSS5KmRmbikRZ"
total_cost
0.046575
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval