NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-25-01KYCRB6922RMD9AEFBMMYNY55
Run Details
Model:
Claude Opus 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
44.6s
Cost:
$0.061425
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight at the Stables (Version 1)" data-color="red"> The stable yard smelled of hay and hot iron, and I had scarcely swung down from the saddle before a shadow fell across Thunder's flank. "You ride hard for a boy with no spurs." He was broad as a door, this man, with a beard the color of old rust and a scar that ran from his left ear to the corner of his mouth, pulling his smile crooked. His surcoat had once been white. Now it was the color of every road between here and the sea. "Frederick, my lord. Of Ashmere. I've come to—" "I know why you've come." He took Thunder's bridle from my hands without asking, and the stallion, who had bitten three grooms and one blacksmith, went meek as a lamb beneath his palm. "Sir Roland. I'll be the one shouting at you come morning, so mark the voice now and save yourself the surprise." I bowed, too low. He snorted. "None of that. Squires bow to lords. To me you'll say 'yes, Sir Roland' and 'at once, Sir Roland,' and if you're clever, very little else." He ran a hand down Thunder's foreleg, frowning. "He's favoring the near side. You didn't notice." "I—no, sir." "Then that's your first lesson, and it cost you nothing but pride, which is the cheapest coin you own." He straightened, and for the first time I saw his eyes properly: pale, tired, and watching me the way a man watches weather on the horizon. "Rub him down. Water him slow. Then come to the hall and eat, because tomorrow you won't have the time." He was halfway across the yard when he stopped. "Ashmere," he said, not turning. "That's east. Near the Cinderfells." "Yes, sir." "Then you'll have seen the sky over the mountains this past month." I had. Everyone in Ashmere had. We had simply agreed, in the way villages do, not to speak of it. "Yes, sir," I said. Sir Roland nodded once, slowly, and went inside without another word. </nc-section> <nc-section data-title="Chapter 2: The Knight at the Stables (Version 2)" data-color="green"> I found the stables by following the noise—the stamp and snort of forty horses settling for the night—and I had just begun loosening Thunder's girth when someone laughed at me. "Left to right, lad. Always left to right, else you'll drop the saddle on your own foot and spend a fortnight limping about the yard while the other boys invent names for you." He was sitting on an upturned barrel with a whetstone in one hand and a sword across his knees, and he had clearly been sitting there watching me for some time. Younger than I expected a knight to be, though the grey at his temples argued otherwise. Long face. Amused mouth. Two fingers missing from his left hand. "Sir Roland," he said, and gestured with the whetstone toward my chest. "You're the Ashmere boy. Frederick." "You knew I was coming?" "I knew someone was coming. Your father wrote a letter." He returned to the blade, and the stone sang. "It was a very long letter. He listed your virtues in some detail." Heat crawled up my neck. "He is... enthusiastic, sir." "He is a liar," Sir Roland said pleasantly. "All fathers are, in letters. Mine claimed I could read Old Valyan. I could not read Old Valyan. I spent four years pretending, which is how I learned to lie myself, so perhaps it was a kindness." He tested the edge against his thumb and seemed dissatisfied. "Do you know what a squire actually does here, Frederick of Ashmere?" "Serves his knight. Learns the sword. Tends the armor and the horses and—" "Carries things," he said. "Mostly you carry things. Occasionally you carry things uphill. Once, memorably, I carried a dead man's leg across a frozen river because his widow wanted something to bury." He looked up. "Still want the post?" I thought about it longer than a braver boy would have. "Yes, sir." "Good." He stood, and he was taller than the barrel had suggested. "Left to right, Frederick. Then find me in the armory. There's something in the east tower I'd rather you heard from me than from the kitchen girls." </nc-section> <nc-section data-title="Chapter 2: The Knight at the Stables (Version 3)" data-color="blue"> The gates swallowed me and spat me out into a courtyard of torchlight and confusion, and it was pure luck that a groom pointed me toward the stables rather than the middens. The man waiting there was not waiting for me. That much was plain. He stood in the wide doorway with his back to the lamps, staring out past the walls at the darkening east, and he did not turn when Thunder's hooves rang on the cobbles. He wore no mail, only a plain wool tunic, and his hands hung open and empty at his sides. Something about the stillness of him made me stop three paces off and say nothing at all. A long moment passed. Somewhere in the stalls, a mare kicked her boards. "Do you smell that?" he said. I sniffed. Hay. Dung. Woodsmoke from the kitchens. "Sir?" "No." He turned then, and I saw a weathered face, a soldier's face, and eyes that had been looking at something a great deal farther away than the wall. "No, you wouldn't. It's been eleven years. There's not a soul under this roof who remembers but me and the old cook, and she says it's my imagination." He rubbed his jaw. "Roland. Sir Roland Vance, Master-at-Arms, and you'll be the squire they promised me at midsummer and delivered in autumn." "Frederick, sir. There was flooding on the Kingsroad, and my mother—" "Doesn't matter. You're here." He came forward and took my hand in both of his, which no knight had ever done to me, and which unsettled me more than a blow would have. His palms were rough as bark. "Listen to me now, because I'll only say it once while I'm still soft enough to say it kindly. Whatever you came here hoping to become—tourneys, ribbons, a lady's favor on your arm—put it down. Set it in the straw and leave it. You'll want your hands free." "Sir, I don't understand." "I know." He let go and clapped my shoulder, and just like that the strangeness went out of him and he was only a tired man in a wool tunic. "Get your horse fed. There's stew in the hall and a pallet in the west barracks, third from the window, and don't let Wilkin tell you otherwise—he'll have you sleeping under the stairs." He started toward the keep, then paused. "And Frederick. If you wake in the night and the horses are screaming, don't go outside. Come and find me." He left me standing in the doorway, holding my reins, looking east at nothing. </nc-section>
created_at
"2026-07-25T13:44:57.387Z"
7/25/2026, 1:44:57 PM
model
"anthropic/claude-opus-5-20260723"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2950
moderation_latency
140
generation_time
44355
tokens_prompt
303
tokens_completion
1698
native_tokens_prompt
435
native_tokens_completion
2370
native_tokens_completion_images
(null)
native_tokens_reasoning
53
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.061425
router
(null)
provider_responses
0
endpoint_id
"76cb4608-f48c-483d-8da8-9957fb44244e"
id
"msg_011CdNsnZLGvNrFhxA7kDfDU"
is_byok
false
latency
1104
model_permaslug
"anthropic/claude-opus-5-20260723"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1784987097-DDrS4QjySTunKJl7xzhP"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1784987097-BMLC3CDAoiWOqKBIP42X"
upstream_id
"msg_011CdNsnZLGvNrFhxA7kDfDU"
total_cost
0.061425
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval