NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-25-01KYCPYQ6VCZGWXVWD034XCWRH
Run Details
Model:
Claude Opus 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
25.5s
Cost:
$0.034750
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight at the Stables (Version 1)" data-color="red"> The gates groaned open before me, and I guided Thunder through the archway into a courtyard thick with the smell of hay and hot iron. A man stood waiting beside the stables, broad as a barn door, his surcoat dusty at the hem and his grey hair cropped close as a soldier's. "You'll be the boy from Ashvale," he said. Not a question. He took Thunder's bridle in one scarred hand and ran the other down the stallion's neck with a gentleness that surprised me. "Sir Roland. I train the squires here, when I'm not burying them." I dismounted too quickly and nearly turned my ankle on the cobbles. He watched without offering a hand. "Frederick, my lord. Frederick of Ashvale." "Just Roland will do. Lords are for the great hall." He looked me over the way a farmer looks over a calf at market — not unkindly, but with an eye for what would break first. "Skinny. Well. There's worse things to be. Rub him down yourself, mind. A knight who lets another man tend his horse is a knight who'll die wondering why it threw him." </nc-section> <nc-section data-title="Chapter 2: The Knight at the Stables (Version 2)" data-color="green"> I found the stables by the noise before I found them by sight — the stamp of hooves, the low murmur of grooms, a whistled tune that stopped abruptly as I rode into view. The whistler was a knight. He sat on an upturned water bucket with a saddle across his knees and a rag in his hand, working oil into the leather. Younger than I expected, though there was a white seam of scar running from his ear down beneath his collar, and he had the sort of face that seemed to be holding back a laugh at all times. "Ha!" He set the saddle aside and rose. "The sunset arrival. Very grand. Did you time it, or was that providence?" Heat climbed my neck. "I rode as fast as I could, sir." "Then providence. Better luck than skill, in my experience — skill runs out." He offered his hand, and his grip was iron. "Roland. Sir Roland, if the Marshal's within earshot, which he usually is. And you're Frederick." "You know my name?" "I know everything that comes through that gate. It's most of what being a knight is, boy. The rest is falling off horses with dignity." He clapped my shoulder hard enough to stagger me. "Come. Thunder, is it? Fine beast. Let's get him fed before we worry about you." </nc-section> <nc-section data-title="Chapter 2: The Knight at the Stables (Version 3)" data-color="blue"> The courtyard was quieter than I had imagined a castle could be. Torches were being lit along the inner wall, one by one, and in the blue dusk between them a figure waited by the stable door, motionless, hands folded behind his back. He did not move as I approached. He did not speak until Thunder had come to a full stop and the echo of the hooves had died away in the stone. "You are late," Sir Roland said. "The river road was flooded, sir. I had to go around by the mill." "I know. I rode it this morning." His voice was very level, and something in that levelness made me sit up straighter in the saddle. "I am not scolding you, Frederick. I am telling you a thing you will need to learn: the world does not care for your reasons. It only counts your arrivals. Remember that when you are older and someone's life depends upon your hour." He stepped forward then, out of the shadow of the doorway, and I saw that he was missing two fingers from his left hand, and that his eyes were the pale grey of winter water. "Down you come," he said. "There is a stall at the end for him, and straw in the loft. When you have finished, come and find me at the well. We will see what your father has taught you, and how much of it must be unlearned." </nc-section>
created_at
"2026-07-25T13:20:40.161Z"
7/25/2026, 1:20:40 PM
model
"anthropic/claude-opus-5-20260723"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1257
moderation_latency
(null)
generation_time
25381
tokens_prompt
303
tokens_completion
959
native_tokens_prompt
435
native_tokens_completion
1303
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.03475
router
(null)
provider_responses
0
endpoint_id
"76cb4608-f48c-483d-8da8-9957fb44244e"
id
"msg_011CdNqw8NMzTdRTNmt8HdDa"
is_byok
false
latency
1254
model_permaslug
"anthropic/claude-opus-5-20260723"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1784985640-OwnTJqvpSTIZApeNB3ZU"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1784985640-UFDwI43AxGD46Ni4RxvR"
upstream_id
"msg_011CdNqw8NMzTdRTNmt8HdDa"
total_cost
0.03475
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval