NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-25-01KYCRHRX8KQ3M4DN9BRKRVEBC
Run Details
Model:
Claude Opus 5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
31.2s
Cost:
$0.041225
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival — Version 1" data-color="red"> The gates swallowed me whole, and the courtyard beyond smelled of hay and hot iron. I had barely swung down from Thunder's back when a shadow fell across the cobbles, long and broad-shouldered, cast by a man who seemed to have been carved from the same grey stone as the walls. "You'll be the boy from Ashcombe." His voice was gravel dragged over gravel. He did not offer his hand; instead he took Thunder's bridle, and the stallion — who bit anyone who dared such a liberty — went still as a lamb. "Sir Roland. I keep the training yard, the armoury, and what little patience remains to me." "Frederick, my lord." I bowed too deeply and felt the flush climb my neck. "Sir will do. Lords sit in halls." He ran a hand down Thunder's flank, and something almost like approval flickered under his iron brows. "You rode him hard." "I wanted to arrive before dark." "You wanted to arrive looking splendid." He handed the reins to a stable boy who had appeared from nowhere. "Wanting things is not a sin, squire. Wanting them more than your horse's legs — that is a habit we will break tonight. Come. You'll rub him down yourself, and then you'll eat, and then you'll sleep, because tomorrow begins at the fourth bell and I do not knock twice." </nc-section> <nc-section data-title="Chapter 1: The Arrival — Version 2" data-color="green"> The stables stood at the eastern edge of the courtyard, warm and dim and loud with the shifting of hooves. I led Thunder inside, and there, leaning against a stall post with a bridle half-mended in his lap, sat a knight. He was younger than I had imagined a knight could be, and older than any man I had ever seen laugh so easily. A scar ran from his left ear into his beard, pale as a thread of silver. "Well," he said, without rising. "Either you're the new squire, or you're the cleverest horse thief in three counties, and I confess I hope for the second. It's been a dull month." "Frederick, sir. Of Ashcombe." "Roland." He set the bridle aside and stood, and standing he was very tall indeed. "Sir Roland, when the Marshal is listening, which he never is after supper." He looked me over — not unkindly, but thoroughly, the way a smith looks at unworked metal. "Ashcombe. That's four days' ride." "Five, sir. There was rain." "Five days alone on the road, at your age." He whistled softly. "And here I was told you were sent to us because your father wished you out from under his feet. Well. Feet are a poor reason to make a knight, but I've seen worse. Bring him in — the third stall's empty, and mind the mare beside it, she has opinions." </nc-section> <nc-section data-title="Chapter 1: The Arrival — Version 3" data-color="blue"> I found the stables by the smell of them, and I had my cheek pressed to Thunder's neck, whispering my thanks into his hide, when someone cleared his throat behind me. I turned so fast I nearly fell. The knight standing in the doorway had the last of the sunset behind him, so that for a moment he was only a shape — mail, and a cloak, and the long line of a sword. Then he stepped in, and the lamplight found a weathered face, and eyes that had gone grey the way the sea goes grey before weather. "Talking to your horse," he said. "Good. The ones who talk to their horses tend to live longer than the ones who talk to themselves." He inclined his head, a shallow, formal thing. "Roland of Marrowfield. Knight of this house, for whatever that is still worth." "Frederick, sir." My mouth had gone dry. "I've come to serve." "Everyone comes to serve." He said it gently, and that made it worse somehow. "Listen to me, squire, because I will say it once tonight and then not again for a year: this castle is not what the songs told you. There are things stirring in the north that the Marshal will not name at table, and you will hear whispers of them before the week is out. When you do, come to me. Not to the other boys. Me." Behind him, somewhere high in the darkening sky, something cried out — a sound like nothing I had heard, thin and enormous at once. Sir Roland did not look up. That frightened me more than the sound had. "Now," he said. "Water for your horse. Then follow me." </nc-section>
created_at
"2026-07-25T13:48:33.074Z"
7/25/2026, 1:48:33 PM
model
"anthropic/claude-opus-5-20260723"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4054
moderation_latency
(null)
generation_time
31130
tokens_prompt
303
tokens_completion
1127
native_tokens_prompt
435
native_tokens_completion
1562
native_tokens_completion_images
(null)
native_tokens_reasoning
40
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.041225
router
(null)
provider_responses
0
endpoint_id
"76cb4608-f48c-483d-8da8-9957fb44244e"
id
"msg_011CdNt4TK5AhW6UBSU269F6"
is_byok
false
latency
1315
model_permaslug
"anthropic/claude-opus-5-20260723"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer
(null)
request_id
"req-1784987313-DpOwKMUidzWnFxOfrKiR"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1784987313-qclBP3GK03jKCkwjWM8d"
upstream_id
"msg_011CdNt4TK5AhW6UBSU269F6"
total_cost
0.041225
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval