NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ0G5QDN85WNPRFQ0KW4GJMS
Run Details
Model:
Claude Opus 4.7 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
20.3s
Cost:
$0.039505
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Gruff Welcome" data-color="red"> As I dismounted near the stables, the scent of hay and horseflesh thick in the evening air, a broad shadow fell across me. I looked up to see a mountain of a man clad in weathered mail, his beard streaked with silver and his eyes the color of a stormy sea. "You'll be the new squire, then." It was not a question. Sir Roland's voice rumbled like distant thunder, and he regarded me with the measured scrutiny of a man who had seen countless boys pass through these gates, few of them worthy. "Frederick, isn't it?" "Yes, my lord." I bowed, perhaps too deeply, and felt heat rise to my cheeks. He grunted, neither approving nor dismissive, and ran a calloused hand along Thunder's flank. The stallion, who had bitten three stable boys on our journey, stood perfectly still. "Good horse. Better than the lad who rides him, I'd wager." A flicker of something—amusement, perhaps—crossed his weathered face. "Stable him yourself. A knight who cannot tend his own mount is no knight at all. When you're finished, find me in the mess hall. We've much to discuss, and little time before the trouble finds us." Before I could ask what trouble, he had turned and strode away, his cloak snapping behind him like a battle standard. </nc-section> <nc-section data-title="Version 2: An Unexpected Kindness" data-color="green"> I had barely swung down from the saddle when a warm, booming laugh echoed across the courtyard. "By the gods, they sent me a child!" I turned to find a tall knight approaching, his armor polished but clearly battle-worn, a crooked smile splitting his sun-browned face. He was younger than I had expected—perhaps thirty—with unruly brown hair and a scar that traced from his left ear to his jaw like a signature. "Sir Roland, at your service," he said, sweeping into a theatrical bow that made the stable hands snicker. Then, rising, he clapped a heavy hand on my shoulder. "And you must be Frederick. Your father wrote to me, you know. Three pages about your virtues and not a single word about your faults. I find that suspicious in any man, but especially a father." I fumbled for a response, but he was already taking Thunder's reins from my hands, speaking to the horse in low, soothing tones. "Come, lad. You look half-starved and wholly exhausted. There will be time enough tomorrow for oaths and drills and all the grim business of becoming a knight." He winked. "Tonight, we eat. And I want to hear everything about the road. A squire's first journey is never dull, no matter what he thinks." Something tight in my chest began to loosen. Perhaps, I thought, this would not be so terrible after all. </nc-section> <nc-section data-title="Version 3: An Omen at the Gate" data-color="blue"> The stables smelled of iron and smoke rather than hay, and I knew before I dismounted that something was wrong. Stable boys moved with the hushed urgency of mourners. A grey warhorse near the far stall bore fresh wounds, hastily bandaged, and its rider stood beside it—a knight still in his battered harness, helm tucked beneath one arm. He looked up as I approached, and I saw a face carved from hard years: a jaw like an anvil, pale eyes set deep beneath a brow that had forgotten how to soften. Blood, not his own, had dried along his gauntlet. "Frederick of Ashvale." His voice was quiet, which somehow made it worse. "I am Sir Roland. I had hoped to meet you under kinder stars." "My lord, what has happened?" He studied me for a long moment, as though weighing whether I was yet a man, or still a boy who should be sent home before the dark arrived. Whatever he saw seemed to settle the matter, though not happily. "Three villages along the eastern border burned last night. The things that did the burning were not men, nor any beast our hunters can name." His gaze drifted past me, toward the darkening horizon. "The old stories are waking, Frederick. And you have ridden into the castle on the very eve of them." He turned toward the keep, then paused without looking back. "Stable your horse. Eat what you can. Sleep if sleep will have you. Tomorrow, your training begins—and I fear we shall not have the luxury of years." </nc-section>
created_at
"2026-04-24T19:41:23.769Z"
4/24/2026, 7:41:23 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
826
moderation_latency
(null)
generation_time
20234
tokens_prompt
318
tokens_completion
1099
native_tokens_prompt
446
native_tokens_completion
1491
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.039505
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"986d5c64-92c3-44a3-9a56-474bde0ef204"
is_byok
false
latency
826
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777059683-2pUEgwoY1Yb1lmaBya4L"
session_id
(null)
api_type
"completions"
id
"gen-1777059683-zyfqAcxnio51v0F0Opsd"
upstream_id
"986d5c64-92c3-44a3-9a56-474bde0ef204"
total_cost
0.039505
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval