NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KPZV65CNT5H0T9J2KRE2TGFE
Run Details
Model:
Claude Opus 4.7
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
14.5s
Cost:
$0.028555
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: A Knight's Welcome" data-color="red"> The stable doors creaked open as I dismounted, my boots hitting the packed earth with a weary thud. From the shadows emerged a towering figure clad in polished mail, a crimson surcoat bearing the sigil of a rampant lion draped across his broad chest. Sir Roland, the castle's most celebrated knight, approached with a measured stride, his weathered face breaking into a rare smile. "So you're the new squire they've been telling me about," he rumbled, his voice deep as a war drum. He clasped my shoulder with a grip that nearly buckled my knees. "Frederick, is it? I served under your father at the Battle of Thornfield. A finer swordsman I have never known." His dark eyes studied me intently, measuring, weighing. "Let us hope his blood runs true in your veins, lad. These are dangerous times, and I have need of a squire with courage." </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome" data-color="green"> I had barely led Thunder toward the stables when a voice called out from the shadows of the doorway. "You must be Frederick." The speaker stepped into the fading light—a tall man with silver threading through his dark beard, wearing a simple tunic stained with the honest labor of the training yard. Sir Roland, I realized with a start, looking far less imposing than the legends had led me to believe. He took Thunder's reins from my trembling hands with practiced ease, running a calloused palm along the stallion's neck. "A fine beast. You've cared for him well on the road." His gray eyes lifted to meet mine, and though his manner was gentle, there was steel beneath. "Come, lad. We'll see your horse settled, and then I'll show you to your quarters. Tomorrow we begin at dawn—and I warn you, I am not a patient teacher of the lazy." I bowed deeply, hoping he could not see how my hands still shook from the long ride. </nc-section> <nc-section data-title="Chapter 2: A Knight's Welcome" data-color="blue"> The clang of a hammer on steel rang from the smithy as I guided Thunder toward the stables, the scent of hay and horses thick in the evening air. Before I could call for a stable boy, a figure stepped out from behind a wooden post—a man not much taller than myself, but built like a fortress, with arms corded from decades of swordplay and a jagged scar running from temple to jaw. "Hold there, boy." His voice was gruff, suspicious. "State your name and purpose before you take another step toward my master's stables." "F-Frederick, sir. Son of Edmund of Greyhollow. I've come to serve as squire, by arrangement with the Lord Steward." The hard lines of his face softened, and he barked a laugh that startled Thunder. "By the saints, the pup has arrived at last! I am Sir Roland, and I'll be the one turning you from a soft-handed lordling into something resembling a warrior. Whether you survive the making—" he grinned wolfishly, "—well, that's up to you." </nc-section>
created_at
"2026-04-24T13:34:37.987Z"
4/24/2026, 1:34:37 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1449
moderation_latency
(null)
generation_time
14365
tokens_prompt
318
tokens_completion
770
native_tokens_prompt
446
native_tokens_completion
1053
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.028555
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"97ad0afd-6667-4087-8275-d25d4b7757cc"
is_byok
false
latency
1445
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777037678-QUEvnbNfvTgyOxbbLVb6"
session_id
(null)
api_type
"completions"
id
"gen-1777037678-zY7Y3yWnSCXwthyhusGV"
upstream_id
"97ad0afd-6667-4087-8275-d25d4b7757cc"
total_cost
0.028555
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval