NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ0G3YRSW0VRRMHVJASF18Z9
Run Details
Model:
Claude Opus 4.7 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.9s
Cost:
$0.036505
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight's Welcome (Version 1)" data-color="red"> The stable hands rushed forward to take Thunder's reins as I dismounted, my legs stiff from the long ride. The scent of hay and horseflesh filled my nostrils, a familiar comfort after days on the road. Before I could even brush the dust from my traveling cloak, a tall figure emerged from the shadow of the stable doorway. Sir Roland was every bit the knight the songs had promised. His silver-streaked hair was cropped short in the practical manner of a soldier, and though he wore no armor now—only a simple linen tunic and leather breeches—his bearing spoke of a lifetime spent in battle. A long scar traced down his left cheek, disappearing into the grey of his beard. "You must be Frederick," he said, his voice deep and measured. He extended a calloused hand, studying me with eyes the color of winter steel. "I am Sir Roland. Your father wrote to me of your coming, though I confess I expected someone... taller." Heat rushed to my cheeks, but before I could stammer a reply, the knight's stern face broke into a surprising grin. "Fear not, lad. I was a scrawny thing myself once. The castle has a way of building a man—or breaking him. We shall see which you prove to be." </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (Version 2)" data-color="green"> As I reined Thunder to a halt near the stables, the smell of leather, oats, and smoke greeted me like an old friend. I had barely swung down from the saddle when a booming laugh echoed from behind a stack of hay bales. "By the gods, they've sent me a child!" The man who stepped into view was enormous—easily a head taller than any man I'd ever known, with shoulders that seemed to block out the dying sun. His red beard was braided in three thick plaits, and a warhammer hung casually from his belt as though it weighed no more than a loaf of bread. "Sir Roland, at your service," he said, though his grin suggested he was mostly amused by his own greeting. He clapped a massive hand on my shoulder, and I nearly buckled beneath the weight of it. "And you would be young Frederick, the squire I've been promised. Tell me, boy, can you swing a sword, or have you come here merely to polish mine?" I opened my mouth, though no words came. Sir Roland laughed again and took Thunder's reins with surprising gentleness. "Never mind, never mind. Come—there's stew in the hall, and tomorrow we'll see what sort of steel lies beneath that traveling cloak." </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (Version 3)" data-color="blue"> I had just begun to loosen Thunder's girth when I felt a presence behind me—the quiet, deliberate stillness of someone accustomed to moving without sound. When I turned, I found a man leaning against the stable post, arms folded across his chest, watching me with the patient interest of a hawk observing a field mouse. He was not what I had imagined. Lean rather than broad, with dark hair pulled back from a weathered face, he wore no mark of rank save for a silver ring on his smallest finger, etched with the royal seal. Yet I knew him at once. There was something in the way he stood—balanced, unhurried, entirely present—that marked him as a man who had survived things lesser men had not. "You've a good seat on a horse," he said quietly. "Better than most who arrive here. Did your father teach you, or the stable master at Ashford?" "The stable master, sir," I managed, surprised he knew of my home at all. A faint smile touched the corner of his mouth. "I am Sir Roland. I will be your teacher, your tormentor, and—if you survive the first winter—perhaps your friend." He pushed off from the post and stepped closer, his grey eyes searching mine. "Tell me, Frederick. Why have you come to this castle? And mind your answer—I will know if you lie." </nc-section>
created_at
"2026-04-24T19:40:25.759Z"
4/24/2026, 7:40:25 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
693
moderation_latency
(null)
generation_time
16870
tokens_prompt
318
tokens_completion
1013
native_tokens_prompt
446
native_tokens_completion
1371
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.036505
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"27d70ee3-384b-4085-b9f5-a305d9776f65"
is_byok
false
latency
693
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777059625-pUzG0bcKep1r9JECXird"
session_id
(null)
api_type
"completions"
id
"gen-1777059625-3wOv3klMAlDw5uaILDaF"
upstream_id
"27d70ee3-384b-4085-b9f5-a305d9776f65"
total_cost
0.036505
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval