NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KPZV68AF8431YXKFSKKC0NSG
Run Details
Model:
Claude Opus 4.7
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.8s
Cost:
$0.023780
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight's Welcome" data-color="red"> As I dismounted near the stables, the scent of hay and leather filled my nostrils. A tall figure emerged from the shadows, his armor gleaming faintly in the dying light. Sir Roland, the castle's most celebrated knight, strode toward me with purposeful steps. His weathered face bore the scars of countless battles, yet his eyes held a surprising warmth. "You must be Frederick," he said, his voice deep and resonant. He clapped a gauntleted hand on my shoulder, nearly buckling my knees under its weight. "Your father spoke highly of you before he fell at Ravenspire. I see much of him in your bearing, lad. Come, there is much to discuss before nightfall." </nc-section> <nc-section data-title="Chapter 2: An Unexpected Meeting" data-color="green"> The stable boy took Thunder's reins with practiced ease, whispering soothing words to my travel-weary steed. As I turned to retrieve my satchel, I nearly collided with a broad chest clad in chainmail. I stumbled back, looking up into the amused face of a man whose dark beard was streaked with silver. "Easy there, young squire," he chuckled, steadying me with a firm grip. "I am Sir Roland, Knight-Commander of this castle, and you must be the boy we've been expecting." His gaze traveled over me with the practiced eye of a man who had trained many before. "A bit scrawny, perhaps, but we'll remedy that soon enough. Tell me, Frederick—have you ever held a real sword?" </nc-section> <nc-section data-title="Chapter 2: The Measure of a Squire" data-color="blue"> I had barely set foot upon the cobblestones when a voice like rolling thunder called out from the stable doors. "Ho there! You'd be the new arrival, I wager." A knight stepped into the lantern light, tall and lean, with hair the color of autumn wheat and a sword at his hip that looked older than the castle itself. This, I knew from the tales my father had told, could only be Sir Roland the Steadfast. He did not smile, but neither was his expression unkind. He studied me for a long moment, taking in my road-stained cloak and the nervous tremor in my hands. "Training begins at dawn, Frederick. Not a moment later. A squire who cannot rise with the sun is no squire at all." He nodded once, sharply. "See to your horse first. A man who neglects his mount neglects his soul." </nc-section>
created_at
"2026-04-24T13:34:40.988Z"
4/24/2026, 1:34:40 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1599
moderation_latency
(null)
generation_time
10680
tokens_prompt
318
tokens_completion
610
native_tokens_prompt
446
native_tokens_completion
862
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.02378
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"df044e7e-0efb-4f62-bc15-1107071c6c2f"
is_byok
false
latency
1579
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777037680-OGfzPkXPnvpGE3t6WmGL"
session_id
(null)
api_type
"completions"
id
"gen-1777037680-Rg2HQL1Lylx2YZ7Rwlak"
upstream_id
"df044e7e-0efb-4f62-bc15-1107071c6c2f"
total_cost
0.02378
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval