NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ0GAGZTRMWGA63CNE8DV3DW
Run Details
Model:
Claude Opus 4.7 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.4s
Cost:
$0.034605
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight's Welcome (v1)" data-color="red"> As I dismounted near the stables, the scent of hay and leather filled my nostrils. A tall figure emerged from the shadows of the archway, his armor catching the last rays of sunlight. Sir Roland stood before me, a man whose reputation had reached even the furthest corners of the realm. His weathered face bore the scars of countless battles, and his steel-grey eyes studied me with careful appraisal. "So you are the boy they sent me," he said, his voice deep and commanding. He stepped forward and placed a heavy gauntleted hand on Thunder's neck, stroking the stallion with surprising gentleness. "A fine beast. Let us hope his rider proves equally worthy." I bowed my head, unable to find my voice. Sir Roland chuckled—a low, rumbling sound—and clapped me on the shoulder with enough force to nearly buckle my knees. "Come, young Frederick. There is much you must learn, and the road ahead is neither short nor easy. But first, we shall see that Thunder is stabled properly. A knight who does not care for his mount is no knight at all." </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (v2)" data-color="green"> The stables smelled of fresh straw and horse sweat, a scent I had grown to love during my years on my father's farm. I was leading Thunder toward an empty stall when a voice called out behind me. "You must be Frederick." I turned to find a knight leaning casually against a wooden post, his arms crossed over a surcoat emblazoned with a silver falcon. He was younger than I had expected, perhaps thirty summers, with a ready smile and an easy manner that immediately put me at ease. Only the faint scar running along his jaw hinted at the warrior beneath the friendly exterior. "Sir Roland, at your service," he said, pushing off the post and offering his hand. "I've been expecting you. Your father wrote to me some weeks ago, singing your praises. I hope you can live up to them." I grasped his hand, surprised by the firmness of his grip. "I shall do my best, my lord." "None of that 'my lord' business," he said with a wink. "Save such formalities for the court. Here in the stables, we are simply two men and their horses. Now, tell me about this magnificent creature of yours." </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (v3)" data-color="blue"> I had barely swung down from Thunder's back when I heard the steady rhythm of boots on cobblestone. A knight approached from the direction of the keep, his cloak of deep crimson billowing behind him. Though he wore no armor save for a polished breastplate, there was no mistaking his bearing—this was a man accustomed to command. "Frederick of Ashvale, I presume?" His voice was neither warm nor cold, but measured, like a blade being weighed for balance. "Yes, sir." I straightened my back and tried to match his formal tone. "I have come as summoned." "I am Sir Roland, Master-at-Arms of this castle and the man responsible for turning green boys into knights of the realm." He circled me slowly, his dark eyes missing nothing—not the road dust on my cloak, nor the calluses on my hands, nor the tremor I fought to suppress. "Many have stood where you stand now. Few have earned their spurs. Fewer still have lived to wear them long." He stopped before me and extended his hand—not in greeting, but palm up, expectant. "Your sword, squire. A blade is a privilege, not a right. You shall earn its return through service, through obedience, and through blood. Do you understand?" My hand trembled only slightly as I drew the weapon and laid it across his waiting palm. </nc-section>
created_at
"2026-04-24T19:44:01.023Z"
4/24/2026, 7:44:01 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
642
moderation_latency
(null)
generation_time
16373
tokens_prompt
318
tokens_completion
956
native_tokens_prompt
446
native_tokens_completion
1295
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.034605
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"f195d39b-0f62-48a7-bc05-d48227e12215"
is_byok
false
latency
642
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777059841-5jv008hpBiCMm86ruXHD"
session_id
(null)
api_type
"completions"
id
"gen-1777059841-XlRnyTS2NLqluBJIS79r"
upstream_id
"f195d39b-0f62-48a7-bc05-d48227e12215"
total_cost
0.034605
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval