NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ0GDH5M953WPCXVESVRBCXG
Run Details
Model:
Claude Opus 4.7 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
16.2s
Cost:
$0.035580
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight's Welcome (Version 1)" data-color="red"> The stables smelled of fresh hay and leather, a comforting blend that reminded me of my father's farm. As I dismounted Thunder, a tall figure emerged from the shadows of the stable doorway. His armor gleamed in the dying light, polished to a mirror sheen, and a crimson cloak hung from his broad shoulders. "You must be Frederick," the knight said, his voice deep and resonant. "I am Sir Roland, Knight of the Crimson Order. I have been expecting you." I dropped to one knee, the way my mother had taught me to greet a knight of the realm. "Sir Roland, it is an honor." "Rise, boy. Save your knees for the chapel." A rare smile crossed his weathered face as he extended a gauntleted hand. "Come. Tend to your steed, and then we shall see what kind of squire the king has sent me. I've trained a dozen boys before you, and I'll warn you now—none of them found it easy." There was a glint in his eye, equal parts challenge and kindness, and I felt a shiver of both fear and excitement race down my spine. </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (Version 2)" data-color="green"> I had barely swung down from Thunder's back when a gruff voice called out from behind the stable door. "Took you long enough, lad. I expected you before the sun began its descent." The man who stepped into view was not what I had imagined. Sir Roland wore no armor, only a simple tunic stained with sweat and what looked to be horse liniment. His beard was wild and streaked with grey, and a scar ran from his left temple down to the corner of his mouth. But his eyes—his eyes were sharp as a hawk's. "Forgive me, Sir Roland," I stammered. "The road from Ashford was—" "The road from Ashford is the same road it has always been." He took Thunder's reins from my hands with the ease of a man who had handled a thousand horses. "Excuses are the refuge of poor knights and worse squires. Remember that." I felt my cheeks burn. But then he clapped me on the shoulder, a gesture surprisingly warm given his harsh words. "Don't look so stricken, boy. You are here now, and that is what matters. Come, let us see to your horse together. A squire's first lesson is always in the stables." </nc-section> <nc-section data-title="Chapter 2: The Knight's Welcome (Version 3)" data-color="blue"> The stable yard was quieter than I had expected. A few stable hands moved about their evening duties, but most of the castle's inhabitants had retreated indoors as dusk settled over the battlements. I was leading Thunder toward an empty stall when I heard the soft crunch of boots on gravel behind me. "A fine animal," said a voice, calm and measured. "Stallions of that breed are rare this far north." I turned to find a man of middling years watching me with quiet intensity. He was not dressed as I had imagined a knight would be—no shining armor, no sword at his hip—only a dark green riding coat and well-worn boots. Yet there was something in his bearing, a stillness, that made me certain of his identity even before he spoke again. "Sir Roland?" I ventured. He inclined his head. "And you are Frederick, son of Gerard. I knew your father, once. We rode together in the Northern Campaign, many years ago." My breath caught. My father had rarely spoken of his days as a soldier, and to meet someone who had known him then felt like discovering a hidden door in a familiar room. "He spoke well of you in his letter," Sir Roland continued, stepping forward to stroke Thunder's neck. "Though he did not mention that you had inherited his stubborn jaw. Come, Frederick. We have much to discuss, but first, your horse deserves rest. As do you, I imagine." </nc-section>
created_at
"2026-04-24T19:45:39.511Z"
4/24/2026, 7:45:39 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
942
moderation_latency
(null)
generation_time
16145
tokens_prompt
318
tokens_completion
977
native_tokens_prompt
446
native_tokens_completion
1334
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.03558
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"e80c44e4-6cb8-4bb6-af5d-aca7dfb2f511"
is_byok
false
latency
936
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777059939-2i4c2r8vTzkNDoO4FhMd"
session_id
(null)
api_type
"completions"
id
"gen-1777059939-a0dlTY4VJKQ0v6CyfOT1"
upstream_id
"e80c44e4-6cb8-4bb6-af5d-aca7dfb2f511"
total_cost
0.03558
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval