NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KPZTW2W5DXG7PY7TGRMZ8FER
Run Details
Model:
Claude Opus 4.7
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
14.6s
Cost:
$0.031280
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: A Knight's Welcome" data-color="red"> As I dismounted near the stables, the scent of fresh hay and saddle oil filled my nostrils. A towering figure emerged from the shadows of the stable doorway, his armor catching the last rays of the setting sun. Sir Roland, the castle's most renowned knight, strode toward me with a commanding presence that made my knees weaken. "You must be Frederick," he boomed, his voice like thunder rolling across distant hills. His weathered face bore the scars of a hundred battles, yet his eyes held a surprising warmth. "I've heard much about you from your father. A fine man, he was." I bowed deeply, my hand trembling as I held Thunder's reins. "Sir Roland, it is an honor beyond words." He clapped a heavy gauntleted hand on my shoulder, nearly buckling my knees. "None of that now, boy. Save your honor for the battlefield. Tonight, we feast. Tomorrow, we begin making a knight of you." </nc-section> <nc-section data-title="Chapter 2: The Scarred Knight" data-color="green"> The stables smelled of hay, leather, and horse sweat—a scent I would come to know as intimately as my own breath. I was leading Thunder toward an empty stall when a voice called out behind me. "That's a fine beast you've got there." I turned to find a man leaning against a wooden post, arms crossed over a tunic bearing the royal crest. A jagged scar ran from his temple to his jaw, and his dark hair was streaked with premature gray. Though he wore no armor, I knew at once this was Sir Roland—the knight whose deeds were sung in every tavern from here to the western sea. "Thank you, sir," I stammered, suddenly aware of how travel-worn and dusty I must appear. Sir Roland pushed off the post and approached, circling Thunder with the practiced eye of a cavalryman. "Strong legs. Good chest. He'll serve you well." Then his sharp gaze turned on me. "The question is, squire—will you serve him? A knight who cannot care for his mount cannot care for his men. Remember that, and we shall get along famously." </nc-section> <nc-section data-title="Chapter 2: First Meeting" data-color="blue"> Thunder's hooves clattered against the cobblestones as we approached the stables. A stableboy rushed forward to take the reins, but before I could dismount properly, another figure appeared—tall, broad-shouldered, and moving with the unmistakable grace of a seasoned warrior. "Welcome to Thornwall Castle, young Frederick." Sir Roland was not what I had expected. The ballads painted him as a grizzled giant, but the man before me was perhaps only ten years my senior, with kind blue eyes and a neatly trimmed auburn beard. He wore a simple green cloak over his tunic, and a longsword hung at his hip as naturally as another man might carry a walking stick. "Sir Roland." I dropped to one knee on the cobblestones. "I pledge my service to you and to the crown." He laughed—a genuine, hearty sound—and pulled me back to my feet. "Up, up. You'll have plenty of time for kneeling in the years to come. For now, let's see to your horse, find you some supper, and tomorrow we shall discover what sort of squire the road has delivered to my doorstep." </nc-section>
created_at
"2026-04-24T13:29:07.732Z"
4/24/2026, 1:29:07 PM
model
"anthropic/claude-4.7-opus-20260416"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
864
moderation_latency
(null)
generation_time
14473
tokens_prompt
318
tokens_completion
832
native_tokens_prompt
446
native_tokens_completion
1162
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
usage
0.03128
router
(null)
provider_responses
0
endpoint_id
"0fa65117-00d9-4835-808d-9b68041d9ce4"
id
"fc5aecdd-a846-46a9-80bc-5a11973d97c1"
is_byok
false
latency
864
model_permaslug
"anthropic/claude-4.7-opus-20260416"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777037347-3NJ5gb5U42xjpWcv4GD5"
session_id
(null)
api_type
"completions"
id
"gen-1777037347-fXvtHjycwFA1JIGHy6hi"
upstream_id
"fc5aecdd-a846-46a9-80bc-5a11973d97c1"
total_cost
0.03128
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval