NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-01-01KT1G8VWEDXF4Y0NJ4MXNEETQ
Run Details
Model:
Claude Opus 4.8 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.0s
Cost:
$0.027275
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
I'll craft three alternate continuations for this moment in Frederick's journey. <nc-section data-title="Chapter 2: A Knight's Welcome" data-color="red"> As I dismounted near the stables, the smell of hay and leather filling my nostrils, a towering figure emerged from the shadows. Sir Roland, the legendary knight whose deeds were sung in every tavern, fixed me with steel-grey eyes that seemed to measure my very soul. "So you're the new squire," he rumbled, his voice like distant thunder. A scar traced a pale line across his weathered cheek. "I've buried three squires this past year. Boys who thought training was a game." He stepped closer, the firelight glinting off his chainmail. "Tell me, young Frederick—do you have the stomach for what lies ahead, or shall I send you home to your mother?" I gripped Thunder's reins tighter, refusing to look away. Something in his challenge stirred a fire within me. </nc-section> <nc-section data-title="Chapter 2: An Unexpected Friend" data-color="green"> I had barely tied Thunder to the post when a warm, booming laugh echoed through the courtyard. A broad-shouldered man with a russet beard and kind, crinkling eyes strode toward me, arms open wide as if greeting an old friend. "Frederick! By the gods, you have your father's look about you," Sir Roland exclaimed, clapping a heavy hand on my shoulder. "I served alongside him in the northern campaigns, you know. A finer man never drew breath." He glanced at Thunder and gave an approving nod. "And a fine eye for horses, too. Come, lad—you must be famished after your ride. We'll see to your training tomorrow, but tonight, you'll eat at my table and hear stories that'll curl your toes." His warmth melted away the nervous knot in my chest, and for the first time since leaving home, I felt I might belong here. </nc-section> <nc-section data-title="Chapter 2: The Silent Test" data-color="blue"> The stables were quiet save for the soft nickering of horses when I noticed him—a lean, gray-haired knight standing perfectly still in the doorway, watching me with an unreadable expression. Sir Roland said nothing as I led Thunder inside, but his eyes followed my every movement. I sensed this was a test. So I worked in silence, brushing down my stallion, checking his hooves, ensuring fresh water and feed before tending to my own needs. Only when I had finished did the old knight finally speak. "Most boys see to themselves first," he said quietly, stepping into the lamplight. "You put the horse before your own comfort." A faint smile touched his lips. "Perhaps your master was right to send you. We begin at dawn, Frederick. Sleep well—it may be the last good rest you'll have for some time." With that cryptic warning, he turned and vanished into the gathering dark. </nc-section>
created_at
"2026-06-01T11:49:26.55Z"
6/1/2026, 11:49:26 AM
model
"anthropic/claude-4.8-opus-20260528"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2430
moderation_latency
(null)
generation_time
16998
tokens_prompt
318
tokens_completion
766
native_tokens_prompt
435
native_tokens_completion
1004
native_tokens_completion_images
(null)
native_tokens_reasoning
43
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.027275
router
(null)
provider_responses
0
endpoint_id
"b0d3beaa-5ff7-4666-a749-b1bb2b14c916"
id
"msg_01ALk7sKH76JWyrz8pxKNvnT"
is_byok
false
latency
1135
model_permaslug
"anthropic/claude-4.8-opus-20260528"
provider_name
"Anthropic"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1780314566-YeGpUYunInp4lfKGc4mu"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1780314566-7cxRAwiW7Zz29NB9lGWc"
upstream_id
"msg_01ALk7sKH76JWyrz8pxKNvnT"
total_cost
0.027275
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval