NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-29-01KSSK9WK4Y3TA8F5ZQA1XV6PF
Run Details
Model:
Claude Opus 4.8 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.2s
Cost:
$0.026125
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
I'll create three alternate continuations for this scene. <nc-section data-title="Chapter 1: A Gruff Welcome" data-color="red"> As I dismounted near the stables, a towering figure clad in worn leather and dented steel strode toward me. His beard was streaked with grey, and a long scar ran across his weathered cheek. This was Sir Roland, the castle's most seasoned knight, whose name I had heard whispered with reverence and fear. "So, you're the new squire," he grunted, looking me up and down as if measuring a sack of grain. "Skinny thing, aren't you? We'll soon put some iron in those arms." He clapped a heavy hand on my shoulder, nearly buckling my knees. "Stable your horse and meet me in the yard at dawn. Training waits for no one, boy—least of all sleep." With that, he turned and marched off, leaving me to wonder what trials awaited me in the days to come. </nc-section> <nc-section data-title="Chapter 1: An Unexpected Kindness" data-color="green"> I had barely tied Thunder to the post when a warm voice called out from the shadows of the stable. "Easy now—you've ridden hard." Sir Roland emerged, a tall man with kind eyes and a gentle smile that softened his battle-scarred features. He offered Thunder an apple from his pocket, and the stallion took it eagerly. "A good rider cares for his mount first and himself second. You've done well, lad." He extended a callused hand, and I shook it. "I'm Roland. I'll be overseeing your training. Don't let the others frighten you—they enjoy testing newcomers, but there's honor in this castle if you know where to look." He smiled again. "Come. You must be hungry after such a journey. Let's find you a warm meal before the night settles in." </nc-section> <nc-section data-title="Chapter 1: A Test in Disguise" data-color="blue"> I led Thunder into the stable, and as I reached for a brush, a man's voice cut through the dim air. "Tell me, squire—what do you fear most?" I turned to find a knight leaning against a wooden beam, arms crossed, his expression unreadable. Sir Roland, I would later learn, was famous for judging a man's character in a single breath. His sharp eyes studied me, awaiting my answer. I swallowed hard. "Failing those who depend on me, sir." For a long moment, he said nothing. Then a slow smile crept across his lips. "Good answer. Cowards fear pain. Fools fear nothing. But a true knight fears only that he might fall short of his duty." He pushed off from the beam and approached. "Perhaps there's hope for you yet, Frederick. We begin at first light. Don't be late." </nc-section>
created_at
"2026-05-29T10:08:30.319Z"
5/29/2026, 10:08:30 AM
model
"anthropic/claude-4.8-opus-20260528"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2784
moderation_latency
(null)
generation_time
17214
tokens_prompt
318
tokens_completion
700
native_tokens_prompt
435
native_tokens_completion
958
native_tokens_completion_images
(null)
native_tokens_reasoning
30
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.026125
router
(null)
provider_responses
0
endpoint_id
"b0d3beaa-5ff7-4666-a749-b1bb2b14c916"
id
"msg_01Hpe5yc1XrVRLwSr9C3fAXC"
is_byok
false
latency
1493
model_permaslug
"anthropic/claude-4.8-opus-20260528"
provider_name
"Anthropic"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1780049310-qe83fbuxgxIjM5Ybyhx9"
session_id
(null)
api_type
"completions"
id
"gen-1780049310-iusKeaXhtD8AvnN2EwAt"
upstream_id
"msg_01Hpe5yc1XrVRLwSr9C3fAXC"
total_cost
0.026125
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval