NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-01-01KT1HKNRWT7AMNE9RCKT1Z8MF
Run Details
Model:
Claude Opus 4.8 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
14.4s
Cost:
$0.024875
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: A Knight's Welcome" data-color="red"> As I dismounted near the stables, a broad-shouldered man in worn leather armor approached with measured steps. His weathered face bore the scars of countless battles, yet his eyes held a surprising warmth. "You must be Frederick," he said, extending a calloused hand. "I am Sir Roland. I've been expecting you." His grip was firm, almost crushing, but his smile was genuine. "Word of your arrival reached us days ago. Come, let us see if you have the makings of a true knight, or merely the dreams of one." Thunder snorted beside me, as if sensing the gravity of the moment. Sir Roland chuckled, patting the stallion's neck with practiced ease. </nc-section> <nc-section data-title="Chapter 2: The Old Warrior" data-color="green"> The stables smelled of hay and horseflesh as I led Thunder toward an empty stall. A gruff voice stopped me in my tracks. "Mind how you handle that beast, boy." A tall figure emerged from the shadows, his silver hair catching the last rays of sunlight. This was no ordinary stablehand—the bearing of a seasoned knight was unmistakable. "I am Sir Roland, and I've trained more squires than you've seen summers." He circled me slowly, appraising my stance, my build, the calluses on my hands. "Hmph. Soft. But there's fire in your eyes, I'll grant you that." He turned away, beckoning over his shoulder. "Tend to your horse, then follow me. Your training begins at dawn, and I show no mercy to those who arrive late." </nc-section> <nc-section data-title="Chapter 2: An Unexpected Greeting" data-color="blue"> I had barely tied Thunder's reins to the post when a hearty laugh echoed across the courtyard. "Ha! Another lamb sent to the slaughter!" The man who approached was younger than I expected, perhaps in his thirties, with a quick grin and laughing eyes. He wore the silver sigil of a knight upon his breast. "Sir Roland, at your service—though after a few weeks of my training, you may curse the day we met." He clapped me on the shoulder with such force that I nearly stumbled. "Don't look so frightened, lad! I was a green squire once myself. Tell me your name, and let's get you settled before the cook stops serving supper. Trust me, you'll need your strength." Despite my nerves, I found myself smiling. Perhaps this place would not be so daunting after all. </nc-section>
created_at
"2026-06-01T12:12:49.314Z"
6/1/2026, 12:12:49 PM
model
"anthropic/claude-4.8-opus-20260528"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2149
moderation_latency
(null)
generation_time
14387
tokens_prompt
318
tokens_completion
646
native_tokens_prompt
435
native_tokens_completion
908
native_tokens_completion_images
(null)
native_tokens_reasoning
28
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.024875
router
(null)
provider_responses
0
endpoint_id
"b0d3beaa-5ff7-4666-a749-b1bb2b14c916"
id
"msg_01Haqxo6T6gV8UothGLMcnnp"
is_byok
false
latency
987
model_permaslug
"anthropic/claude-4.8-opus-20260528"
provider_name
"Anthropic"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1780315969-WEMZ5pYp3KfZS5hSxK4D"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1780315969-dvy9Ak9hrP724gooT97k"
upstream_id
"msg_01Haqxo6T6gV8UothGLMcnnp"
total_cost
0.024875
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval