NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-31-01KSYXH1BB371V3D0G2YAV914A
Run Details
Model:
Claude Opus 4.8 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.2s
Cost:
$0.022800
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight's Welcome" data-color="red"> As I dismounted near the stables, a broad-shouldered figure clad in worn chainmail strode toward me. His weathered face bore the scars of countless battles, yet his eyes were kind beneath his graying brow. "You must be Frederick," he said, his voice deep and commanding. "I am Sir Roland, knight of this realm. I have heard much about you from your father." He clasped my forearm in a firm grip. "The road has been long, I imagine. Tend to your horse, and then we shall speak of the duties that await you." I felt a swell of pride and nervousness. This was the man who would shape me into a knight. </nc-section> <nc-section data-title="Chapter 2: An Unexpected Meeting" data-color="green"> The stable doors creaked open, and out stepped a tall man brushing straw from his tunic. Unlike the polished knights I had imagined, Sir Roland looked more like a farmer than a warrior—until I noticed the longsword at his hip and the steady, assessing gaze he fixed upon me. "So, the new squire arrives at last," he chuckled, wiping his hands. "I'm Roland. No need for all the 'Sir' nonsense when it's just the two of us and the horses." He nodded toward Thunder. "Fine beast you've got there. A knight is only as good as how he treats his mount. Remember that, lad." There was something disarming about him, and I found myself smiling despite my exhaustion. </nc-section> <nc-section data-title="Chapter 2: First Impressions" data-color="blue"> A shadow fell across the stable entrance as I led Thunder inside. Sir Roland waited there, arms crossed, his armor gleaming faintly in the dying light. He said nothing at first, only studied me with an intensity that made my heart quicken. "They told me you were young," he finally murmured, circling me slowly like a hawk surveying its prey. "But youth is no excuse for weakness. Training here is harder than anything you've known, Frederick. Many squires break before they earn their spurs." He paused, and the faintest hint of a smile touched his lips. "But something tells me you might be different. We shall see at dawn." With that, he turned and vanished into the deepening twilight, leaving me to wonder what trials lay ahead. </nc-section>
created_at
"2026-05-31T11:43:22.487Z"
5/31/2026, 11:43:22 AM
model
"anthropic/claude-4.8-opus-20260528"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2078
moderation_latency
(null)
generation_time
13179
tokens_prompt
318
tokens_completion
611
native_tokens_prompt
435
native_tokens_completion
825
native_tokens_completion_images
(null)
native_tokens_reasoning
27
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0228
router
(null)
provider_responses
0
endpoint_id
"b0d3beaa-5ff7-4666-a749-b1bb2b14c916"
id
"msg_01FstekuY5Zoy21gmVTj3X6e"
is_byok
false
latency
938
model_permaslug
"anthropic/claude-4.8-opus-20260528"
provider_name
"Anthropic"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1780227802-2yvuP3YRW5Wg3laxDVZA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1780227802-TlswhhlfsENlma7z3BfI"
upstream_id
"msg_01FstekuY5Zoy21gmVTj3X6e"
total_cost
0.0228
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval