NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1HAGV6KR2SXFMN320CASQAT
Run Details
Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
22.4s
Cost:
$0.005328
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight’s Welcome" data-color="red"> Frederick reined in Thunder as the great stallion’s hooves struck the cobbled yard before the stables. The air smelled of hay, warm horseflesh, and the faint tang of smith-fire from the nearby forge. Before he could dismount, a broad-shouldered man stepped from the stable doorway, his armor dulled with travel but his bearing proud. “You must be Frederick,” said Sir Roland, his voice deep but not unkind. “You’ve arrived just before the evening bell. I trust the road treated you well?” Frederick straightened, suddenly aware of the dust on his cloak and the nervousness in his chest. “It did, my lord. I am honored to begin my training here.” Sir Roland’s eyes flicked toward Thunder, then back to Frederick with a faint smile. “A fine horse. A squire who can ride well has already learned one useful thing. Come. Let us see what else you bring besides courage.” </nc-section> <nc-section data-title="Version 2: Steel and Straw" data-color="green"> The stables rose low and long beside the castle wall, their doors open to the fading light. Frederick was just guiding Thunder into the yard when a knight appeared from within, brushing straw from his gauntlets. His hair was iron-gray, though his face was still sharp with authority. “Frederick,” the knight said, not as a question but as a confirmation. “I am Sir Roland. I oversee the training of squires here, and I was told you would arrive today.” Frederick slid from the saddle and bowed his head. “Sir Roland. I did not expect to be met so soon.” “Good,” Sir Roland replied. “Knighthood begins with expecting the unexpected.” He laid a hand on Thunder’s neck, calming the horse with practiced ease. “You’ll find no easy road within these walls, boy. But if you have the heart for it, you may yet become something worth remembering.” </nc-section> <nc-section data-title="Version 3: A Quiet Omen" data-color="blue"> As Frederick led Thunder toward the stables, the evening shadows stretched long across the ground. A knight stood waiting near the water trough, his cape still fastened at his shoulder despite the hour. There was something watchful about him, as though he had been expecting more than just a new squire. “Frederick?” the knight asked. “Yes, sir,” Frederick answered, tightening his grip on the reins. “I am Sir Roland.” The knight studied him for a moment, then glanced beyond him toward the open road, as if checking whether anyone had followed. “You are welcome here. But hear me well: this castle has many eyes, and not all of them are friendly. Keep your blade clean, your tongue quieter, and your ears open.” Frederick felt a chill that had nothing to do with the evening air. “Yes, Sir Roland.” The knight gave a short nod. “Then come. Your training begins tonight.” </nc-section>
created_at
"2026-09-02T15:06:40.224Z"
9/2/2026, 3:06:40 PM
model
"qwen/qwen3.8-max-20260803"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1167
moderation_latency
(null)
generation_time
22392
tokens_prompt
303
tokens_completion
865
native_tokens_prompt
369
native_tokens_completion
765
native_tokens_completion_images
(null)
native_tokens_reasoning
93
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.005328
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788361600-wVjyXOUfPT83kZUxX7WZ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788361600-q0KZLaJ89PacJeh8KuAU"
upstream_id
"chatcmpl-4a658a6a-7da1-9b59-bde8-8a38fa9e1134"
provider_responses
0
endpoint_id
"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id
"chatcmpl-4a658a6a-7da1-9b59-bde8-8a38fa9e1134"
is_byok
false
latency
1167
model_permaslug
"qwen/qwen3.8-max-20260803"
provider_name
"Alibaba"
status
200
total_cost
0.005328
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval