NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1HBFEKCQJB2TEE9Y4XZ3GSP
Run Details
Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
21.9s
Cost:
$0.004998
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> The stables smelled of hay, horse sweat, and warm iron. Frederick slid from Thunder’s back, his boots landing in the straw with a soft crunch. Before he could lead his mount into the stall, a broad-shouldered man stepped from the shadows of the stable door. “Frederick,” said Sir Roland, his voice like a blade drawn slowly from its sheath. “You ride in like a man chasing glory. Here, we teach men to survive it.” His armor bore the dents of old battles, and a red cloak hung heavy from his shoulders. Frederick straightened, remembering every lesson he had ever been taught about honor and humility. Sir Roland studied him for a long moment, then gave a single nod. “See to your horse first,” he said. “Then we begin.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Thunder snorted and stamped near the stable yard, Frederick heard the slow clink of spurs against stone. He turned to find a knight approaching, his green cloak trimmed with silver thread and his dark hair threaded with gray. “So,” said Sir Roland, smiling faintly, “the boy who begged the king for a sword has finally arrived.” Frederick flushed. “I didn’t beg, my lord. I asked.” Sir Roland laughed, a warm and unexpected sound. “Good. A squire who can argue politely will need that skill before the week is out.” He laid a hand on Thunder’s neck, calming the restless horse. “You’ve spirit, Frederick. Let us hope the castle does not break it.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stable yard was hushed in the last blue light of evening. Frederick had barely thrown Thunder’s reins over a post when a knight emerged from the archway, his presence as steady as the castle walls themselves. “I am Sir Roland,” he said. “And you are late.” Frederick blinked. “My horse is not at fault, sir. The road was—” “Excuses rust faster than steel,” Sir Roland interrupted, though his eyes held no true anger. He glanced toward the distant towers, where lanterns were beginning to glow. “In this place, Frederick, you will learn more than swordplay. You will learn when to speak, when to listen, and when to fear.” Frederick’s mouth went dry. “When to fear?” Sir Roland looked at him then, and for the first time, his voice softened. “Especially when you think you are ready.” </nc-section>
created_at
"2026-09-02T15:23:23.132Z"
9/2/2026, 3:23:23 PM
model
"qwen/qwen3.8-max-20260803"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1308
moderation_latency
(null)
generation_time
21821
tokens_prompt
303
tokens_completion
792
native_tokens_prompt
369
native_tokens_completion
710
native_tokens_completion_images
(null)
native_tokens_reasoning
137
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.004998
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788362603-tnbR0BaKGy7cO8zlPcrA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788362603-noRDQnPy0Pd7hznBSOdZ"
upstream_id
"chatcmpl-94d66c5d-3302-9f81-82d2-6acf7c6d5822"
provider_responses
0
endpoint_id
"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id
"chatcmpl-94d66c5d-3302-9f81-82d2-6acf7c6d5822"
is_byok
false
latency
1308
model_permaslug
"qwen/qwen3.8-max-20260803"
provider_name
"Alibaba"
status
200
total_cost
0.004998
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval