NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1H9S4B64E0S50BQKNCCDQF6
Run Details
Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
14.6s
Cost:
$0.003714
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick slid from Thunder’s back and led the stallion toward the stables, where torchlight flickered against worn stone. A broad-shouldered man in a plain surcoat stepped out from the shadows, a warhorse nickering softly behind him. “You must be the new squire,” Sir Roland said, his voice low and steady. “I’m the knight who’ll see whether you’re made of more than fine clothes and hopeful words.” His gaze flicked to Frederick’s sword hand. “Tomorrow, we begin before dawn.” </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick guided Thunder beneath the arched entry to the stables, the scent of hay and warm horses wrapped around him. A knight with silver threading through his beard approached, offering a measured smile. “Frederick,” Sir Roland said, extending a calloused hand. “Welcome to the castle. A squire’s path is not easy, but you’ll find honest work and honest steel here.” He glanced toward the fading sunset. “Rest tonight. Tomorrow, your training begins.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stables rose ahead, dim and quiet beneath the coming night. Frederick had barely tied Thunder’s reins when a figure emerged from the gloom, armor dulled by travel but bearing still bright. “Sir Roland,” Frederick said, recognizing the knight from whispered tales. Roland inclined his head. “And you are late for peace, boy. The world grows restless, and those who would serve must learn quickly.” He turned toward the courtyard. “Come. Let us see what mettle lies beneath that eager heart.” </nc-section>
created_at
"2026-09-02T14:53:43.15Z"
9/2/2026, 2:53:43 PM
model
"qwen/qwen3.8-max-20260803"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1970
moderation_latency
(null)
generation_time
14545
tokens_prompt
303
tokens_completion
573
native_tokens_prompt
369
native_tokens_completion
496
native_tokens_completion_images
(null)
native_tokens_reasoning
111
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.003714
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788360823-FAjmIGKOSu7ZdAxLATl8"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788360823-2IgCEZ3gXckWCtewocLU"
upstream_id
"chatcmpl-7702f76e-f8c3-97c2-ba56-1827c0aadebc"
provider_responses
0
endpoint_id
"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id
"chatcmpl-7702f76e-f8c3-97c2-ba56-1827c0aadebc"
is_byok
false
latency
1968
model_permaslug
"qwen/qwen3.8-max-20260803"
provider_name
"Alibaba"
status
200
total_cost
0.003714
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval