NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1H9RJWQCJ708GTH4GWCFEGX
Run Details
Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
20.2s
Cost:
$0.005370
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick slid from Thunder’s saddle just as a broad-shouldered man emerged from the shadow of the stables. The knight wore a weathered crimson surcoat over his mail, and his beard was streaked with iron-gray. “So you’re the new squire,” Sir Roland said, his voice low and measuring. “You ride like the wind, boy, but riding is only the first lesson. Here, you’ll learn steel, duty, and when to keep your mouth shut.” Frederick straightened under the knight’s sharp gaze. “I’m ready, my lord.” Sir Roland almost smiled. “Ready is a word for fools and kings. Come. The horses need tending before I see whether you’re fit to carry a shield.” </nc-section> <nc-section data-title="Version 2" data-color="green"> Near the stables, where the smell of hay and warm horseflesh hung thick in the evening air, Sir Roland was waiting. He leaned against a wooden post with his arms crossed, his green cloak fluttering lightly behind him. “Frederick,” he said, as though he had known the boy for years. “You made good time. Few arrive at Castle Ashward with their courage still intact.” Frederick blinked. “Courage, sir?” “The road is long and full of whispers,” Sir Roland replied. “Dragons may be gone from these lands, but their stories still bite.” He pushed off the post and clapped Frederick on the shoulder. “Come. If you’re to be my squire, you’ll begin by learning what a knight protects—and what he fears.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The stable yard was quiet except for the soft shifting of horses within their stalls. Sir Roland stepped out from beneath the archway, his blue cloak brushing the stones like water. “Frederick,” he said, extending a gloved hand. “Welcome to your new life.” Frederick clasped it, surprised by the knight’s firm but not unkind grip. Sir Roland’s eyes were pale and thoughtful, as if he saw more than he cared to speak aloud. “You carry yourself well for one so young,” Sir Roland continued. “But a squire’s worth is not measured in posture. It is measured in patience, loyalty, and what he does when no one is watching.” He turned toward the stable doors. “Come. We begin there.” </nc-section>
created_at
"2026-09-02T14:53:25.284Z"
9/2/2026, 2:53:25 PM
model
"qwen/qwen3.8-max-20260803"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1091
moderation_latency
(null)
generation_time
20127
tokens_prompt
303
tokens_completion
851
native_tokens_prompt
369
native_tokens_completion
772
native_tokens_completion_images
(null)
native_tokens_reasoning
225
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00537
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788360805-qITEyhVs2oUFD0NJi2Fs"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788360805-tGermfYBmwSJJWfEvIZL"
upstream_id
"chatcmpl-b798d648-e09a-9290-bdd5-a65f5e20022c"
provider_responses
0
endpoint_id
"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id
"chatcmpl-b798d648-e09a-9290-bdd5-a65f5e20022c"
is_byok
false
latency
1091
model_permaslug
"qwen/qwen3.8-max-20260803"
provider_name
"Alibaba"
status
200
total_cost
0.00537
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval