NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1HHV5Y8MC7SFH13JV47N4AH
Run Details
Model:
Qwen 3.8 Flash (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.1s
Cost:
$0.000299
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Alternate Version 1: The Knight's Warning" data-color="red"> Thunder slowed to a trot as Frederick passed beneath the castle’s shadowed arch, the scent of hay and damp stone rising from the stables. There, leaning against the paddock gate with his arms crossed, stood a knight whose armor bore the deep red crest of the realm. “Squire Frederick,” Sir Roland said, his voice low and steady as a blade being drawn. “You ride well for a boy, but the road to knighthood is not won on a gallop.” The knight stepped forward, and the lantern light caught the old scar that ran from his temple to his jaw. “Welcome to Castle Alder. Keep your wits sharper than your sword, and your sword steadier than your tongue.” </nc-section> <nc-section data-title="Alternate Version 2: A Warm Greeting" data-color="green"> At the stables, groomsmen hurried to take Thunder’s reins, but it was Sir Roland who approached first, a broad smile breaking across his weathered face. “So you’re the squire they’ve sent us at last,” the knight said warmly. “Frederick of Ashfeld, is it?” He extended a gauntleted hand. “I’m Sir Roland, captain of the castle guard. A pleasure, young man.” Frederick took the hand, surprised by the firm but courteous grip. “I’ll do my best to serve, my lord.” Sir Roland laughed quietly. “Then you’ll already be ahead of most.” </nc-section> <nc-section data-title="Alternate Version 3: An Unlikely Welcome" data-color="blue"> Near the stables, Frederick reined Thunder to a halt when a knight in blue-and-silver armor stepped from the shadows. Sir Roland regarded him with calm, assessing eyes, as though measuring not just the boy’s height, but the steel within him. “You arrived on the eve of the moon’s dark,” Sir Roland said. “That is either good fortune or poor timing.” Frederick dismounted quickly. “I mean no discourtesy, my lord.” The knight’s mouth tightened, but not unkindly. “Discourtesy can be forgiven. Unpreparedness cannot. Come. If you are to serve under the banners of Castle Alder, you will learn that much first.”
created_at
"2026-09-02T17:14:38.93Z"
9/2/2026, 5:14:38 PM
model
"qwen/qwen3.8-flash-20260826"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
878
moderation_latency
(null)
generation_time
11100
tokens_prompt
303
tokens_completion
663
native_tokens_prompt
369
native_tokens_completion
591
native_tokens_completion_images
(null)
native_tokens_reasoning
84
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.000298816
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788369278-vhHj9WE0ZgelnGLGCmHp"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788369278-DJFXYKRdMIrvO0ucfqgp"
upstream_id
"chatcmpl-7183acc5-d9a0-948d-a059-bf3a3bcb7bbd"
provider_responses
0
endpoint_id
"84b1e4a7-5aed-4464-818f-1994f0b4ee18"
id
"chatcmpl-7183acc5-d9a0-948d-a059-bf3a3bcb7bbd"
is_byok
false
latency
865
model_permaslug
"qwen/qwen3.8-flash-20260826"
provider_name
"Alibaba"
status
200
total_cost
0.000298816
cache_discount
0.000034304
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval