NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1HJPWESSPMDHFRN8DT36CBK
Run Details
Model:
Qwen 3.8 Flash (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
26.8s
Cost:
$0.000409
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Knight of the North Gate" data-color="red"> Frederick pulled the reins beside the stables, where lantern light spilled across wet hay and stone. A broad figure waited by the paddock gate, armor dented from old wars but polished enough to gleam even as dusk deepened. “Sir Roland, my lord,” Frederick said, dismounting before his legs betrayed him. “I am here to begin my training.” The knight’s gaze traveled from the stallion’s foam-flecked bit to the squire’s travel-stained coat, then finally to his eyes. “You rode hard to get here, lad,” Sir Roland said, his voice like gravel under a cartwheel. “Too hard, perhaps. But if you’ve the spine to match your courage, you’ll do yet.” He clasped Frederick’s forearm with a grip that tested more than courtesy. “Welcome to Ashenhold,” Roland added. “Mind the horses first, and the men second.” </nc-section> <nc-section data-title="Chapter 2: At the Stable’s Shadow" data-color="green"> The stables smelled of rain-soaked timber and horse sweat. Frederick led Thunder toward the nearest trough, only to find a knight leaning against the stable wall as though he had been waiting there since the sun began to fade. Sir Roland was younger than Frederick had imagined, but no less imposing: dark hair tied back, a sword worn at his hip, and the kind of stillness that made a man think twice before speaking. “You must be the new squire,” Roland said, smiling without warmth. “Frederick, I think they called you.” “Sir Roland,” Frederick replied, bowing as well as exhaustion allowed. “My lady sent me to train under the garrison knights.” Roland studied him for a long moment. “Then you should know your first lesson,” he said, turning toward the stable doors. “In this castle, a squire learns not when he speaks, but when he listens. Follow me.” </nc-section> <nc-section data-title="Chapter 2: The Steward’s Knight" data-color="blue"> Frederick tied Thunder to the post near the stables, hoping the beast would forgive the haste of his arrival. He was rubbing the stallion’s shoulder when a deep voice broke through the evening quiet. “Not the friendliest way to meet the castle, boy,” Sir Roland said, stepping from the shadows between two stalls. Frederick straightened. “My lord?” The knight wore a surcoat marked with a silver hawk, its edges frayed from campaign. He gestured at the horse without looking at Frederick. “A man who rushes his mount into the yard at dusk will have no time to answer for it when the horses grow nervous.” Frederick flushed. “I meant no disrespect, sir.” Roland’s expression softened just enough to make the scold seem like instruction rather than insult. “No, you meant to impress,” he said. “Welcome to the keep. Let us see whether you can learn the difference.”
created_at
"2026-09-02T17:30:02.934Z"
9/2/2026, 5:30:02 PM
model
"qwen/qwen3.8-flash-20260826"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
685
moderation_latency
(null)
generation_time
10541
tokens_prompt
303
tokens_completion
935
native_tokens_prompt
369
native_tokens_completion
826
native_tokens_completion_images
(null)
native_tokens_reasoning
160
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.000409266
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788370202-1zCA24rGS0H9j3i8Tyrx"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788370202-5oiwhHs81VprAuKHRY6V"
upstream_id
"chatcmpl-3cfbd148-2cd1-9769-ae9b-af4fc443251e"
provider_responses
0
endpoint_id
"84b1e4a7-5aed-4464-818f-1994f0b4ee18"
id
"chatcmpl-3cfbd148-2cd1-9769-ae9b-af4fc443251e"
is_byok
false
latency
685
model_permaslug
"qwen/qwen3.8-flash-20260826"
provider_name
"Alibaba"
status
200
total_cost
0.000409266
cache_discount
0.000034304
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval