NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1H976DNWM5GZ0BG2RDV8DHY
Run Details
Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
28.2s
Cost:
$0.007434
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As Frederick guided Thunder toward the stables, a broad-shouldered man stepped out from the shadow of the gatehouse. His armor was worn but polished, and a crimson cloak hung from his shoulders like a banner of old battles. “So you’re the new squire,” Sir Roland said, his voice deep but not unkind. His eyes swept over Frederick with the practiced calm of a man who had measured many young hopefuls and found most wanting. “I’ve seen boys arrive with finer horses and richer cloaks, but fewer of them had the look of someone who knows how to listen. That matters more here than gold.” He reached out and rested a gloved hand on Thunder’s neck, and the stallion, surprisingly, did not shy away. “The castle will try to make you into something,” Sir Roland continued. “A soldier. A servant. A hero, if the singers are lucky. But first, it will try to break you. If you survive the breaking, you may yet become useful.” Frederick dismounted, his legs stiff from the ride, and bowed his head. “I’m ready to learn, sir.” Sir Roland gave a short laugh. “No, you’re not. But readiness is a thing built, not born. Come. We’ll see if you can muck a stall before I decide whether to trust you with a sword.” </nc-section> <nc-section data-title="Version 2" data-color="green"> The stables smelled of hay, warm horseflesh, and iron. Frederick had just swung down from Thunder’s back when a voice called out from behind a stack of saddles. “Careful with that one,” said Sir Roland, stepping into the lantern light. He was younger than Frederick had expected—perhaps only a few years older than a squire himself—with sharp green eyes and an easy smile. “Thunder looks noble, but horses can smell fear. And you, Frederick, smell like a boy who has never been farther than a day’s ride from home.” Frederick flushed. “I’m not afraid.” “Good,” Sir Roland said. “Fear keeps men alive. Pride gets them killed. Try to keep the first and lose the second while you’re under my roof.” He took Thunder’s reins and led the stallion into an empty stall with surprising gentleness. Frederick followed, uncertain whether he had been insulted or welcomed. “You’ll start tomorrow before dawn,” Sir Roland said, tossing a bundle of straw into the stall. “You’ll clean, you’ll carry water, you’ll polish mail until your fingers ache. And if you do all that without complaint, I might teach you how not to die in your first battle.” Frederick stared at the straw, then at the knight. “That’s all?” Sir Roland’s smile sharpened. “For tonight, yes. But tomorrow, boy, the real training begins.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The last light of evening pooled in the courtyard as Frederick led Thunder toward the stables. The castle loomed above him, ancient and silent, its windows dark as closed eyes. He had expected trumpets, or at least a greeting. Instead there was only the creak of the wind in the rafters and the soft shuffle of hooves on stone. Then a figure emerged from the stable doorway. “You must be Frederick,” said Sir Roland. The knight was tall and lean, his hair silver despite the strength still evident in his stance. His armor bore no crest, only the dents and scratches of long service. When he looked at Frederick, it was not with suspicion or warmth, but with something older: recognition. “I had hoped you would come sooner,” Sir Roland said quietly. Frederick frowned. “Sir?” The knight glanced toward the castle keep, where the shadows seemed thicker than they should have been. “There are things moving in this place that have little to do with swords or squires. But perhaps that is why you were sent here.” Thunder snorted and stamped, as if he too had felt something unseen. Sir Roland laid a hand on Frederick’s shoulder. “Rest tonight while you can. Tomorrow I will teach you to fight. But if you are wise, you will also learn to listen. The castle has secrets, Frederick. And some of them are still breathing.” </nc-section>
created_at
"2026-09-02T14:43:55.457Z"
9/2/2026, 2:43:55 PM
model
"qwen/qwen3.8-max-20260803"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
787
moderation_latency
(null)
generation_time
28194
tokens_prompt
303
tokens_completion
1259
native_tokens_prompt
369
native_tokens_completion
1116
native_tokens_completion_images
(null)
native_tokens_reasoning
173
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.007434
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788360235-mJdmptJknvEKffTFuHbm"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788360235-0LUjlH1L7lZK7auLzIff"
upstream_id
"chatcmpl-2ca365e8-fd85-968e-9368-d242d937a7b1"
provider_responses
0
endpoint_id
"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id
"chatcmpl-2ca365e8-fd85-968e-9368-d242d937a7b1"
is_byok
false
latency
787
model_permaslug
"qwen/qwen3.8-max-20260803"
provider_name
"Alibaba"
status
200
total_cost
0.007434
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval