NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-25-01KMJ8MAWFPST6EA4HMCZ9KM1E
Run Details
Model:
Qwen3 235B A22B Instruct 2507
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.3s
Cost:
$0.000401
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As I reined in Thunder before the stables, a tall knight clad in darkened steel stepped forward, his tabard bearing the sigil of a silver hawk. His face was weathered, lined with years of battle, and his eyes appraised me like a blacksmith inspecting flawed iron. "Another squire," he said, voice like gravel under boot. "I trust you can stable your own horse, boy? Or must we assign you a nursemaid as well?" I swallowed hard, dismounting with what dignity I could muster. "I can manage, ser." "Good," Sir Roland grunted. "Because tomorrow, before dawn, you’ll be mucking those stalls before we begin your training. We’ll see if city softness lingers in those hands." He turned on his heel, leaving me with nothing but the chill of his presence and the weight of impending duty. </nc-section> <nc-section data-title="Version 2: A Grizzled Mentor" data-color="green"> I was brushing down Thunder when a broad-shouldered figure emerged from the stable shadows, one hand resting on the hilt of a well-worn blade. His armor bore the dents of forgotten battles, but his smile—though rare—was kind. "First time away from home, lad?" Sir Roland asked, his voice low and steady as river stone. I nodded, suddenly feeling younger than my sixteen years. He clapped a gauntleted hand on my shoulder. "Every knight begins exactly where you stand—nervous, eager, and covered in horse dust. Stable your mount, then meet me in the courtyard. There’s much to teach, but we begin with trust: yours in me, mine in you." I straightened at his words, the burden of expectation now threaded with hope. </nc-section> <nc-section data-title="Version 3: An Unexpected Bond" data-color="blue"> The stable doors creaked as Sir Roland stepped out, not in armor, but in plain tunic and boots. In his hands was a leather-bound book, its pages worn at the edges. He paused, studying me with sharp, curious eyes. "You’ve the look of the northern clans," he said. "Your father a woodsman or a warrior?" "A bit of both, ser," I replied. "He taught me to track before I could read." Roland’s lips curled into a rare smile. "Then you may teach *me* before the week is out. Come—let’s see if your hands are as clever with a sword as they are with that halter." And with that, he tossed me a practice blade from the rack, its weight strange but promising in my grip. </nc-section>
created_at
"2026-03-25T10:28:48.147Z"
3/25/2026, 10:28:48 AM
model
"qwen/qwen3-235b-a22b-07-25"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
508
moderation_latency
(null)
generation_time
10254
tokens_prompt
318
tokens_completion
634
native_tokens_prompt
306
native_tokens_completion
594
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000400959
router
(null)
provider_responses
0
endpoint_id
"813ce28a-1334-47e3-881e-a7f8833b34b4"
id
"chatcmpl-dc2f34a1-b046-9a1c-8855-c61a85885678"
is_byok
false
latency
508
model_permaslug
"qwen/qwen3-235b-a22b-07-25"
provider_name
"Alibaba"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1774434528-oRxvxhrcqGIIAVX9qs1e"
upstream_id
"chatcmpl-dc2f34a1-b046-9a1c-8855-c61a85885678"
total_cost
0.000400959
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval