NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-25-01KMJ8NRFSE52WMSFX961749R2
Run Details
Model:
Qwen3 235B A22B Instruct 2507
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
8.5s
Cost:
$0.000095
Provider:
WandB
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As Thunder slowed to a trot near the stables, a tall knight in dented plate armor stepped forward, one gauntleted hand resting on the hilt of his sword. His face was weathered, his beard streaked with gray, and his eyes—pale as winter sky—studied Frederick with cool scrutiny. “You’re late,” Sir Roland said, voice like gravel beneath a boot. “We don’t coddle stragglers here. Drop your reins, dismount, and introduce yourself properly—or don’t bother staying at all.” Frederick fumbled with the stirrups, heart pounding. He hadn’t expected such severity. “S-sir Frederick of Elden Hollow, sir! I meant no disrespect—” “No excuses,” Roland cut in. “Respect is earned in silence and service. Stow your horse. Then report to the armory. We’ll see if you’ve the spine of a knight… or the whimper of a page.” </nc-section> <nc-section data-title="Version 2: A Brother in Arms" data-color="green"> Thunder nickered softly as he came to a halt by the stables, steam rising from his flanks in the cooling evening air. Before Frederick could even unhook his saddlebag, a broad-shouldered knight in polished but well-used armor emerged with a grin as warm as a summer hearth. “Ah! The new squire!” Sir Roland clasped Frederick’s hand before he’d even dismounted. “I’ve been expecting you. Heard you rode through the Blackfen alone—brave, or foolhardy, I haven’t decided yet.” Frederick flushed. “Just… following the map, sir.” Roland laughed, a booming sound that sent birds fluttering from the rafters. “Good! We need squires with grit. Come—let the stable hands tend to Thunder. You’ve earned a meal, and I’ve tales that’ll make your eyes water.” </nc-section> <nc-section data-title="Version 3: Shadows and Secrets" data-color="blue"> The stables loomed in the twilight, shadowed and still. Frederick dismounted, brushing dust from his travel-worn cloak, when a figure detached itself from the darkness beneath the overhang. Sir Roland stepped forward, clad not in ceremonial plate but in dark leather and a cloak lined with ravens’ feathers. His eyes, sharp and watchful, flicked over Frederick—and then to the horizon, as if expecting pursuit. “You’ve come at a dire hour,” he murmured, voice low. “The castle sleeps, but the throne does not. They told me you carried the signet of the Last Dragon in your family seal.” Frederick froze. That relic had been hidden for generations. “I… I don’t know what you mean, sir—” “Don’t lie to survive,” Roland said, gripping his shoulder. “Lie to win. Now follow me. The real training begins tonight.” </nc-section>
created_at
"2026-03-25T10:29:34.845Z"
3/25/2026, 10:29:34 AM
model
"qwen/qwen3-235b-a22b-07-25"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
136
moderation_latency
(null)
generation_time
8430
tokens_prompt
318
tokens_completion
723
native_tokens_prompt
306
native_tokens_completion
640
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0000946
router
(null)
provider_responses
0
endpoint_id
"c9f927db-d559-49eb-9846-80862c5e3b4e"
id
"chatcmpl-82a7deb60f8aa02c"
is_byok
false
latency
33
model_permaslug
"qwen/qwen3-235b-a22b-07-25"
provider_name
"WandB"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1774434574-4i6938Lcp3sj4NtLudTR"
upstream_id
"chatcmpl-82a7deb60f8aa02c"
total_cost
0.0000946
cache_discount
(null)
upstream_inference_cost
0
provider_name
"WandB"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval