NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-25-01KMJ8CGQGZH8DFQ2VC6QTE5AV
Run Details
Model:
Qwen3 235B A22B Instruct 2507
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
9.3s
Cost:
$0.000371
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> Sir Roland stood by the stables, arms crossed, his polished armor gleaming even in the fading light. His expression was unreadable as Frederick dismounted, nearly stumbling in the dirt. "Another squire," Sir Roland said, voice dry as autumn leaves. "How many more must we polish before one actually shines?" Frederick straightened, dusting off his tunic. "I’ll shine, ser. Just give me the cloth." A flicker of amusement crossed the knight’s stern face. "We shall see. Stable your horse, then report to the armory. And don’t dawdle—laziness is rust, boy. It ruins more than mail." </nc-section> <nc-section data-title="Version 2: A Fatherly Greeting" data-color="green"> As Frederick led Thunder into the stable yard, a broad-shouldered knight emerged with a gentle smile. Sir Roland wiped his hands on a cloth, then extended one in greeting. "Welcome, lad. I’m Roland. I was a squire once—stumbled into the stables just like you, if I recall, with hay in my boots and stars in my eyes." Frederick hesitated, then shook the knight’s hand firmly. "I’m Frederick, ser. I... I hope to be worthy of this place." "And I hope you’re hungry," Roland laughed. "Because training starts at dawn, and hunger makes the best teacher. First lesson: care for your horse as you would your brother. He got you here—he deserves your respect." </nc-section> <nc-section data-title="Version 3: An Ominous Encounter" data-color="blue"> The shadows stretched long as Sir Roland stepped from the stables, his armor darker than steel should be—almost blackened, as if forged in smoke. His eyes, sharp and cold, locked onto Frederick before he’d even loosened Thunder’s reins. "You feel it, don’t you?" Roland whispered, glancing skyward. "The silence. No birds. No dragons. Not anymore." Frederick frowned. "Ser?" "The castle sleeps," Roland said, turning to face him. "But you—you carry fire in your step. That’s why you were summoned. The Last Egg stirs beneath the keep. And squires don’t come here by accident." A chill ran down Frederick’s spine. "I didn’t know—" "Few do," Roland interrupted. "But now, you begin to." </nc-section>
created_at
"2026-03-25T10:24:31.988Z"
3/25/2026, 10:24:31 AM
model
"qwen/qwen3-235b-a22b-07-25"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
450
moderation_latency
(null)
generation_time
9320
tokens_prompt
318
tokens_completion
583
native_tokens_prompt
306
native_tokens_completion
544
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000371059
router
(null)
provider_responses
0
endpoint_id
"813ce28a-1334-47e3-881e-a7f8833b34b4"
id
"chatcmpl-7254e283-6832-9c7c-b576-ed71ba78b28b"
is_byok
false
latency
450
model_permaslug
"qwen/qwen3-235b-a22b-07-25"
provider_name
"Alibaba"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1774434271-uQeOVkIggXtF6PdiatZL"
upstream_id
"chatcmpl-7254e283-6832-9c7c-b576-ed71ba78b28b"
total_cost
0.000371059
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval