NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-25-01KMJ8DK5FMP2SKXMDZ92MNVN8
Run Details
Model:
Qwen3 235B A22B Instruct 2507
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.1s
Cost:
$0.000302
Provider:
Novita
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As I dismounted, a tall knight in polished armor approached, his cape flaring behind him like a banner of storm clouds. His face was weathered, his beard trimmed close, and his eyes sharp as steel. “You must be the new squire,” he said, voice low and firm. “I’m Sir Roland. If you’re to serve under this banner, you’ll learn discipline before you learn honor. Stable your horse, then report to the armory—polish every piece of training gear. We’ll see if you’ve the mettle to stand beside a knight.” I swallowed hard, suddenly aware that my journey had only just begun. </nc-section> <nc-section data-title="Version 2: A Brother in Armor" data-color="green"> A broad smile cracked across the face of the knight approaching from the stables. “Frederick! At last, you’ve arrived,” he said, clapping me on the shoulder with a gauntleted hand. “I’m Sir Roland—your uncle spoke highly of you.” His voice carried warmth, like embers in a hearth. “Come, let one of the stable hands take Thunder. You look half-starved. We’ll break bread in the hall and you can tell me all about your journey. Tomorrow, the real work begins.” There was kindness in his eyes, and for the first time since leaving home, I felt a flicker of belonging. </nc-section> <nc-section data-title="Version 3: Shadows and Secrets" data-color="blue"> Sir Roland emerged from the shadows near the stables, his armor dull and unadorned, as if he wished to remain unseen. He studied me for a long moment, silent, before speaking. “You carry your father’s eyes,” he murmured. “And his recklessness, I assume.” My breath caught. I had never spoken of my father here. “Follow me,” he said, turning without waiting for a reply. “The castle has ears, and some truths are not meant for stables or sunlight.” Confused and curious, I led Thunder behind him, wondering if this training would be about more than swordplay and chivalry. </nc-section>
created_at
"2026-03-25T10:25:07.252Z"
3/25/2026, 10:25:07 AM
model
"qwen/qwen3-235b-a22b-07-25"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1122
moderation_latency
(null)
generation_time
11053
tokens_prompt
318
tokens_completion
522
native_tokens_prompt
306
native_tokens_completion
473
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00030188
router
(null)
provider_responses
0
endpoint_id
"cf186489-d252-4fb7-aca9-87ef7b557eff"
id
"6e8ce1f3e6e3930d0908bcc04f61aaa3"
is_byok
false
latency
840
model_permaslug
"qwen/qwen3-235b-a22b-07-25"
provider_name
"Novita"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1774434307-PvZhGpbsHx8k3EMdyQmY"
upstream_id
"6e8ce1f3e6e3930d0908bcc04f61aaa3"
total_cost
0.00030188
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval