NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHK24C6M141YZDXW2BXGSCB3
Run Details
Model:
Qwen 3.5 397B A17B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
52.2s
Cost:
$0.006550
Provider:
Alibaba
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Iron Greeting" data-color="red"> I reined Thunder in before the wooden expanse of the stable doors, the horse snorting softly as the adrenaline of the ride faded. Before I could dismount, a shadow fell over us. Sir Roland stepped from the gloom of the stallways, his plate armor gleaming like fresh blood in the dying light. He did not smile. His eyes, hard and evaluating, scanned me from boot to helm. "Frederick," he rumbled, his voice like grinding stones. "You ride well, but the road matters less than the steel you hold. Welcome to the fortress. Leave your comfort at the gate." He took Thunder's reins from my trembling hands, his grip iron-tight. "Training begins at dawn. Do not be late." </nc-section> <nc-section data-title="Chapter 1: The Hay-Scented Welcome" data-color="green"> The scent of dry hay and earth washed over me as I guided Thunder into the courtyard. A man emerged from the shadows of the stallways, brushing straw from a tunic worn soft with age. Sir Roland smiled, the lines around his eyes crinkling with genuine warmth. "Easy now, lad," he said, reaching out to stroke Thunder's velvet nose. "He's a fine beast. You've treated him well on the road." Roland turned to me, offering a hand that smelled of leather and mint. "I am Roland. Here, we train not just the sword arm, but the heart. Rest tonight, Frederick. The castle is your home now." </nc-section> <nc-section data-title="Chapter 1: Shadows in the Stable" data-color="blue"> Twilight deepened into indigo as I pulled Thunder to a halt near the stone troughs. Sir Roland was waiting, though I hadn't heard him approach. He stood perfectly still, his blue cloak merging with the shadows of the stables. "The wind carries many things," Roland said quietly, his gaze fixed not on me, but on the northern tower where a faint, unnatural glow flickered. "It carries dust, and rain, and sometimes... whispers." He finally looked at me, his eyes piercingly bright. "You have come seeking knighthood, Frederick. But know this: the training you undergo here is for a threat far older than steel. Welcome to the watch." </nc-section>
created_at
"2026-02-16T11:08:15.362671+00:00"
2/16/2026, 11:08:15 AM
model
"qwen/qwen3.5-397b-a17b-20260216"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
877
moderation_latency
(null)
generation_time
52169
tokens_prompt
318
tokens_completion
1830
native_tokens_prompt
327
native_tokens_completion
1765
native_tokens_completion_images
(null)
native_tokens_reasoning
1247
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0065502
router
(null)
provider_responses
0
id
"chatcmpl-ba2479fd-c80f-9c91-b357-46db07fdd1d3"
status
200
is_byok
false
latency
877
endpoint_id
"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name
"Alibaba"
model_permaslug
"qwen/qwen3.5-397b-a17b-20260216"
api_type
"completions"
id
"gen-1771240042-a0fr2lfJcM3R8dCzNOT0"
upstream_id
"chatcmpl-ba2479fd-c80f-9c91-b357-46db07fdd1d3"
total_cost
0.0065502
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%