NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHK14J0ZSWBZ5231PMT7FSXW
Run Details
Model:
Qwen 3.5 397B A17B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
54.6s
Cost:
$0.007141
Provider:
Alibaba
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Iron Greeting" data-color="red"> Thunder slowed to a halt as I pulled the reins near the stone troughs, the heat radiating from the stallion's flanks matching my own nervous sweat. Before I could dismount, a shadow fell over me, long and imposing against the setting sun. Sir Roland stood there, plate armor gleaming even in the dying light, his hand resting casually on the pommel of his sword. He didn't smile. His eyes scanned me from boot to helm, critical and cold. "You're late," he rumbled, his voice like grinding stones. He stepped closer, inspecting Thunder, then me. "A squire is only as good as his bond with his beast. Let's see if you deserve the steel you hope to wear." </nc-section> <nc-section data-title="Chapter 1: Bonds of Straw" data-color="green"> The scent of hay and earth welcomed me as I guided Thunder into the stable yard, a soothing contrast to the dust of the road. Sir Roland was already there, quietly brushing down a grey mare in the twilight. He looked up as I approached, wiping sweat from his brow with a rag, and offered a warm, weathered smile that crinkled the corners of his eyes. "Welcome, lad," he said, tossing the brush aside into the hay. "The road is long, but the stables are safe. Tend to your mount first; a knight's duty begins with care, not combat. We shall speak once the horse is fed." </nc-section> <nc-section data-title="Chapter 1: The Azure Oath" data-color="blue"> I reined Thunder in before the wooden gates of the stable, where Sir Roland awaited like a statue carved from ice. His cloak bore the azure sigil of the Dragon Guard, fluttering softly in the evening breeze. As I swung my leg over the saddle, he stepped forward, eyes piercing through the twilight with an unsettling intensity. "Frederick," he stated, knowing my name before I spoke it. "The stars align strangely tonight. Come. There is much you must learn before the shadows rise, and the last dragon stirs in its sleep." </nc-section>
created_at
"2026-02-16T10:50:55.048156+00:00"
2/16/2026, 10:50:55 AM
model
"qwen/qwen3.5-397b-a17b-20260216"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
854
moderation_latency
(null)
generation_time
54556
tokens_prompt
318
tokens_completion
2003
native_tokens_prompt
327
native_tokens_completion
1929
native_tokens_completion_images
(null)
native_tokens_reasoning
1448
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0071406
router
(null)
provider_responses
0
id
"chatcmpl-90b020b1-6e3a-935f-ae19-af193b9abcd6"
status
200
is_byok
false
latency
854
endpoint_id
"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name
"Alibaba"
model_permaslug
"qwen/qwen3.5-397b-a17b-20260216"
api_type
"completions"
id
"gen-1771239000-vyWcAhJt2SGw7gqlVlfw"
upstream_id
"chatcmpl-90b020b1-6e3a-935f-ae19-af193b9abcd6"
total_cost
0.0071406
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%