NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHK1WVMP5AAYHQJWXH9MHPBQ
Run Details
Model:
Qwen 3.5 397B A17B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
44.9s
Cost:
$0.005647
Provider:
Alibaba
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Iron Welcome" data-color="red"> I guided Thunder into the courtyard, the cobblestones echoing under his hooves until we reached the stables. Waiting there was Sir Roland, a man carved from the same granite as the castle walls. His armor was not polished for ceremony but scarred from genuine conflict, the steel dull in the fading light. He did not smile as I dismounted. "You ride well enough," Roland said, his voice gravelly and devoid of warmth. He circled Thunder, inspecting the beast with a critical eye before turning his gaze upon me. "But riding is the least of what you must learn. Put the horse away, squire. Your training begins at dawn, and sleep is a luxury you shall rarely afford." </nc-section> <nc-section data-title="Chapter 1: The Gentleman Knight" data-color="green"> The scent of hay and earth welcomed me as I led Thunder into the stable yard. Sir Roland was there, leaning casually against a wooden post, stripping a blade of grass between his teeth. He pushed off the post as I approached, a warm smile crinkling the corners of his eyes. "Frederick, is it?" he asked, extending a hand clad in leather rather than steel. "I am Roland. Welcome to the hold." He reached out to stroke Thunder's nose, calming the stallion instantly. "Stable your friend well tonight. There will be time for swords and shields later, but first, you must feel at home within these walls." </nc-section> <nc-section data-title="Chapter 1: Whispers of Scale and Steel" data-color="blue"> Twilight deepened into violet as I reined Thunder in near the stables. Sir Roland emerged from the shadows of the archway, his movements silent despite the plate mail he wore. There was an intensity in his gaze that seemed to look through me, toward something distant and ancient. "You have arrived," he said softly, lowering his voice as if the walls themselves might listen. He stepped closer, pressing a small, cold medallion into my palm. It bore the engraving of a winged serpent. "The road was long, but the true journey starts now. Keep your wits about you, Frederick. The legacy of the dragons does not sleep, and neither should you." </nc-section>
created_at
"2026-02-16T11:04:01.516246+00:00"
2/16/2026, 11:04:01 AM
model
"qwen/qwen3.5-397b-a17b-20260216"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
781
moderation_latency
(null)
generation_time
44851
tokens_prompt
318
tokens_completion
1571
native_tokens_prompt
327
native_tokens_completion
1514
native_tokens_completion_images
(null)
native_tokens_reasoning
1006
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0056466
router
(null)
provider_responses
0
id
"chatcmpl-0f1bd6ef-529f-996e-b32d-e087ffcde490"
status
200
is_byok
false
latency
781
endpoint_id
"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name
"Alibaba"
model_permaslug
"qwen/qwen3.5-397b-a17b-20260216"
api_type
"completions"
id
"gen-1771239796-sxK6Y4SBBCsnZe0DJLWq"
upstream_id
"chatcmpl-0f1bd6ef-529f-996e-b32d-e087ffcde490"
total_cost
0.0056466
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%