NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHK2E8R7WAKY8C64DCYWHDCS
Run Details
Model:
Qwen 3.5 397B A17B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
58.4s
Cost:
$0.007036
Provider:
Alibaba
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Iron Greeting" data-color="red"> I pulled Thunder to a halt before the stone stable doors, the horse's flank heaving from the long ride. The air here smelled of iron and old sweat. Sir Roland stepped from the shadows of the archway, his armor dented from recent battles, reflecting the dying light of the sun. He didn't smile. He looked at me, then at the horse, his expression unreadable beneath his visor. "You ride well," he said, his voice rough like gravel grinding on stone. "But riding is the least of what you must learn." He placed a gauntleted hand on my shoulder, heavy as a millstone. "Leave the beast. Your real training begins now." </nc-section> <nc-section data-title="Chapter 1: The Stablemaster's Knight" data-color="green"> The scent of fresh hay welcomed me as I guided Thunder into the courtyard. Sir Roland was already there, currying a chestnut mare with rhythmic, gentle strokes. He looked up, wiping straw from his tunic, and offered a genuine smile that crinkled the corners of his eyes. "Ah, Frederick," he said, tossing the brush aside into the soft dirt. "A fine mount you have there. Treat him well, and he will treat you well." He approached us not as a commander, but as a fellow rider, extending a hand to stroke Thunder's nose. "Come, let us see to the horses before we speak of swords." </nc-section> <nc-section data-title="Chapter 1: The Oathkeeper's Welcome" data-color="blue"> As I crossed the threshold, the torches flared with an unnatural blue fire. Sir Roland stood waiting near the stable entrance, his cloak embroidered with the silver sigil of the dragon. He was tall and stoic, embodying the legends I had heard since childhood. "Frederick of the Vale," he intoned, his voice echoing off the stone walls as if amplified by magic. "You stand upon hallowed ground." He extended a hand, not to shake, but to bless, a faint glow emanating from his ring. "The path of the dragon is fraught with peril. Are you prepared to walk it?" </nc-section>
created_at
"2026-02-16T11:13:45.549168+00:00"
2/16/2026, 11:13:45 AM
model
"qwen/qwen3.5-397b-a17b-20260216"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
781
moderation_latency
(null)
generation_time
58327
tokens_prompt
318
tokens_completion
1944
native_tokens_prompt
327
native_tokens_completion
1900
native_tokens_completion_images
(null)
native_tokens_reasoning
1409
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0070362
router
(null)
provider_responses
0
id
"chatcmpl-581c35ed-eb4e-9cc7-a491-da59dc32c0d5"
status
200
is_byok
false
latency
780
endpoint_id
"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name
"Alibaba"
model_permaslug
"qwen/qwen3.5-397b-a17b-20260216"
api_type
"completions"
id
"gen-1771240366-sT4ayTiHVbsYrJpFbmyC"
upstream_id
"chatcmpl-581c35ed-eb4e-9cc7-a491-da59dc32c0d5"
total_cost
0.0070362
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%