NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M1S0JSEP5CFXE5AP1442JS
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
23.4s
Cost:
$0.002646
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> The stables smelled of hay, leather, and fresh earth. Frederick tied Thunder to the wooden post and was just reaching for his saddlebag when a broad-shouldered knight emerged from the shadowed aisle. He wore weathered armor, and a long scar crossed his jaw, fading into his beard. “So this is the new squire?” Sir Roland said, his voice low and dry as flint. His eyes swept over Frederick with careful appraisal. “Small. Quick. That will have to do.” Frederick straightened his spine. “I am Frederick. I have come to serve and to learn.” Sir Roland almost smiled, but only just. “Then you will learn that learning begins before the sword is ever drawn.” He turned and walked toward the stable’s inner door. “Follow. The castle has rules, the horses have moods, and I do not repeat myself often.” </nc-section> <nc-section data-title="Version 2" data-color="green"> Frederick had not yet dismounted before a voice called out from the stable yard. “If that horse of yours is as proud as his rider, we may have a long evening together.” Sir Roland stepped from beside a grey mare, a half-broken piece of cloth slung over one shoulder. His armor was not polished, but it was clean, and his sword hung ready at his hip. He looked at Frederick with open eyes rather than suspicion. “You have ridden far,” the knight said. “Your horse’s breathing says so. And your posture says you are afraid of being laughed at more than you are of failing.” Frederick blinked. “I am Frederick. I am here to train.” Sir Roland nodded. “Good. Training is not about proving you are brave in front of others. It is about deciding, in the quietest moments, what you are willing to endure.” He took Thunder’s bridle gently. “Now come inside. I will show you where the squire’s things are kept, and you will help me feed the horses. Even princes and princes’ hopes must begin with stable work.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> The first sound Frederick heard near the stables was not a greeting, but the sharp click of a horse’s hoof on stone. Thunder snorted, and Frederick’s hand moved instinctively to his sword hilt. A knight stood a few paces away, tall and still, with a dark cloak clasped by a silver dragon’s head. Sir Roland watched Frederick with the patience of a man who had seen many young men arrive full of certainty and leave full of humility. “You have arrived at the right time,” Roland said at last. “The last squire left this morning. He was not afraid of hard work, but he was afraid of being ordinary. That is the harder fear.” Frederick studied him. “What kind of knight are you?” Roland’s mouth tightened, almost into respect. “One who still chooses duty after the glory has gone cold.” He reached out and touched Thunder’s neck, calming the horse at once. “You may stay. But do not mistake the castle for a reward. It is a place where promises are made, and some of them cannot be broken without blood.” </nc-section>
created_at
"2026-09-03T16:31:33.984Z"
9/3/2026, 4:31:33 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
576
moderation_latency
(null)
generation_time
23407
tokens_prompt
303
tokens_completion
1084
native_tokens_prompt
369
native_tokens_completion
976
native_tokens_completion_images
(null)
native_tokens_reasoning
263
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.002645625
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453093-4MEeALTFQoaBSJvsx88d"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453093-Cl2UTVhxgiPPwNgS671Q"
upstream_id
"chatcmpl-e1dde508-1e4c-9f32-88ab-4bdfdf888a84"
provider_responses
0
endpoint_id
"255a02bd-df93-4ea7-bda9-44d4373aae18"
id
"chatcmpl-e1dde508-1e4c-9f32-88ab-4bdfdf888a84"
is_byok
false
latency
576
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"Alibaba"
status
200
total_cost
0.002645625
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval