NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M02Q0455R9NR81GZ3D9W38
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.3s
Cost:
$0.002491
Provider:
AkashML
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight's First Test" data-color="red"> Near the stables, Frederick pulled Thunder’s reins as the horse snorted at the sight of a rider leaning against the wooden posts. A knight in dented armor looked up, his face hard beneath a battered helm. “So,” the knight said, “the castle has taken in another boy who thinks he can tame steel.” Frederick stepped down and bowed, trying to keep his voice steady. “I mean no disrespect, sir.” The knight raised an eyebrow. “Good. Disrespect is easier to cut out of a squire than fear.” He extended a gloved hand. “Sir Roland. If you survive the first month, I’ll tell you which of us is luckier.” </nc-section> <nc-section data-title="Version 2: The Stable-Side Welcome" data-color="green"> As Frederick tied Thunder to the stable rail, a low laugh came from behind a row of saddles. A broad-shouldered knight emerged, wiping hay from his cloak and smiling like the place had been expecting him all along. “New arrival?” the knight asked, taking Frederick’s hands and shaking them firmly. “Name’s Roland. Local knight, local trouble, and the one they send to find out why the horses won’t sleep.” Frederick grinned despite himself. “The castle looked large enough to hide its own problems, sir.” Roland laughed again. “It does. But so does a squire with good eyes.” He pointed a thumb toward the training yard. “You’ll need both here.” </nc-section> <nc-section data-title="Version 3: The Warning in the Shadows" data-color="blue"> By the stables, the lantern light flickered, and Frederick sensed a presence before he saw one. Sir Roland stood half in shadow, his armor scarred and his expression unreadable. “Frederick,” the knight said, his voice low. “Some come here seeking glory. You came here seeking something else.” Frederick met his gaze. “I didn’t come for glory, sir.” “No,” Roland replied, glancing briefly toward the dark gate beyond the yard. “You came for the dragon.” For a moment, the air between them seemed to still, as if the castle itself held its breath. Then Roland turned away. “Be careful, squire. Not every door in this place was opened for you.” </nc-section>
created_at
"2026-09-03T16:01:54.701Z"
9/3/2026, 4:01:54 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
455
moderation_latency
(null)
generation_time
12223
tokens_prompt
303
tokens_completion
1022
native_tokens_prompt
369
native_tokens_completion
949
native_tokens_completion_images
(null)
native_tokens_reasoning
442
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00249058
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788451314-M3jUhF2bhTTFUIT7hRlu"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788451314-ELALy3kOQ0UHVfMNepuP"
upstream_id
"chatcmpl-b765f0efb4d55d2a"
provider_responses
0
endpoint_id
"c15e008c-6180-4155-8707-bde541bc7884"
id
"chatcmpl-b765f0efb4d55d2a"
is_byok
false
latency
454
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"AkashML"
status
200
total_cost
0.00249058
cache_discount
(null)
upstream_inference_cost
0
provider_name
"AkashML"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval