NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KYFSKJ500V78WRAA0A7TNY
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.4s
Cost:
$0.002462
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Gruff Welcome" data-color="red"> Frederick had barely tied Thunder to the post when a heavy hand clapped him on the shoulder. The young squire turned to find a broad-shouldered knight in dented armor, his weathered face half-shadowed by a plumed helm. “Frederick, is it?” Sir Roland said, his voice low and blunt. “You’re early. The last squire who came to this castle was late, and the one before him never stayed long.” Frederick straightened, trying to hide his unease. “I’m ready to begin, my lord.” Sir Roland studied him a moment longer, then grunted. “Better than most. The stables are where your first lesson starts. If you think knighthood is all shining swords and songs, the smell of hay and horse dung will be your first reality check.” </nc-section> <nc-section data-title="Version 2: A Warm Welcome" data-color="green"> As Frederick tied Thunder to the stable post, a familiar laugh drifted from the shadow of the archway. A knight in polished bronze emerged, his armor catching the fading light, and extended a hand with a smile that seemed to ease the tension from Frederick’s shoulders. “Frederick! Welcome to the castle,” Sir Roland said warmly. “I was told a boy on a fine stallion would arrive today. You did not disappoint.” Frederick took the offered hand, surprised by its steady strength. “Thank you, my lord. I’ve been eager to begin.” Sir Roland gestured toward the stables. “Then we shall begin here. A knight who cannot care for a horse is no knight at all, no matter how bright his blade. Thunder looks to be in good spirits—perhaps he senses you are not a stranger to hard work.” </nc-section> <nc-section data-title="Version 3: A Formal Welcome" data-color="blue"> The stable doors groaned open as Frederick dismounted, and before he could gather his thoughts, a figure in dark blue livery stepped into the lane. The knight’s armor was immaculate, his movements precise, as though even a greeting were a duty to be performed without flaw. “You are Frederick,” Sir Roland said. It was not a question. His grey eyes measured the young squire from head to helm. “I am Sir Roland. I oversee the training of all who seek the king’s favor.” Frederick bowed, keeping his voice steady. “I am honored, my lord.” Sir Roland gave a curt nod. “Honor is earned, not given. Tonight you will learn the name of every stallion in these stables, the name of every strap, and the name of your first failure if you neglect them.” He turned away, then paused. “Follow me. The lesson begins now.” </nc-section>
created_at
"2026-09-03T15:34:06.204Z"
9/3/2026, 3:34:06 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
278
moderation_latency
(null)
generation_time
11289
tokens_prompt
303
tokens_completion
1154
native_tokens_prompt
369
native_tokens_completion
1077
native_tokens_completion_images
(null)
native_tokens_reasoning
455
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00246165
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788449646-xM8I8DEeJbIJKA2dpjyD"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788449646-KTdvRpwtNgZCmWtb8s4p"
upstream_id
"chatcmpl-3564ef3e59b3cf69999221802968804f"
provider_responses
0
endpoint_id
"a58a4a1f-4e83-4776-a40e-9f55b72783cb"
id
"chatcmpl-3564ef3e59b3cf69999221802968804f"
is_byok
false
latency
277
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"Parasail"
status
200
total_cost
0.00246165
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval