NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M1J76NJ4AC9PGW5HAY8WQD
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
9.8s
Cost:
$0.001865
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Fail
Match green prose section
(details)
Fail
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Warm Welcome" data-color="red"> As Frederick tied Thunder to the stable post, a broad-shouldered knight emerged from the shadows of the stalls. His armor gleamed in the fading sunlight, and a weathered smile broke across his scarred face. "You must be the new squire," the knight said, his voice steady as forged steel. "I am Sir Roland. The road has treated you well, it seems." Frederick tried to keep his knees from knocking. "Thank you, my lord. I'm honored to be here." Sir Roland clapped a hand on his shoulder, surprisingly gentle. "Save the honor for later, boy. Tonight, you'll eat. Tomorrow, we begin." <nc-section data-title="Version 2: A Cautionary Greeting" data-color="green"> The stables smelled of hay, sweat, and old rain. Frederick was still adjusting his belt when a voice called from between two horses. "So the castle has taken another squire." Sir Roland stepped into view, his hand resting on the pommel of his sword. His eyes were sharp, searching Frederick from cloak to boots. "Lord Sir Roland," Frederick managed, bowing as best he could. "Stand straight," the knight replied, not unkindly. "A squire who bends too early will break later. My name is Roland, and I mean to make sure you do not become another nameless ghost wandering these walls." Frederick swallowed, but he lifted his chin. "Then I will try not to fail you." Roland’s gaze lingered a moment, then softened into something almost like approval. "Good. That will have to be enough for now." <nc-section data-title="Version 3: The Knight's Measure" data-color="blue"> Near the stables, where the lanterns were just being lit, a knight in polished steel waited with the stillness of a statue. Frederick approached slowly, his boots soft on the stone. The knight turned, his expression composed, his voice carrying the quiet authority of long service. "Frederick, I presume. I am Sir Roland, keeper of the eastern gate and trainer of the castle's junior knights." Frederick inclined his head. "My lord. It is a privilege to serve here." "It is a responsibility," Sir Roland corrected. "The castle does not need mere boys who wish to be heroes. It needs those who can bear duty when no one is watching." The knight studied him for a breath longer, then nodded once. "Begin by learning the horses. A knight without humility is only a man who carries a sword too large for him."
created_at
"2026-09-03T16:27:51.391Z"
9/3/2026, 4:27:51 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
967
moderation_latency
(null)
generation_time
9711
tokens_prompt
303
tokens_completion
874
native_tokens_prompt
369
native_tokens_completion
806
native_tokens_completion_images
(null)
native_tokens_reasoning
231
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00186545
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788452871-fi7XTDbstfknjb7sNgPj"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788452871-iXn2OhEiq1Tg2qWl8ylt"
upstream_id
"chatcmpl-59a576f1a567d904a681ab828f15f2ca"
provider_responses
0
endpoint_id
"a58a4a1f-4e83-4776-a40e-9f55b72783cb"
id
"chatcmpl-59a576f1a567d904a681ab828f15f2ca"
is_byok
false
latency
965
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"Parasail"
status
200
total_cost
0.00186545
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval