NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M1SXE2YF8HBF4DWSSS2K51
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
23.3s
Cost:
$0.002287
Provider:
Reka
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Near the stables, where the smell of hay and leather hung thick in the evening air, Frederick dismounted with his heart still beating from the ride. A broad-shouldered knight in dented steel steps from the stable door, his gauntlet resting on the pommel of his sword. “So,” Sir Roland says, his voice low and sharp as a whetstone. “They send us a boy instead of a blade.” Frederick swallows his frustration. “I came to be trained, my lord. I am ready to learn.” Sir Roland’s gaze sweeps over him—his too-new tunic, his uncalloused hands, his eager eyes. For a moment, the knight says nothing. Then, with a curt nod, he turns back toward the stable. “If you mean to survive, you will learn faster than you know how to ask.” </nc-section> <nc-section data-title="Version 2" data-color="green"> By the stables, where warm breath misted from the horses’ nostrils in the fading light, Frederick found a knight leaning against the wooden stall, feeding a chunk of carrot to a restless grey. “You must be Frederick,” Sir Roland says, wiping a stray drop of carrot from his glove. “And you must be Thunder, if that fine horse of yours is any mark of the young man he serves.” Frederick’s cheeks warm, but he smiles. “I am, my lord. I am ready to begin.” Sir Roland pushes off the stall and regards him without unkindness. “Good. Then we shall begin with the simplest lesson of all.” “And what is that?” Frederick asks. “A knight is not made by armor,” Roland says. “He is made by choice.” </nc-section> <nc-section data-title="Version 3" data-color="blue"> As Frederick tied Thunder’s reins to a post by the stables, a shadow moved across the stable yard. A knight stood there, still and watchful, his helm tucked under one arm and his eyes unreadable in the dimming light. “Frederick,” Sir Roland said quietly, as if the name itself carried some weight beyond the common. “You have come a long way to begin so close to the end.” Frederick’s hand tightened on the leather. “The end, my lord?” Roland did not answer at once. His gaze drifted past the stables, toward the distant spires of the castle and the pale sliver of moon above them. “Every training,” he said at last, “is a rehearsal for something older than duty.” </nc-section>
created_at
"2026-09-03T16:32:03.529Z"
9/3/2026, 4:32:03 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
214
moderation_latency
(null)
generation_time
23247
tokens_prompt
303
tokens_completion
939
native_tokens_prompt
369
native_tokens_completion
862
native_tokens_completion_images
(null)
native_tokens_reasoning
326
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00228666
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453123-zV4LfjHEYAjZ1cuImhmY"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453123-lZY8j7bFPlh7aBNFgTPQ"
upstream_id
"chatcmpl-a7bcb841-52ae-4167-a189-0a6110598292"
provider_responses
0
endpoint_id
"15086968-df2f-4d69-86bb-c74c31644bb6"
id
"chatcmpl-a7bcb841-52ae-4167-a189-0a6110598292"
is_byok
false
latency
214
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"Reka"
status
200
total_cost
0.00228666
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Reka"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval