NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KXX1ATEVYGSE3ESVTJ42HH
Run Details
Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.6s
Cost:
$0.003653
Provider:
AkashML
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight by the Manger" data-color="red"> Near the stables, the smell of hay and horse sweat filled the air. Frederick led Thunder to a wooden manger when a heavy hand clapped him on the shoulder. “So,” said a deep voice. “The new squire.” Frederick turned to find a broad-shouldered knight in dented silver armor. A scar crossed one cheek, and his eyes were sharp as a hawk’s. “I am Sir Roland,” the knight said. “I ride the local roads and keep them from rotting into chaos.” He studied Frederick with a faint nod. “You look thinner than a blade and more nervous than a fox in the snow.” Before Frederick could answer, Roland pointed toward the castle tower. “Your training begins at dawn. Sleep if you can. The kingdom is not in the mood for boys who only know how to carry their own bags.” </nc-section> <nc-section data-title="Version 2: A Greeting Under Lantern Light" data-color="green"> By the time Frederick reached the stables, a single lantern burned above the doors, swinging softly in the evening breeze. A knight in green-trimmed armor was stroking the neck of a grey mare when he noticed the young squire. “You must be Frederick,” the knight said, his voice warm and easy. “I am Sir Roland. I have watched many hopefuls come through those gates, but few arrive with a horse named Thunder.” Frederick managed a small smile. “He earned the name.” Roland laughed. “Then we may both be in for a wild ride.” He reached into his belt pouch and placed a small iron token into Frederick’s palm. “Keep this close. It will not stop a sword, but it will remind you that the old roads still remember their promises.” As Roland turned to return to the castle, he added quietly, “The night is young, squire. Try to outlast it with honor.” </nc-section> <nc-section data-title="Version 3: Smoke and Warning" data-color="blue"> The stables were quiet, but not empty. Frederick tied Thunder to a post and stepped back when a shadow moved between the stalls. Sir Roland stepped into the dim light, his armor dull and unpolished, as if he had not yet taken the time to dress for the evening. His face was grave. “You were not meant to arrive alone,” Roland said. Frederick frowned. “I did not know there was a danger.” The knight’s eyes flicked toward the castle walls, where a thin thread of smoke rose against the darkening sky. “No one did. That is why you are here now.” Roland lowered his voice. “The dragons are gone, they say. But gone things have a way of returning to the places they once ruled.” He extended a hand. “Come. If you are to be my squire, there are questions you need to ask before the first lesson begins.” </nc-section>
created_at
"2026-09-03T15:23:51.523Z"
9/3/2026, 3:23:51 PM
model
"qwen/qwen3.8-27b-20260814"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
333
moderation_latency
(null)
generation_time
17562
tokens_prompt
303
tokens_completion
1596
native_tokens_prompt
369
native_tokens_completion
1414
native_tokens_completion_images
(null)
native_tokens_reasoning
885
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00365308
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788449031-xw77cH8ufCtw3awkWZ1Z"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788449031-jiCHRH5a8ahgpy5SQGiL"
upstream_id
"chatcmpl-9714015ea73a0d6e"
provider_responses
0
endpoint_id
"c15e008c-6180-4155-8707-bde541bc7884"
id
"chatcmpl-9714015ea73a0d6e"
is_byok
false
latency
332
model_permaslug
"qwen/qwen3.8-27b-20260814"
provider_name
"AkashML"
status
200
total_cost
0.00365308
cache_discount
(null)
upstream_inference_cost
0
provider_name
"AkashML"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval