NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-02-01M1H9Q5PCN2C1S6324R6JC6BP
Run Details
Model:
Qwen 3.7 Flash (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.1s
Cost:
$0.000284
Provider:
Alibaba
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Iron Welcome" data-color="red"> Thunder’s hooves echoed against the cobbled courtyard before I could even dismount. Before my boots touched the stone, a figure detached himself from the shadowed archway of the royal stables. He was broad-shouldered and scarred, his plate armor polished to a dull bronze sheen that caught the dying embers of sunset. This was Sir Roland, the realm’s most seasoned knight, though his eyes held none of the warmth I had hoped for. “You ride like a man fleeing his own shadow, boy,” he grunted, taking my stirrup without invitation. His grip was iron, his assessment sharper. “Drop your pack, wash the road from your face, and stand ready. Dawn does not wait for squires who sleep past first bell.” The stable doors stood open behind him, spilling the scent of hot hay and dark leather into the cooling air. My training had truly begun. </nc-section> <nc-section data-title="Chapter 1: Roots in the Stone" data-color="green"> I slipped from the saddle just as the last amber light faded beneath the western battlements. A familiar clatter of iron boots on stone announced an arrival before I saw him. Leaning against a weathered hitching post near the stables stood Sir Roland, his once-bright surcoat long traded for a practical leather jerkin embroidered with ivy and oak leaves—the sigil of his house. He watched me with the quiet patience of an old forester surveying new saplings. “Thunder carries you well,” he observed, offering a calloused hand to help me down. His smile was faint but genuine. “But horses only half the equation. You’ve got the spirit of the highlands in your stride, Frederick. Let’s hope this castle’s stone doesn’t dampen it.” He gestured toward the cool, fragrant air drifting from the open mews, where lanterns were being lit for the night shift. “Come. We’ll have supper while I tell you what kind of oath you’re about to take.” </nc-section> <nc-section data-title="Chapter 1: The Watchman’s Oath" data-color="blue"> Moonlight bled across the ramparts as I led Thunder toward the stone stalls. The day’s heat still radiated through the cobblestones, but a crisp evening wind carried the distant chime of temple bells. Near the tack room, a lone figure awaited me—Sir Roland. His mail shirt gleamed like poured silver under the rising moon, and a heavy cloak of indigo wool draped over his shoulders. He did not speak at once. Instead, his gaze traveled over me, measuring bone and bearing, until finally his voice cut through the quiet like a drawn blade. “Frederick of Oakhaven. I expected you sooner, or perhaps later. Time bends strangely when destiny draws near.” He stepped forward, placing a gauntleted hand over his heart. “Welcome to the keep. Leave your wonder at the gate tomorrow; tonight, we prepare you for the weight of steel, statute, and silence.” Behind him, the stables breathed warmly, alive with snorting beasts and crackling hearths—a world away from the secrets already waiting within the castle walls. </nc-section>
created_at
"2026-09-02T14:52:38.998Z"
9/2/2026, 2:52:38 PM
model
"qwen/qwen3.7-flash-20260727"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
409
moderation_latency
(null)
generation_time
15027
tokens_prompt
303
tokens_completion
2288
native_tokens_prompt
327
native_tokens_completion
2110
native_tokens_completion_images
(null)
native_tokens_reasoning
1414
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00028411
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788360758-BZp10McrjOjnzV53iOot"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788360758-yM9MJHPVShk2UeLciUyS"
upstream_id
"chatcmpl-88b3f47c-2897-90f2-bd29-aa4f69456894"
provider_responses
0
endpoint_id
"5a9a0ee6-874a-4d03-92be-e5094c0df4e7"
id
"chatcmpl-88b3f47c-2897-90f2-bd29-aa4f69456894"
is_byok
false
latency
409
model_permaslug
"qwen/qwen3.7-flash-20260727"
provider_name
"Alibaba"
status
200
total_cost
0.00028411
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval