NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-11-11-01M75N9D1BXNNC0BXB34ZM2A7D
Run Details
Model:
Hy4 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 39s
Cost:
$0.011523
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (red): The Scarlet Greeting" data-color="red"> I reined Thunder in beside the stables just as the last light burned along the castle walls. The stable yard smelled of hot iron, straw, and horse sweat; torches had been lit early, their flames snapping like small red pennants. A groom hurried forward to take the bridle, but before his hand touched the leather, a mailed figure stepped from the shadow of the stable arch. “Frederick,” said Sir Roland, the local knight, greeting me with a grip that was more test than courtesy. His voice had the edge of a drawn blade. He wore a scarlet tabard over battered mail, and the device upon his breast—a dragon with one wing torn away—seemed darkened by old smoke. “So the boy has come to be made into a squire.” His gauntlet closed around my shoulder, firm but not unkind. “Welcome to the keep. Mind the horses, mind your temper, and mind the north tower after dusk.” He glanced toward a high, shuttered turret where no banner flew. “Some lessons here still have teeth.” </nc-section> <nc-section data-title="Version 2 (green): A Kindly Welcome" data-color="green"> I slid from Thunder’s saddle in the stable yard, where moss softened the cobbles and swallows darted beneath the eaves. The castle’s noise fell away behind me, replaced by the whisk of hay, the stamp of hooves, and the low cooing of pigeons in the loft. I was brushing dust from my sleeves when a broad-shouldered man in a weathered green cloak came round the water trough, leading an old gray mare. “Frederick, welcome,” he said. Sir Roland, the local knight, greeted me as if we had met only yesterday and not for the first time. “I am Sir Roland, knight of this valley—and, on busy mornings, humble judge of bridles and bad saddles.” He smiled, took Thunder’s reins from the stableboy, and checked the cinch with practiced hands. “Your father once rode a horse with that same impatient eye.” From his pouch he produced an apple, which Thunder accepted with embarrassing enthusiasm. Sir Roland laughed, then nodded toward the castle. “Come, lad. Supper first, drills at dawn. Before you learn to carry a sword, you must learn which creatures trust you.” </nc-section> <nc-section data-title="Version 3 (blue): The Moon in the Trough" data-color="blue"> By the time I reached the stables, sunset had drained from the sky and the castle stones had taken on a blue, bruised sheen. Thunder tossed his head at the trough; the water held a sliver of moon though the moon had not yet risen. Above the stable door, carved into the lintel, I noticed a coiled serpent with jeweled eyes, its tail disappearing beneath centuries of weathering. “Do not stare too long at that sign,” said a voice behind me. I turned. Sir Roland, the local knight, stood near the stall shadows in a cloak the color of winter rain, one hand resting on a plain sword hilt. His hair was silver at the temples, and his gaze was as calm and cold as a mountain lake. Then he inclined his head, and the sternness softened as he greeted me. “Forgive me. Welcome, Frederick. You arrived on a strange evening.” He offered me a gauntleted hand. “The banners are restless, the horses know it, and the old folk will be muttering of the Last Dragon before moonrise. But you are here for training, not omens. Leave Thunder with us, and I will show you where squires begin.” </nc-section>
created_at
"2026-11-11T15:58:08.439Z"
11/11/2026, 3:58:08 PM
model
"tencent/hy4-20261104"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1433
moderation_latency
(null)
generation_time
98674
tokens_prompt
303
tokens_completion
9440
native_tokens_prompt
317
native_tokens_completion
9109
native_tokens_completion_images
(null)
native_tokens_reasoning
8297
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.011522993
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.22.2; linux; x64))"
http_referer
(null)
request_id
"req-1794412688-3BGjvYg6Ey0QT8oCSquu"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1794412688-1W4EzMjbQlp8JFn2l6a0"
upstream_id
"1d875b5e-ff88-4aa1-bcd2-6527387a922c"
provider_responses
0
endpoint_id
"b5b076de-19fd-4e5c-adc2-2420a425969e"
id
"1d875b5e-ff88-4aa1-bcd2-6527387a922c"
is_byok
false
latency
1433
model_permaslug
"tencent/hy4-20261104"
provider_name
"Tencent"
status
200
total_cost
0.011522993
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval