NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M10D2NF6GADEDTYKKP43MX
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 34s
Cost:
$0.014878
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival – Version 1: A Fiery Welcome" data-color="red"> I urged Thunder through the castle gates and drew rein in the stable yard, the banner’s crimson folds still dancing in my mind. The moment my boots touched the straw-strewn ground, a voice like grinding stone called out. “Ho there! You ride as if the hounds of hell are on your heels.” Sir Roland emerged from the stable’s shadow, a mountain of a man in scarred plate armor, a red cloak billowing behind him. His eyes swept over me, sharp and assessing. “I am Sir Roland,” he said, “and you must be Frederick. You’ve spirit—I’ll grant you that. But spirit without discipline is a wildfire that burns its own forest. Stow your saddle, then find me in the training yard at dawn. We’ll see if you can be tempered into a knight.” He turned on his heel, leaving me with Thunder’s warm breath and the sudden, thrilling weight of expectation. </nc-section> <nc-section data-title="Chapter 1: The Arrival – Version 2: A Gentle Hand" data-color="green"> I guided Thunder beneath the raised portcullis and across the outer ward until the stables rose before me, their timbered walls glowing in the last light. Sliding from his back, I led him toward an open stall. A knight knelt in the straw nearby, cradling a foal’s leg with surprising tenderness. He looked up, and I saw a kindly face framed by a faded green hood. “Frederick?” he asked, rising. “I am Sir Roland. Welcome.” His voice was warm, like sun on turned earth. “You’ve come a long way, and your horse has carried you well. Let’s get Thunder rubbed down and fed; a squire’s first duty is to those who cannot speak for themselves.” As we worked side by side, the castle’s bustle seemed to fade, and I felt, for the first time, that I might truly belong. </nc-section> <nc-section data-title="Chapter 1: The Arrival – Version 3: The Forge and the Hammer" data-color="blue"> The banners snapped once more as I guided Thunder through the castle gates and into the outer ward, their blue hues darkening with the twilight. I dismounted beside the stables, my boots sinking into cool mud. From the stillness of the archway stepped a knight clad in immaculate steel, a deep-blue cloak clasped at his throat. He regarded me with eyes the color of a frozen lake. “You are Frederick,” he stated, not as a question but as a verdict. “I am Sir Roland. You have arrived later than the schedule I set for your father’s son.” His tone was not unkind, merely precise, as if weighing my worth on an unseen scale. “Stable your horse, then report to the armory. Here, we rise before the sun and answer for every hour we waste. Do not mistake this castle for a haven, squire. It is a forge—and I am the hammer.” With that, he gestured for a groom and turned away, leaving me alone with the echo of his challenge. </nc-section>
created_at
"2026-09-03T16:18:07.581Z"
9/3/2026, 4:18:07 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2555
moderation_latency
(null)
generation_time
94046
tokens_prompt
303
tokens_completion
6234
native_tokens_prompt
317
native_tokens_completion
5904
native_tokens_completion_images
(null)
native_tokens_reasoning
5197
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.014878218
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788452287-fhXbyLS0SNvsRGOxnLki"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788452287-Iebl6cQN14x9TsLUKIaC"
upstream_id
"06ceaf0d-2c2c-49db-a4b0-e61d7ab81f0e"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"06ceaf0d-2c2c-49db-a4b0-e61d7ab81f0e"
is_byok
false
latency
2555
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.014878218
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval