NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M28VEKBSXFSQVDR6NXFFMQ
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 27s
Cost:
$0.013605
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (Red): A Hearty Welcome" data-color="red"> I guided Thunder through the arched gatehouse, his hooves striking sparks against the cobblestones. The outer yard opened before me, and there, beside the timbered stables, stood a broad-shouldered man in battered plate armor. A crimson cloak hung from his shoulders, and the hilt of a greatsword rose over his right shoulder. "You must be Frederick," he said, his voice like a rumble of distant thunder—fitting, I thought, given my horse. "I am Sir Roland, knight of these lands. Welcome to Castle Ashborne." He extended a gauntleted hand. I dismounted, my legs stiff from the ride, and clasped his forearm. His grip was iron, but his eyes crinkled with a warmth that set me at ease. "Stableboy!" he barked, and a lad scurried from the shadows to take Thunder's reins. "See him rubbed down and fed double oats. The beast has earned it." He turned back to me. "Your training begins at dawn, squire. Rest well tonight—you'll need it." </nc-section> <nc-section data-title="Version 2 (Green): The Dragon's Shadow" data-color="green"> The shadows lengthened across the courtyard as I rode through the gate and reined Thunder toward the stables. The air carried the scent of hay and woodsmoke, but beneath it lay something older, like the memory of burned scales. A figure waited in the gloom beside the stable doors—a tall knight whose armor was the color of moss and old copper. Across his breastplate coiled the faded emblem of a dragon, its tail ending in a spearpoint. "Frederick," he said, not as a question but as a quiet confirmation. "I am Sir Roland. You are later than the ravens promised, but the road forgives no man's hurry." He stepped into the torchlight, and I saw that his eyes were the pale green of a winter sky. "They sent you to learn the sword," he murmured, "but the realm needs more than a blade. The last dragon is not dead, whatever the songs say. Remember that when your arms ache and your faith wavers." A stable hand materialized to take Thunder, and Sir Roland rested a heavy hand on my shoulder. "Come. There is bread and salt by the hearth, and a place at my table tonight." </nc-section> <nc-section data-title="Version 3 (Blue): The Measure of a Squire" data-color="blue"> I slowed Thunder to a walk as we passed beneath the portcullis, the great stones swallowing the sound of his hooves. Near the stables, a knight in polished blue-enameled armor stood waiting, his helm tucked beneath one arm. His hair was iron-gray, his face lined with the patient creases of a man who had watched many young squires ride through those gates. "Frederick?" he asked, and when I nodded, he inclined his head. "Sir Roland. I have been asked to oversee your training." He waited while I swung down from the saddle, my boots crunching on the straw-strewn yard. Only when I stood straight did he speak again. "A squire's first duty is to his horse, and his second to the truth of his own heart. You have done well by Thunder. Now let us see what you are made of." He signaled to a groom, who led my stallion toward a waiting stall. "The mess hall will feed you, and the barracks will give you a cot. Tomorrow, at first light, we begin. Do not be late, and do not mistake my courtesy for softness." Then, almost kindly, he added, "Welcome, lad. May the forge of discipline temper you well." </nc-section>
created_at
"2026-09-03T16:40:13.022Z"
9/3/2026, 4:40:13 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2744
moderation_latency
(null)
generation_time
86938
tokens_prompt
303
tokens_completion
5753
native_tokens_prompt
317
native_tokens_completion
5395
native_tokens_completion_images
(null)
native_tokens_reasoning
4566
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.013605209
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453613-l7QuLy1urYr5M6v97XcJ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453613-YKfoUXurppXJZ2l16uUe"
upstream_id
"ca6201ea-b71c-4c96-be62-e92f2e033cac"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"ca6201ea-b71c-4c96-be62-e92f2e033cac"
is_byok
false
latency
2744
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.013605209
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval