NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KZC36B42TAQPNDEA608563
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 25s
Cost:
$0.012487
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Reception" data-color="red"> I guided Thunder through the towering castle gates, the shadows of the archway swallowing the last of the daylight. The stables stood to my right, a long stone building from which the warm scent of hay and the soft nickering of horses drifted. As I dismounted, my boots crunching on the gravel, a tall figure detached itself from the deepening gloom near the stable doors. “You must be Frederick,” the man said, his voice as hard and unyielding as the armor he wore. Moonlight glinted off the polished breastplate emblazoned with the kingdom’s crest. “I am Sir Roland, knight of this castle and your master in the arts of war.” He stepped closer, and I saw the stern lines etched around his eyes, the wary set of his jaw. He extended a gauntleted hand, not in friendship, but in assessment. I took it, feeling the calloused strength in his grip as he looked me up and down, silently measuring the worth of the young squire who had come to train beneath his banner. </nc-section> <nc-section data-title="Version 2: A Warm Welcome" data-color="green"> Thunder’s hooves struck a steady rhythm on the cobblestones as I turned toward the stables that hugged the castle’s outer wall. The scent of fresh straw and the gentle rustle of restless horses greeted me like an old friend. I had just swung my leg over the saddle when a booming voice shattered the quiet evening. “Well met, lad! You must be Frederick!” I turned to see a broad-shouldered knight approaching, his armor scuffed from use but his face split by a grin that reached his eyes. This was no distant lord of the court; this was a man who lived in the saddle and smelled of the earth. “I’m Sir Roland,” he said, striding forward with one hand outstretched and the other resting easily on the hilt of his sword. “And you’ve arrived just in time to help me settle the horses for the night.” His laugh was rich and contagious, and as I shook his hand, the last of my nervousness melted away. Surrounded by the gentle beasts and the warmth of the lantern light, I felt for the first time that I had truly come home. </nc-section> <nc-section data-title="Version 3: The First Meeting" data-color="blue"> The sky had deepened to a rich twilight blue by the time Thunder and I reached the stables at the edge of the castle yard. The torches lining the path flickered to life, casting long, dancing shadows across the wooden doors. I slid from the saddle, my legs stiff from the long ride, and led my stallion toward a waiting trough. A figure emerged from the cool shadows of the stable interior, moving with the quiet confidence of a man who had faced countless battles and lived to speak of them. He was older than I had expected, with threads of silver at his temples and a calmness in his bearing that seemed to still the very air around him. “Frederick,” he said, and his voice was low, carrying the weight of unspoken prophecies. “I am Sir Roland. I have watched for your coming.” He inclined his head, and in the stillness, with only the soft breath of the horses between us, I felt the heavy mantle of destiny settling onto my shoulders. The chronicles of old had spoken of a last dragon, and as Sir Roland’s steady gaze met mine, I knew my training was about to become something far greater than either of us had imagined. </nc-section>
created_at
"2026-09-03T15:49:33.521Z"
9/3/2026, 3:49:33 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1902
moderation_latency
(null)
generation_time
84542
tokens_prompt
303
tokens_completion
5406
native_tokens_prompt
317
native_tokens_completion
4948
native_tokens_completion_images
(null)
native_tokens_reasoning
4163
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.012487262
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788450573-kd7FFxCSagxjwGwtq4me"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788450573-ZP0QgZmQEtVG4lo2gmkF"
upstream_id
"4b33cdc0-aa72-4d03-8ca2-61e9563b26c5"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"4b33cdc0-aa72-4d03-8ca2-61e9563b26c5"
is_byok
false
latency
1902
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.012487262
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval