NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KZWCBE2F4KQH76K3X8FK51
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 24s
Cost:
$0.011772
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (Red): The Forge of Welcome" data-color="red"> The outer gates yawned wide before me, and Thunder's hooves struck sparks from the cobblestones as we thundered into the castle ward. The sky above the battlements was the color of fresh blood, and the crimson banner of the house snapped like a wound in the wind. I reined in beside the stables, where the scent of hot iron and scorched leather rolled from the forge. Stableboys scattered like frightened sparrows as a towering figure stepped from the shadows. His armor was scarred and soot-blackened, a red cloak hanging from his shoulders like a banked fire. "So," the man said, his voice a low rumble that matched Thunder's uneasy snort. "You must be Frederick." Sir Roland's gauntleted hand closed on my shoulder, hard enough to make me sit straighter in the saddle. "I am Sir Roland, and these stables are my charge. Before you touch a sword, lad, you'll learn that a knight's first duty is to the beasts that carry him to war." He grinned then, and the torchlight turned his teeth to gold. "Dismount. Let's see if your hands are as steady as your eyes." </nc-section> <nc-section data-title="Version 2 (Green): The Verdant Knight" data-color="green"> By the time Thunder and I passed beneath the gatehouse, the sun had spilled its last gold across the fields, and the world seemed to breathe in green and gold. Ivy clung to the stable walls in thick, contented ropes, and the thatched roof was bright with moss. The air smelled of rain-soaked hay, crushed mint, and the warm, living scent of horses. I had just swung down from the saddle when a voice called out, soft as a breeze through wheat. "Easy, now. That's a fine stallion you've brought us." A knight stood in the stable doorway, his armor polished but unadorned, a wreath of dried herbs tucked into his belt. Sir Roland's face was weathered and kind, his eyes the calm brown of tilled earth. He approached without haste and rested a hand on Thunder's neck; to my astonishment, the great horse lowered his head at once. "You must be Frederick," Sir Roland said, turning that gentle gaze on me. "I am Sir Roland, and I keep the stables and the old herb gardens. Welcome to Aldermere." He smiled, and the lines beside his eyes deepened. "Come inside. There is hot broth, and afterward we will find a proper stall for your friend. All things must be tended before they can grow strong." Above the stable door, a weathered weathervane caught the fading light: a dragon, green with age, turning slowly in the breeze as if it, too, were listening. </nc-section> <nc-section data-title="Version 3 (Blue): The Hour of Twilight" data-color="blue"> Dusk had deepened to a deep, bruised blue by the time Thunder carried me through the castle gates. The torches along the ward burned pale and cold, their light more silver than gold, and the banner above the keep—azure, embroidered with a coiled dragon—hung still in the cooling air. I turned toward the stables, their arches swallowing the twilight, and there I saw him. Sir Roland stood alone beneath the stone archway as if he had been carved from the night itself. His armor was chased with faint blue tracery, and his cloak was the color of a winter river. When he stepped forward, his spurs made no sound; only the faint creak of leather betrayed his movement. Thunder tossed his head, and the knight's gaze flicked to the horse, then to me. "Frederick of Aldermere," he said. His voice was quiet, precise, and utterly without warmth. "I am Sir Roland, knight of the Azure Order, and I have been instructed to receive you." He extended a gauntleted hand, not to help me down, but in formal greeting. "You are later than the ravens promised. Come. Leave your horse with the grooms. The stables will care for him; I will discover whether you are worthy of the training you seek." Somewhere in the rafters above, a lone owl called, and the first stars pricked through the blue like the points of forgotten swords. </nc-section>
created_at
"2026-09-03T15:58:27.188Z"
9/3/2026, 3:58:27 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2080
moderation_latency
(null)
generation_time
83476
tokens_prompt
303
tokens_completion
5002
native_tokens_prompt
317
native_tokens_completion
4662
native_tokens_completion_images
(null)
native_tokens_reasoning
3703
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.011771976
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788451107-FOMFus3qlVm5xZshDOqd"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788451107-jlM56EsJ38xSCX3JrZWO"
upstream_id
"58dde2a0-3f20-4b6e-9909-b9b247461100"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"58dde2a0-3f20-4b6e-9909-b9b247461100"
is_byok
false
latency
2080
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.011771976
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval