NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M1X33APNA2G0FVFMCRM8FC
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 32s
Cost:
$0.013525
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Fiery Welcome" data-color="red"> I spurred Thunder the last few paces and rode beneath the shadow of the gatehouse. The heavy portcullis was already raised, and the castle’s outer ward opened before me, bathed in the bloody light of sunset. The stables stood to my left, their doors yawning wide and lanterns already lit against the coming night. I drew rein, swung down from the saddle, and led my stallion toward the trough. It was then that a tall figure stepped from the stable’s ruddy glow. A crimson cloak billowed behind him, and his armor bore the scarred marks of a dozen tourneys. “Frederick!” he barked, his voice carrying across the yard like a trumpet. “By the flames, you took long enough. I am Sir Roland, knight of this castle—and the man who will forge you into a warrior.” He crossed the distance in a few strides and thrust out a gauntleted hand. I grasped it, feeling the heat of the forge still clinging to the metal. “The stables are your first charge, squire,” Sir Roland said, a fierce grin splitting his beard. “Learn their rhythm, and you will learn the heartbeat of this keep. Now, see to your horse. Your training has already begun.” </nc-section> <nc-section data-title="Version 2: The Gentle Knight" data-color="green"> I slowed Thunder to a walk as we passed beneath the castle gate, the banners still stirring in the warm evening breeze. Inside the walls, the ward was softer somehow, the cobblestones bordered by creeping moss and the stable yard shaded by an ancient oak. The scent of fresh hay and turned earth drifted from the stables, and I felt some of the tension leave my shoulders. Dismounting near the water trough, I was running my hand along Thunder’s neck when a quiet voice spoke my name. “Frederick?” I turned to find a knight standing in the stable doorway. He wore a surcoat of forest green, its hem embroidered with golden leaves, and his face was lined with a patience that seemed carved from the land itself. “I am Sir Roland,” he said, stepping forward with an easy grace. “You’ve arrived just as the light turns golden. A good hour to begin.” He greeted me not with a shout, but with a nod and a calloused hand resting lightly on my shoulder. “A squire’s first duty is here, among the beasts who carry us into battle,” Sir Roland explained, his eyes crinkling at the corners. “Tend to Thunder, learn the rhythm of the stables, and the rest will follow in time. Welcome, lad. You are among kin now.” </nc-section> <nc-section data-title="Version 3: Twilight and Destiny" data-color="blue"> The sun had all but vanished by the time Thunder carried me through the castle gates, leaving the world washed in the deep, solemn blue of twilight. The stables rose ahead, their lanterns pale as winter stars, and the air had grown cold enough that my breath misted before me. I dismounted stiffly, my boots crunching on the frost-dusted cobbles, and led my horse toward the stable door. A knight was waiting there, armored in steel that caught the blue light and held it like still water. His bearing was formal, almost grim, and when he spoke, his voice was low and measured. “Frederick of the western valley,” he said. “I have watched the road for days. I am Sir Roland, knight of this keep, and I am to be your master.” He greeted me with a hand upon my arm, his grip cool and unyielding. “You have come to train in dark times,” Sir Roland continued, glancing toward the battlements as if he could see beyond them. “The old songs of the Last Dragon are stirring once more, and a squire must be forged before the storm breaks.” His eyes returned to mine, pale and searching. “Begin here, with your horse and your duty. The rest will come when the dragon’s shadow falls.” </nc-section>
created_at
"2026-09-03T16:33:47.632Z"
9/3/2026, 4:33:47 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1892
moderation_latency
(null)
generation_time
91597
tokens_prompt
303
tokens_completion
5865
native_tokens_prompt
317
native_tokens_completion
5363
native_tokens_completion_images
(null)
native_tokens_reasoning
4463
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.013525177
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453227-850LygtXkbo5N9Q6UewT"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453227-1t7EJwz6wzB1NieQwZhi"
upstream_id
"bb321664-54de-48e5-a845-7187f8fa0ecd"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"bb321664-54de-48e5-a845-7187f8fa0ecd"
is_byok
false
latency
1892
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.013525177
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval