NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M20MGFH3BXP6QN038VX4YX
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
2m 23s
Cost:
$0.021708
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Fiery Welcome" data-color="red"> Frederick urged Thunder through the castle gatehouse, the stallion’s hooves ringing like hammer blows on the cobblestones as the last blood-red light of sunset washed over the stone walls. He rode on until the warm, dusty scent of hay told him he had reached the stables. There, near the wide double doors, stood a broad-shouldered man in scarred plate armor, a crimson cloak hanging heavy from his shoulders. This was Sir Roland, the local knight. “You must be Frederick,” Sir Roland said, his voice rough as gravel as he greeted Frederick near the stables. “I am Sir Roland. Dismount, lad—let us see whether your sword arm is as bold as your ride.” He extended a gauntleted hand, his eyes sharp and appraising beneath a helm pushed back on his brow, and Frederick felt the first spark of the fire that would forge him into a knight. </nc-section> <nc-section data-title="Version 2: The Green Knight's Welcome" data-color="green"> Frederick guided Thunder beneath the raised portcullis and into the castle’s outer ward, where the stables stood beside a lush training yard bright with new grass. He slid from the saddle at the stable door, his legs stiff from the long ride, and led the stallion forward with a reassuring murmur. Near the stables, Sir Roland, the local knight, greeted Frederick with a warmth that instantly eased his nerves. “Welcome, Frederick,” the knight said, his voice as easy as a summer breeze. He wore a forest-green tunic over polished mail, and his smile reached his eyes. “I am Sir Roland, and I will be overseeing your training. That is a fine horse—Thunder, is it not? A stable hand will see to him. Then we shall begin where every true knight begins: by learning to care for the beasts that carry us into legend.” Frederick felt the tightness in his chest loosen; in the green hush of the ward, the path ahead no longer seemed so steep. </nc-section> <nc-section data-title="Version 3: Twilight and Omen" data-color="blue"> The sky had deepened to a cold, steel blue by the time Frederick rode Thunder through the castle gates and down the shadowed lane toward the stables. Lanterns guttered to life along the walls, their pale flames doing little to push back the gathering dusk. Near the stables stood Sir Roland, the local knight, his armor the dark blue of a winter sea. He greeted Frederick with a solemn inclination of his head, his expression unreadable. “So you have come at last, Frederick,” Sir Roland said, his voice low and edged with something very like sorrow. “I am Sir Roland. Come, walk with me where the shadows are thin. There are tales in this castle—of the Last Dragon, and of the darkness that stirs beyond the hills. Your training begins tonight, squire, and it will not be the glory you have dreamed.” A chill that had nothing to do with the evening air traced Frederick’s spine as he dismounted before the knight, and the banners of the kingdom snapped once, sharply, in the rising wind. </nc-section>
created_at
"2026-09-03T16:35:43.766Z"
9/3/2026, 4:35:43 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2191
moderation_latency
(null)
generation_time
142407
tokens_prompt
303
tokens_completion
9620
native_tokens_prompt
317
native_tokens_completion
8635
native_tokens_completion_images
(null)
native_tokens_reasoning
7932
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.021708449
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453343-YRBdwHJlUUY9ct4Jimwv"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453343-W20bxbASN3hMz3m5hlC6"
upstream_id
"ab133aa2-e829-484b-8fa0-36dc16434454"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"ab133aa2-e829-484b-8fa0-36dc16434454"
is_byok
false
latency
2191
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.021708449
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval