NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1M25DSTYA0K06TGSQJP6HY8
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 46s
Cost:
$0.016284
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Warm Welcome" data-color="red"> I urged Thunder onward, and the castle gates parted before me with a groan of iron and wood. I rode into the outer ward, the banners I had seen from afar now snapping overhead. The stables stood to my left, their doors wide and lanterns glowing. I dismounted and led Thunder toward a waiting groom, but before I could hand over the reins, a tall knight stepped into my path. His armor was polished to a mirror shine, and his blue eyes crinkled at the corners. “Frederick?” he asked, though it was more a statement than a question. “I am Sir Roland, knight of this castle. We received word of your coming.” He clasped my shoulder in a firm, welcoming grip. “Welcome, lad. Your training begins tomorrow, but tonight you shall eat by my hearth. Come, let us see your horse settled.” </nc-section> <nc-section data-title="Version 2: A Gruff Reception" data-color="green"> I rode hard until the gates swallowed me, then slowed Thunder to a walk as the stable yard opened on my right. The scent of straw and sweat filled the air. I had just swung down from the saddle when a shadow fell across me. A broad knight in a battered green surcoat stood there, arms crossed over a chest plate etched with old scratches. “You’re Frederick,” he said, his voice rough as gravel. “Sir Roland. Master of the stables and of every raw recruit who thinks knighthood is glory.” He eyed Thunder with a critical grunt. “Near the stables is where all squires start, and near the stables is where most of them learn they know nothing. Drop your gear and grab a bucket. If you’re to serve here, you’ll muck stalls before you ever hold a sword.” With that, he jerked a thumb toward the stable door, already turning away. </nc-section> <nc-section data-title="Version 3: The Dragon's Warden" data-color="blue"> The gates opened like the maw of some great beast, and I guided Thunder into the castle’s shadowed ward. Dismissing the distant banners, I made for the stables, where the flicker of torches danced on stone. I had barely touched the ground when a hush stole over the yard. From the stable’s dim interior emerged a knight whose armor was the color of twilight, a lone dragon sigil picked out in silver on his breastplate. “Frederick,” he murmured, as though he had known me for years. “I am Sir Roland. You have come to train, but fate has woven a longer road for you.” His gaze drifted to the distant mountains, where storms gathered. “The last dragon sleeps, and this castle is its ward. Rest your horse, squire. Tomorrow your true apprenticeship begins—and it will test more than your sword arm.” He extended a hand, not in greeting alone, but in solemn welcome. </nc-section>
created_at
"2026-09-03T16:38:20.737Z"
9/3/2026, 4:38:20 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1828
moderation_latency
(null)
generation_time
105899
tokens_prompt
303
tokens_completion
7074
native_tokens_prompt
317
native_tokens_completion
6466
native_tokens_completion_images
(null)
native_tokens_reasoning
5805
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.01628378
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788453500-hevxLT44aqosJOGNe14c"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788453500-KOz9edJbYzAO0Qofa78A"
upstream_id
"4781e658-805a-4905-b624-20aa731adfe8"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"4781e658-805a-4905-b624-20aa731adfe8"
is_byok
false
latency
1827
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.01628378
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval