NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KYGTTMDKWS4171X5AKAVW8
Run Details
Model:
Hy4 Preview (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 15s
Cost:
$0.011124
Provider:
Tencent
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Trial of Mettle" data-color="red"> I slowed Thunder to a trot as the stables came into view. The scent of hay and horse hung in the air. Near the stable doors stood Sir Roland, the local knight, his hand resting on the pommel of his sword. "You must be Frederick," he said, his voice like grinding stone. He looked me over, from my dusty boots to my nervous grip on the reins. "They told me you had spirit. Let us see if you have discipline to match. Dismount, squire, and show me how you care for your beast before you ever hope to care for a sword." I slid from Thunder's back, my legs stiff from the ride, and felt the weight of his gaze. The other squires paused in their chores to watch. My training had begun not with a ceremony, but with a challenge. </nc-section> <nc-section data-title="Version 2: A Gentle Hand" data-color="green"> I reined Thunder in near the weathered stables, the golden light of dusk painting the straw-strewn yard. Sir Roland, the local knight, stepped forward, his face creased in a welcoming smile. "Frederick!" he called, his tone as warm as fresh bread. "You've arrived just in time to see the evening feeding." He gestured to Thunder, who snorted and nuzzled his shoulder. "A fine stallion. He trusts you, and that is no small thing." I dismounted, my anxiety easing at his kindness. Roland clapped a hand on my shoulder. "Fear not, lad. Every knight once stood where you stand—nervous, unsure, and hopefully hungry. Come, let's get Thunder settled, then I'll introduce you to the others." As we led the horse into the cool shadow of the stables, I knew I had found a friend in Sir Roland. </nc-section> <nc-section data-title="Version 3: The Weight of the Oath" data-color="blue"> The stables loomed ahead, their timber walls dark against the deepening twilight. I brought Thunder to a halt, the steam of his breath mingling with the chill air. From the shadows stepped Sir Roland, the local knight, his armor a deep, polished blue that seemed to swallow the light. His eyes were tired, yet sharp as honed steel. "Frederick," he said quietly, as if weighing the name. "You arrive on the eve of dark tidings. The Last Dragon stirs, and the realm needs knights more than ever." He placed a gauntleted hand on Thunder's neck, and the great horse calmed. "I greet you not with fanfare, but with a warning: the road ahead is paved with ash and valor. If your heart falters, turn back now." I swallowed hard, the cold biting at my cheeks, and shook my head. "I will not turn back, sir." A ghost of a smile touched his lips. "Then welcome, squire. Your training begins tonight." </nc-section>
created_at
"2026-09-03T15:34:40.222Z"
9/3/2026, 3:34:40 PM
model
"tencent/hy4-preview-20260827"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1953
moderation_latency
(null)
generation_time
74943
tokens_prompt
303
tokens_completion
4691
native_tokens_prompt
317
native_tokens_completion
4403
native_tokens_completion_images
(null)
native_tokens_reasoning
3745
native_tokens_cached
192
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.011124217
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788449680-viVM15tfBBCgBvRIjBHa"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788449680-fwTz9lXvkzzetxnGPNIm"
upstream_id
"5b8ab1a8-9d21-493e-be3f-554b3545a222"
provider_responses
0
endpoint_id
"ad2a4093-3d2a-41d9-adf1-8b499ac8445d"
id
"5b8ab1a8-9d21-493e-be3f-554b3545a222"
is_byok
false
latency
1953
model_permaslug
"tencent/hy4-preview-20260827"
provider_name
"Tencent"
status
200
total_cost
0.011124217
cache_discount
0.000152064
upstream_inference_cost
0
provider_name
"Tencent"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval