NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-24-01KVX2TZT9A5XH9P9WVKZFR67Q
Run Details
Model:
Z.AI GLM 5.2 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
25.3s
Cost:
$0.005238
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I dismounted Thunder near the stables, a tall figure in gleaming plate armor strode toward me. His face was weathered by countless battles, a jagged scar running from his left brow to his jaw. Sir Roland, the local knight, stopped before me and looked me up and down with cold, appraising eyes. "So, you're the boy they've sent," he said, his voice like gravel scraping against stone. "You look half-starved and barely strong enough to hold a sword, let alone swing one." I swallowed hard and bowed my head. "I am Frederick of Ashwood, sir. I've come to—" "I know why you've come," he interrupted, snatching Thunder's reins from my hand and handing them to a stable boy. "Whether you're ready is another matter entirely. Training begins at dawn. You will not eat until your chores are done, and you will not sleep until I say so. Am I understood?" "Yes, Sir Roland," I replied, my voice trembling slightly. He leaned in close, and I could smell iron and leather on him. "Forget everything you think you know about being a knight, boy. By the time I'm through with you, you'll either be a warrior or you'll be gone. There is no middle ground." He turned sharply on his heel and walked toward the keep without another word, leaving me standing in the fading light, my heart pounding against my ribs. </nc-section> <nc-section data-title="Version 2: The Warm Greeting" data-color="green"> The smell of hay and horses filled the air as I led Thunder into the stable yard. A broad-shouldered man with a kind face and a thick brown beard was already waiting there, leaning against a fence post with his arms crossed. He wore a simple tunic emblazoned with the crest of the kingdom, and a longsword hung casually at his hip. "Frederick, I presume?" he called out, a warm smile breaking across his weathered face. I nodded quickly, suddenly feeling self-conscious. "Yes, sir. I'm here to begin my training." Sir Roland pushed off the fence and approached me with an easy, confident stride. He clasped my forearm in a firm but friendly grip. "Welcome, lad. I've heard good things about you from the villagers in Ashwood. They say you've got a strong arm and a stronger heart." I felt heat rise to my cheeks. "I've tried my best to prepare, sir." "And that's all anyone can ask," he said, turning to look at Thunder with an approving nod. "Fine horse, that one. You've clearly been taking good care of him." He gestured toward the stable. "Come, let's get your stallion settled. Then I'll show you to your quarters and we can share a meal. Training starts tomorrow, but tonight, you rest. You've had a long journey." As we walked side by side into the stables, Sir Roland told me about the castle, the other squires, and what I could expect in the weeks ahead. For the first time since leaving home, I felt a sense of belonging. </nc-section> <nc-section data-title="Version 3: The Mysterious Encounter" data-color="blue"> The stable yard was quieter than I expected. Shadows stretched long across the cobblestones as the last light of day retreated behind the hills. I was just about to unsaddle Thunder when I noticed a figure standing in the doorway of the stables, half-hidden in darkness. "You ride well for one so young," came a low, measured voice. I tensed, my hand instinctively moving toward the small dagger at my belt. The figure stepped forward into the dim light, revealing silver-streaked hair and piercing gray eyes that seemed to see right through me. He wore armor unlike any I had seen before—dark, almost black, with strange runes etched along the pauldrons. "I am Sir Roland," he said, watching my hand on the dagger with what might have been amusement. "Put that away, boy. You'll have need of real weapons soon enough." "Forgive me, sir," I said, straightening up. "I wasn't expecting—" "No one ever is," he interrupted, his gaze drifting toward the distant mountains to the east. A strange, troubled expression crossed his face before he composed himself. "Tell me, Frederick, why do you wish to become a knight?" The question caught me off guard. "To serve the kingdom, sir. To protect the innocent and uphold justice." Sir Roland studied me for a long moment, then nodded slowly. "A fine answer. But I wonder if you know what truly threatens this kingdom." He glanced once more toward the mountains, and I thought I saw a faint flicker of something—fear? urgency?—in his eyes. "Come. There is much we need to discuss, and less time than either of us would like." </nc-section>
created_at
"2026-06-24T15:09:06.261Z"
6/24/2026, 3:09:06 PM
model
"z-ai/glm-5.2-20260616"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3320
moderation_latency
(null)
generation_time
25166
tokens_prompt
318
tokens_completion
1236
native_tokens_prompt
300
native_tokens_completion
1095
native_tokens_completion_images
(null)
native_tokens_reasoning
40
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.005238
router
(null)
provider_responses
0
endpoint_id
"442ea97f-ad5e-40d5-b9a6-66e9e0417dce"
id
"202606242309069012344f0cd54bf7"
is_byok
false
latency
3320
model_permaslug
"z-ai/glm-5.2-20260616"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1782313746-a0fGASZieJrrgGX9OGLf"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782313746-OaNN2BvJVWjAHdynEDn0"
upstream_id
"202606242309069012344f0cd54bf7"
total_cost
0.005238
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval