NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-24-01KVX2W3AY2VJQQ9MFZXD6PH57
Run Details
Model:
Z.AI GLM 5.2 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
22.4s
Cost:
$0.004134
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a tall figure emerged from the shadows of the stone archway. His armor gleamed in the fading light, and I recognized the crest of the kingdom emblazoned on his breastplate. It was Sir Roland, the local knight, known throughout the land for his bravery in battle and his unwavering loyalty to the crown. "So, you must be the new squire," he said, his voice deep and commanding. He studied me with sharp, discerning eyes, as if measuring my worth with a single glance. "I've heard tales of your father's service. Let us hope the apple hasn't fallen far from the tree." I swallowed hard, bowing my head respectfully. "I am Frederick, sir. I am honored to be in your service." Sir Roland let out a gruff laugh and clapped a heavy hand on my shoulder. "Honored, are you? We'll see if you still feel that way after your first day of training. Come, let me show you to your quarters. Tomorrow, your real education begins." </nc-section> <nc-section data-title="Version 2: The Knight's Test" data-color="green"> The smell of hay and horse manure filled the air as I led Thunder into the stables. Before I could even secure him in a stall, a booming voice called out from behind me. "Boy! Is that any way to handle a warhorse?" I spun around to find Sir Roland striding towards me, his boots crunching against the straw-covered floor. His face was weathered by years of battle, and a long scar ran from his left temple down to his jaw. He snatched the reins from my hands and examined Thunder with an expert eye. "This animal has carried you far," he remarked, running a hand along Thunder's flank. "You've ridden him hard. A knight must care for his mount before he cares for himself. Remember that." He handed the reins back to me, his expression softening just slightly. "I am Sir Roland. You must be Frederick. I wasn't sure what to expect when they told me a squire was coming, but you've at least got the look of a fighter about you. Get your horse settled, then find me in the courtyard. We have much to discuss." </nc-section> <nc-section data-title="Version 3: An Unexpected Welcome" data-color="blue"> I was barely off Thunder's back when I heard the sound of metal clanking against metal. A knight in full armor rounded the corner of the stable, nearly colliding with me. He steadied himself and pulled off his gauntlet, extending a calloused hand. "Frederick? I'm Sir Roland. Welcome to Castle Greyhold." His handshake was firm, almost painfully so, but his eyes were warm and welcoming. Unlike the fearsome knights I had heard about in tavern tales, Sir Roland had a kindness about him that immediately put me at ease. "I apologize for not meeting you at the gates," he said, gesturing to a servant who hurried over to take Thunder's reins. "We had a... situation earlier today. One of the border patrols spotted something unusual in the mountains. Dragons, or so they claim." My heart skipped a beat at the word. Dragons? I had grown up on stories of the great beasts, but everyone knew they had been extinct for centuries. Sir Roland must have noticed the alarm on my face, because he quickly waved his hand dismissively. "Probably nothing but a large eagle or a trick of the light. But it does mean I'll need you ready to work sooner than expected. Can you handle that, young squire?" </nc-section>
created_at
"2026-06-24T15:09:42.634Z"
6/24/2026, 3:09:42 PM
model
"z-ai/glm-5.2-20260616"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3928
moderation_latency
(null)
generation_time
22292
tokens_prompt
318
tokens_completion
959
native_tokens_prompt
300
native_tokens_completion
844
native_tokens_completion_images
(null)
native_tokens_reasoning
57
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0041336
router
(null)
provider_responses
0
endpoint_id
"442ea97f-ad5e-40d5-b9a6-66e9e0417dce"
id
"2026062423094246229f3b845b4730"
is_byok
false
latency
3928
model_permaslug
"z-ai/glm-5.2-20260616"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1782313782-dbTQGhzzryXRY9TBhu3f"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782313782-GizR21yL9OYWyxnJ9Bs6"
upstream_id
"2026062423094246229f3b845b4730"
total_cost
0.0041336
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval