NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-24-01KVX2WJD65F56GYGJMD9VM2ST
Run Details
Model:
Z.AI GLM 5.2 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
21.8s
Cost:
$0.004349
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I dismounted Thunder near the stables, a towering figure emerged from the shadows of the stone archway. Sir Roland, the local knight, stood over six feet tall, his broad shoulders draped in a worn leather jerkin that spoke of countless battles. His gray eyes, sharp as a freshly honed blade, studied me with an intensity that made my stomach knot. "So, you're the new squire," he said, his voice deep and gravelly, like stones grinding together. He crossed his arms, the scars on his forearms catching the fading light. "I've read your letter of recommendation. Pretty words from your lord. But words don't swing a sword, do they, boy?" I swallowed hard. "No, sir. They don't." A stable boy rushed forward to take Thunder's reins, and Sir Roland watched the exchange with a critical eye. "We'll see if you're made of the same steel as your words. Training begins at dawn. Not a moment later. Do you understand?" "Yes, Sir Roland," I said, standing as straight as I could manage. He grunted, turning on his heel. "Get some rest. Tomorrow, your real life begins." </nc-section> <nc-section data-title="Version 2: A Warm Reception" data-color="green"> The smell of hay and horse sweat filled the air as I led Thunder into the stables. A cheerful whistle echoed off the wooden stalls, and a man with a silver-tinged beard stepped out, wiping his hands on a cloth. "Frederick! You made it!" Sir Roland's weathered face broke into a warm smile that crinkled the corners of his eyes. He clasped my shoulder with a firm but kind hand. "When your lord said you'd be coming, I couldn't believe it. The youngest squire I've ever taken on, and already with a reputation for hard work." I felt heat rise to my cheeks. "I try my best, Sir Roland." "Trying is half the battle, lad," he laughed, a hearty sound that seemed too big for the modest stable. He gestured for a stable hand to tend to Thunder. "Come, come. You must be starving after such a journey. The cook has kept some stew warm, and I've prepared a room for you in the east wing." He walked beside me, his gait unhurried and easy. "We'll have plenty of time to discuss your training tomorrow. Tonight, you're a guest in my home. Welcome to Castle Valdris, Frederick." </nc-section> <nc-section data-title="Version 3: An Unsettling Encounter" data-color="blue"> The stable lanterns flickered as I tied Thunder to a post, my muscles aching from the long ride. A shadow shifted in the corner of my eye, and I turned to find a man leaning against the stable wall, half-hidden in darkness. "You ride well for a boy," the man said. He stepped forward, and the lantern light revealed the insignia of the king's knights on his chest — Sir Roland. But something about his expression gave me pause. His smile didn't quite reach his eyes. "Thank you, Sir Roland," I managed, though my voice wavered. He circled me slowly, like a wolf appraising its prey. "I didn't expect you so soon. Your lord mentioned you wouldn't arrive for another fortnight." He stopped in front of me, his head tilted slightly. "Tell me, Frederick — why the hurry?" I hesitated, unsure how much to reveal. The real reason for my early departure wasn't something I wanted to share with a stranger, even a knight. "The roads were clear. I made good time." Sir Roland held my gaze for a long moment, then nodded slowly. "Good time. Yes." He glanced toward the castle, where a single window glowed with an eerie pale light. "Things have a way of... accelerating here. Be careful what speed you wish for, young squire." </nc-section>
created_at
"2026-06-24T15:09:58.066Z"
6/24/2026, 3:09:58 PM
model
"z-ai/glm-5.2-20260616"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3280
moderation_latency
(null)
generation_time
21751
tokens_prompt
318
tokens_completion
984
native_tokens_prompt
300
native_tokens_completion
893
native_tokens_completion_images
(null)
native_tokens_reasoning
35
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0043492
router
(null)
provider_responses
0
endpoint_id
"442ea97f-ad5e-40d5-b9a6-66e9e0417dce"
id
"20260624230958f952f23740924475"
is_byok
false
latency
3280
model_permaslug
"z-ai/glm-5.2-20260616"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1782313798-TrtYeK1zi0TFtbyzTQTD"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782313798-2sK1LOLPgglIeq30Mc6R"
upstream_id
"20260624230958f952f23740924475"
total_cost
0.0043492
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval