NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-24-01KVX2HC59MYHBFK0J45RBYGHC
Run Details
Model:
Z.AI GLM 5.2 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
19.5s
Cost:
$0.003113
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> I dismounted Thunder near the stables, my legs stiff from the long ride. A tall figure in gleaming armor stepped from the shadows of the archway. His face was weathered, scarred from countless battles, and his eyes bore into me with an intensity that made my stomach tighten. "So, you're the boy they sent," Sir Roland said, his voice deep and commanding. He looked Thunder over, then back at me. "I've trained squires for twenty years. Most of them didn't last. Let's see if you're different." I swallowed hard and bowed. "I won't disappoint you, Sir Roland." "We'll see," he grunted, turning on his heel. "Stable your horse. You're late, and I don't tolerate tardiness." </nc-section> <nc-section data-title="Version 2: The Warm Greeting" data-color="green"> The scent of hay and horses filled the air as I led Thunder into the stable yard. A burly man with a kind face and a thick brown beard was already waiting, leaning against a wooden post with his arms crossed. When he saw me, a wide grin spread across his weathered features. "Frederick! You made it!" Sir Roland pushed off the post and strode toward me, clasping my shoulder with a firm hand. "I was beginning to worry the road had swallowed you whole." I couldn't help but smile at his warmth. "The journey was long, Sir Roland, but worth every step." "Good lad," he chuckled, glancing at Thunder. "Fine horse you've got there. Come, let's get him settled, and then I'll show you to the barracks. You must be starving." </nc-section> <nc-section data-title="Version 3: The Unsettling Encounter" data-color="blue"> The stables were quieter than I expected. I swung down from Thunder's saddle, my boots crunching on the straw-covered ground. That's when I noticed him—Sir Roland, standing perfectly still in the dim light of a lantern, as if he had been waiting for some time. "You carry the mark," he said quietly, his eyes fixed on something about me I couldn't see. "Sir?" I asked, confused. He stepped closer, studying my face with a strange expression—something between hope and fear. "There's a reason you were chosen to come here, Frederick. It has nothing to do with swordplay or horsemanship." He paused, glancing over his shoulder as if checking that we were alone. "But we'll speak of that later. For now, stable your horse and say nothing of what I've told you." </nc-section>
created_at
"2026-06-24T15:03:51.226Z"
6/24/2026, 3:03:51 PM
model
"z-ai/glm-5.2-20260616"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4447
moderation_latency
(null)
generation_time
19316
tokens_prompt
318
tokens_completion
677
native_tokens_prompt
300
native_tokens_completion
612
native_tokens_completion_images
(null)
native_tokens_reasoning
34
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0031128
router
(null)
provider_responses
0
endpoint_id
"442ea97f-ad5e-40d5-b9a6-66e9e0417dce"
id
"2026062423035179d9f045bca74bd0"
is_byok
false
latency
4446
model_permaslug
"z-ai/glm-5.2-20260616"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1782313431-SWmAvuMoa3Ogo8gfLVBL"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782313431-FQcPMO4zAXwSOG5xegbf"
upstream_id
"2026062423035179d9f045bca74bd0"
total_cost
0.0031128
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval