NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-06-24-01KVX38QA6VTC5TG7HABB4B3TW
Run Details
Model:
Z.AI GLM 5.2 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.7s
Cost:
$0.003663
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Gruff Welcome" data-color="red"> As I dismounted Thunder near the stables, a tall figure clad in gleaming armor strode toward me. His face was weathered by years of battle, a thick scar running from his left eye to his jaw. Sir Roland, the local knight, stopped before me and looked me up and down with a critical eye. "So, you're the new squire," he said, his voice like gravel grinding beneath a cart wheel. "You look like a strong wind could knock you over." I straightened my back and met his gaze. "I am Frederick of Ashwood, sir. I am stronger than I appear." Sir Roland let out a grunt that might have been a laugh. "We shall see, boy. We shall see. Stables need mucking first thing. Then we'll see if you can hold a sword without cutting yourself." He turned on his heel and walked away, his cape swishing behind him. I swallowed hard. My training had begun. </nc-section> <nc-section data-title="Version 2: A Warm Reception" data-color="green"> The smell of hay and horses filled the air as I led Thunder into the stables. A kind-faced man with silver hair approached, wiping his hands on a cloth. Despite his age, his arms were thick with muscle, and he moved with the easy grace of a seasoned warrior. "You must be Frederick," he said warmly, extending a calloused hand. "I'm Sir Roland. I've been expecting you." I shook his hand, feeling the firm grip of a man who had spent a lifetime holding a sword. "It's an honor, sir. I've heard stories of your deeds since I was a boy." Sir Roland smiled, his eyes crinkling at the corners. "Stories grow taller with each telling, I assure you. But come, let's get your horse settled. You've had a long journey, and tomorrow we begin your training in earnest. There is much to learn, and less time to learn it than there once was." A shadow passed over his face as he said this, as if some unspoken worry weighed on his mind. </nc-section> <nc-section data-title="Version 3: An Unsettling Encounter" data-color="blue"> I had barely dismounted when I sensed someone watching me. Near the stable entrance, leaning against a wooden post, stood a knight in dark armor. His arms were crossed, and his eyes—pale blue and piercing—studied me with an intensity that made my skin prickle. "Took your time getting here," Sir Roland said flatly, not moving from his post. "The roads were—" "I don't care about the roads." He pushed off from the post and walked slowly toward me. "What I care about is whether you're worth the trouble. Lord Aldric sent word that you have potential. I don't see it yet." He stopped inches from me. Up close, I could see the faint silvery pattern of old burns on his neck, disappearing beneath his armor. "Tell me, Frederick of Ashwood," he whispered, glancing toward the darkening sky to the east. "Do you believe in dragons?" The question caught me off guard. Before I could answer, he turned away. "Get some rest. Tomorrow, everything changes."
created_at
"2026-06-24T15:16:36.307Z"
6/24/2026, 3:16:36 PM
model
"z-ai/glm-5.2-20260616"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3119
moderation_latency
(null)
generation_time
17617
tokens_prompt
318
tokens_completion
817
native_tokens_prompt
300
native_tokens_completion
737
native_tokens_completion_images
(null)
native_tokens_reasoning
36
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0036628
router
(null)
provider_responses
0
endpoint_id
"442ea97f-ad5e-40d5-b9a6-66e9e0417dce"
id
"20260624231636aba67fb963324a57"
is_byok
false
latency
3119
model_permaslug
"z-ai/glm-5.2-20260616"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1782314196-WtkhQ6SjWpOJzXGmVWS4"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782314196-WoE3DVH05DK71J1wW5D2"
upstream_id
"20260624231636aba67fb963324a57"
total_cost
0.0036628
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval