NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-24-01KQ030WPYF6BWHEYHKJ7PMWCS
Run Details
Model:
Z.AI GLM 4.5 Air
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
24.7s
Cost:
$0.000824
Provider:
Z.AI
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Knight's Welcome" data-color="red"> As Frederick dismounted his horse near the stables, a knight in polished silver armor approached with measured steps. The knight's red cloak billowed gently in the breeze, and his face bore the weathered lines of many battles. "You must be Frederick, the new squire," he stated, his voice resonant with authority. "I am Sir Roland, Knight Commander of this castle." Frederick bowed deeply, his heart pounding. "I am honored to meet you, Sir Roland." The knight nodded curtly. "The stables are through that archway. See to your horse, then report to the training yard at dawn. Come prepared to work hard, for knighthood is not granted lightly but earned through sweat and sacrifice." </nc-section> <nc-section data-title="Chapter 1: The Knight's Welcome" data-color="green"> Frederick led his weary horse into the castle courtyard, heading for the stables. As he approached, a cheerful voice called out from nearby stalls. "Well now, who have we here?" Frederick turned to see a knight with kind eyes and a warm smile leaning against a fencepost. "I'm Frederick, sir. I've come to begin my training as a squire." The knight's smile widened. "Splendid! Sir Roland at your service. No need for formalities just yet—let's get your horse settled first." He clapped Frederick on the shoulder. "I remember my first day like it was yesterday. Nervous as a field mouse, I was. But you'll find this castle is more home than fortress. Come, I'll show you around after you've seen to your mount." </nc-section> <nc-section data-title="Chapter 1: The Knight's Welcome" data-color="blue"> Frederick paused at the entrance to the stables, taking in the smell of hay and horses. A figure emerged from the shadows, his dark blue tabard embroidered with silver dragons that seemed to shift in the dim light. "The Last Dragon approaches," the knight murmured, his eyes intense. "I am Sir Roland." Frederick stared, startled by the cryptic greeting. "I—I'm Frederick, sir. Reporting for duty." Sir Roland stepped closer, lowering his voice. "There are things you should know about this castle, boy. Dragons are not merely creatures of legend here. They are memories, and sometimes... they return." He placed a hand on Frederick's shoulder. "Your training will be unlike any other. Prepare your mind, not just your body." </nc-section>
created_at
"2026-04-24T15:51:33.867Z"
4/24/2026, 3:51:33 PM
model
"z-ai/glm-4.5-air"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3237
moderation_latency
(null)
generation_time
13682
tokens_prompt
318
tokens_completion
795
native_tokens_prompt
297
native_tokens_completion
696
native_tokens_completion_images
(null)
native_tokens_reasoning
188
native_tokens_cached
8
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00082364
router
(null)
provider_responses
0
endpoint_id
"f7dc79ca-bbbd-41a1-8eef-616d981ff1cb"
is_byok
false
latency
10318
model_permaslug
"z-ai/glm-4.5-air"
provider_name
"SiliconFlow"
status
504
1
endpoint_id
"90fc9bb3-01bb-419f-bb58-dea60a80d201"
is_byok
false
latency
94
model_permaslug
"z-ai/glm-4.5-air"
provider_name
"Novita"
status
429
2
endpoint_id
"c8760514-8a81-4a73-ae2c-be4942ba93f3"
id
"20260424235144ddd15a7c59134d6c"
is_byok
false
latency
3237
model_permaslug
"z-ai/glm-4.5-air"
provider_name
"Z.AI"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777045893-2eLqulUUF3fEXCwCkE2H"
session_id
(null)
api_type
"completions"
id
"gen-1777045893-Pp516lbPatCXhKe1Svsn"
upstream_id
"20260424235144ddd15a7c59134d6c"
total_cost
0.00082364
cache_discount
0.00000136
upstream_inference_cost
0
provider_name
"Z.AI"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval