NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR91MXNQQ15EXANETJJB9VR2
Run Details
Model:
Gemma 4 26B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
5.7s
Cost:
$0.000213
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Mentor" data-color="red"> As I pulled Thunder to a halt near the heavy timber of the stables, the rhythmic clatter of armored boots approached. A man of imposing stature, clad in polished steel that caught the dying sunlight, stepped into my path. Sir Roland, a knight whose reputation for discipline was as sharp as his blade, eyed my dusty traveling cloak with a discerning gaze. "You're late, boy," he barked, though his eyes held a flicker of curiosity. "A squire's first lesson is punctuality. Get your mount settled; we begin at dawn." </nc-section> <nc-section data-title="Version 2: The Welcoming Veteran" data-color="green"> The scent of hay and leather greeted me as I dismounted near the stables. Before I could even begin to unbuckle my saddlebags, a friendly hand rested on my shoulder. It was Sir Roland, a man whose face was a map of scars and stories, wearing a smile that seemed to soften his heavy plate armor. "Welcome to the fold, Frederick," he said warmly, his voice like rolling thunder. "The road is long and the training harder, but you've made it. Let's get you fed and rested before the master finds you." </nc-section> <nc-section data-title="Version 3: The Formal Greeting" data-color="blue"> Near the entrance to the stables, a figure emerged from the shadows of the archway, standing with a rigid, practiced grace. Sir Roland stood there, his hand resting casually on the pommel of a magnificent longsword. He did not move to embrace me, but gave a single, respectful nod that acknowledged my arrival. "The castle has been expecting you, Frederick," he stated formally. "Your lineage brings expectations, and your service shall determine if you meet them. Follow me; the Master of Arms awaits your report." </nc-section>
created_at
"2026-05-10T13:36:24.767Z"
5/10/2026, 1:36:24 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
552
moderation_latency
(null)
generation_time
4982
tokens_prompt
318
tokens_completion
457
native_tokens_prompt
329
native_tokens_completion
425
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00021277
router
(null)
provider_responses
0
endpoint_id
"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id
"chatcmpl-92b7f95ed2c58a92"
is_byok
false
latency
551
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778420184-Bn405UKUZrYZu6LJ9RQz"
session_id
(null)
api_type
"completions"
id
"gen-1778420184-pBBNAD6SXS80REwr8RNp"
upstream_id
"chatcmpl-92b7f95ed2c58a92"
total_cost
0.00021277
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval