NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR91S43G5JYFHC77D7ZDD9M5
Run Details
Model:
Gemma 4 26B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.0s
Cost:
$0.000503
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Instructor" data-color="red"> As the rhythmic thud of Thunder's hooves slowed near the timber-framed stables, a tall figure stepped from the shadows. Sir Roland, a man whose armor seemed to hold the weight of a thousand battles, stood waiting. His gaze was piercing, sweeping over Frederick and his mount with clinical precision. "You're late, boy," he remarked, his voice like grinding stones. "In this castle, punctuality is as vital as the edge of a blade. Get that beast settled; we begin your lessons at first light." </nc-section> <nc-section data-title="Version 2: The Kind Mentor" data-color="green"> The scent of fresh hay and oiled leather greeted me as I guided Thunder toward the stalls. Standing by the manger was Sir Roland, his face etched with lines of experience and a surprising warmth. He caught my eye and offered a wide, welcoming grin. "Welcome to the fold, Frederick!" he called out, stepping forward to pat Thunder's neck. "A fine beast you have there. Rest him well, and find your way to the mess hall. You'll need your strength for the tasks ahead." </nc-section> <nc-section data-title="Version 3: The Weary Guardian" data-color="blue"> Shadows lengthened across the stable yard as I dismounted. Sir Roland was already there, leaning heavily against a post, his hand resting idly on the pommel of his weathered sword. He didn't speak at first, his eyes studying me with an intensity that made my skin prickle. "So, the new squire arrives," he said softly, the sound barely rising above the evening breeze. There was something in his expression—not quite kindness, but a profound, weary recognition—that made me wonder if I had truly understood the gravity of the path I had chosen. </nc-section>
created_at
"2026-05-10T13:38:42.424Z"
5/10/2026, 1:38:42 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
245
moderation_latency
(null)
generation_time
6739
tokens_prompt
318
tokens_completion
1211
native_tokens_prompt
327
native_tokens_completion
1151
native_tokens_completion_images
(null)
native_tokens_reasoning
759
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00050291
router
(null)
provider_responses
0
endpoint_id
"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id
"chatcmpl-86aad24563eda843"
is_byok
false
latency
223
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778420322-WQdalpVevR8MnA4gfEDH"
session_id
(null)
api_type
"completions"
id
"gen-1778420322-FWcnihjNALpVjRemJzUS"
upstream_id
"chatcmpl-86aad24563eda843"
total_cost
0.00050291
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval