NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR93EXWVAGT38X9285X7HJQW
Run Details
Model:
Gemma 4 26B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
3.3s
Cost:
$0.000250
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Mentor" data-color="red"> As I steered Thunder toward the heavy timber doors of the stables, the rhythmic clatter of hooves was interrupted by a commanding voice. "A bit heavy on the reins, aren't we, lad?" A man stepped out from the shadows of the hayloft, his armor polished to a mirror sheen despite the twilight. It was Sir Roland. He stood with a posture so rigid it seemed carved from the very stone of the castle walls. His eyes, sharp and discerning, swept over me and my mount, assessing my worth before I had even dismounted. "If you intend to serve the crown, you must learn that a horse is not a toy, but a partner in survival." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> The scent of dry hay and leather greeted me as I pulled Thunder to a halt near the stables. Before I could even leap from the saddle, a hearty laugh echoed through the courtyard. "So, the new squire has finally arrived!" Sir Roland emerged from the stable entrance, wiping his hands on a grease-stained cloth. He was a broad-shouldered man with a kind, weathered face that crinkled at the corners of his eyes. He approached with a stride that spoke of easy confidence, extending a hand to clap me on the shoulder. "Welcome to the Citadel, Frederick. Don't look so nervous—the horses are much friendlier than the Captain of the Guard." </nc-section> <nc-section data-title="Version 3: The Ominous Encounter" data-color="blue"> The shadows grew long as I reached the stable block, the air turning chilly with the approaching night. A tall, imposing figure leaned against the post near the entrance, his silhouette cutting a dark shape against the dying light. It was Sir Roland, a knight known more for his grim silence than his camaraderie. He didn't move as I approached, merely watching me with an inscrutable expression. "You're late," he said, his voice low and rasping like whetstone on steel. He didn't offer a hand or a smile; instead, he gestured toward the dark stalls behind him. "Unload your gear quickly. In this castle, the night holds more teeth than the day." </nc-section>
created_at
"2026-05-10T14:08:05.539Z"
5/10/2026, 2:08:05 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
218
moderation_latency
(null)
generation_time
2565
tokens_prompt
318
tokens_completion
555
native_tokens_prompt
329
native_tokens_completion
518
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00024997
router
(null)
provider_responses
0
endpoint_id
"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id
"chatcmpl-b96219295f398437"
is_byok
false
latency
218
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778422085-GdlQul6fMjj3kEfq6Alp"
session_id
(null)
api_type
"completions"
id
"gen-1778422085-uYKZInyDohVEqbRUdO6H"
upstream_id
"chatcmpl-b96219295f398437"
total_cost
0.00024997
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval