NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8W4Z4Q4VZCNHM0VHBC7W8E
Run Details
Model:
Gemma 4 26B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.9s
Cost:
$0.000229
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I steered Thunder toward the rhythmic clatter of the stables, a shadow detached itself from the stone archway. Sir Roland stood there, his armor dull and scuffed from years of service, his face etched with the lines of a man who had seen too many winters. He didn't offer a smile, only a sharp, discerning gaze that seemed to weigh my worth before I had even dismounted. "So, the boy arrives," he grunted, his voice like grinding gravel. "Leave the beast. Training begins at dawn, and I'll have no tardiness from a squire." </nc-section> <nc-section data-title="Version 2: The Warm Greeting" data-color="green"> The scent of hay and cedar greeted me as I approached the stables, but it was the booming laughter of Sir Roland that truly announced his presence. He stepped out from beside a heavy timber stall, wiping grease from his hands with a rag. "Ah, Frederick! You've made good time!" he exclaimed, clapping a heavy, reassuring hand on my shoulder. His eyes crinkled with genuine kindness. "Don't look so nervous, lad. The castle can be a daunting place, but you'll find we treat our own well here. Come, let's get your horse settled." </nc-section> <nc-section data-title="Version 3: The Mysterious Encounter" data-color="blue"> I pulled Thunder to a halt near the stable doors, the evening air growing chilly. A figure was already waiting there, silhouetted against the lantern light. It was Sir Roland, but he wasn't clad in his usual polished plate; instead, he wore a dark traveling cloak that seemed to swallow the light. He watched me approach with an unreadable expression, his hand resting habitually on the pommel of his sword. "You're later than the messenger predicted," he said quietly, his eyes darting toward the castle battlements as if checking for eavesdroppers. "Follow me. We shouldn't speak of your arrival in the open." </nc-section>
created_at
"2026-05-10T12:00:19.105Z"
5/10/2026, 12:00:19 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
237
moderation_latency
(null)
generation_time
4679
tokens_prompt
318
tokens_completion
492
native_tokens_prompt
329
native_tokens_completion
466
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00022917
router
(null)
provider_responses
0
endpoint_id
"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id
"chatcmpl-8bb93643a9cde857"
is_byok
false
latency
237
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778414419-42H9UO7RGhuhIKOThZ1V"
session_id
(null)
api_type
"completions"
id
"gen-1778414419-TDDcQ2O68igWvIfw4Cqx"
upstream_id
"chatcmpl-8bb93643a9cde857"
total_cost
0.00022917
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval