NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8Z7BS2794HVZ7B1911SMEC
Run Details
Model:
Gemma 4 31B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
39.6s
Cost:
$0.000430
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Mentor" data-color="red"> As I guided Thunder toward the stables, a towering figure stepped out from the shadows of the eaves. He wore a suit of weathered plate armor that had seen a hundred battles, and his gaze was as sharp as the blade at his hip. "You're late, boy," the man barked, his voice sounding like grinding stones. "I am Sir Roland. If you expect to spend your days grooming horses and sleeping in straw, you've come to the right place. But if you intend to become a knight, you'll find that my patience is shorter than your reach." He didn't offer a hand to shake; instead, he pointedly looked at my dusty boots and sighed. "First lesson: a squire who cannot keep his kit clean cannot keep his head in a fight. Get to work." </nc-section> <nc-section data-title="Version 2: The Jovial Veteran" data-color="green"> I had barely brought Thunder to a halt when a booming laugh echoed through the stable yard. A broad-shouldered man with a magnificent, salt-and-pepper beard stepped forward, his cape billowing behind him. "Ha! Look at those eyes! Full of fire and hope!" he exclaimed, clapping a heavy hand on my shoulder that nearly knocked the wind out of me. "I am Sir Roland. Welcome to the keep, lad! It’s been far too long since we’ve had a fresh face around here to keep the other squires on their toes." He beamed at me, his eyes twinkling with genuine warmth. "Come, let's get your horse settled. Once you've fed the beast, I'll show you where you'll be sleeping. We shall start your training tomorrow, but tonight, we feast!" </nc-section> <nc-section data-title="Version 3: The Weary Guardian" data-color="blue"> Near the stables, a man stood leaning against a stone pillar, staring off toward the distant mountains with a look of profound longing. He wore a simple tunic over his mail, and his movements were slow, burdened by a weight that seemed more spiritual than physical. As I approached, he turned his gaze toward me. His eyes were a faded grey, filled with a quiet melancholy. "So," he murmured, his voice barely above a whisper. "Another young soul arrives to learn the art of the sword." He stepped forward, offering a thin, tired smile. "I am Sir Roland. You have the look of your father about you—the same stubborn chin. Be careful what you wish for, Frederick. The glory of the blade is a fleeting thing, but the scars it leaves... those stay with you forever. But come, let us get you inside before the chill sets in." </nc-section>
created_at
"2026-05-10T12:54:03.333Z"
5/10/2026, 12:54:03 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
230
moderation_latency
(null)
generation_time
29013
tokens_prompt
318
tokens_completion
1033
native_tokens_prompt
327
native_tokens_completion
1020
native_tokens_completion_images
(null)
native_tokens_reasoning
383
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00043011
router
(null)
provider_responses
0
endpoint_id
"576fca5b-f09c-4bda-b560-9989c39ac3ab"
is_byok
false
latency
10318
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Together"
status
504
1
endpoint_id
"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id
"chatcmpl-RK4vl1YS30kCUvMnujvsHP4d"
is_byok
false
latency
47
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778417643-RzpWxROT9SG0Y2jDvv6I"
session_id
(null)
api_type
"completions"
id
"gen-1778417643-qROiPyF2y92hdjqKz3MI"
upstream_id
"chatcmpl-RK4vl1YS30kCUvMnujvsHP4d"
total_cost
0.00043011
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval