NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8X4ZGA2XT02R99W3902QPD
Run Details
Model:
Gemma 4 31B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 7s
Cost:
$0.000405
Provider:
Novita
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Mentor" data-color="red"> As I brought Thunder to a halt near the stables, a towering figure stepped out from the shadows of the eaves. Sir Roland, clad in polished steel that reflected the dying light of the sun, looked me up and down with a gaze as cold as winter ice. "You're late, boy," he barked, his voice like grinding stones. He didn't offer a hand or a smile; instead, he pointed a gauntleted finger toward the mounting block. "The stables are no place for idling. If you expect to survive your first month under my tutelage, you will learn that punctuality is the first step toward discipline. Un saddle your horse and report to the barracks immediately." </nc-section> <nc-section data-title="Version 2: The Kind Veteran" data-color="green"> I had barely stepped off Thunder's back when a hearty laugh echoed through the stable yard. A man with a weathered face and eyes that crinkled with genuine warmth approached me, his crimson cloak billowing slightly in the breeze. This was Sir Roland. "Welcome, Frederick!" he exclaimed, clapping a heavy, friendly hand on my shoulder. "Your father was a fine man and a braver soldier; I see his spirit lives on in your eyes. Come, let's get your horse settled in a warm stall with some fresh oats before we find you a meal. You look as though you've ridden halfway across the continent without a break." </nc-section> <nc-section data-title="Version 3: The Eccentric Knight" data-color="blue"> Near the stables, a man sat perched precariously atop a stack of hay bales, humming a tune that sounded vaguely like a lullaby. He wore a suit of armor that had seen better days, mismatched plates held together by leather straps and a touch of luck. He looked up as I approached, his piercing blue eyes shimmering with an odd intensity. "Ah, the arrival," Sir Roland mused, jumping down with an agility that defied his bulky gear. He circled me slowly, as if examining a curious specimen. "The wind whispered of your coming, though it forgot to mention you'd be bringing such a spirited stallion. Tell me, Frederick—do you believe in destiny, or are you simply here because your father didn't want you wandering the village anymore?" </nc-section>
created_at
"2026-05-10T12:17:48.051Z"
5/10/2026, 12:17:48 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
792
moderation_latency
(null)
generation_time
67267
tokens_prompt
318
tokens_completion
938
native_tokens_prompt
344
native_tokens_completion
892
native_tokens_completion_images
(null)
native_tokens_reasoning
364
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00040496
router
(null)
provider_responses
0
endpoint_id
"69279254-6a96-4e9d-abc6-ea76e6bf8e97"
id
"a8448c777e145aedcef05746a4bfd738"
is_byok
false
latency
599
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Novita"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778415468-LoErsTL5IaGpYJ7W3rbF"
session_id
(null)
api_type
"completions"
id
"gen-1778415468-Pd0zB9IQ2nJbvfJHEkXs"
upstream_id
"a8448c777e145aedcef05746a4bfd738"
total_cost
0.00040496
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Novita"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval