NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8XB43HEJFQ5DQKA33ARV42
Run Details
Model:
Gemma 4 31B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
49.0s
Cost:
$0.000296
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Greeting" data-color="red"> As I pulled Thunder to a halt near the stables, a man with a face like carved granite stepped forward. Sir Roland did not smile; his armor was polished to a mirror sheen, reflecting the dying light of the sun. He eyed me with a critical gaze, lingering on my dusty boots and the slight tremble in my hands. "So, you are the new recruit," he rumbled, his voice sounding like stones grinding together. "I hope you possess more fortitude than you do polish, boy. Training begins at dawn, and I do not tolerate tardiness." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> The smell of hay and leather filled the air as I dismounted. A hearty laugh echoed from the shadows of the stable eaves, and a broad-shouldered knight stepped into the light. Sir Roland beamed at me, his eyes twinkling with genuine kindness. He clapped a heavy hand on my shoulder, nearly knocking the wind out of me. "Welcome, Frederick! A fine beast you've brought with you," he exclaimed, gesturing toward Thunder. "Come, let's get your gear sorted. You'll find the life of a squire demanding, but there is no greater honor in the realm." </nc-section> <nc-section data-title="Version 3: The Mysterious Encounter" data-color="blue"> I was still adjusting the cinch on Thunder's saddle when I realized I was no longer alone. Sir Roland stood a few paces away, leaning casually against a wooden pillar, his gaze fixed not on me, but on the distant mountains. He seemed lost in thought until he suddenly turned his head, his eyes piercing and perceptive. "You have the look of your father about you," he murmured, his voice laced with a strange melancholy. He didn't offer a hand to shake, but rather a knowing nod. "The castle has a way of revealing one's true nature, Frederick. Let us see what yours is." </nc-section>
created_at
"2026-05-10T12:21:09.369Z"
5/10/2026, 12:21:09 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3788
moderation_latency
(null)
generation_time
48830
tokens_prompt
318
tokens_completion
483
native_tokens_prompt
347
native_tokens_completion
454
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0002964
router
(null)
provider_responses
0
endpoint_id
"29b94af5-d8f8-419a-9cf1-ae1f2831142b"
is_byok
false
latency
112
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Venice"
status
429
1
endpoint_id
"576fca5b-f09c-4bda-b560-9989c39ac3ab"
id
"oiXWAb9-zfFMX-9f98e6ee60450432"
is_byok
false
latency
3788
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Together"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778415669-FGnoS0WSzow3zgpYWgTG"
session_id
(null)
api_type
"completions"
id
"gen-1778415669-ky5bEYKEy48sfHvvTXtC"
upstream_id
"oiXWAb9-zfFMX-9f98e6ee60450432"
total_cost
0.0002964
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval