NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8WY7Y5WWWAC97DQDJ8YE8P
Run Details
Model:
Gemma 4 31B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.8s
Cost:
$0.000214
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I pulled Thunder to a halt, the screech of leather and gravel filling the air, a towering figure stepped from the shadows of the stables. Sir Roland stood with his arms crossed, his armor dull and scarred from a dozen campaigns. He didn't smile. His eyes, sharp as a hawk's, swept over my meager belongings and my trembling hands. "So, you're the new recruit," he barked, his voice sounding like grinding stones. "I hope you brought more than just a pretty horse, boy, for the castle has no room for fragility." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> I had barely dismounted when a hearty laugh echoed from the stable eaves. A man with a magnificent silver beard and eyes that twinkled with mischief stepped forward, clapping a heavy hand on my shoulder. Sir Roland, the renowned champion of the valley, beamed at me. "Welcome, Frederick! We've been expecting you," he boomed, his voice full of genuine warmth. He looked at Thunder with an appreciative nod. "A fine beast you have there. Come, let's get you settled before the evening meal; you look as though you've ridden halfway across the continent." </nc-section> <nc-section data-title="Version 3: The Mysterious Welcome" data-color="blue"> Near the stables, a man leaned against a weathered fence post, watching my arrival with an unreadable expression. He wore a simple tunic over his mail, and a heavy broadsword hung loosely at his hip. This was Sir Roland, though he lacked the pomp and ceremony I had expected of a knight. He didn't speak at first, merely studying me as if reading a map of my future. "The timing of your arrival is curious, Frederick," he said softly, his voice carrying a strange weight. "Some would say it is fate; others would say it is a warning. Which do you believe?" </nc-section>
created_at
"2026-05-10T12:14:07.309Z"
5/10/2026, 12:14:07 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
177
moderation_latency
(null)
generation_time
15697
tokens_prompt
318
tokens_completion
481
native_tokens_prompt
329
native_tokens_completion
451
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00021415
router
(null)
provider_responses
0
endpoint_id
"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id
"chatcmpl-RyGXZ5dwVYAT4gSOqBOvQ1lf"
is_byok
false
latency
92
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778415247-5OQT9N7TcmcKzIrewnun"
session_id
(null)
api_type
"completions"
id
"gen-1778415247-5EVJxMwXJB7Rt66Zldry"
upstream_id
"chatcmpl-RyGXZ5dwVYAT4gSOqBOvQ1lf"
total_cost
0.00021415
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval