NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8YHERT312BBBMDSXMW0J8D
Run Details
Model:
Gemma 4 26B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
34.5s
Cost:
$0.000494
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I dismounted, the heavy scent of cedar and old hay drifted from the stables. A shadow fell over me, tall and imposing, cutting through the twilight. It was Sir Roland. His armor, scarred from countless skirmishes, glinted dully in the fading light, and his presence seemed to command the very air around him. "So, you're the boy from the valley," he said, his voice sounding like grinding stone. He didn't offer a hand or a smile; instead, his eyes scanned me with the clinical precision of a blacksmith inspecting a flawed blade. "Don't expect softness here, squire. The stables wait for no one, and neither does the training." </nc-section> <nc-section data-title="Version 2: A Warm Arrival" data-color="green"> The rhythmic sound of horses neighing guided me toward the stable yard, where a man in polished silver plate stood waiting. "Welcome, Frederick!" Sir Roland called out, a genuine smile breaking through his weary features as he stepped toward me. He extended a gloved hand, his eyes bright with a kindness that immediately eased the knot of anxiety tightening in my chest. "We've been expecting you. It takes a brave soul to seek the life of a knight, and you'll find that while the work is hard, this castle is a fine place to find your footing." </nc-section> <nc-section data-title="Version 3: The Duty of the Dawn" data-color="blue"> Shadows were lengthening across the stable yard when a figure emerged from the gloom. Sir Roland was preoccupied, checking the cinch on his mare with movements that were precise, practiced, and silent. He looked up as I approached, his gaze steady and unreadable, carrying the weight of a man governed by discipline. "You're late, lad," he noted. There was no malice in his tone, only the blunt observation of a man who lived by the clock. He gestured toward the dark interior of the stables. "Get your gear stowed and your mind set. Tomorrow, the real work begins." </nc-section>
created_at
"2026-05-10T12:42:05.473Z"
5/10/2026, 12:42:05 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
208
moderation_latency
(null)
generation_time
34378
tokens_prompt
318
tokens_completion
1406
native_tokens_prompt
327
native_tokens_completion
1385
native_tokens_completion_images
(null)
native_tokens_reasoning
896
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00049379
router
(null)
provider_responses
0
endpoint_id
"d71c6981-347d-4622-a86b-2c9e5d0f2c6c"
id
"chatcmpl-ROmhOPINSrLhuZsvDhj2TcMk"
is_byok
false
latency
48
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778416925-0tnbnZQHdVo7SnsGhE7e"
session_id
(null)
api_type
"completions"
id
"gen-1778416925-Q8a2V3siVbfFt9NX1yUd"
upstream_id
"chatcmpl-ROmhOPINSrLhuZsvDhj2TcMk"
total_cost
0.00049379
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval