NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8ZJH3CS0A3RRZNF0SF4XTP
Run Details
Model:
Gemma 4 26B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.7s
Cost:
$0.000158
Provider:
DekaLLM
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I reined in Thunder near the heavy timber of the stables, a shadow fell across the cobblestones. A man of imposing stature, clad in battered steel plate that bore the scars of many skirmishes, stepped into my path. This was Sir Roland. He did not offer a smile; instead, his gaze swept over me and my mount with a clinical, unforgiving intensity. "So, the boy arrives," he remarked, his voice like grinding stones. "I hope your sword arm is swifter than your horse, squire. The training here leaves no room for the soft-hearted." </nc-section> <nc-section data-title="Version 2: The Warm Greeting" data-color="green"> The scent of hay and leather greeted me as I guided Thunder toward the stables. Before I could dismount, a tall knight with a friendly, weathered face approached, wiping grease from his hands with a rag. "Welcome, Frederick!" Sir Roland called out, his eyes crinkling with genuine warmth. He extended a hand, clapping me firmly on the shoulder. "The castle has been too quiet lately. Rest your beast and find some water; tomorrow, your real journey begins, and we shall have much to discuss." </nc-section> <nc-section data-title="Version 3: The Mysterious Encounter" data-color="blue"> The stables loomed ahead, dark and smelling of ancient dust. As I approached, a figure detached itself from the gloom of the archway. Sir Roland stood there, his silver armor gleaming faintly in the twilight. He didn't speak at first, merely watching me with an expression that bordered on melancholy. "You have the look of your father about you," he said softly, a cryptic remark that sent a shiver down my spine. "Come, let us get you settled. There are things about this castle—and the legends that dwell within it—that you must learn quickly." </nc-section>
created_at
"2026-05-10T13:00:09.203Z"
5/10/2026, 1:00:09 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
771
moderation_latency
(null)
generation_time
11645
tokens_prompt
318
tokens_completion
470
native_tokens_prompt
302
native_tokens_completion
424
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00015804
router
(null)
provider_responses
0
endpoint_id
"d99bcbe6-bec3-4991-965e-45fea79fe63c"
id
"chatcmpl-39a41f0303c295cf759d06ea711e93f0"
is_byok
false
latency
771
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"DekaLLM"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778418009-gHht7vtcTzFdI0s0sLQe"
session_id
(null)
api_type
"completions"
id
"gen-1778418009-NbZa7RjkN3nocEG9EvfP"
upstream_id
"chatcmpl-39a41f0303c295cf759d06ea711e93f0"
total_cost
0.00015804
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DekaLLM"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval