NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8W5R1CAZ87FP1VCHQ877W6
Run Details
Model:
Gemma 4 26B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
18.7s
Cost:
$0.000363
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Welcome" data-color="red"> As I guided Thunder toward the heavy oak doors of the stables, a tall, imposing figure stepped out from the shadows. It was Sir Roland, a man whose reputation for discipline was as sharp as the blade at his hip. He stood with his arms crossed over a polished breastplate, his gaze scanning me with unsettling scrutiny. "So, the boy arrives at last," he rumbled, his voice like grinding stones. "I hope your skills with a blade are better than your timing, lad. Training begins at dawn." </nc-section> <nc-section data-title="Version 2: The Warm Greeting" data-color="green"> The scent of hay and old leather greeted me as I pulled Thunder toward the stables. To my surprise, a broad-shouldered man with a weathered, kind face was already there, wiping down a saddle. "Welcome to the citadel, Frederick!" Sir Roland called out, offering a hearty grin that reached his eyes. He stepped forward to clap a heavy hand on my shoulder. "You've had a long ride. Get your horse settled, and then we shall share a meal. There is much to learn, but we'll take it one step at a time." </nc-section> <nc-section data-title="Version 3: The Ominous Arrival" data-color="blue"> The twilight deepened as I approached the stables, the rhythmic clopping of Thunder's hooves the only sound in the cooling courtyard. A silhouette detached itself from the darkness near the stalls—Sir Roland. He didn't look like a man ready to celebrate an arrival; instead, his eyes were fixed on the darkening horizon, filled with a strange melancholy. "You've arrived, then," he said quietly, his voice barely a whisper against the wind. "I only hope you've arrived in time. The shadows are growing longer than they ought to be." </nc-section>
created_at
"2026-05-10T12:00:44.599Z"
5/10/2026, 12:00:44 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
336
moderation_latency
(null)
generation_time
18518
tokens_prompt
318
tokens_completion
1058
native_tokens_prompt
327
native_tokens_completion
1001
native_tokens_completion_images
(null)
native_tokens_reasoning
604
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00036323
router
(null)
provider_responses
0
endpoint_id
"d71c6981-347d-4622-a86b-2c9e5d0f2c6c"
id
"chatcmpl-RE0AHNasKrbcus7IRwCwwmMU"
is_byok
false
latency
51
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778414444-oovxAc56vpZwGXj2yp8H"
session_id
(null)
api_type
"completions"
id
"gen-1778414444-Q1xHpI87QVeFnQ8w4HeB"
upstream_id
"chatcmpl-RE0AHNasKrbcus7IRwCwwmMU"
total_cost
0.00036323
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval