NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8XQYJ9A4V0C71JXCN713TH
Run Details
Model:
Gemma 4 31B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
18.8s
Cost:
$0.000343
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Noble Welcome" data-color="red"> As I brought Thunder to a halt near the stables, a man clad in polished steel armor stepped forward. His cape, a deep crimson, flowed behind him like a river of blood. This was Sir Roland. He offered a measured smile and extended a gauntleted hand. "Welcome to the Citadel, Frederick," he said, his voice resonant and warm. "You have a long road ahead of you, and the training will be arduous, but I see a spark of determination in your eyes. Come, let us see to your horse before we introduce you to the Master-at-Arms." </nc-section> <nc-section data-title="Version 2: The Stern Greeting" data-color="green"> I had barely dismounted when a sharp voice cut through the air. "You're late, boy!" Standing by the stable doors was Sir Roland, leaning against a wooden pillar with his arms crossed. He didn't look like the shining paragon of chivalry I had imagined; his armor was scuffed, and his expression was one of blatant skepticism. He eyed my stallion with a critical gaze before looking back at me. "I hope your sword arm is stronger than your sense of punctuality," he grunted, gesturing toward the stables. "Get that beast stabled and report to the courtyard. Now!" </nc-section> <nc-section data-title="Version 3: The Eccentric Encounter" data-color="blue"> Near the stables, a knight was humming a tuneless melody while feeding a handful of golden oats to a nervous pony. He wore a mismatched set of armor—some pieces gleaming, others rusted—and a weathered leather cloak. When he noticed me, he beamed, his eyes twinkling with an odd sort of mischief. "Ah! The new arrival!" Sir Roland exclaimed, stepping forward with a sudden, energetic stride. "Frederick, yes? I’ve heard whispers of your arrival. Tell me, does the wind still smell of salt and cedar on the road from the coast? Fascinating. Come along, lad, there are mysteries in this castle far more interesting than polishing shields." </nc-section>
created_at
"2026-05-10T12:28:09.681Z"
5/10/2026, 12:28:09 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
260
moderation_latency
(null)
generation_time
18609
tokens_prompt
318
tokens_completion
834
native_tokens_prompt
327
native_tokens_completion
791
native_tokens_completion_images
(null)
native_tokens_reasoning
319
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00034309
router
(null)
provider_responses
0
endpoint_id
"9d4644e9-a5e5-41f4-b810-d75f484d2c24"
is_byok
false
latency
20
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Parasail"
status
429
1
endpoint_id
"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id
"chatcmpl-RjOYz1IzudsHBqb1RaNchYZR"
is_byok
false
latency
53
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778416089-ULLJTrWtI16Nl9Jei8Oo"
session_id
(null)
api_type
"completions"
id
"gen-1778416089-a5EWxhYXTVdevHjeLLET"
upstream_id
"chatcmpl-RjOYz1IzudsHBqb1RaNchYZR"
total_cost
0.00034309
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval