NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8X3C2T357FKX56Z8NFEG9Z
Run Details
Model:
Gemma 4 31B (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
24.4s
Cost:
$0.000413
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Meeting Sir Roland - Version 1" data-color="red"> As I dismounted, the heavy scent of hay and horse leather enveloped me. Standing by the stable doors was a man who looked as though he had been carved from the very stone of the castle walls. Sir Roland didn't smile; his eyes, sharp as a hawk's, scanned me from my dusty boots to my wind-swept hair. "So, you're the new squire," he said, his voice a low rumble that commanded instant attention. He stepped forward, his polished armor clinking softly. "You look scrawny, boy. I hope your resolve is stronger than your frame, for the training here is not for the faint of heart. Hand me the reins and get to the barracks. You've already wasted five minutes of my time." </nc-section> <nc-section data-title="Meeting Sir Roland - Version 2" data-color="green"> I barely had time to pat Thunder on the neck before a hearty laugh echoed through the courtyard. A broad-shouldered man with a kind face and a salt-and-pepper beard approached me, his cape billowing behind him. This was Sir Roland, and the warmth in his eyes told me I was welcome here. "Welcome, Frederick!" he exclaimed, clapping a heavy, friendly hand on my shoulder that nearly knocked the wind out of me. "The journey from the village is a long one, and you've made good time. You have the look of a true rider about you. Come, let us get your horse settled and fed, and then I shall introduce you to the others. We are glad to have you in our ranks." </nc-section> <nc-section data-title="Meeting Sir Roland - Version 3" data-color="blue"> The stables were a hive of activity, and in the center of the chaos stood Sir Roland. He was currently preoccupied, arguing intensely with a stable hand about the proper way to oil a saddle, a polishing cloth draped haphazardly over his shoulder. He looked up abruptly as I approached, blinking as if remembering I existed. "Ah! The lad! Frederick, yes?" He stepped over a bucket of water with surprising agility for a man in full greaves. "Right. You're here. Excellent. Splendid. Now, listen closely—the kitchens are serving stew in an hour, but before that, I need you to help me organize the armory. It's a disaster, absolute chaos! Follow me, and try not to trip over your own feet." </nc-section>
created_at
"2026-05-10T12:16:55.395Z"
5/10/2026, 12:16:55 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
183
moderation_latency
(null)
generation_time
24334
tokens_prompt
318
tokens_completion
1005
native_tokens_prompt
327
native_tokens_completion
976
native_tokens_completion_images
(null)
native_tokens_reasoning
420
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00041339
router
(null)
provider_responses
0
endpoint_id
"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id
"chatcmpl-RYnz06gXo5OzzW9c5u1M7YRz"
is_byok
false
latency
50
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778415415-HNmy1atnbdzOmAnbZW4N"
session_id
(null)
api_type
"completions"
id
"gen-1778415415-6Y89cmcyi8QjYpFqE6Jg"
upstream_id
"chatcmpl-RYnz06gXo5OzzW9c5u1M7YRz"
total_cost
0.00041339
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval