NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8XDWAF5H6D3QS5AJ5J5MSB
Run Details
Model:
Gemma 4 26B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
6.1s
Cost:
$0.000197
Provider:
Parasail
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Mentor" data-color="red"> As I pulled Thunder to a halt near the scent of hay and leather, a shadow fell over me. A man clad in polished steel, his face etched with the lines of a hundred battles, stepped from the shade of the stable doors. "You're late, boy," Sir Roland barked, his voice like grinding stones. He didn't offer a hand or a smile, only a sharp, assessing gaze that seemed to weigh my worth as a squire before I had even dismounted. </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> The rhythmic sound of hammering echoed from the nearby smithy, but it was the steady footsteps of a knight that drew my attention. Sir Roland approached with a jovial stride, his armor gleaming softly in the twilight. "Ah, the new recruit!" he exclaimed, extending a gauntleted hand. "I heard the rumors of your arrival. Come, let us get your mount settled so we can get some food into you. Training begins at dawn, and you'll need your strength." </nc-section> <nc-section data-title="Version 3: The Mysterious Knight" data-color="blue"> Near the quiet gloom of the stables, a figure emerged from the twilight. Sir Roland was less the warrior I had imagined and more a phantom in silver; he moved with a silence that belied the weight of his plate. He stood motionless for a moment, watching the horizon before turning his eyes toward me. "The castle has many secrets, Frederick," he said quietly, his voice barely a whisper against the evening wind. "I suggest you learn to keep yours as well." </nc-section>
created_at
"2026-05-10T12:22:39.704Z"
5/10/2026, 12:22:39 PM
model
"google/gemma-4-26b-a4b-it-20260403"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1162
moderation_latency
(null)
generation_time
5873
tokens_prompt
318
tokens_completion
406
native_tokens_prompt
329
native_tokens_completion
385
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00019677
router
(null)
provider_responses
0
endpoint_id
"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id
"chatcmpl-b84f66b1fc294e66"
is_byok
false
latency
1155
model_permaslug
"google/gemma-4-26b-a4b-it-20260403"
provider_name
"Parasail"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778415759-LCBxjpg9TH5dMA1Ophjk"
session_id
(null)
api_type
"completions"
id
"gen-1778415759-nPwiEAZInnPD3wYWmIfK"
upstream_id
"chatcmpl-b84f66b1fc294e66"
total_cost
0.00019677
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Parasail"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval