NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KRJMHF97XCDRX7D333YD4E
Run Details
Model:
Muse Glimmer 30B (Reasoning, Medium)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
6.1s
Cost:
$0.001074
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Fail
Match green prose section
(details)
Fail
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<n c-section data-title="Version 1: The Stable Test" data-color="red"> Frederick dismounted near the stables, patting Thunder's damp neck as grooms rushed to take the reins. The smell of hay and leather filled the air. From the shadows stepped Sir Roland, his armor scarred and his cloak still dusty from the road. "So you're the boy sent to train," he said, not smiling. "Put your horse away yourself, squire. If you can't care for your mount, you can't care for a kingdom." He watched as Frederick fumbled with the bridle, then finally steadied himself and spoke with quiet respect. Sir Roland grunted, the first sign of approval. </n c-section> <n c-section data-title="Version 2: The Warm Welcome" data-color="green"> Frederick led Thunder toward the stables, his heart thudding with nerves. Just as he reached for the latch, a broad hand clapped his shoulder. Sir Roland stood there, the local knight, his silvered hair catching the late light. "Well met, Frederick," Sir Roland said warmly. "I heard you rode hard from the valley. Come, let me show you where the best horses are kept." He walked beside the young squire into the stable yard, offering water for Thunder and a spare blanket. "Training starts tomorrow at dawn. Tonight, you rest, and you eat." </n c-section> <n c-section data-title="Version 3: The Cold Introduction" data-color="blue"> The castle gates had barely closed behind Frederick when the stable yard swallowed him in noise and heat. A horse whinnied as Sir Roland emerged from the stalls, wiping his hands on a rag. He looked Frederick up and down once, slowly. "You are late," Sir Roland said flatly. "The squire before you arrived three days early." Frederick opened his mouth to explain the river crossing, but the knight cut him off. "Stables are to the left. Your bunk is to the right. Don't touch my horse." He turned back to work, leaving Frederick alone with Thunder and the weight of the castle walls. </n c-section>
created_at
"2026-09-03T13:50:47.864Z"
9/3/2026, 1:50:47 PM
model
"meta/muse-glimmer-30b-20260810"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
139
moderation_latency
(null)
generation_time
5999
tokens_prompt
303
tokens_completion
940
native_tokens_prompt
319
native_tokens_completion
843
native_tokens_completion_images
(null)
native_tokens_reasoning
447
native_tokens_cached
128
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00107402
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788443447-0YuNkDi0z3r3B5u65SsD"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788443447-h8Z4uFZ3lA7tHT7UFVzz"
upstream_id
"chatcmpl-RYNNHG29F5y3XC2IzmibsxOw"
provider_responses
0
endpoint_id
"a9912acb-568e-4147-8ed3-5d20aea22135"
id
"chatcmpl-RYNNHG29F5y3XC2IzmibsxOw"
is_byok
false
latency
73
model_permaslug
"meta/muse-glimmer-30b-20260810"
provider_name
"DeepInfra"
status
200
total_cost
0.00107402
cache_discount
0.00003328
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval