NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TAZ3FHBS2FCDQ5YW4VAN7E
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
19.6s
Cost:
$0.014256
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As I dismounted Thunder near the stables, a towering figure emerged from the shadows of the stone archway. Sir Roland, his armor gleaming dully in the fading light, regarded me with eyes like flint. "So you're the new squire," he said, his voice carrying the weight of a hundred battles. He circled me slowly, appraising me the way a blacksmith examines flawed iron. "You're late. The sun has already touched the western tower." I opened my mouth to explain—the muddy roads, the broken wheel at Millbrook—but he raised a gauntleted hand. "Excuses are the refuge of the weak, boy. Here, you will learn that a knight's word is his bond, and punctuality is the first virtue of service." He turned sharply, his crimson cloak swirling. "Stable your horse. Your training begins at dawn, and I assure you—dawn shows no mercy to the unprepared." As I led Thunder toward the stalls, I felt the weight of his gaze upon my back, and I wondered what I had truly signed up for. </nc-section> <nc-section data-title="Version 2: An Unexpected Kindness" data-color="green"> A stablehand took Thunder's reins as a warm laugh echoed across the courtyard. Sir Roland strode toward me, not in full armor as I'd expected, but in a simple tunic with his sleeves rolled to the elbows, hay clinging to his shoulders. "Frederick, is it? Welcome, welcome!" He clasped my forearm in the warrior's grip, his smile genuine and broad. "You've picked a fine evening to arrive. Cook has just pulled fresh bread from the ovens, and I daresay there's a bowl of stew with your name on it." I blinked, caught off guard. The tales had spoken of Sir Roland the Fierce, the Dragonbane, the terror of the northern marches—not this jovial man who smelled of horses and honest work. "You expected someone grimmer," he said, reading my expression with a knowing grin. "Everyone does. Come, lad. A knight's first duty is to his stomach, and the second is to his horse. We'll see to both, then I'll show you where you'll sleep." He clapped a hand on my shoulder. "Tomorrow, the hard work begins. But tonight? Tonight, you rest." </nc-section> <nc-section data-title="Version 3: Whispers of the Past" data-color="blue"> The stable yard was empty when I arrived, save for a single figure standing motionless beside the watering trough. Sir Roland did not turn as I approached, though I was certain he'd heard Thunder's hoofbeats long before we rounded the corner. "Your father rode that same road, twenty years ago," he said at last, still gazing into the darkening water. "Did you know that?" I froze, one hand on Thunder's bridle. My father had never spoken of this place. He had never spoken of knights at all. Sir Roland turned then, and in the twilight I saw something in his weathered face I could not name—grief, perhaps, or recognition. "You have his eyes," he murmured. Then, louder, with the practiced ease of a man setting aside old ghosts: "The stables are to your left. Mind the third stall—the mare there bites." As he walked past me toward the keep, he paused. "When you've settled in, boy, come find me. There are things you should know about why you were summoned here. Things about this castle." His voice dropped to barely a whisper. "And things about what sleeps beneath it." </nc-section>
created_at
"2026-10-13T09:54:42.81Z"
10/13/2026, 9:54:42 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
793
moderation_latency
(null)
generation_time
19615
tokens_prompt
303
tokens_completion
1018
native_tokens_prompt
410
native_tokens_completion
942
native_tokens_completion_images
(null)
native_tokens_reasoning
141
native_tokens_cached
409
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0142557
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885282-zsTsJ4xhHnOU4BkK3IYR"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885282-QwrzPFMZ2Xqs7TiIzp60"
upstream_id
"chatcmpl-c251b0b32a944871bda15a5218bad813"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-c251b0b32a944871bda15a5218bad813"
is_byok
false
latency
793
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0142557
cache_discount
0.0011043
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval