NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TAEJXP11H4ZBEN6YREJ6WX
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
1m 26s
Cost:
$0.023340
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Iron Greeting" data-color="red"> As I reined Thunder to a halt before the stables, a figure detached itself from the shadows between the stalls. He was broad as a barn door, with a scar that split his beard from chin to ear, and eyes like flint struck in darkness. "So." His voice was gravel over iron. "The boy they sent me." I dismounted, my legs stiff from the long ride, and straightened to my full height. "Frederick, sir. Squire to—" "I know what you are." Sir Roland circled Thunder slowly, running a calloused hand along the stallion's flank, inspecting him the way a butcher inspects a side of beef. "What you *will be* remains to be seen. The castle eats soft boys for breakfast, and I've buried more squires than I've knighted." He stopped in front of me, close enough that I could smell leather and old sweat. "Your horse is good. Better than you deserve, I'd wager. Stable him yourself—no one tends your mount but you, not while I'm breathing. Then find the armory before the bell tolls, or you'll spend your first night scrubbing mail with the rats." He turned and strode toward the keep without another word. I stood there in the dying light, heart hammering, and wondered what manner of man I had been sent to serve. </nc-section> <nc-section data-title="Version 2: A Warm Welcome" data-color="green"> A booming laugh rolled out of the stables before I'd even pulled Thunder to a stop. "Easy, lad, easy—you look like you've been in the saddle since the first snow!" The man who emerged was built like an oak tree, graying at the temples, with a smile that seemed to have permanently creased his weathered face. He caught Thunder's bridle with the ease of someone who had handled a thousand horses. "Sir Roland," he said, though he was still looking at my horse with open admiration. "And this fine fellow must be Thunder. Word of your arrival rode ahead of you, young Frederick." He winked. "The whole castle's been wagering on whether you'd arrive before nightfall. I owe the cook two copper pennies, so thank you for that." I dismounted, embarrassed and relieved all at once. "Sir, I—" "Roland will do, at least until you've earned the right to curse my name in training." He clapped me on the shoulder hard enough to rattle my teeth. "Come. Let's get your beast fed and watered, and then we'll find you something hot to eat. I was a squire once, arriving at a strange castle with sore legs and a nervous stomach. First lesson, and it's free: a knight who doesn't care for his horse and his belly won't last long enough to care for anything else." For the first time in three days of riding, the knot in my chest began to loosen. </nc-section> <nc-section data-title="Version 3: The Knight Who Watches the Sky" data-color="blue"> No one came to meet me. I led Thunder into the stable yard myself, the evening mist curling low around the stones, and found only a single man standing apart from the grooms and stablehands. He stood at the fence line, perfectly still, gazing west toward the mountains where the sun had drowned itself in gold and violet. "Sir Roland?" I ventured. He did not turn. "Do you see it?" he asked quietly. "There, above the peaks. The sky burns differently than it did when I was your age." I followed his gaze but saw only clouds and fading light. "I... see only the sunset, sir." "Mm." At last he faced me, and I was struck by the weariness in him—not the tiredness of a long day, but of long years. His eyes, though, were sharp as a hawk's, and they studied me with an intensity that made me feel translucent. "Frederick. Yes. You've your mother's look about you." "You knew my mother?" Something flickered across his face—grief, perhaps, or memory. "Once. Before you were born." He took Thunder's reins from my hands gently, and for a moment his fingers brushed the old scar on my stallion's neck, the one shaped strangely like a claw mark. His eyes narrowed, just slightly. "Stable your horse, Frederick," he said softly, turning away. "Rest well tonight. Tomorrow your training begins, and I suspect—" he paused, glancing once more at the darkening mountains, "—that this kingdom will need you trained sooner than either of us would like." </nc-section>
created_at
"2026-10-13T09:46:31.189Z"
10/13/2026, 9:46:31 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
722
moderation_latency
(null)
generation_time
36421
tokens_prompt
303
tokens_completion
1625
native_tokens_prompt
410
native_tokens_completion
1474
native_tokens_completion_images
(null)
native_tokens_reasoning
468
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.02334
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791884791-FWnKuIRRq2iIS0tk4bxI"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791884791-5KbbQ9i9Ty4mTgDX6o2v"
upstream_id
"chatcmpl-1b6c97b44f6a46d8a1eb2f77e4669fd8"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-1b6c97b44f6a46d8a1eb2f77e4669fd8"
is_byok
false
latency
722
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.02334
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval