NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBAVTD2QF414RY1YT8T9KK
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
20.0s
Cost:
$0.015051
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Greeting" data-color="red"> As I led Thunder toward the stables, a figure emerged from the shadows of the arched doorway. He was tall and broad-shouldered, his armor bearing the scars of a hundred battles. His eyes, cold as winter steel, fixed upon me with an intensity that made my steps falter. "So," the knight said, his voice like gravel grinding beneath a boot. "You're the new boy they've sent me." He circled me slowly, appraising me the way a butcher examines a side of beef. "I am Sir Roland, and I will tell you now what I tell every squire who passes through these gates: I did not ask for you, I do not want you, and I expect you to fail." He stopped in front of me, close enough that I could smell the leather and oil of his armor. "Prove me wrong, boy. If you can." I swallowed hard and met his gaze. "I'll do my best, sir." "Your best," he repeated, turning away with a dismissive wave, "is rarely good enough. Stable your horse. Training begins at dawn—don't be late." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> A hearty laugh echoed across the stable yard as I dismounted, and I turned to see a knight striding toward me with his arms spread wide. Despite the fading light, his smile seemed to shine all its own. "Frederick, is it? Ha! Look at you—younger than I expected, but there's fire in those eyes!" The man clapped a gauntleted hand on my shoulder, nearly buckling my knees. "Sir Roland, at your service, lad. Though around here, it's just Roland to friends—and I have a feeling we're going to be great friends indeed." He reached up to stroke Thunder's muzzle, and to my amazement, my temperamental stallion nickered softly and leaned into his touch. "Ah, what a fine beast! You've cared for him well; that tells me more about your character than any letter of recommendation." He winked at me. "Come, come! The stable hands will see to your Thunder here. You've had a long journey, and Cook has kept a pot of her famous stew warm just for you. Training can wait until morning—tonight, we welcome you home." </nc-section> <nc-section data-title="Version 3: The Cryptic Encounter" data-color="blue"> The stables were quieter than I expected, the only sound the soft shuffling of horses settling for the night. As I led Thunder into an empty stall, I felt it—a prickling sensation at the back of my neck, as though unseen eyes watched me from the dark. "You feel it too, don't you?" The voice came from nowhere and everywhere, low and measured. I spun around to find a knight leaning against a wooden post, half-hidden in shadow. He did not wear the polished armor I expected, but a weathered cloak of deep grey, and his eyes held a strange, distant light. "That feeling. Like something ancient stirs beneath these stones." "I... I'm not sure what you mean, sir," I stammered. "Sir Roland," he said, though he offered no hand in greeting. Instead, he studied me with an unsettling intensity, as if searching for something hidden beneath my skin. "They send me squires every few years. Strong lads, clever lads, eager lads. All of them ordinary." He pushed off from the post and stepped closer. "But you arrived at sunset, on a black stallion, as the last light touched the western tower. The old signs, boy. The very old signs." He turned toward the door, his cloak whispering against the straw. "Rest well tonight, Frederick. Tomorrow, your true training begins—and I suspect it will be nothing like what you imagined." </nc-section>
created_at
"2026-10-13T10:01:08.184Z"
10/13/2026, 10:01:08 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2222
moderation_latency
(null)
generation_time
19960
tokens_prompt
303
tokens_completion
1068
native_tokens_prompt
410
native_tokens_completion
995
native_tokens_completion_images
(null)
native_tokens_reasoning
143
native_tokens_cached
409
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0150507
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885668-BshcZIFcIWX5au6LG2yc"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885668-bNMZFefEXi8uAZl9gt9W"
upstream_id
"chatcmpl-d173576753a94e049b5b0cfb6478f30e"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-d173576753a94e049b5b0cfb6478f30e"
is_byok
false
latency
2222
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0150507
cache_discount
0.0011043
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval