NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TAW067BJCZDWRV0QD0J4SB
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
17.2s
Cost:
$0.014736
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Knight" data-color="red"> As I led Thunder toward the stables, a figure stepped out from the shadows of the stone archway, blocking my path. He was a mountain of a man, clad in scarred plate armor that bore the dents of a hundred battles. His eyes, cold as winter steel, looked me up and down with open disdain. "So. You're the new whelp they sent." His voice was gravel and thunder. "Sir Roland, master-at-arms of this castle. And I'll tell you now, boy—I've buried more squires than I've trained. The weak ones never last the winter." He circled me slowly, gauntleted hand resting on the pommel of his sword. "Your horse is lathered and half-lame. You rode him too hard through the pass. A knight who cannot care for his mount cannot be trusted with a sword." He stopped before me, close enough that I could smell iron and old sweat. "Stable him. Rub him down yourself. Then report to the yard at dawn—and pray you're not as soft as you look." </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> A booming laugh echoed across the courtyard as I dismounted. "Ha! Right on schedule, young Frederick!" A broad-shouldered knight strode from the stable doors, wiping hay from his gauntlets. His armor was polished but practical, and a gray-streaked beard framed a grin that seemed permanently fixed to his weathered face. "Sir Roland, at your service—though around here, it's just Roland, or 'old man' if you're feeling brave." He clapped a hand on my shoulder with enough force to stagger me. "Come, come! Let's get this fine beast settled. Thunder, is it? Good name. Strong name." He ran a practiced hand along the stallion's neck, nodding approval. "I knew your father, lad. Fought beside him at Rivermoor. He saved my life twice in one afternoon, though he'll deny it to his dying breath." Roland tossed me a curry brush and winked. "You'll bunk with the other squires, but the training yard's where you'll live. Rest well tonight—tomorrow, the real work begins. And Frederick? I'm glad you're here." </nc-section> <nc-section data-title="Version 3: The Keeper of Secrets" data-color="blue"> The stable yard was empty when I arrived—or so I thought. A voice drifted from the darkness between the stalls, quiet and measured. "You rode through the night. Most squires wait for morning. Most squires are wise." A lantern flared to life, revealing a knight seated on a bale of hay, whittling a small wooden figure. His armor was dark, almost black, and his eyes held a strange, distant light. "Sir Roland," he said, not rising. "Forgive the theatrics. I prefer the stables at this hour. The horses don't ask questions." He held up the carving—a dragon, wings spread, no larger than his palm. Something flickered across his face, there and gone. "They sent you here to learn swordplay and heraldry, Frederick. And you will." He stood, slipping the carving into his cloak, and took Thunder's reins from my hands with surprising gentleness. "But this castle keeps older lessons than that. When you're ready—when you've proven you can keep your silence as well as your sword—come find me. There are things you should know about why you were truly summoned here." </nc-section>
created_at
"2026-10-13T09:53:01.138Z"
10/13/2026, 9:53:01 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1044
moderation_latency
(null)
generation_time
17142
tokens_prompt
303
tokens_completion
1061
native_tokens_prompt
410
native_tokens_completion
974
native_tokens_completion_images
(null)
native_tokens_reasoning
195
native_tokens_cached
409
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0147357
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885181-r2DJVga8RwiteikZ6lhc"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885181-x0HZr1j7yJY59S0mSocP"
upstream_id
"chatcmpl-54d932de6115412dbcd087fc31354045"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-54d932de6115412dbcd087fc31354045"
is_byok
false
latency
1044
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0147357
cache_discount
0.0011043
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval