NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TC2V65J6G5BAE526RPVMR8
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 30% dialogue
Duration:
1m 31s
Cost:
$0.109427
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
99.74%
Matches word count
(details)
91.45%
Dialogue to Total Word Ratio
(details)
95.5951%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 30% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly unrolled the blueprint across the hood of the Buick, pinning the corners with a juice box, a sock full of pennies, a can of off-brand cheese whiz, and Bill's left hand. They had been parked across from the Henderson residence since dawn, living on gas station taquitos and ambition. "Quit fidgeting." "I'm expressing concern with my fingers." She tapped the diagram with a crayon, the good crayon, the one Bill wasn't allowed to touch. The target: one birthday boy, age six, twenty guests, and a pile of presents the size of a refrigerator. Through the fence they could see the yard being prepped. A catered taco bar. A petting zoo. A cake shaped like a dinosaur with feelings. "What's the security situation?" "One bouncy castle, a magician, and a grandmother who naps after cake." "Grandmothers are unpredictable. Mine once bit a mailman." Molly pinched the bridge of her nose. This was the crew she could afford. Bill's criminal record consisted of shoplifting a ham and returning the next day for the glaze, and he had once been outrun by a mall cop on a Segway with a flat tire. "We go in as entertainers," she said. "Clowns?" "Balloon artists." "Same thing. Same dark arts." In the trunk sat two matching aprons reading BALLOON BUDDIES, purchased with a coupon, because Molly believed in professionalism and also in saving two dollars. "You make a dog, a sword, a hat. I watched a tutorial." "How long?" "Four minutes." Bill went pale beneath his five o'clock shadow, which was approaching six-thirty. "At two-fifteen the magician starts his finale. Every kid watches." "Does the rabbit have a name?" "No." "A good thief knows the rabbit's name." Molly counted to ten, a technique her parole officer swore by. "We sweep the gifts into duffel bags. Ninety seconds." She quizzed him on the plan three times. He failed twice, then passed by accident. "What if some six-year-old hero tries to stop us?" "We give him a balloon dog." "A bribe." "A distraction." Bill nodded the way a man nods when he understands one word in ten. Molly folded the blueprint and stared at the house, where a banner reading HAPPY 6TH BIRTHDAY TYLER flapped in the breeze like a dare. "You know what the take is? Twenty presents. Gaming systems. Bikes. One kid got a pony." "A pony won't fit in a duffel bag." "That's why we brought the trailer." Bill turned to regard the rusted trailer behind them, which held two duffel bags, three hundred balloons, and a helium tank stolen from a party supply store the week before, an event Bill called the practice heist and the police called an active investigation. "He's six," Bill said, suddenly troubled. "He's had six good years, Bill. Nobody gets seven." She started the engine. Somewhere in the trailer, a balloon popped, and Bill screamed like a teakettle. Molly smiled for the first time in weeks. It was going to be a beautiful crime.
created_at
"2026-10-13T10:14:13.971Z"
10/13/2026, 10:14:13 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
485
moderation_latency
(null)
generation_time
90550
tokens_prompt
75
tokens_completion
6504
native_tokens_prompt
149
native_tokens_completion
7292
native_tokens_completion_images
(null)
native_tokens_reasoning
6504
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1094274
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886453-BccRt3CmqGn11cMe5rPU"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886453-8HQRZK8WXapVbmZQQwEJ"
upstream_id
"chatcmpl-56b5f0bbf7e1444db3b03e6e8e01cdc9"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-56b5f0bbf7e1444db3b03e6e8e01cdc9"
is_byok
false
latency
485
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1094274
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
99.74%
Matches word count
n/a
neededClean
false
words
496
91.45%
Dialogue to Total Word Ratio
Ratio: 31.34%, Deviation: 1.34%
neededClean
false
wordsTotal
501
wordsDialogue
157
95.5951%