NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBRDH6DC4D69F3GR4GD1MH
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 70% dialogue
Duration:
2m 43s
Cost:
$0.152612
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
27.17%
Matches word count
(details)
42.54%
Dialogue to Total Word Ratio
(details)
34.8541%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 70% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly unrolled the blueprint across the hood of the Civic. It was a crayon drawing she'd bribed off the birthday boy's sister for two dollars and a hair tie. "Okay. Party starts at two. Presents go on the picnic table, here, by the fence. That's our vault." "What's this squiggle?" Bill asked. "Bouncy castle." "And the angry sun?" "That's Marjorie. The clown. Do not engage Marjorie." Bill nodded. He had been told not to engage clowns before. "What's our cover?" "Balloon animal people." "I don't know how to make balloon animals." "Can you make a snake?" "...Yes." "Then you can make balloon animals. Everything else is just a snake with anxiety." Bill studied the map like it might confess something. "Walk me through it." "One forty-five, we arrive. I case the gift table, you inflate decoys. Two-thirty, they cut the cake, and every eye in that yard is on a six-year-old holding a knife. That's our window." "A six-year-old with a knife." "Butter knife. Stay focused. I load, you drive. Pull the van around to the side gate." "The Civic." "Pull the Civic around. Thirty seconds. We take everything with ribbons. Ribbon means quality." "What about the piñata?" Molly looked at him for a long moment. "Leave the piñata." "It's full of candy. That's cash with a wrapper on it." "The piñata is structural. You take it, the kids riot. Kids are chaos agents, Bill. No loyalty, no fear. One of them spots us loading presents, what then?" Bill had once been outrun by a toddler at the mall job, so this was not a hypothetical. "Bribe him." "With what?" Bill patted his pockets. "Balloon snake." "Now you're thinking." Bill puffed up a little. "What's the take, realistically?" Molly flipped open a small notebook. "Rich neighborhood. Trampoline money. Two Lego sets, a scooter, one of those robots that judges you, four gift cards to the frozen yogurt place." "Fro-Yo-Mania?" "Fro-Yo-Mania." "That's good eatin'." "That's thirty percent of our retirement." Bill frowned at the crayon sun. "One problem. Marjorie." "Don't engage her." "You said that about the magician at the Henderson job, and he made my watch disappear." "It turned up." "In his pocket, Molly." She tapped the crayon sun with one finger. "Focus. If she comes at you, hit her with the snake." "That's assault with a reptile." "It's latex." Bill was quiet for a moment. "You ever feel bad? The kids?" Molly rolled up the blueprint. "These kids have a bouncy castle. They'll survive the greatest heist of their young lives. Someday Tyler tells this story at a bar and drinks free forever. We're giving him a gift." "We're taking his gifts." "A gift of narrative. Get in the car. Balloon shift starts in twenty." Bill climbed in, cradling a grocery bag of uninflated snakes. "For the record, I can also do a worm." "Astonishing. Save it for the encore."
created_at
"2026-10-13T10:08:32.303Z"
10/13/2026, 10:08:32 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
432
moderation_latency
(null)
generation_time
163389
tokens_prompt
75
tokens_completion
9062
native_tokens_prompt
149
native_tokens_completion
10171
native_tokens_completion_images
(null)
native_tokens_reasoning
9062
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1526124
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886112-gT53KVFPQ86X2B7QJ1Uu"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886112-buPBi5qI7vbpRutB88ae"
upstream_id
"chatcmpl-8660b43cab9e4047a73b88bc320a6ab5"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-8660b43cab9e4047a73b88bc320a6ab5"
is_byok
false
latency
432
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1526124
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
27.17%
Matches word count
n/a
neededClean
false
words
481
42.54%
Dialogue to Total Word Ratio
Ratio: 74.13%, Deviation: 4.13%
neededClean
false
wordsTotal
491
wordsDialogue
364
34.8541%