NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBTDM8JZH0B9WPTSBW3AHS
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 30% dialogue
Duration:
2m 14s
Cost:
$0.119852
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
99.98%
Matches word count
(details)
63.76%
Dialogue to Total Word Ratio
(details)
81.8734%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 30% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly spread the floor plan across the hood of the van and pinned the corners with a brick, a juice box, and Bill's left hand. "Stop moving," she said. "I'm not moving. I'm breathing." "Then stop breathing near the blueprint." The blueprint was a crayon drawing Bill had commissioned from his nephew for two ice pops and a promise, later broken, of a piggyback ride. It showed the Hendersons' backyard, a bouncy castle labeled BOUNS, and a stick figure identified as DAD (GRUMPY). Molly tapped the paper with a stubby pencil. She had sharpened it with a kitchen knife that morning, because professionals sharpened things. She had rules for jobs like this: no crying, no witnesses under four feet tall, and no stealing anything handmade. Handmade things had souls, and souls were traceable. "The presents hit the patio table at two. We get twelve minutes while the magician does his finale." "What's the finale?" "He pulls a rabbit out of a hat. The rabbit resists." Bill squinted at the drawing, then at the actual backyard thirty yards away, where a dinosaur-shaped piñata swayed from the oak like a condemned man. "Why is the bouncy castle on fire?" "That's the sun. Kids' suns have faces." Molly produced a laminated clipboard from her clown bag, which also contained a rubber chicken, forty feet of rope, and lock picks that, in that company, passed as a sight gag. "I'm the clown. You're the magician's assistant." "I thought I was the clown." "You cry at balloons." Bill had cried at balloons once, at his niece's fifth birthday, and the family spoke of it the way other families spoke of affairs. He sulked into his juice box until it made the sad squeak of an empty thing. "Thirty kids with a stick and a grudge. That's a security system." "We go during the piñata. Nobody watches presents when candy hits the lawn." Molly had cased three birthdays and a christening to learn this. She knew the choreography of childhood greed the way safecrackers knew tumblers: the gasp, the swing, the scramble, the sacramental hush. Bill nodded slowly, his pre-stupid nod. "Are we bad people?" "We're stealing from a kid with a pony rental. We're wealth redistribution with face paint." "There's a pony?" "Focus. The pony is not in the budget." "What budget? We're stealing." Molly rolled up the blueprint and tucked it away with the reverence of a general filing a map of Normandy. Somewhere beyond the fence, a mother shrieked about the cake. A father, presumably the grumpy one, was losing a fight with a folding chair. The magician's doves were already mutinous in their cage; Molly could hear them plotting. At one fifty-five, the backyard erupted. Bill adjusted his sequined vest, which itched in places sequins should never reach, and climbed out of the van with the dignity of a man who had accepted his sequins. "Remember: in and out before the rabbit." "And if the rabbit resists?" "Then we're rich."
created_at
"2026-10-13T10:09:37.939Z"
10/13/2026, 10:09:37 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
505
moderation_latency
(null)
generation_time
134290
tokens_prompt
75
tokens_completion
7261
native_tokens_prompt
149
native_tokens_completion
7987
native_tokens_completion_images
(null)
native_tokens_reasoning
7261
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1198524
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886177-pKCsQatbLiT9TcixWpMv"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886177-prL3MdNKokEbwhxHRH7I"
upstream_id
"chatcmpl-58a3f080ee6e492f84bb9410b20e60ba"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-58a3f080ee6e492f84bb9410b20e60ba"
is_byok
false
latency
505
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1198524
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
99.98%
Matches word count
n/a
neededClean
false
words
498
63.76%
Dialogue to Total Word Ratio
Ratio: 33.00%, Deviation: 3.00%
neededClean
false
wordsTotal
500
wordsDialogue
165
81.8734%