NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TC3TY7NTX6C4A81CHSDAQN
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 50% dialogue
Duration:
27.4s
Cost:
$0.025527
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
2.01%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
1.0058%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly spread the blueprint across the hood of the car, weighing down the corners with a juice box and a half-eaten dinosaur nugget. "Alright, Bill. The Henderson residence. Saturday, two p.m. Timmy Henderson turns seven, and we turn a profit." Bill squinted at the map. "Molly, why is the blueprint drawn in crayon?" "Because I infiltrated the target's arts and crafts hour yesterday. Deep cover. I was Aunt Molly." "You don't have a sister." "That's what made it so convincing." Bill rubbed his temples. "Walk me through it." "The presents arrive between one-thirty and two. They get stacked on the gift table, here, next to the bouncy castle. That's our window." "How big's the haul?" "Conservative estimate? Twenty gifts. One's a bike. Timmy's grandmother is loaded and has no imagination." "Security?" Molly tapped the map with a nugget. "One clown, name of Giggles. Possibly ex-military; the man makes balloon animals like he's defusing bombs. A piñata hanging over the patio, which is a crowd control risk. And the mother, Sharon. Room mom. Black belt in small talk. Do not engage her, Bill. She will ask where you went to high school, and she will know." "Jesus." "We go in as entertainers. You're the magician." "I can't do magic." "You can pull a rabbit out of a hat." "That's the only trick I know, and last time the rabbit bit a child." "Then you're the DJ." "I own one CD, Molly, and it's whale sounds." "Perfect. Ambient. Kids love whales." Bill paced, tugging his mustache. The fake one. The good one. Forty dollars at Janine's Costume Barn. "Exit strategy?" "Bounce house. We stash the gifts in garbage bags, tell Sharon it's a donation drive for less fortunate children—" "That's terrible." "—which is technically true, because we are less fortunate. Then we bounce, literally, over the fence into the alley where Dave's waiting with the van." "Dave? Dave gets carsick." "Dave's fine." "Dave threw up during the Panera job." "Dave threw up because you gave him the last broccoli cheddar and he's got a nervous stomach!" Bill held up his hands. "Okay. Okay. What about the piñata? Twenty sugared-up seven-year-olds swinging a stick between us and freedom." Molly smiled the smile she reserved for vaults, vents, and very small safes. "Already handled. I bribed the birthday boy." "With what?" "A sneak peek at the bike. Timmy's ours now. He'll swing low, take out Giggles at the knees. Chaos. Cotton candy everywhere. In the confusion, we walk out with the whole table." Bill stared at her with something close to awe. "You turned a seven-year-old." "I turned the seven-year-old. The birthday boy. The one person at that party nobody questions." "Remind me why we don't rob banks." "Because banks have alarms, Bill. Birthday parties have cake." She folded the blueprint. "And after the job, we're having cake."
created_at
"2026-10-13T10:14:46.484Z"
10/13/2026, 10:14:46 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4978
moderation_latency
(null)
generation_time
27319
tokens_prompt
75
tokens_completion
1814
native_tokens_prompt
149
native_tokens_completion
1672
native_tokens_completion_images
(null)
native_tokens_reasoning
979
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.025527
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886486-UB5Q2Z7PKtLjgCUkecLA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886486-aZBZdSJo81ToZyvKgjy1"
upstream_id
"chatcmpl-4c0a7deb34e5401ea89afd9007025f12"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-4c0a7deb34e5401ea89afd9007025f12"
is_byok
false
latency
4978
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.025527
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
2.01%
Matches word count
n/a
neededClean
false
words
475
0.00%
Dialogue to Total Word Ratio
Ratio: 76.65%, Deviation: 26.65%
neededClean
false
wordsTotal
484
wordsDialogue
371
1.0058%