NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TAKWJN9CSG4CY6F6V8KBGZ
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 70% dialogue
Duration:
44.4s
Cost:
$0.030807
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.03%
Dialogue to Total Word Ratio
(details)
0.0146%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 70% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly unrolled the blueprint across the hood of the car. "The Henderson place. Saturday, two p.m. Cake at two-thirty. We hit the gift table at two-forty-five, when the magician does the dove trick." Bill squinted at the diagram. "That's a Denny's placemat." "It's a blueprint, Bill." "It's got a maze on the back. You finished the maze." "I finished the maze. Focus. In and out in six minutes. We grab the presents, we're gone before anyone sings happy birthday." "Which one of us carries the loot?" "You do. You're the muscle." "I'm allergic to wrapping paper." "Nobody's allergic to wrapping paper." "I get sneezy. It's the foil kind. Makes my eyes itch." "Then don't touch the foil kind, Bill." "They're all the foil kind, Molly. That's what wrapping paper is." Molly pinched the bridge of her nose. "Fine. I'll carry the presents. You handle security." "Security?" "A golden retriever named Biscuit and a father with a spatula." "I can take a dog." "Biscuit took down a census worker." "That's just a guy with a clipboard." "He had pepper spray, Bill. Biscuit didn't even blink." Bill thought about this. "What's the take, anyway? Last job we cleared forty bucks and a gift card to Applebee's." "This is bigger. Rich neighborhood. The kid's turning seven. Seven-year-olds in this zip code get iPads. Dirt bikes. Pony rides, Bill." "We stealing a pony?" "We're stealing the presents. The pony is a rental." "Pony'd fit in the trunk." "The pony would not fit in the trunk." "You don't know that." "I measured the trunk for space. For the presents." "So there's room for a pony." Molly rolled up the placemat and hit him with it. "There is no pony. There is no dog fight. There is no foil sneezing. We walk in wearing clown costumes—" "Clown costumes?" "They're expecting a clown. Two clowns. I hired us." "You hired us as clowns." "Forty dollars an hour, Bill. We get paid to case the joint. It's the perfect crime." "I can't juggle." "Nobody juggles anymore. You do balloon animals." "I can't do balloon animals." "You blow up a balloon, you tie it in a knot, you call it a snake." "What if they want a dog?" "It's a snake." "What if they want a snake?" "It's a snake, Bill. Everything's a snake. That's the beauty of it." Bill nodded slowly, the way he nodded when he was lost but committed. "And the magician?" "The magician's the only real threat. He saw me take a wallet in Reno." "What's he doing at a kid's party?" "Same as us, probably. Everybody's working, Bill. It's the economy." "So we've got a dog, a dad, a magician, and a pony." "The pony is not a factor." "Ponies are always a factor, Molly. That's rule one." "Rule one is don't get caught." "Rule one is ponies. My uncle told me." "Your uncle's in prison." "He knows about ponies, though." Molly looked at the horizon. Somewhere out there, a seven-year-old was about to have the worst birthday of his life, and she felt almost bad about it. Almost. "Saturday," she said. "Two o'clock. Bring your own nose." "I don't have a clown nose." "Then use the red thing from the dashboard." "That's a foam dice." "Same thing. Bite it. Make it round." Bill bit the foam dice. It did not become round. "Tastes like 2019," he said. "Everything does," said Molly, and got in the car.
created_at
"2026-10-13T09:48:35.301Z"
10/13/2026, 9:48:35 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
568
moderation_latency
(null)
generation_time
44348
tokens_prompt
75
tokens_completion
2151
native_tokens_prompt
149
native_tokens_completion
2024
native_tokens_completion_images
(null)
native_tokens_reasoning
1201
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.030807
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791884915-dq9V0Vn9HyCAYsNUBxSt"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791884915-avJ7gtyEvC61FHliTlBh"
upstream_id
"chatcmpl-058d5643c05047d1b6489a377110ab99"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-058d5643c05047d1b6489a377110ab99"
is_byok
false
latency
568
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.030807
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
573
0.03%
Dialogue to Total Word Ratio
Ratio: 82.76%, Deviation: 12.76%
neededClean
false
wordsTotal
580
wordsDialogue
480
0.0146%