NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TASRXQF8EVPBQJ1YHPH0QT
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 50% dialogue
Duration:
2m 41s
Cost:
$0.146247
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
62.24%
Dialogue to Total Word Ratio
(details)
31.1182%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Bill unrolled the blueprint across the hood of his Buick, pinning the corners with a juice box, a half-eaten sandwich, and two casino chips he considered lucky. The paper crinkled in the wind. Down the street, a dog barked at nothing, and Molly pulled her coat tighter, wondering how her career had arrived at this exact moment. "This is the target," Bill said. "Eight-year-old's birthday party. Saturday, two p.m. Sharp." Molly squinted at the map, which featured a house, a tree, and something labeled "SNACCS." "Bill, this blueprint is drawn in crayon." "My informant is seven. His name is Tyler. He charges two Fruit Roll-Ups per intel session." "You bribed a child with snacks." "I compensated a source. Same thing." Molly had once worked with a forger who charged forty thousand a job and delivered half the time. Tyler, apparently, worked for fruit snacks and loyalty. She pinched the bridge of her nose. "Walk me through it." Bill straightened and tapped the crayon piñata with the gravity of a general addressing his troops. "Phase one: infiltration. We arrive disguised as a clown and a balloon artist. Phase two: we wait for the piñata. When the kids swarm it, the gift table is undefended. Phase three: we load the presents into the bounce house." "The bounce house." "It's a decoy transport vehicle. Nobody suspects a bounce house driving away." "Bounce houses don't drive, Bill." "Mine does. I've been modifying it in my garage for three weeks." Molly stared at him the way she had once stared at a vault in Geneva that turned out to contain nothing but decorative soaps. "That's not even the dumbest thing you've said today." "Thank you." "Not a compliment. What about security?" Bill flipped to page two, which appeared to be a drawing of a dog wearing sunglasses. "Tyler reports one golden retriever, easily bribed. One magician, moderately threatening. And a grandmother who, quote, 'sees everything.'" "Grandmas always do." "That's why you're handling her." "Me? Why me?" "You knit. You speak their language." It was, she had to admit, a fair point. Her cardigans had disarmed harder women than Tyler's grandmother. Molly examined the gift list, written in purple marker with several letters reversed. "A bike, a drone, and forty bucks from an aunt. Bill, our usual take is in the thousands." "This isn't about money. It's about sending a message." "To whom? Children?" "To Gerald." "Who's Gerald?" Bill's jaw tightened. He gazed down the street, wounded and proud, like a soldier remembering the war. "The birthday boy's dad. He beat me at fantasy football last year. By one point. One point, Molly." She folded her arms. "We're robbing a child's birthday party because of fantasy football." "We're redistributing wealth as an act of justice." "You're unbelievable." "Are you in or out?" Molly looked at the crayon blueprint, at the juice box, at the man she had inexplicably chosen as her partner in crime. Somewhere along the way, her life had gone terribly wrong, and this was it, and she was going to do it anyway. "I'm in. But I get the drone." "Deal. Now help me practice my balloon animals. I can only make a snake, and the snake just looks like a balloon." "That is a snake, Bill." "Then I'm basically ready."
created_at
"2026-10-13T09:51:48.161Z"
10/13/2026, 9:51:48 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
564
moderation_latency
(null)
generation_time
160882
tokens_prompt
75
tokens_completion
9566
native_tokens_prompt
149
native_tokens_completion
9720
native_tokens_completion_images
(null)
native_tokens_reasoning
8954
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.146247
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885108-xjsBzsApVqTRfZHQhHGa"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885108-Yxsq8guRO1Kf7J8FoJc5"
upstream_id
"chatcmpl-b6215751c44647de8830ab8f374602e3"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-b6215751c44647de8830ab8f374602e3"
is_byok
false
latency
564
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.146247
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
548
62.24%
Dialogue to Total Word Ratio
Ratio: 53.08%, Deviation: 3.08%
neededClean
false
wordsTotal
552
wordsDialogue
293
31.1182%