NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBK7DM0Z5W8KRA0JDW7VD4
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 500 words with 50% dialogue
Duration:
2m 53s
Cost:
$0.165902
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Matches word count
(details)
62.44%
Dialogue to Total Word Ratio
(details)
81.2179%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 500 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly spread the blueprint across the hood of the sedan, pinning the corners with a juice box, a granola bar, and Bill's left hand, which he hadn't moved fast enough. The blueprint was drawn in crayon. Crayon was all her source accepted as payment. "Split-level on Maple Street," she said. "Party at two. Bounce house out back covers our exit." "We're escaping via bounce house?" Bill asked, freeing his thumb. "Through the gap in the fence behind it. The bounce house is cover." "Can I go in the bounce house?" "No." "One bounce." "Bill." He fell silent, but she could see him filing the idea away for later, which concerned her. A kid wobbled past on a bicycle and they both leaned casually over the blueprint until he was gone. Molly tapped the crayon rectangle labeled GIFT TABLE in letters that suggested the artist had recently learned to spell. "Twenty-three guests, twenty-three presents minimum. Source says the grandmother went big this year." "How big?" "Nintendo Switch big." Bill whistled low, the way he had once whistled at a Rembrandt, before Rotterdam. "Who's your source?" "Chloe. She's seven. I traded her a pack of gum for the guest list." "That's cold, Molly." "That's business." She produced a laminated card from her jacket. "Disguises. I'm the face painter. The mother thinks I'm with the party company." "What party company?" "Fun Time Friends. I made business cards." She flicked one at him. It was genuinely well designed. "You're the balloon animal guy." Bill brightened, then dimmed. "I don't know how to make balloon animals." "Learn one dog and one sword. That's all kids ask for." "My nephew asked for a giraffe once." "Tell him it's a tall dog." Bill considered this, turning a balloon over in his hands like it might contain answers. It contained only air, which in his opinion was also what the plan contained, but he kept that to himself. He gave the balloon an experimental twist. It became, unmistakably, a snake. "Okay," he said. "But I want it on record that I feel bad." "Noted." "These are kids, Molly. Kids love presents. It's their whole thing." "One last job, then Florida. Beach. No more windows." He sighed the sigh of a man who had agreed to Florida without reading the brochure. "What if we ruin the kid's birthday?" "We're not ruining it. There's still cake." "And the bounce house." "Which you are not—" "One bounce. While I'm there." Molly pinched the bridge of her nose, a gesture eleven years of partnership had perfected. "Fine. One bounce. But blow this job and I'm telling Florida you died." "When do we rehearse?" "Thursday. My garage. Folding table, shoeboxes wrapped in birthday paper." "Where'd you get birthday paper?" "Chloe." "You're going to put that kid through college with gum." "Or she'll put us in prison. She's a shark. Never negotiate with a seven-year-old on her home turf." Bill nodded solemnly and twisted the balloon again. It popped. Somewhere, distantly, a dog barked.
created_at
"2026-10-13T10:05:42.207Z"
10/13/2026, 10:05:42 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
408
moderation_latency
(null)
generation_time
172856
tokens_prompt
75
tokens_completion
9626
native_tokens_prompt
149
native_tokens_completion
11057
native_tokens_completion_images
(null)
native_tokens_reasoning
9626
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1659024
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885942-samlcehu3DbyzlxkuB5S"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885942-8hhllLO153WCMoLetlu1"
upstream_id
"chatcmpl-5430b4b25bf0488898ca72cfe7fd62a4"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-5430b4b25bf0488898ca72cfe7fd62a4"
is_byok
false
latency
408
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1659024
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Matches word count
n/a
neededClean
false
words
500
62.44%
Dialogue to Total Word Ratio
Ratio: 53.07%, Deviation: 3.07%
neededClean
false
wordsTotal
505
wordsDialogue
268
81.2179%