NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TAVGHHCGFP5WFTZ821JAT3
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 200 words with 50% dialogue
Duration:
2m 42s
Cost:
$0.138182
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
99.98%
Matches word count
(details)
100.00%
Dialogue to Total Word Ratio
(details)
99.9920%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 50% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
Molly unrolled the blueprint across the van's hood, weighing the corners down with juice boxes. "The bouncy castle is our way in. You're going as the clown." "Clowns see everything, Mol. They're cops with worse shoes." "It's a six-year-old's birthday, not Fort Knox." "Fort Knox doesn't have a piƱata full of witnesses." She tapped the gift table, circled in red marker and labeled THE SCORE. "Thirty presents, says my source. One's a trampoline." "Who's the source?" "His grandmother. Her knees can't take it." Bill rubbed the mustache he'd grown specifically for criminal occasions. "We're stealing from a child." "We're redistributing joy." "To us." "Capitalism, Bill." He sighed and pulled the clown wig from the duffel bag, holding it at arm's length like a dead animal. "If one balloon animal pops, I'm walking." "The magician's off limits. He's seen things." Bill stared at the bouncy castle swaying in the distance like a pastel fortress. Somewhere inside, a child laughed, and thirty wrapped boxes waited under a folding table. He put on the red nose. He had never felt more ridiculous. "This is the lowest we've ever sunk," he said. "Lower than the aquarium job?" "The aquarium job had dignity."
created_at
"2026-10-13T09:52:45.117Z"
10/13/2026, 9:52:45 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1167
moderation_latency
(null)
generation_time
161972
tokens_prompt
75
tokens_completion
7552
native_tokens_prompt
149
native_tokens_completion
9209
native_tokens_completion_images
(null)
native_tokens_reasoning
7552
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.1381824
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885165-8ESAGkjkWDT5Y4KrnsNA"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885165-wJWEiVxsirHjNlGTmIYr"
upstream_id
"chatcmpl-95c69ebbc6384241aebff0440cdb80ed"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-95c69ebbc6384241aebff0440cdb80ed"
is_byok
false
latency
1167
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.1381824
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
99.98%
Matches word count
n/a
neededClean
false
words
198
100.00%
Dialogue to Total Word Ratio
Ratio: 50.00%, Deviation: 0.00%
neededClean
false
wordsTotal
200
wordsDialogue
100
99.9920%