NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBADETBVP883FMVMPP164F
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
20.2s
Cost:
$0.017837
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
95.99%
Matches word count
(details)
77.39%
Dialogue to Total Word Ratio
(details)
86.6878%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
"Pass me the blueprint," Molly whispered. "That's a crayon drawing," said Bill. "It's the birthday girl's. Best intel we've got. Now, the bouncy castle is here, so our exit route—" "Why is there a dragon on it?" "Her dad's a firefighter. Focus, Bill. We go in as clowns." "I look terrible in polka dots." "You look terrible in everything. The presents go in the sack, the sack goes out the window, we follow before the cake arrives." "What if the kids wake up from their nap?" "Kids don't nap at parties, Bill. That's the whole problem with parties." "Then what's our cover?" "Balloon animals. Can you make a balloon animal?" "I can make a balloon snake." "That's just a balloon." "Technically it's accurate." "Fine. You're the snake guy. I'm the face painter. We hit the gift table at exactly three o'clock, during musical chairs, when every adult is distracted." "And the dog?" Molly sighed. "What dog?" "There's always a dog, Molly. Every party we've ever robbed, there's been a dog." "We've never robbed a party." "But I've seen movies." "Bribe it with a sausage. Next question?" "What if the presents are terrible?" "Then we've learned a valuable lesson about other people's taste. Masks on. We move in five."
created_at
"2026-10-13T10:00:53.477Z"
10/13/2026, 10:00:53 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
403
moderation_latency
(null)
generation_time
20158
tokens_prompt
75
tokens_completion
1228
native_tokens_prompt
149
native_tokens_completion
1186
native_tokens_completion_images
(null)
native_tokens_reasoning
877
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0178374
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885653-YteTlFJqdFbRMPWFA7hV"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885653-irqRf2BiOjrBrllkHUFh"
upstream_id
"chatcmpl-04e1c52f10f44c4596fa1e218a16a242"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-04e1c52f10f44c4596fa1e218a16a242"
is_byok
false
latency
403
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0178374
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
95.99%
Matches word count
n/a
neededClean
false
words
208
77.39%
Dialogue to Total Word Ratio
Ratio: 97.12%, Deviation: 7.12%
neededClean
false
wordsTotal
208
wordsDialogue
202
86.6878%