NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBSGSJNJQAKDWDHTFNXQVD
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
15.1s
Cost:
$0.012167
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The bell over the Crumb & Crust door jingled as morning fog pressed against the windows. Inside, cinnamon warmed the air. "You're saying he was found behind the flour mill?" "Face-down in a pile of bran muffins, no less. Myrtle's, from the church social." "That's odd. He hated bran. Told me so Tuesday, right over this counter." "Then why was he carrying a bag of them?" "Maybe he wasn't carrying it. Maybe someone put it there." The oven timer chimed. A tray of scones emerged, golden and steaming. "Mrs. Pemberton ordered twelve dozen bran muffins last week. Never picked them up." "Twelve dozen? What's a woman need with that many muffins?" "Exactly what I've been wondering. Along with why she paid cash, and why she asked if they could be made... extra strong." "Strong?" "Her word. Strong bran muffins. Who says that?" "Someone who knows the victim had a heart condition, perhaps." Silence, save for the rain starting against the glass. "We should call the sheriff." "We should. But first—try a scone. Sleuthing on an empty stomach never solved anything."
created_at
"2026-10-13T10:09:08.411Z"
10/13/2026, 10:09:08 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
616
moderation_latency
(null)
generation_time
15086
tokens_prompt
78
tokens_completion
882
native_tokens_prompt
149
native_tokens_completion
808
native_tokens_completion_images
(null)
native_tokens_reasoning
538
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0121674
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886148-E2KrVTQbKKxwibkzOYcV"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886148-lUrRVmlqmHNQGUGLJGev"
upstream_id
"chatcmpl-18bab79126f843569458011bd399e7f1"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-18bab79126f843569458011bd399e7f1"
is_byok
false
latency
616
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0121674
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)