NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TBZZVD0KF39XBGCD7ZDRWY
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
33.8s
Cost:
$0.024932
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The cinnamon rolls were barely out of the oven when the bell over the door of Flour & Fancy jingled, letting in a gust of October rain. "You heard about Mr. Abernathy, then." "Everyone's heard. Found behind the library at dawn. Poor man." "Poor man, my foot. He was about to sell the mill to those developers." "That doesn't mean someone killed him." "Doesn't it? The coroner says heart attack. I say convenient timing." "You say a lot of things before your coffee." "And you have flour on your nose again. Listen—he was in here yesterday. Ordered a blueberry scone and argued with someone on the phone the whole time." "Argued about what?" "A deed, I think. He kept saying, 'Tuesday changes everything.' Well, Tuesday's come and gone, hasn't it?" "Who was on the other end?" "That's the question. Oh—and he left this." A napkin, folded twice, slid across the marble counter, an address scrawled in pencil. "You're not thinking of going there." "I'm thinking the scones can wait." "At least take the banana bread. If you insist on snooping, snoop fed." Outside, thunder grumbled over the rooftops, and the oven timer chimed like a small, insistent warning.
created_at
"2026-10-13T10:12:40.44Z"
10/13/2026, 10:12:40 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2391
moderation_latency
(null)
generation_time
33738
tokens_prompt
78
tokens_completion
1763
native_tokens_prompt
149
native_tokens_completion
1659
native_tokens_completion_images
(null)
native_tokens_reasoning
1367
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0249324
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791886360-BcEe4nfjqHnxf1zhFYfW"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791886360-jFgHOmwGNHSCC6ZNUf7e"
upstream_id
"chatcmpl-acbd1a4b15674a6fb9a9c2f731db8c20"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-acbd1a4b15674a6fb9a9c2f731db8c20"
is_byok
false
latency
2391
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0249324
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)