NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-13-01M4TB0RQABBSZF8C208D7FB9Z
Run Details
Model:
Ember-1 (Reasoning, Max)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
14.4s
Cost:
$0.011327
Provider:
Fireworks
Evaluation summary
Score
Evaluator
Details Link
100.00%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The bell over the door of Buttercrust Bakery jingled as the morning rush settled into whispers. "You heard about Harold Pemberton, didn't you?" "Found dead behind his own garden shed. Face down in the petunias." "Petunias? I heard it was the compost heap." "Either way, the man's dead, and Sheriff Dolan is calling it a heart attack." "Harold had a heart like an ox. He ate three of my maple scones every morning for twenty years." "That's not the defense you think it is." "The point is, someone wanted him gone. He was about to change his will, you know." "Everyone knows. His nephew's been circling like a gull on a chip." "And then there's the missing recipe box." "What recipe box?" "His mother's. Sourdough instructions older than this town. Worth a fortune to the right collector." "You're telling me someone killed him over bread?" "I'm telling you the oven in his kitchen was still warm when they found him. And Harold never baked on Tuesdays." "...It was Tuesday." "It was Tuesday." The coffee pot gurgled. Outside, rain speckled the window, and somewhere in Millbrook Falls, a murderer was enjoying a fresh loaf.
created_at
"2026-10-13T09:55:37.331Z"
10/13/2026, 9:55:37 AM
model
"fireworks/ember-1-20260923"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
603
moderation_latency
(null)
generation_time
14414
tokens_prompt
78
tokens_completion
842
native_tokens_prompt
149
native_tokens_completion
752
native_tokens_completion_images
(null)
native_tokens_reasoning
474
native_tokens_cached
148
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.0113274
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791885337-o0LX72Vvsto9U2W2kqmE"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791885337-NCXR14Wot87byMbBm0Pi"
upstream_id
"chatcmpl-05b4dd46b29b43c7a00699f0a86f8f37"
provider_responses
0
endpoint_id
"b89a2f05-4051-4446-a9b0-7bc8ae7b7c90"
id
"chatcmpl-05b4dd46b29b43c7a00699f0a86f8f37"
is_byok
false
latency
603
model_permaslug
"fireworks/ember-1-20260923"
provider_name
"Fireworks"
status
200
total_cost
0.0113274
cache_discount
0.0003996
upstream_inference_cost
0
provider_name
"Fireworks"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Count dialogue tags
n/a
neededClean
false
dialogueTags
(empty)