NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KA3KKQCDC3ZA1XS6JGCN42
Run Details
Model:
DeepSeek V4 Flash 0731 (Reasoning, High)
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
17.5s
Cost:
$0.000077
Provider:
OpenInference
Evaluation summary
Score
Evaluator
Details Link
1.11%
Count dialogue tags
(details)
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The bell above the bakery door chimed a tinny, cheerful lie. Nora wiped a smear of flour from her apron and watched Harold Finch, the town’s retired postmaster, settle onto his usual stool with a groan that said more than words. “The usual, Harold?”
she asked
, already reaching for the day-old sourdough. He always bought the day-old. He always complained about it. “Depends,”
he muttered
, adjusting his cap. “You get any more of those raspberry jam-filled from Lila’s farm?” “Same as every Thursday.” Nora slid the paper-wrapped loaf across the counter. “Why? Something wrong with the batch?” “Not the batch. The source.” He leaned in, lowering his voice despite the empty shop. “Lila’s been acting peculiar. Saw her at dawn, digging behind her chicken coop. Not planting, mind you. Digging up.” Nora’s hand stilled on the register. “Berries are early this year. Maybe she’s moving them.” “With a shovel? And a flashlight?” Harold shook his head, the crumbs of a stale croissant clinging to his mustache. “And that’s not all. The new librarian—the quiet one with the glasses—was over at the old Miller place last night. The *abandoned* Miller place.” “People take walks.” “In the rain? At midnight?” He paused, letting the silence hang like a question. “Found her shoes this morning. Dry as a bone, on the welcome mat outside the museum, though it poured all night.” Nora’s fingers froze on the pastry tongs. She looked through the window at the sun-drenched street, then back at Harold. “What are you saying?” “I’m saying,”
Harold said
, picking a piece of dough off his sleeve and popping it in his mouth, “that for a town this quiet, our mornings are getting awfully loud.”
created_at
"2026-09-03T09:37:55.333Z"
9/3/2026, 9:37:55 AM
model
"deepseek/deepseek-v4-flash-20260731"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
565
moderation_latency
(null)
generation_time
17272
tokens_prompt
78
tokens_completion
518
native_tokens_prompt
65
native_tokens_completion
458
native_tokens_completion_images
(null)
native_tokens_reasoning
52
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00007653
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788428275-fMrFJdFa5XgvVl9uaonJ"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788428275-gYJvJUYaOO2qsGNLXB2l"
upstream_id
"chatcmpl-320c75a9-3fed-4748-933f-31b45b92fd5c"
provider_responses
0
endpoint_id
"f954a48e-1c90-433b-9348-4720f8030331"
id
"chatcmpl-320c75a9-3fed-4748-933f-31b45b92fd5c"
is_byok
false
latency
565
model_permaslug
"deepseek/deepseek-v4-flash-20260731"
provider_name
"OpenInference"
status
200
total_cost
0.00007653
cache_discount
(null)
upstream_inference_cost
0
provider_name
"OpenInference"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
1.11%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"she asked"
1
"he muttered"
2
"Harold said"