NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHK2MGY3JQR91KYSV5NE1322
Run Details
Model:
Qwen 3.5 397B A17B
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
2m 55s
Cost:
$0.025139
Provider:
Alibaba
Model input
User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.
Model response
Messages
Meta
AI
The oven timer dinged, cutting through the heavy scent of burnt sugar and rising yeast. Flour dusted the counter like fresh snow, settling on the edges of the open ledger. A spoon rested against a bowl of dough. "You heard about the mayor?" "Hard not to. The whole town's talking over cinnamon rolls and coffee." A tray slid onto the marble surface with a clatter. Blueberry muffins, steaming, wept juice onto the liners. "Found his prize rooster in the feed bin. Dead as a doornail." "Poison?" "Looks like it. Arsenic, maybe. Or just bad grain." Hands paused over a mixing bowl, knuckles white against the steel. "Who'd want to kill a chicken?" "Who'd want to kill the mayor? Same thing, really." A cup was set down, steam curling into the air. "You think he's next?" "I think someone's baking a storm. Did you see who bought the rat poison yesterday?" "Old Miller?" "Miller spends his money on whiskey. No, it was someone sweeter. Someone who loves lemon tarts." The bell above the door jingled. A draft swept through the warm shop, flickering the candle. "Speaking of lemon tarts,"
a whisper cut through the air
. "She just walked in." "Then hide the ledger." "Too late. She's smelling the almonds. And she's looking right at us."
created_at
"2026-02-16T11:19:07.529436+00:00"
2/16/2026, 11:19:07 AM
model
"qwen/qwen3.5-397b-a17b-20260216"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
848
moderation_latency
(null)
generation_time
175322
tokens_prompt
81
tokens_completion
6003
native_tokens_prompt
78
native_tokens_completion
6970
native_tokens_completion_images
(null)
native_tokens_reasoning
6649
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0251388
router
(null)
provider_responses
0
id
"chatcmpl-67236678-ad4c-9712-9608-a00f7a6dce08"
status
200
is_byok
false
latency
848
endpoint_id
"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name
"Alibaba"
model_permaslug
"qwen/qwen3.5-397b-a17b-20260216"
api_type
"completions"
id
"gen-1771240571-ostXZpQaXcRH6BxCLMcK"
upstream_id
"chatcmpl-67236678-ad4c-9712-9608-a00f7a6dce08"
total_cost
0.0251388
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Alibaba"
Evaluation details
Result
Evaluator
Details
Meta Data
60.6531%
Count dialogue tags
n/a
neededClean
false
dialogueTags
0
"a whisper cut through the air"