Run: 2026-05-27-01KSMEKH6JNHTPXJAM52CYPYV6

Run Details

Model:
Cydonia 24B V4.1
Test:
Dialogue tags
Scenario:
Write unattributed dialogue
Duration:
4.6s
Cost:
$0.000136
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
60.65% Count dialogue tags (details)

Model input

User/Human
You are an expert novel writer in the cozy mystery genre. Write a scene of about 200 words, with dialogue between two characters. The dialogue should be unattributed, meaning the speaker is not explicitly mentioned. The scene should be set in a small town bakery. Only return the story, nothing else.

Model response

AI
The bell above the door jingled. The sweet scent of cinnamon and vanilla filled the air. "I saw Mrs. Henderson at the library. She seemed distracted." "Really? With that case still open?" "She'd probably know more than she's letting on. The way she hovers around the old bookstore..." "Or she's just looking for a good mystery novel to takeover her thoughts." "But the timing is suspicious. The crime happened right after she took over that council seat." "Give her the benefit of the doubt. Small towns can be unforgiving." "A missing diamond brooch doesn't resolve itself." "Neither does an accusation against our town's quietest resident." "Fine, but I saw her coming from the lighthouse just before the discovery." The voice behind the counter interrupted, "Can I get you any pastries while you solve the case?"
created_at"2026-05-27T10:10:11.294Z" 5/27/2026, 10:10:11 AM
model"thedrummer/cydonia-24b-v4.1"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency188
moderation_latency(null)
generation_time4550
tokens_prompt81
tokens_completion222
native_tokens_prompt242
native_tokens_completion179
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached176
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0001357
router(null)
provider_responses
0
endpoint_id"4d46db86-63fe-47eb-85f1-6a7567af190c"
id"chatcmpl-8fdad8bf70724c9381265618aa1e00a2"
is_byokfalse
latency188
model_permaslug"thedrummer/cydonia-24b-v4.1"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.15.0; linux; x64))"
http_referer(null)
request_id"req-1779876611-6A0ODPYKL9hxxKtpC2Tn"
session_id(null)
api_type"completions"
id"gen-1779876611-NhlG9WuTyQczCCHohRkM"
upstream_id"chatcmpl-8fdad8bf70724c9381265618aa1e00a2"
total_cost0.0001357
cache_discount0.0000264
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
60.65% Count dialogue tags n/a
neededCleanfalse
dialogueTags
0"The voice behind the counter interrupted"