Run: 2026-02-26-01KJCRYB07H9S005BVM010KHT7

Run Details

Model:
LFM2 24B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
4.3s
Cost:
$0.000034
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
**Voice Sheet:** **Melanie:** (softly, eyes fixed on her camera) *"Es ist... unheimlich hier. Die Leute verschwinden, und niemand redet darüber. Ich fühle mich beobachtet."* **Hunter:** (pausing, brow furrowing) *"What? You mean—?"* (he glances around, then checks his phone, voice tightening) *"I need to go. Something’s come up. I’ll… I’ll call you back."* **Melanie:** (voice trembling, clutching her camera strap) *"Bitte… bleiben Sie. Ich… ich habe etwas gesehen. Etwas, das nicht gehört."* **Hunter:** (already turning away, jaw set) *"I’ll explain later. Just… stay safe."* (he strides off, leaving only the hum of the café and the faint click of Melanie’s shutter.)
created_at"2026-02-26T10:47:02.758Z" 2/26/2026, 10:47:02 AM
model"liquid/lfm-2-24b-a2b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency363
moderation_latency(null)
generation_time4246
tokens_prompt319
tokens_completion188
native_tokens_prompt292
native_tokens_completion207
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0000336
router(null)
provider_responses
0
endpoint_id"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id"oYufB6e-2j9zxn-9d3edcb24304339b"
is_byokfalse
latency362
model_permaslug"liquid/lfm-2-24b-a2b-20260224"
provider_name"Together"
status200
api_type"completions"
id"gen-1772102822-zOWAGo4letPPzj9YZoi5"
upstream_id"oYufB6e-2j9zxn-9d3edcb24304339b"
total_cost0.0000336
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Es ist... unheimlich hier. Die Leute verschwinden, und niemand redet darüber. Ich fühle mich beobachtet."
detectedLang"de"
heavyLang"de"
scores
de0.8194480268248645
nl0.5148995148995149
es0.3996569468267582
da0.36993699369936994
ca0.30417495029821073
hu0.2842535787321063
no0.27083333333333337
sq0.27007299270072993
sv0.2545260915867945
fr0.24406047516198706
pl0.24324324324324328
tr0.2349726775956284
lt0.1935483870967742
en0.17355371900826447
pt0.16567342073897498
ro0.1606714628297362
sk0.15048543689320387
lv0.14634146341463414
hi0.1315136476426799
yo0.1116751269035533
fi0.0990990990990991
it0.09326424870466321
is0.08735332464146023
az0.077733860342556
reliabletrue
passestrue
1
name"Hunter"
dialogue"I need to go. Something’s come up. I’ll… I’ll call you back."
detectedLang"en"
heavyLang"en"
scores
en0.8198847262247838
tl0.656907593778591
pl0.4959677419354839
cs0.455732946298984
yo0.44526627218934917
it0.4248466257668711
hr0.40476190476190477
no0.4038155802861685
da0.39320388349514557
sk0.35233160621761656
et0.35008665511265163
lv0.33035714285714285
nl0.3206521739130435
lt0.3081180811808118
ca0.2690058479532163
sv0.2690058479532163
sq0.2632612966601179
sl0.24395161290322584
ro0.1935483870967742
es0.17218543046357618
pt0.17218543046357618
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
2
name"Melanie"
dialogue"Bitte… bleiben Sie. Ich… ich habe etwas gesehen. Etwas, das nicht gehört."
detectedLang"de"
heavyLang"de"
scores
de0.8483699772554966
nl0.3640699523052464
pl0.3620414673046252
pt0.29328621908127206
sk0.2366412213740458
eu0.22330097087378642
et0.2202729044834308
sv0.2047713717693837
cs0.2
hu0.1902834008097166
fi0.18032786885245902
tr0.18032786885245902
es0.16317991631799164
da0.15789473684210525
it0.15789473684210525
no0.15789473684210525
reliabletrue
passestrue
3
name"Hunter"
dialogue"I’ll explain later. Just… stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8034934497816594
nl0.5544554455445544
sv0.5351239669421488
tl0.5233050847457626
fr0.5171673819742489
de0.5022123893805309
ca0.4485294117647059
pt0.4230769230769231
ms0.3343195266272189
et0.3119266055045872
es0.30769230769230765
da0.29467084639498436
no0.2879746835443038
ro0.2879746835443038
fi0.2524916943521595
hi0.2524916943521595
pl0.2524916943521595
reliabletrue
passestrue