Run: 2026-02-26-01KJCS2NHEJNKGG7T4NPP5T8RT

Run Details

Model:
LFM2 24B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
8.3s
Cost:
$0.000056
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
**Voice Sheet:** **Melanie:** (softly, eyes still on her camera) *"Was ist hier geschehen? Ich verstehe nicht, warum die Leute verschwinden..."* **Hunter:** (pausing, brow furrowing) *"Entschuldigung, was? Ich verstehe kein Deutsch."* **Melanie:** (turning to him, voice trembling slightly) *"Es ist... es ist etwas Seltsames passiert. Die Leute, sie gehen einfach weg. Ohne ein Wort. Keine Spuren."* **Hunter:** (frowning, glancing at his watch) *"Ich muss los. Ein weiterer Fall. Ich kann jetzt nicht erklären, was ich meine."* (pulls out his phone, voice tight) *"Entschuldigung, aber ich habe einen Anruf."* **Melanie:** (leaning forward, urgent) *"Warten Sie! Bitte... sagen Sie mir, was los ist. Ich kann Ihnen helfen. Ich kenne die Stadt besser als jeder andere."* **Hunter:** (already stepping back, tone firm but polite) *"Danke. Aber ich komme nicht mit Ihnen. Ich muss zurück."* (pauses, glancing over his shoulder) *"Sprechen Sie mit dem Sheriff. Er weiß mehr."* **Melanie:** (watching him go, voice quiet but desperate) *"Nein... er wird verstehen. Er muss verstehen."* (clutches her camera tighter, eyes darting to the street as he disappears) --- *The café hums softly around them, the clink of cups and distant chatter fading as Melanie’s breath hitches—caught between fear and the weight of secrets she can’t yet translate.*
created_at"2026-02-26T10:49:24.617Z" 2/26/2026, 10:49:24 AM
model"liquid/lfm-2-24b-a2b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency242
moderation_latency(null)
generation_time8169
tokens_prompt319
tokens_completion360
native_tokens_prompt292
native_tokens_completion396
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00005628
router(null)
provider_responses
0
endpoint_id"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id"oYufuGf-2j9zxn-9d3ee028f3a1e51e"
is_byokfalse
latency242
model_permaslug"liquid/lfm-2-24b-a2b-20260224"
provider_name"Together"
status200
api_type"completions"
id"gen-1772102964-zWo1HGH4rkk7ajxmbX2w"
upstream_id"oYufuGf-2j9zxn-9d3ee028f3a1e51e"
total_cost0.00005628
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Was ist hier geschehen? Ich verstehe nicht, warum die Leute verschwinden..."
detectedLang"de"
heavyLang"de"
scores
de0.8332221480987325
nl0.637155297532656
pl0.31224209078404397
da0.3084370677731674
tr0.3006993006993007
en0.29873772791023845
hu0.26035502958579887
yo0.25925925925925924
sv0.24357034795764
ca0.24127465857359634
no0.23547400611620795
fr0.23195084485407066
es0.2223950233281493
sq0.21752738654147105
sk0.19871794871794873
eu0.18699186991869918
hi0.1749174917491749
cs0.16666666666666666
fi0.14965986394557826
lt0.1334488734835355
it0.12587412587412586
is0.11816578483245149
pt0.11190053285968028
az0.10554561717352416
ro0.10554561717352416
reliabletrue
passestrue
1
name"Hunter"
dialogue"Entschuldigung, was? Ich verstehe kein Deutsch."
detectedLang"de"
heavyLang"de"
scores
de0.8236570808464461
nl0.5672436750998668
en0.3959107806691449
ca0.3285123966942149
sk0.27616926503340755
pl0.26136363636363635
ms0.2562929061784897
yo0.2111650485436893
lt0.19154228855721395
hu0.181360201511335
it0.181360201511335
is0.1709183673469388
es0.16237113402061853
fr0.16237113402061853
no0.16237113402061853
pt0.16237113402061853
az0.15364583333333331
ro0.15364583333333331
sq0.15364583333333331
sv0.15364583333333331
reliabletrue
passesfalse
2
name"Melanie"
dialogue"Es ist... es ist etwas Seltsames passiert. Die Leute, sie gehen einfach weg. Ohne ein Wort. Keine Spuren."
detectedLang"de"
heavyLang"de"
scores
de0.8264815803523758
nl0.526584122359796
no0.494949494949495
ca0.43965517241379315
is0.36399217221135033
et0.34277047522750254
fr0.2857142857142857
da0.27697441601779754
eu0.24681344148319811
it0.23439340400471145
pt0.2111650485436893
en0.20828258221680876
sv0.20440636474908203
fi0.2034313725490196
yo0.2034313725490196
es0.18444165621079048
ms0.18032786885245902
lv0.15584415584415584
pl0.14698162729658792
hi0.1402116402116402
hu0.1356382978723404
tr0.12634408602150538
lt0.12280701754385964
tl0.11444141689373298
reliabletrue
passestrue
3
name"Hunter"
dialogue"Entschuldigung, aber ich habe einen Anruf."
detectedLang"de"
heavyLang"de"
scores
de0.8145859085290483
nl0.49238578680203043
fi0.33920704845814975
sk0.29245283018867924
pl0.27710843373493976
ms0.27184466019417475
eu0.2665036674816626
no0.2227979274611399
reliabletrue
passesfalse
4
name"Melanie"
dialogue"Warten Sie! Bitte... sagen Sie mir, was los ist. Ich kann Ihnen helfen. Ich kenne die Stadt besser als jeder andere."
detectedLang"de"
heavyLang"de"
scores
de0.8228683117517713
nl0.6597841389019241
da0.5842889908256881
no0.5629897528631705
sv0.49687716863289383
pl0.4081632653061225
es0.3521000893655049
ca0.33056325023084027
it0.318609022556391
sk0.28851815505397443
fr0.27860696517412936
tr0.24714434060228452
et0.20851528384279477
is0.20154185022026433
yo0.19444444444444445
ro0.19265033407572385
hr0.18539325842696627
fi0.17707150964812712
en0.17142857142857143
ms0.16474654377880185
hi0.12755716004813478
cs0.11907654921020656
hu0.11693057247259439
eu0.103831891223733
lv0.0903387703889586
pt0.0903387703889586
sl0.08227848101265822
sq0.08227848101265822
reliabletrue
passestrue
5
name"Hunter"
dialogue"Sprechen Sie mit dem Sheriff. Er weiß mehr."
detectedLang"de"
heavyLang"de"
scores
de0.8333333333333334
da0.6376811594202898
no0.53125
is0.44029850746268656
nl0.42196531791907516
sv0.4163424124513619
en0.3603411513859275
pl0.27184466019417475
sl0.2682926829268293
sq0.25
lt0.23076923076923078
hu0.22680412371134018
hr0.20424403183023873
it0.18699186991869918
sk0.18699186991869918
reliabletrue
passesfalse
6
name"Melanie"
dialogue"Nein... er wird verstehen. Er muss verstehen."
detectedLang"de"
heavyLang"de"
scores
de0.834280303030303
is0.5721271393643031
nl0.5668316831683169
no0.56575682382134
da0.4942196531791907
eu0.396551724137931
fi0.3346007604562738
lt0.3055555555555556
hu0.29149797570850206
it0.29149797570850206
en0.2647058823529412
es0.2647058823529412
fr0.2647058823529412
pt0.2647058823529412
az0.25213675213675213
ca0.25213675213675213
ro0.25213675213675213
sq0.25213675213675213
sv0.25213675213675213
reliabletrue
passestrue