Run: 2026-02-26-01KJCRWW5J18PX4X99YRCH1ME2

Run Details

Model:
LFM2 24B
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
6.7s
Cost:
$0.000052
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
88.89% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
**Voice Sheet:** **Maria:** *(looking up from her camera, eyes tense)* "¿Qué pasó? ¿Alguien desapareció otra vez?" *(Her voice trembles slightly, fingers tightening around the camera strap.)* **Hunter:** *(frowning, stepping closer)* "What happened? Who disappeared?" *(He gestures vaguely toward the street, brow furrowed.)* **Maria:** *(shaking her head, speaking faster)* "No lo sé… solo sé que cada vez es peor. Las personas… se van y nadie sabe por qué." *(She glances around nervously, as if expecting someone to overhear.)* **Hunter:** *(checking his watch, tone sharp)* "I don’t have time for this. I need to go—" *(His phone buzzes; he answers, voice low.)* **Maria:** *(softly, almost to herself)* "Otra vez… como siempre." **Hunter:** *(into phone)* "Yes. I’ll be back later. Stay safe." *(He hangs up, then turns to Maria with a weary sigh.)* **Maria:** *(quietly, in Spanish)* "Gracias… pero no entiendes." **Hunter:** *(confused, raising an eyebrow)* "What do you mean?" **Maria:** *(shrugs, avoiding eye contact)* "Nada. Just… keep your eyes open." *(Hunter nods, already walking away, leaving Maria alone with her camera and the weight of unspoken fears.)*
created_at"2026-02-26T10:46:14.798Z" 2/26/2026, 10:46:14 AM
model"liquid/lfm-2-24b-a2b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency300
moderation_latency(null)
generation_time6527
tokens_prompt317
tokens_completion334
native_tokens_prompt287
native_tokens_completion363
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00005217
router(null)
provider_responses
0
endpoint_id"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id"oYuevr5-2j9zxn-9d3edb86838de516"
is_byokfalse
latency300
model_permaslug"liquid/lfm-2-24b-a2b-20260224"
provider_name"Together"
status200
api_type"completions"
id"gen-1772102774-jZ56NgV9nlZRXbgrKYia"
upstream_id"oYuevr5-2j9zxn-9d3edb86838de516"
total_cost0.00005217
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
88.89% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"¿Qué pasó? ¿Alguien desapareció otra vez?"
detectedLang"es"
heavyLang"es"
scores
es0.8216601815823605
pt0.6451612903225806
ca0.6180555555555556
et0.27055702917771884
lv0.26666666666666666
hu0.2647058823529412
eu0.2506811989100818
sk0.23822714681440443
en0.21875
ms0.21875
tr0.21875
reliabletrue
passestrue
1
name"Hunter"
dialogue"What happened? Who disappeared?"
detectedLang"en"
heavyLang"en"
scores
en0.8145094806265457
eu0.3818681318681319
nl0.3181818181818182
tl0.30769230769230765
ms0.303405572755418
it0.27884615384615385
fr0.2549668874172185
reliabletrue
passestrue
2
name"Maria"
dialogue"No lo sé… solo sé que cada vez es peor. Las personas… se van y nadie sabe por qué."
detectedLang"es"
heavyLang"es"
scores
es0.8318924111431315
pt0.6982758620689654
ca0.6960046323103648
it0.56575682382134
fr0.5102611940298507
lv0.47968285431119917
sq0.42560175054704596
tl0.41077441077441074
yo0.38596491228070173
lt0.38162544169611307
sv0.37200956937799046
no0.37050359712230213
hr0.3581907090464548
hu0.35503685503685506
de0.3453865336658354
ro0.34045226130653267
nl0.3251928020565552
en0.3208279430789133
is0.3181818181818182
pl0.31282722513089006
da0.3027888446215139
cs0.27083333333333337
vi0.2647058823529412
ms0.2369186046511628
tr0.22794117647058826
sk0.2222222222222222
az0.20694864048338368
sl0.2009132420091324
et0.18351477449455675
fi0.16267942583732056
reliabletrue
passestrue
3
name"Hunter"
dialogue"I don’t have time for this. I need to go—"
detectedLang"en"
heavyLang"en"
scores
en0.8460591133004927
tl0.7308934337997848
da0.7139588100686498
no0.66078697421981
pl0.5961227786752827
hr0.5755517826825127
yo0.5462794918330308
cs0.48559670781893005
sk0.44933920704845814
et0.4469026548672566
lv0.42528735632183906
pt0.40476190476190477
lt0.4004796163069544
ca0.3556701030927836
sv0.3556701030927836
sq0.34895833333333337
sl0.32614555256064687
it0.3150684931506849
ro0.2647058823529412
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
4
name"Maria"
dialogue"Otra vez… como siempre."
detectedLang"es"
heavyLang"es"
scores
es0.836173001310616
pt0.749498997995992
it0.6019108280254777
ca0.4444444444444444
lv0.4444444444444444
tl0.4075829383886255
reliabletrue
passestrue
5
name"Hunter"
dialogue"Yes. I’ll be back later. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.819422150882825
tl0.5463709677419355
nl0.48156682027649766
de0.4094488188976378
hu0.34210526315789475
lt0.33234421364985167
yo0.3283582089552239
da0.29467084639498436
no0.2879746835443038
sv0.27652733118971057
hi0.2524916943521595
pl0.2524916943521595
fr0.2398648648648649
pt0.2398648648648649
reliabletrue
passestrue
6
name"Maria"
dialogue"Gracias… pero no entiendes."
detectedLang"es"
heavyLang"es"
scores
es0.8275862068965517
pt0.7217806041335453
ca0.630801687763713
fr0.5901639344262295
tl0.580335731414868
en0.527027027027027
pl0.5
no0.4897959183673469
et0.4582043343653251
lv0.4281045751633987
da0.37722419928825623
hr0.36594202898550726
de0.34210526315789475
fi0.34210526315789475
sk0.34210526315789475
tr0.3346007604562738
it0.3137254901960784
nl0.3055555555555556
sv0.2886178861788618
reliabletrue
passestrue
7
name"Hunter"
dialogue"What do you mean?"
detectedLang"en"
heavyLang"en"
scores
en0.8330550918196995
cs0.6784565916398714
pt0.609375
pl0.588477366255144
sk0.5689655172413793
hr0.5454545454545454
sl0.5454545454545454
sq0.5391705069124424
vi0.5260663507109005
tl0.43820224719101125
yo0.43820224719101125
reliabletrue
passestrue
8
name"Maria"
dialogue"Nada. Just… keep your eyes open."
detectedLang"en"
heavyLang"en"
scores
en0.7851002865329513
sv0.5412844036697247
tl0.504950495049505
es0.4545454545454546
pt0.4444444444444444
et0.40476190476190477
nl0.3775933609958506
ms0.34210526315789475
ca0.33920704845814975
no0.3333333333333333
sk0.3333333333333333
reliabletrue
passesfalse