Run: 2026-02-26-01KJCS68ATF6J31DMNSKBTS77Y

Run Details

Model:
LFM2 24B
Duration:
45.4s
Cost:
$0.000121
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet:** **[Scene: A quiet corner of a cozy café in Alborn, MN. The soft hum of conversation and the clink of coffee cups fill the air. SELVI sits by the window, her camera resting on the table beside her. Her brow is furrowed, eyes scanning the street outside. HUNTER enters, his posture stiff, and approaches her table.]** **Hunter:** (firm, slightly impatient) "Excuse me. I’m Detective Hunter. Are you Selvi?" **Selvi:** (startled, then nods quickly. She glances up, her voice low and urgent, words flowing in Hindi.) *"Aaj… aaj kuchh nahi chahta… bahut ghabraak hai. Koi naya samay se hua hai…"* **[Her hands tremble slightly as she lowers the camera, fingers brushing the edge of her scarf. Her gaze flicks to Hunter, searching for understanding.]** **Hunter:** (frowning, leaning in) "What’s happening? What’s ‘ghabraak’? You’re scaring me." **Selvi:** (voice cracking, switching to halting English) "No… not… *that*. Just… *ghabraak*. People gone. Last week, Mrs. Patel’s grandson… vanished. No note. No trace. Then last night, the Miller boy—same thing. They say it’s the same… *something*." (She gestures vaguely toward the window, where townsfolk pass by, oblivious.) **Hunter:** (pulls out his phone, thumb hovering over the receiver) "Gone? Like… moved away? Or…?" **Selvi:** (shakes her head, eyes wide) "*Nahi*. Not like that. *Disappeared*. Like they… never existed." (She pauses, swallowing hard.) "I saw them. In photos. But now… only shadows." **[Hunter’s jaw tightens. He checks his watch, then taps his earpiece.]** **Hunter:** (into phone) "Yeah. I’ll be right back. This isn’t my beat." (He hangs up, turning back to her.) "Who told you this?" **Selvi:** (softly, avoiding his gaze) "A man. At the market. He said… *‘Dil ko chhod do.’* Don’t forget your heart." (She trails off, lips pressed thin.) **Hunter:** (confused, frustrated) "What does that mean? And why should I care?" **Selvi:** (stands abruptly, camera slipping to the floor) "Because… you’re looking for *people*. I’m looking for… *truth*. But the truth here… it’s *hiding*." (She hesitates, then adds quietly.) "In Hindi. You don’t understand." **[A distant bell rings. Hunter’s eyes narrow, but he’s already stepping back, checking his watch again.]** **Hunter:** (grim) "I need to go. This… isn’t helping." **Selvi:** (reaching for his arm, voice desperate) "Wait! Please—" **[He pulls away gently, offering a small, apologetic smile.]** **Hunter:** "Stay safe, then. Whatever’s going on… it’s not good." **[He turns, strides toward the door, and pauses, glancing back once. His expression is unreadable, but his shoulders tense as if bracing for something.]** **Selvi:** (whispers, alone again) *"Kya hua…?"* (What happened?) **[The café door swings shut behind Hunter. Selvi stares after him, then sinks back into her seat, clutching her camera. Her fingers brush the lens—a habit, a comfort—as she whispers to the empty room.]** **Selvi:** (to herself, in Hindi) *"Kuchh chhoo gaya… bas chhoo gaya."* (Someone’s gone… just… gone.) **[Fade out.]**
created_at"2026-02-26T10:51:46.988Z" 2/26/2026, 10:51:46 AM
model"liquid/lfm-2-24b-a2b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency237
moderation_latency(null)
generation_time20542
tokens_prompt315
tokens_completion853
native_tokens_prompt292
native_tokens_completion936
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00012108
router(null)
provider_responses
0
endpoint_id"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id"oYugdbC-2j9zxn-9d3ee3a2b283c637"
is_byokfalse
latency237
model_permaslug"liquid/lfm-2-24b-a2b-20260224"
provider_name"Together"
status200
api_type"completions"
id"gen-1772103106-13vAPvXkp49qarDeNQL4"
upstream_id"oYugdbC-2j9zxn-9d3ee3a2b283c637"
total_cost0.00012108
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. I’m Detective Hunter. Are you Selvi?"
detectedLang"en"
heavyLang"en"
scores
en0.7610921501706485
tl0.6208017334777898
ro0.5673671199011124
fr0.5042492917847025
no0.4942196531791907
pt0.47839046199701935
ca0.47447447447447455
it0.47447447447447455
sq0.4615384615384615
es0.4444444444444444
da0.44267515923566875
nl0.3955094991364421
sl0.3794326241134752
fi0.34579439252336447
de0.32950191570881227
cs0.3
ms0.29006085192697767
sv0.2813141683778234
et0.21348314606741572
hr0.1606714628297362
tr0.14425427872860636
reliabletrue
passestrue
1
name"Hunter"
dialogue"What’s happening? What’s ‘ghabraak’? You’re scaring me."
detectedLang"en"
heavyLang"en"
scores
en0.7848537005163512
nl0.5888157894736842
tl0.5222929936305732
no0.4703389830508474
it0.416796267496112
da0.4028662420382166
sv0.39999999999999997
ms0.3194192377495462
sq0.2829827915869981
is0.22680412371134018
es0.21383647798742136
sk0.21052631578947367
et0.20212765957446807
fr0.19527896995708155
pt0.19006479481641467
sl0.19006479481641467
de0.17943107221006563
ro0.17218543046357618
fi0.16666666666666666
reliabletrue
passestrue
2
name"Selvi"
dialogue"No… not… that. Just… ghabraak. People gone. Last week, Mrs. Patel’s grandson… vanished. No note. No trace. Then last night, the Miller boy—same thing. They say it’s the same… something."
detectedLang"en"
heavyLang"en"
scores
en0.7915363769022306
tl0.609375
nl0.421631000578369
fr0.40191387559808617
ca0.3909866017052376
no0.3868792152053955
da0.34253780407626566
tr0.2907801418439716
sv0.27219796215429404
es0.27166788055353236
de0.24069855732725895
it0.23076923076923078
pt0.23017705927636642
et0.21691464369616287
yo0.19871794871794873
hr0.19743178170144465
lv0.1823385118560916
pl0.1823385118560916
lt0.14163090128755365
ms0.13494809688581316
cs0.13269731136166524
sk0.13043478260869565
sq0.12049252418645558
az0.08172635445362718
hu0.08172635445362718
is0.08088235294117647
fi0.06976744186046512
ro0.05571293673276676
sl0.05571293673276676
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Gone? Like… moved away? Or…?"
detectedLang"en"
heavyLang"en"
scores
en0.8325892857142858
tl0.5562130177514794
no0.4545454545454546
sl0.39999999999999997
fr0.34210526315789475
reliabletrue
passestrue
4
name"Selvi"
dialogue"I saw them. In photos. But now… only shadows."
detectedLang"en"
heavyLang"en"
scores
en0.8106060606060606
tl0.5401337792642141
de0.5183887915936953
fr0.4954128440366973
it0.4878957169459963
sv0.47115384615384615
ro0.4575936883629191
nl0.45219123505976094
pl0.43298969072164945
ca0.4318181818181818
ms0.3888888888888889
yo0.3888888888888889
sl0.358974358974359
tr0.34988179669030733
az0.3483412322274882
no0.34523809523809523
lt0.34210526315789475
da0.3357487922705314
hr0.3357487922705314
lv0.3276283618581907
sq0.3276283618581907
cs0.2763157894736842
es0.22535211267605632
pt0.22535211267605632
hi0.21875
sk0.207492795389049
be0.20289855072463767
hu0.19590643274853803
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Who told you this?"
detectedLang"en"
heavyLang"en"
scores
en0.8542274052478134
tl0.6402877697841727
cs0.43820224719101125
reliabletrue
passestrue
6
name"Selvi"
dialogue"A man. At the market. He said… ‘Dil ko chhod do.’ Don’t forget your heart."
detectedLang"en"
heavyLang"en"
scores
en0.7886728655959425
tl0.7129735935706085
da0.5777027027027027
no0.5659722222222222
yo0.5178399228543876
sv0.5073891625615764
sq0.4444444444444444
sl0.441340782122905
pt0.4152046783625731
tr0.3983152827918171
cs0.3961352657004831
nl0.3909866017052376
sk0.3909866017052376
pl0.3834771886559803
lv0.3757802746566792
hr0.37421777221526903
ms0.3718592964824121
lt0.3514915693904021
de0.33774834437086093
hu0.33244325767690247
eu0.32614555256064687
et0.31880108991825606
ca0.31224209078404397
fi0.3093922651933701
es0.30167597765363136
fr0.2805755395683453
vi0.26578560939794427
is0.2331288343558282
ro0.21752738654147105
az0.20508744038155804
it0.2
reliabletrue
passesfalse
7
name"Hunter"
dialogue"What does that mean? And why should I care?"
detectedLang"en"
heavyLang"en"
scores
en0.848851269649335
tl0.5335820895522388
ro0.52561669829222
yo0.42660550458715596
no0.3670886075949367
da0.3573264781491003
hr0.3573264781491003
ca0.3556701030927836
sv0.3556701030927836
sq0.34895833333333337
pl0.33510638297872336
it0.3150684931506849
cs0.29577464788732394
sk0.22360248447204967
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
et0.20127795527156547
is0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
8
name"Selvi"
dialogue"In Hindi. You don’t understand."
detectedLang"en"
heavyLang"en"
scores
en0.7887323943661971
tl0.7575431034482759
de0.6017699115044248
nl0.5974955277280859
sv0.5856353591160222
da0.5722433460076045
no0.5689655172413793
it0.5253164556962026
ro0.4897959183673469
is0.43324937027707805
cs0.4186046511627907
pl0.4186046511627907
sl0.4063324538258575
et0.29467084639498436
sk0.2834394904458599
yo0.281150159744409
sq0.27884615384615385
az0.27184466019417475
hi0.25742574257425743
ms0.25
reliabletrue
passesfalse
9
name"Hunter"
dialogue"I need to go. This… isn’t helping."
detectedLang"en"
heavyLang"en"
scores
en0.8292867981790591
tl0.7204968944099379
pl0.6212121212121212
no0.5901639344262295
da0.5817843866171004
yo0.5722433460076045
et0.5472837022132797
hr0.53125
cs0.5119305856832972
sv0.4897959183673469
sk0.4755244755244755
lv0.45121951219512196
lt0.4260204081632653
nl0.412532637075718
ca0.38016528925619836
sq0.3732590529247911
sl0.34971098265895956
it0.3382352941176471
fi0.3055555555555556
ro0.2857142857142857
ms0.25742574257425743
be0.23728813559322032
fr0.23728813559322032
pt0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
10
name"Selvi"
dialogue"Wait! Please—"
detectedLang"en"
heavyLang"en"
scores
en0.8267898383371826
ro0.5714285714285714
tl0.5714285714285714
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Stay safe, then. Whatever’s going on… it’s not good."
detectedLang"en"
heavyLang"en"
scores
en0.8243243243243242
tl0.5901639344262295
et0.32150313152400833
fi0.3157894736842105
fr0.2511520737327189
ca0.23349056603773585
nl0.23349056603773585
hr0.21307506053268765
hi0.20537897310513448
pl0.20537897310513448
tr0.1935483870967742
cs0.1875
sk0.1875
yo0.1875
reliabletrue
passestrue
12
name"Selvi"
dialogue"Kya hua…?"
detectedLang""
heavyLang"tl"
scores
reliablefalse
passestrue
13
name"Selvi"
dialogue"Kuchh chhoo gaya… bas chhoo gaya."
detectedLang"ms"
heavyLang"id"
scores
ms0.6487119437939111
fr0.42748091603053434
tl0.42748091603053434
cs0.33920704845814975
pl0.33920704845814975
sk0.33920704845814975
reliabletrue
passesfalse