NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-26-01KJCRVMF6W4YFS40JEV6A7VQE
Run Details
Model:
LFM2 24B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
11.2s
Cost:
$0.000077
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
70.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** **[Scene: A quiet corner of a cozy café in Alborn, MN. The soft hum of conversation blends with the clinking of cups. SELVI sits by the window, her camera resting on the table, eyes scanning the street outside. HUNTER enters, his posture stiff, and approaches her.]** **Hunter:** (firm, slightly impatient) "Excuse me. Are you Selvi? I’m Detective Hunter. I need to ask you a few questions about the recent disappearances." **Selvi:** (startled, clutching her camera strap; her voice trembles, rapid Hindi spilling out) "*Arre… yeh kya hua? Kya aisa hai?*" (What happened? Is this real?) **Hunter:** (frowning, leaning closer but not understanding) "I don’t speak Hindi. Can you repeat that?" **Selvi:** (voice rising, hands gesturing wildly) "*Mujhe batao… kya hua? Kya aisa hai?*" (Tell me… what happened? Is this real?) **Hunter:** (pausing, glancing around as if searching for a translation app) "Look, I’m sorry—I can’t follow. Are you upset? Did something happen here?" **Selvi:** (tears welling, nodding frantically) "*Haan… haan…*" (Yes… yes…) *She hesitates, then points to herself, then to the camera, then mimes a camera shutter—*"*Camera…*"* **Hunter:** (softening slightly, but still confused) "Your camera? What’s that got to do with it?" **Selvi:** (shaking her head, pointing to the window, then to the sky—*"Sky… disappear…"*) **Hunter:** (sighs, pulling out his phone) "I need to take this seriously. I’ll call my partner. Stay here." (He steps back, already dialing.) **Selvi:** (calling after him, voice breaking) "*Aapka maqsad kya hai?*" (What’s your purpose?) **Hunter:** (over his shoulder, distracted) "Not now. Just… stay safe." (He ends the call, staring at his phone.) **[He turns away, jaw tight, as Selvi watches him go—her camera still open, the lens pointed outward, as if waiting for answers.]** --- *End Scene.*
created_at
"2026-02-26T10:45:34.149Z"
2/26/2026, 10:45:34 AM
model
"liquid/lfm-2-24b-a2b-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
226
moderation_latency
(null)
generation_time
10804
tokens_prompt
315
tokens_completion
515
native_tokens_prompt
292
native_tokens_completion
571
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00007728
router
(null)
provider_responses
0
endpoint_id
"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id
"oYueikv-2j9zxn-9d3eda88734de509"
is_byok
false
latency
226
model_permaslug
"liquid/lfm-2-24b-a2b-20260224"
provider_name
"Together"
status
200
api_type
"completions"
id
"gen-1772102734-fxxnvxkV8hvUajgHRkFd"
upstream_id
"oYueikv-2j9zxn-9d3eda88734de509"
total_cost
0.00007728
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
Evaluation details
Result
Evaluator
Details
Meta Data
70.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Are you Selvi? I’m Detective Hunter. I need to ask you a few questions about the recent disappearances."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7987804878048781
fr
0.6222527472527472
tl
0.5843828715365239
ca
0.5533297238765565
it
0.533106960950764
pt
0.5192307692307693
ro
0.5006053268765134
no
0.47982345523329134
da
0.47883765003158557
nl
0.47751741608613046
cs
0.4455645161290322
es
0.4368600682593857
sq
0.41447835344215755
sv
0.41447835344215755
hr
0.37594553706505296
sl
0.37166793602437165
sk
0.3697478991596639
yo
0.3529411764705882
pl
0.34523809523809523
ms
0.3164871582435791
et
0.3037974683544304
lv
0.2850953206239168
lt
0.2744063324538259
fi
0.23112767940354148
de
0.22462406015037595
hu
0.21278625954198474
tr
0.19980601357904945
is
0.14330218068535827
az
0.13883089770354906
vi
0.13883089770354906
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
1
name
"Selvi"
dialogue
"Arre… yeh kya hua? Kya aisa hai?"
detectedLang
"vi"
heavyLang
"ber"
scores
vi
0.511400651465798
it
0.39999999999999997
reliable
false
passes
false
2
name
"Hunter"
dialogue
"I don’t speak Hindi. Can you repeat that?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7872340425531915
tl
0.7309417040358744
ca
0.5008319467554077
sq
0.42418426103646834
it
0.41972920696324956
cs
0.37888198757763975
ro
0.3697478991596639
is
0.3492407809110629
et
0.3435448577680525
tr
0.3288590604026846
no
0.3258426966292135
az
0.3181818181818182
da
0.31662870159453305
hr
0.31662870159453305
sv
0.3150684931506849
pl
0.29577464788732394
yo
0.2248062015503876
hi
0.20634920634920634
es
0.20212765957446807
pt
0.20212765957446807
sk
0.1935483870967742
be
0.1891891891891892
hu
0.18256130790190736
lt
0.17355371900826447
lv
0.17355371900826447
uk
0.17355371900826447
vi
0.17355371900826447
reliable
true
passes
true
3
name
"Selvi"
dialogue
"Mujhe batao… kya hua? Kya aisa hai?"
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.511002444987775
vi
0.43977591036414565
it
0.3333333333333333
eu
0.3150684931506849
ca
0.2647058823529412
es
0.2647058823529412
fr
0.2647058823529412
ms
0.2647058823529412
pt
0.2647058823529412
ro
0.2647058823529412
reliable
false
passes
false
4
name
"Hunter"
dialogue
"Look, I’m sorry—I can’t follow. Are you upset? Did something happen here?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8043964232488823
tl
0.6502331778814123
it
0.3581907090464548
no
0.31640625
sv
0.31282722513089006
ro
0.3119266055045872
sq
0.308300395256917
da
0.3027888446215139
cs
0.2584745762711864
pt
0.2532005689900427
hu
0.23469387755102045
hr
0.20933734939759033
ca
0.2081447963800905
pl
0.1935483870967742
fi
0.16666666666666666
nl
0.16134185303514376
de
0.1449511400651466
yo
0.14215686274509806
es
0.12935323383084577
ms
0.12935323383084577
sk
0.12060301507537688
be
0.11764705882352942
tr
0.11764705882352942
az
0.10714285714285714
et
0.10714285714285714
is
0.10714285714285714
lt
0.10714285714285714
lv
0.10714285714285714
uk
0.10714285714285714
vi
0.10714285714285714
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Camera…"
detectedLang
"it"
heavyLang
"ro"
scores
it
0.7596153846153846
ro
0.7596153846153846
ca
0.6710526315789473
es
0.6644295302013423
sv
0.6212121212121212
en
0.6031746031746031
fr
0.6031746031746031
nl
0.6031746031746031
de
0.5901639344262295
ms
0.5901639344262295
tl
0.5901639344262295
reliable
false
passes
true
6
name
"Hunter"
dialogue
"Your camera? What’s that got to do with it?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8282770463651976
tl
0.665924276169265
yo
0.49238578680203043
pl
0.4809688581314879
cs
0.46808510638297873
sk
0.46808510638297873
it
0.46236559139784944
sl
0.44547134935304994
hr
0.44029850746268656
ms
0.4318181818181818
lv
0.4094488188976378
sq
0.40357852882703776
nl
0.3684210526315789
ro
0.34497816593886466
pt
0.34210526315789475
vi
0.27007299270072993
no
0.2665036674816626
da
0.25742574257425743
lt
0.25742574257425743
ca
0.2537313432835821
es
0.24812030075187969
sv
0.21465968586387435
fr
0.20212765957446807
de
0.1935483870967742
reliable
true
passes
true
7
name
"Hunter"
dialogue
"I need to take this seriously. I’ll call my partner. Stay here."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8208687863860278
tl
0.6466431095406361
pl
0.5485327313769752
no
0.5391705069124424
da
0.5310668229777257
cs
0.5260663507109005
sk
0.5073891625615764
hr
0.4878361075544174
sq
0.48253557567917205
it
0.47229551451187335
sv
0.46808510638297873
sl
0.4482758620689655
lt
0.42938659058487877
ca
0.4269340974212034
yo
0.4143484626647145
et
0.40476190476190477
lv
0.3911719939117199
ro
0.3893129770992366
de
0.36608557844690964
nl
0.3464052287581699
az
0.33554817275747506
tr
0.3288590604026846
es
0.2907801418439716
pt
0.2907801418439716
fr
0.2805755395683453
ms
0.25925925925925924
hu
0.24528301886792453
eu
0.16666666666666666
be
0.14893617021276595
is
0.13606911447084233
uk
0.13606911447084233
vi
0.13606911447084233
reliable
true
passes
true
8
name
"Selvi"
dialogue
"Aapka maqsad kya hai?"
detectedLang
"vi"
heavyLang
"tr"
scores
vi
0.511400651465798
it
0.39999999999999997
reliable
false
passes
false
9
name
"Hunter"
dialogue
"Not now. Just… stay safe."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8292349726775956
et
0.44933920704845814
sv
0.44933920704845814
tl
0.3842364532019704
tr
0.3842364532019704
ca
0.3811881188118812
reliable
true
passes
true