NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-26-01KJCS270K0WPZGRCEF1H8PSAX
Run Details
Model:
LFM2 24B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
13.1s
Cost:
$0.000078
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
90.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet:** **Melanie:** (turning slightly toward Hunter, her voice soft but tinged with worry) *"Was ist hier geschehen? Die Leute… sie verschwinden, und niemand weiß, wohin."* **Hunter:** (frowning, stepping closer, his tone firm but curious) *"Entschuldigung… was meinen Sie damit? Ich verstehe kein Deutsch."* **Melanie:** (shaking her head gently, eyes flicking to her camera before back to him) *"Ich… ich weiß nicht, wie ich das erklären soll. Es ist, als ob etwas… unsichtbares sie nimmt. Ohne Spuren."* **Hunter:** (pausing, glancing at his watch, then back at her) *"Disappearances? You mean like… people just vanishing?"* (He taps his temple, frustrated.) *"I don’t speak German. Can you say it again? Slower."* **Melanie:** (nodding, her brow furrowing deeper) *"Ja. Verschwinden. Die Leute… sie sind hier gewesen, und dann… weg. Keine Hinweise. Niemand hört etwas."* (She hesitates, then adds softly, almost to herself.) *"Es ist, als ob Alborn… es verschluckt."* **Hunter:** (sighing, rubbing his temples) *"Alborn? What’s special about this town? Any festivals? News lately?"* **Melanie:** (shaking her head, voice trembling slightly) *"Das Apfelfest… jedes Jahr. Aber dieses Jahr… es fühlt sich anders an. Kälter. Die Luft… schwer."* (She gestures vaguely, as if feeling something unseen.) **Hunter:** (glancing at his phone, jaw tightening) *"I’ll check. But I need more than… whatever that was."* (He stands abruptly, voice sharpening.) *"I have to go. Something urgent."* **Melanie:** (rising too, hesitating, then following at a distance) *"Warten Sie… ich verstehe nicht alles, aber… vielleicht können wir zusammen etwas finden?"* **Hunter:** (already walking away, not looking back) *"Don’t follow me. And… what’s ‘unsichtbares’?"* (His voice fades as he disappears into the crowd.) --- *The café hums quietly around them—steam from mugs, distant chatter—as Melanie lingers, her camera forgotten in her lap.*
created_at
"2026-02-26T10:49:09.741Z"
2/26/2026, 10:49:09 AM
model
"liquid/lfm-2-24b-a2b-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
244
moderation_latency
(null)
generation_time
13063
tokens_prompt
319
tokens_completion
534
native_tokens_prompt
292
native_tokens_completion
575
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00007776
router
(null)
provider_responses
0
endpoint_id
"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id
"oYufprB-2j9zxn-9d3edfcbf6dbe52f"
is_byok
false
latency
244
model_permaslug
"liquid/lfm-2-24b-a2b-20260224"
provider_name
"Together"
status
200
api_type
"completions"
id
"gen-1772102949-kboFaICzE23IhDe7ntAO"
upstream_id
"oYufprB-2j9zxn-9d3edfcbf6dbe52f"
total_cost
0.00007776
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
Evaluation details
Result
Evaluator
Details
Meta Data
90.00%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"Was ist hier geschehen? Die Leute… sie verschwinden, und niemand weiß, wohin."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8163051084674597
nl
0.6354166666666666
en
0.3613138686131387
fr
0.3009320905459388
da
0.29718875502008035
pl
0.29718875502008035
tr
0.2905405405405405
hu
0.2510699001426534
yo
0.25
fi
0.2391304347826087
sv
0.23469387755102045
ca
0.2324561403508772
no
0.22680412371134018
es
0.21407185628742514
sq
0.20933734939759033
ro
0.2033383915022762
eu
0.1796875
hi
0.16798732171156894
lt
0.12790697674418602
it
0.12060301507537688
is
0.11317567567567569
pt
0.10714285714285714
az
0.10102739726027396
reliable
true
passes
true
1
name
"Hunter"
dialogue
"Entschuldigung… was meinen Sie damit? Ich verstehe kein Deutsch."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8281786941580757
nl
0.5322245322245323
no
0.35064935064935066
pl
0.3353028064992614
en
0.3212669683257918
tl
0.293563579277865
ca
0.26108374384236455
fi
0.2549668874172185
is
0.24369747899159663
sq
0.23339011925042585
sk
0.21602787456445993
ms
0.199288256227758
eu
0.1949910554561717
yo
0.16201117318435754
hr
0.14772727272727273
lt
0.14611005692599618
hu
0.13793103448275862
it
0.13793103448275862
es
0.12280701754385964
fr
0.12280701754385964
pt
0.12280701754385964
az
0.11591355599214145
ro
0.11591355599214145
sv
0.11591355599214145
reliable
true
passes
false
2
name
"Melanie"
dialogue
"Ich… ich weiß nicht, wie ich das erklären soll. Es ist, als ob etwas… unsichtbares sie nimmt. Ohne Spuren."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8285060975609756
nl
0.4775541795665635
ca
0.38969258589511757
da
0.3181818181818182
pl
0.3112244897959183
pt
0.2857142857142857
es
0.2710583153347732
no
0.2702702702702703
sl
0.2474916387959866
sv
0.23642533936651583
lv
0.21965317919075145
sk
0.15519399249061328
hi
0.1357234314980794
hu
0.13127413127413126
cs
0.12903225806451613
is
0.12790697674418602
eu
0.12677878395860284
tr
0.1222366710013004
lt
0.11879895561357702
en
0.09395973154362416
fr
0.09395973154362416
sq
0.09395973154362416
tl
0.09395973154362416
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I don’t speak German. Can you say it again? Slower."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8263888888888888
tl
0.689569536423841
ca
0.44362017804154297
sq
0.4360902255639098
nl
0.4257274119448699
ro
0.4009584664536741
tr
0.36655405405405406
az
0.358974358974359
sv
0.3567753001715266
it
0.3466898954703833
cs
0.32795698924731176
yo
0.3029739776951673
lv
0.28435114503816794
no
0.27884615384615385
da
0.2704280155642024
hr
0.2704280155642024
pl
0.251497005988024
de
0.16666666666666666
sk
0.1610738255033557
be
0.15730337078651685
es
0.15730337078651685
ms
0.15730337078651685
hu
0.1515837104072398
et
0.14383561643835618
is
0.14383561643835618
lt
0.14383561643835618
uk
0.14383561643835618
vi
0.14383561643835618
reliable
true
passes
true
4
name
"Melanie"
dialogue
"Es ist, als ob Alborn… es verschluckt."
detectedLang
"de"
heavyLang
"de"
scores
de
0.7816593886462883
ca
0.570446735395189
nl
0.4791666666666667
es
0.45652173913043476
hu
0.410377358490566
lt
0.40191387559808617
sl
0.37810945273631835
lv
0.32432432432432434
hi
0.29775280898876405
tr
0.2732558139534884
it
0.22360248447204967
is
0.21135646687697163
en
0.20127795527156547
fr
0.20127795527156547
no
0.20127795527156547
pt
0.20127795527156547
az
0.19093851132686085
ro
0.19093851132686085
sq
0.19093851132686085
sv
0.19093851132686085
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Alborn? What’s special about this town? Any festivals? News lately?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7934832491968793
tl
0.5504495504495505
ca
0.5140388768898488
nl
0.5076586433260394
it
0.5022123893805309
fr
0.42455242966751916
pt
0.412532637075718
ro
0.3935309973045822
de
0.3877551020408163
sq
0.3732590529247911
da
0.36619718309859156
es
0.3343195266272189
pl
0.3253373313343328
hr
0.3150684931506849
lt
0.31402439024390244
cs
0.30448222565687794
sk
0.303405572755418
sl
0.293563579277865
sv
0.2913385826771654
hi
0.2474916387959866
lv
0.24114671163575044
fi
0.23857868020304565
no
0.21875
et
0.21328671328671328
az
0.2077464788732394
ms
0.2077464788732394
ka
0.18772563176895307
reliable
true
passes
true
6
name
"Melanie"
dialogue
"Das Apfelfest… jedes Jahr. Aber dieses Jahr… es fühlt sich anders an. Kälter. Die Luft… schwer."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8134328358208955
da
0.44764649375600385
sv
0.41446028513238287
no
0.41086065573770486
ca
0.4041450777202072
nl
0.40352697095435686
pt
0.3770314192849404
es
0.36882546652030734
en
0.3443557582668187
fr
0.2830423940149626
lv
0.2609254498714653
yo
0.2404227212681638
et
0.21555252387448842
tl
0.21124828532235942
vi
0.1593567251461988
eu
0.1531664212076583
hu
0.15066469719350073
cs
0.14561664190193166
pl
0.14561664190193166
sk
0.14561664190193166
ro
0.14434523809523808
lt
0.13663663663663664
ms
0.12213740458015267
tr
0.10990712074303406
reliable
true
passes
true
7
name
"Hunter"
dialogue
"I have to go. Something urgent."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8080204778156996
da
0.6341463414634145
pl
0.6212121212121212
tl
0.5974955277280859
no
0.5938628158844765
yo
0.5722433460076045
ca
0.5714285714285714
hr
0.53125
ro
0.5292887029288702
cs
0.5119305856832972
sk
0.4755244755244755
lv
0.45121951219512196
lt
0.4260204081632653
es
0.4094488188976378
sv
0.38016528925619836
sq
0.3732590529247911
sl
0.34971098265895956
it
0.3382352941176471
fr
0.2879746835443038
ms
0.25742574257425743
pt
0.25742574257425743
nl
0.25
be
0.23728813559322032
tr
0.23728813559322032
hu
0.22945205479452058
az
0.21875
et
0.21875
is
0.21875
uk
0.21875
vi
0.21875
reliable
true
passes
true
8
name
"Melanie"
dialogue
"Warten Sie… ich verstehe nicht alles, aber… vielleicht können wir zusammen etwas finden?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8394004282655246
nl
0.5943204868154158
no
0.5485327313769752
da
0.5405819295558958
fi
0.4560290117860381
sv
0.42418426103646834
fr
0.38335046248715315
pl
0.3548387096774194
es
0.3281075027995521
hu
0.3212669683257918
it
0.27884615384615385
ca
0.2736077481840194
en
0.2601726263871763
tr
0.24146649810366622
et
0.23857868020304565
is
0.1935483870967742
sq
0.1880920162381597
az
0.1847826086956522
sk
0.1712707182320442
cs
0.14285714285714285
yo
0.12536443148688048
eu
0.12280701754385964
ms
0.11504424778761062
lt
0.1137370753323486
tl
0.1044776119402985
pt
0.09502262443438914
ro
0.08952959028831564
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Don’t follow me. And… what’s ‘unsichtbares’?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7886866059817945
tl
0.6546227417640808
nl
0.48657187993680884
it
0.4425385934819897
de
0.4328097731239092
sq
0.4014732965009208
es
0.3879472693032015
pt
0.37137330754352027
fr
0.33127572016460904
sl
0.3271221532091097
yo
0.23349056603773585
et
0.2261904761904762
no
0.21875
ca
0.20537897310513448
ms
0.20537897310513448
fi
0.1875
da
0.17721518987341772
lv
0.17721518987341772
reliable
true
passes
true