NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-16-01KHM5MD93171F9MX1EDXYXDYT
Run Details
Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
20.6s
Cost:
$0.000424
Provider:
ModelRun
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the scene written as a voice sheet: --- **Melanie:** *(sitting at a café table, frowns at her camera, adjusting the lens)* **Hunter:** *(approaches, standing tall with authority)* "Excuse me, ma’am. You were at the apple festival yesterday, right? Mind if I ask you a few questions?" **Melanie:** *(looks up, startled, replies in rapid German)* "Was ist passiert? Ich war nur Fotos machen…" *(shaken, tightens grip on her camera)* **Hunter:** *(frowns in confusion)* "English? Do you speak English?" **Melanie:** *(shakes head, frustrated)* "Nein, ich verstehe nicht." **Hunter:** *(sighs Mouse looking around for someone who might translate)* "Great. Uh—hold on." *(pulls out phone, hesitates, then tries无边随手 gestures)* "Did you see anything... strange? At the festival?" **Melanie:** *(confused, then realization dawns)* "Ah! Sie meinen… die verschwundene Frau?" *(points toward festival grounds, expression troubled)* **Hunter:** *(leans in, trying to read her meaning)* "Yes! Exactly. Did you see something?" **Melanie:** *(hesitates, then nods slowly, speaking carefully)* "Ja… ein Mann. Er hat… etwas komisch gemacht." *(mimics someone acting suspiciously)* **Hunter:** *(strained patience)* "Okay, but—" *(phone rings sharply. Groans, answers)* "Yeah?建成说什么t now?" *(listens, then grits teeth)* "On my way." *(hangs up, tosses Melanie an apologetic look)* "Gotta go. Stay available, alright?" *( strive*d toward exit*) **Melanie:** *(calls after him, weakly)* "Warten Sie, ich kann helfen—!" *(sighs, slumps back into her seat, staring at her camera with unease)* --- *(Scene ends with Melanie gazing anxiously at her photos, possibly holding a clue she doesn’t yet understand.)* Hope this captures the language barrier and tension between them! Let me know if you'd like any tweaks.
created_at
"2026-02-16T21:28:09.661154+00:00"
2/16/2026, 9:28:09 PM
model
"deepseek/deepseek-chat-v3-0324"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
264
moderation_latency
(null)
generation_time
15261
tokens_prompt
319
tokens_completion
498
native_tokens_prompt
266
native_tokens_completion
481
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
5
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00042357
router
(null)
provider_responses
0
status
(null)
is_byok
false
latency
5319
endpoint_id
"3a816eb8-7a0b-4a9a-b497-e3a1efb349fc"
provider_name
"Novita"
model_permaslug
"deepseek/deepseek-chat-v3-0324"
1
id
"chatcmpl-658bd5ed01c34949a670ad3375101614"
status
200
is_byok
false
latency
97
endpoint_id
"a3938710-1b99-4a1f-85f4-2494f3f659d3"
provider_name
"ModelRun"
model_permaslug
"deepseek/deepseek-chat-v3-0324"
api_type
"completions"
id
"gen-1771277268-R7YIqsCtbT04juSlsD3H"
upstream_id
"chatcmpl-658bd5ed01c34949a670ad3375101614"
total_cost
0.00042357
cache_discount
(null)
upstream_inference_cost
0
provider_name
"ModelRun"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, ma’am. You were at the apple festival yesterday, right? Mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7814548860443334
fr
0.6009122006841505
tl
0.5843230403800476
it
0.542483660130719
no
0.5382585751978892
nl
0.5125348189415042
da
0.5087719298245614
es
0.4795539033457249
ca
0.47049924357034795
pt
0.4627782041442824
sv
0.4492525570416995
sq
0.445324881141046
cs
0.4176372712146422
hr
0.39236111111111116
et
0.381078691423519
ms
0.36594202898550726
yo
0.3560257589696412
hu
0.35064935064935066
sl
0.3427230046948357
de
0.34148635936030103
ro
0.3314231136580707
sk
0.3137254901960784
pl
0.29577464788732394
lt
0.2790937178166838
az
0.2639327024185068
fi
0.22308546059933407
lv
0.21875
tr
0.17355371900826447
is
0.16467780429594273
vi
0.15966386554621848
be
0.09090909090909091
eu
0.09090909090909091
uk
0.08256880733944955
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Was ist passiert? Ich war nur Fotos machen…"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8333333333333334
en
0.6282527881040892
nl
0.5856353591160222
pt
0.5176848874598071
fr
0.46619217081850534
it
0.46619217081850534
ca
0.4495412844036697
sv
0.44751381215469616
no
0.441340782122905
da
0.42196531791907516
sk
0.3890020366598778
pl
0.3670886075949367
ms
0.3548387096774194
tr
0.35344827586206895
es
0.3227990970654628
lt
0.3227990970654628
lv
0.3087557603686636
et
0.29906542056074764
hi
0.26108374384236455
yo
0.2248062015503876
tl
0.2
cs
0.18256130790190736
hr
0.18256130790190736
sl
0.18256130790190736
is
0.1780821917808219
sq
0.17355371900826447
az
0.16434540389972147
ro
0.16434540389972147
reliable
true
passes
true
2
name
"Hunter"
dialogue
"English? Do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8175182481751825
cs
0.5844875346260388
hr
0.5614035087719298
tl
0.5426829268292682
pt
0.5098039215686274
pl
0.48805460750853247
sk
0.46808510638297873
sl
0.4444444444444444
sq
0.43820224719101125
vi
0.42528735632183906
no
0.35344827586206895
yo
0.34210526315789475
da
0.32432432432432434
de
0.32432432432432434
ms
0.32432432432432434
ro
0.32432432432432434
sv
0.32432432432432434
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Nein, ich verstehe nicht."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8404740200546946
nl
0.5700245700245701
sk
0.41471571906354515
pl
0.396551724137931
cs
0.36363636363636365
lt
0.3055555555555556
hu
0.29149797570850206
it
0.29149797570850206
is
0.2768595041322314
en
0.2647058823529412
es
0.2647058823529412
fr
0.2647058823529412
no
0.2647058823529412
pt
0.2647058823529412
az
0.25213675213675213
ca
0.25213675213675213
ro
0.25213675213675213
sq
0.25213675213675213
sv
0.25213675213675213
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Did you see anything... strange? At the festival?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8151308304891922
tl
0.6999076638965835
da
0.6618106139438085
no
0.6582544689800209
nl
0.5723684210526315
fr
0.5560109289617486
ms
0.5504840940525588
sq
0.5303468208092486
et
0.5192307692307693
cs
0.5170876671619613
hr
0.4715447154471545
it
0.46369636963696376
sl
0.4583333333333333
sv
0.4519392917369309
de
0.4257950530035336
ca
0.3879472693032015
sk
0.3879472693032015
pt
0.3821292775665399
lt
0.3725868725868726
ro
0.3725868725868726
es
0.3602362204724409
az
0.35258964143426297
pl
0.30257510729613735
lv
0.2903930131004367
yo
0.2476851851851852
hu
0.1709183673469388
is
0.1709183673469388
fi
0.16237113402061853
tr
0.15364583333333331
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Ah! Sie meinen… die verschwundene Frau?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8052959501557633
no
0.5854063018242123
nl
0.5652173913043478
fi
0.3811881188118812
is
0.3670886075949367
pl
0.3093922651933701
eu
0.30362116991643456
da
0.2711370262390671
yo
0.26035502958579887
hr
0.23547400611620795
lt
0.23547400611620795
hu
0.22360248447204967
it
0.22360248447204967
en
0.20127795527156547
es
0.20127795527156547
fr
0.20127795527156547
pt
0.20127795527156547
az
0.19093851132686085
ca
0.19093851132686085
ro
0.19093851132686085
sq
0.19093851132686085
sv
0.19093851132686085
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Yes! Exactly. Did you see something?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8246297739672643
tl
0.43324937027707805
et
0.43037974683544306
es
0.4094488188976378
cs
0.25742574257425743
ms
0.25742574257425743
pt
0.25742574257425743
ro
0.25742574257425743
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Ja… ein Mann. Er hat… etwas komisch gemacht."
detectedLang
"de"
heavyLang
"de"
scores
de
0.820496083550914
nl
0.6629901960784313
no
0.625340599455041
is
0.6002906976744186
da
0.5299145299145299
et
0.4455645161290322
fi
0.4353182751540041
lv
0.40217391304347827
pl
0.3559718969555035
tr
0.34988179669030733
sk
0.3483412322274882
sl
0.3483412322274882
sq
0.3405275779376499
ms
0.33894230769230765
ca
0.2838541666666667
hu
0.24242424242424243
sv
0.21428571428571427
yo
0.21428571428571427
az
0.207492795389049
lt
0.207492795389049
cs
0.1863905325443787
hr
0.1863905325443787
tl
0.17664670658682635
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Gotta go. Stay available, alright?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7567567567567567
fr
0.599644128113879
tl
0.5454545454545454
it
0.46808510638297873
yo
0.4015957446808511
fi
0.33234421364985167
hu
0.32432432432432434
pl
0.32432432432432434
es
0.3202416918429003
ca
0.3161094224924012
az
0.30769230769230765
sv
0.2549668874172185
da
0.2474916387959866
de
0.2474916387959866
no
0.2474916387959866
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Warten Sie, ich kann helfen—!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8315688161693936
pl
0.6534653465346535
nl
0.5283018867924528
no
0.4971264367816092
sk
0.41471571906354515
da
0.3445692883895131
sv
0.3371212121212121
eu
0.32432432432432434
fi
0.32432432432432434
is
0.308300395256917
ms
0.308300395256917
ca
0.2857142857142857
es
0.2857142857142857
tr
0.2857142857142857
reliable
true
passes
true