Run: 2026-09-10-01M25DFFFS5QFTJVGQ4MZGNFJJ

Run Details

Model:
DeepSeek V4.1 Flash (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
32.1s
Cost:
$0.004213
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Detective Hunter. I'm investigating the disappearances in Alborn. You were at the apple festival yesterday, weren't you? Did you see anything unusual?" Selvi: "मैं... मैं वहाँ थी। मैंने कुछ देखा। वह आदमी... वह अंधेरे में चला गया और फिर रोशनी। मुझे डर लग रहा है। (I... I was there. I saw something. That man... he went into the dark and then a light. I'm scared.)" Hunter: "I'm sorry. I don't understand. Do you speak English?" Selvi: "नहीं... माफ़ कीजिए। मुझे अंग्रेज़ी नहीं आती। (No... sorry. I don't know English.)" Hunter: "Okay. Slow down. You're shaking. Did you see the missing man? The one from the festival?" Selvi: "हाँ... वह आदमी। मेरे कैमरे में उसकी तस्वीर है। (Yes... that man. I have his photo in my camera.)" Hunter: "Your camera? You have a picture? Can I see it?" Selvi: "यह... यह देखिए। मैंने यह पेड़ों के पास ली थी। वह अकेला नहीं था। कोई और था। (Here... look at this. I took it near the trees. He wasn't alone. There was someone else.)" Hunter: "I don't... I see a man. Is this the missing man? And someone else? Someone with him?" Selvi: "हाँ... वह छाया। उसने मुझे देखा। मुझे डर लग रहा है। (Yes... that shadow. It looked at me. I'm scared.)" Hunter: "A shadow? Okay. You're scared. I get that. But I need details. Was it a man? A woman? Did you see a face?" Selvi: "मैं समझा नहीं सकती... मैं बहुत डर गई थी। मैं भाग आई। (I can't explain... I was so scared. I ran away.)" Hunter: "Okay. Just breathe. We'll get someone who can translate. What language do you speak? Hindi?" Selvi: "हिंदी। (Hindi.)" Hunter: "Stay here. Don't go anywhere. I'll find someone who speaks Hindi." Selvi: "क्या? मैं समझी नहीं... (What? I don't understand...)" Hunter: "Detective Hunter. ... What? Where? ... I'm on my way. Secure the scene." Hunter: "Ma'am, I have to go. Stay in town. I'll be back with someone who speaks Hindi. Do you understand? Stay." Selvi: "आप जा रहे हैं? मुझे अकेला मत छोड़िए... कृपया। (You're leaving? Don't leave me alone... please.)" Hunter: "I'll be back. I promise."
created_at"2026-09-10T10:23:09.821Z" 9/10/2026, 10:23:09 AM
model"deepseek/deepseek-v4.1-flash-20260910"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency900
moderation_latency(null)
generation_time32031
tokens_prompt302
tokens_completion7713
native_tokens_prompt294
native_tokens_completion6979
native_tokens_completion_images(null)
native_tokens_reasoning6258
native_tokens_cached128
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.004212684
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.20.0; linux; x64))"
http_referer(null)
request_id"req-1789035789-nXq3d7tG3ScJQvZ88ebt"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1789035789-I9YjQHPfvkyYgWdUFQIY"
upstream_id"c350f4e8-0b1c-4043-86ca-690abd9c67ec"
provider_responses
0
endpoint_id"fd104bc8-535a-4d31-a847-a8e402e86a02"
id"c350f4e8-0b1c-4043-86ca-690abd9c67ec"
is_byokfalse
latency360
model_permaslug"deepseek/deepseek-v4.1-flash-20260910"
provider_name"DeepSeek"
status200
total_cost0.004212684
cache_discount0.000018816
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Detective Hunter. I'm investigating the disappearances in Alborn. You were at the apple festival yesterday, weren't you? Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7638857656847313
tl0.5755860953920776
nl0.5621351125938282
fr0.5548961424332344
pt0.5021337126600285
it0.49952335557673977
es0.4696969696969697
no0.45792462570986064
ms0.45652173913043476
ro0.45595854922279794
de0.41569282136894825
ca0.4143892916899052
da0.41077441077441074
sq0.40878378378378377
sv0.40543601359003395
sl0.3934142114384749
et0.37163375224416517
hr0.3101182654402102
cs0.3078444297956493
az0.2335766423357664
sk0.19601837672281774
lt0.1935483870967742
lv0.16467780429594273
fi0.15797914995990378
yo0.1566265060240964
pl0.12280701754385964
is0.11616161616161616
hu0.05998209489704566
tr0.053201082055906214
reliabletrue
passestrue
1
name"Selvi"
dialogue"मैं... मैं वहाँ थी। मैंने कुछ देखा। वह आदमी... वह अंधेरे में चला गया और फिर रोशनी। मुझे डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8791358211210153
mr0.868399407797335
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry. I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.5161290322580645
pl0.4806094182825485
hr0.4688385269121813
sk0.438622754491018
de0.4140625
pt0.40570522979397783
sq0.4009584664536741
ro0.3862520458265139
it0.3644067796610169
nl0.3218806509945751
vi0.3169398907103825
yo0.3055555555555556
ca0.2690058479532163
is0.267578125
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
3
name"Selvi"
dialogue"नहीं... माफ़ कीजिए। मुझे अंग्रेज़ी नहीं आती।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8847517730496454
mr0.878731343283582
reliabletrue
passestrue
4
name"Hunter"
dialogue"Okay. Slow down. You're shaking. Did you see the missing man? The one from the festival?"
detectedLang"en"
heavyLang"en"
scores
en0.8010887772194305
tl0.6909564085881588
nl0.5766488413547237
no0.5343137254901961
da0.5287698412698413
sv0.5077720207253886
fr0.4571428571428572
ms0.4358669833729216
et0.4290865384615385
de0.41574415744157445
pt0.41502463054187194
hr0.37745740498034075
ca0.36918990703851257
cs0.3581081081081081
it0.35636856368563685
is0.31948424068767906
lt0.31654676258992803
sq0.30453879941434847
sl0.2824773413897281
az0.27811550151975684
es0.27811550151975684
lv0.2647058823529412
pl0.24000000000000002
fi0.22889610389610393
ro0.19898819561551434
sk0.19898819561551434
yo0.18384879725085912
hu0.12361623616236161
reliabletrue
passestrue
5
name"Selvi"
dialogue"हाँ... वह आदमी। मेरे कैमरे में उसकी तस्वीर है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8815826135413765
mr0.8795692830830264
reliabletrue
passestrue
6
name"Hunter"
dialogue"Your camera? You have a picture? Can I see it?"
detectedLang"en"
heavyLang"en"
scores
en0.8167379352474037
tl0.66996699669967
it0.6173469387755102
ro0.6078431372549019
ca0.601593625498008
sq0.5475113122171946
da0.5440729483282675
yo0.5405819295558958
hr0.5290423861852434
cs0.5121951219512195
fr0.5041322314049587
et0.49664429530201337
sv0.4854202401372213
es0.4350282485875706
pl0.4350282485875706
tr0.42748091603053434
hu0.4263862332695985
lv0.42196531791907516
no0.4174757281553398
ms0.4152046783625731
az0.4117647058823529
de0.4117647058823529
sk0.402390438247012
sl0.3617021276595745
nl0.3273542600896861
lt0.3258426966292135
pt0.3181818181818182
is0.3150684931506849
vi0.3071593533487298
be0.1891891891891892
eu0.1891891891891892
fi0.17355371900826447
uk0.17355371900826447
reliabletrue
passestrue
7
name"Selvi"
dialogue"यह... यह देखिए। मैंने यह पेड़ों के पास ली थी। वह अकेला नहीं था। कोई और था।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8864340284947346
mr0.8739110499770747
reliabletrue
passestrue
8
name"Hunter"
dialogue"I don't... I see a man. Is this the missing man? And someone else? Someone with him?"
detectedLang"en"
heavyLang"en"
scores
en0.8372271160474913
tl0.6345657781599313
nl0.5808678500986193
da0.5672097759674134
yo0.5559038662486938
sv0.5415318230852212
no0.5339912280701754
is0.47335811648079307
hu0.4700748129675811
et0.45928753180661575
ca0.4487678339818417
ms0.43633952254641906
it0.41780821917808225
sq0.40056417489421725
pt0.3997175141242938
fr0.38583815028901736
de0.375
hr0.371301775147929
lv0.36186186186186187
lt0.35993975903614456
cs0.3580060422960725
pl0.35213414634146345
ro0.3501529051987768
es0.33070866141732286
sk0.32216905901116427
az0.3178170144462279
tr0.256993006993007
fi0.24911660777385158
vi0.23835125448028674
sl0.17475728155339806
be0.1414141414141414
eu0.1414141414141414
uk0.1290983606557377
reliabletrue
passestrue
9
name"Selvi"
dialogue"हाँ... वह छाया। उसने मुझे देखा। मुझे डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8792918454935622
mr0.8743016759776536
reliabletrue
passestrue
10
name"Hunter"
dialogue"A shadow? Okay. You're scared. I get that. But I need details. Was it a man? A woman? Did you see a face?"
detectedLang"en"
heavyLang"en"
scores
en0.8035363457760314
tl0.5753715498938429
ro0.4827586206896552
nl0.4609164420485175
no0.42363112391930835
de0.4230769230769231
et0.42028985507246375
sq0.4140625
da0.40059940059940063
sv0.39332659251769464
cs0.39148073022312374
hr0.3896236012207528
fr0.3877551020408163
yo0.38080495356037153
ca0.3582887700534759
it0.35344827586206895
lv0.35275080906148865
lt0.3333333333333333
pt0.31662870159453305
is0.2840095465393795
pl0.2779783393501805
hu0.2709599027946537
tr0.25742574257425743
sk0.2518703241895262
es0.2490613266583229
fi0.19246298788694483
az0.18144611186903137
vi0.18144611186903137
sl0.13043478260869565
be0.1044776119402985
eu0.1044776119402985
ms0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
11
name"Selvi"
dialogue"मैं समझा नहीं सकती... मैं बहुत डर गई थी। मैं भाग आई।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8762069819262194
mr0.8618402873722023
reliabletrue
passestrue
12
name"Hunter"
dialogue"Okay. Just breathe. We'll get someone who can translate. What language do you speak? Hindi?"
detectedLang"en"
heavyLang"en"
scores
en0.7741814076025593
tl0.6018579960185799
ro0.3710691823899371
et0.35691318327974275
pt0.3435448577680525
is0.3197278911564626
sq0.3150684931506849
cs0.3103448275862069
hr0.3006993006993007
it0.2857142857142857
no0.27710843373493976
ca0.2762364294330519
pl0.26199261992619927
vi0.2490613266583229
sk0.24528301886792453
sl0.22978177150192552
sv0.21156373193166886
es0.2052980132450331
de0.20424403183023873
da0.2
fr0.2
nl0.2
ms0.19571045576407506
eu0.19463087248322147
yo0.1902834008097166
tr0.1891891891891892
az0.1847826086956522
lt0.1780821917808219
hi0.11504424778761062
lv0.10044977511244377
reliabletrue
passestrue
13
name"Selvi"
dialogue"हिंदी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8985801217038539
mr0.8951781970649895
reliablefalse
passestrue
14
name"Hunter"
dialogue"Stay here. Don't go anywhere. I'll find someone who speaks Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.7792207792207793
tl0.5804540967423495
sq0.38405797101449274
et0.3541033434650456
pl0.2026266416510319
it0.1935483870967742
da0.1904761904761905
is0.18738049713193117
de0.1550695825049702
es0.1550695825049702
hi0.1550695825049702
pt0.1550695825049702
yo0.1533864541832669
reliabletrue
passestrue
15
name"Selvi"
dialogue"क्या? मैं समझी नहीं..."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8864281658148779
mr0.8726925525143221
reliabletrue
passestrue
16
name"Hunter"
dialogue"Detective Hunter. ... What? Where? ... I'm on my way. Secure the scene."
detectedLang"en"
heavyLang"en"
scores
en0.8218776194467727
tl0.6539087947882736
ro0.5298672566371682
fr0.5153933865450399
ca0.4429882044560944
no0.42953020134228187
da0.42876344086021506
it0.4264507422402159
sq0.4201909959072306
sv0.3988684582743989
es0.38405797101449274
pl0.371301775147929
de0.37037037037037035
cs0.3541033434650456
pt0.3541033434650456
hr0.3511450381679389
nl0.3501529051987768
sk0.3491577335375191
sl0.3122977346278317
yo0.29983525535420097
et0.2659758203799654
fi0.2608695652173913
ms0.24377224199288253
hi0.1650294695481336
lt0.15
tr0.121900826446281
reliabletrue
passestrue
17
name"Hunter"
dialogue"Ma'am, I have to go. Stay in town. I'll be back with someone who speaks Hindi. Do you understand? Stay."
detectedLang"en"
heavyLang"en"
scores
en0.7956848643347499
tl0.6312684365781711
da0.5250759878419453
pl0.5188606620477291
yo0.48003327787021627
no0.4685374149659864
cs0.45934256055363326
sv0.421831637372803
sk0.40476190476190477
sl0.3872549019607844
hr0.375
it0.36804853387259856
de0.35233160621761656
sq0.3509865005192108
nl0.3482794577685088
ro0.32867883995703545
et0.32138979370249726
lt0.3086283185840708
is0.2732558139534884
pt0.2724097788125727
lv0.22839506172839508
hu0.22744128553770088
vi0.21777221526908636
ms0.19665809768637532
az0.19041450777202074
ca0.18086500655307994
es0.11095305832147938
hi0.11095305832147938
be0.10071942446043164
tr0.10071942446043164
uk0.09156976744186046
reliabletrue
passestrue
18
name"Selvi"
dialogue"आप जा रहे हैं? मुझे अकेला मत छोड़िए... कृपया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8819289087745463
mr0.875524109014675
reliabletrue
passestrue
19
name"Hunter"
dialogue"I'll be back. I promise."
detectedLang"en"
heavyLang"en"
scores
en0.7771173848439822
cs0.6296296296296297
tl0.6134020618556701
ro0.6124031007751938
hr0.5967741935483871
ca0.5774647887323944
et0.5677233429394812
yo0.5677233429394812
sq0.5626822157434402
pl0.5575221238938053
hu0.5508982035928144
it0.5481927710843374
lt0.5384615384615384
no0.4915254237288135
da0.4809688581314879
sv0.4791666666666667
pt0.3333333333333333
sk0.32432432432432434
be0.3181818181818182
es0.3181818181818182
sl0.3181818181818182
tr0.3181818181818182
fr0.3087557603686636
az0.29577464788732394
is0.29577464788732394
lv0.29577464788732394
uk0.29577464788732394
vi0.29577464788732394
de0.2822966507177033
ms0.2822966507177033
nl0.2822966507177033
reliabletrue
passestrue