Run: 2026-04-25-01KQ2H0AKZWMKQ8JVRH880TS2G

Run Details

Model:
DeepSeek V4 Pro (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
27.1s
Cost:
$0.000972
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "*staring at camera screen, muttering* Kaise ho sakta hai... yeh... yeh sach nahi ho sakta." Hunter: "Excuse me, miss. I’m Detective Hunter. I’m looking into the incident near the old mill last night. You were seen in the area with that camera. Did you capture anything unusual?" Selvi: "*looking up, eyes wide* Aap... aap police hain? Mujhe lagta hai maine kuch bhayanak dekha. Woh aadmi... woh toh... jaise gaayab ho gaya. Camera mein sab kuch hai. Par mujhe yakeen nahi ho raha." Hunter: "I... I’m sorry, I don’t understand. Do you speak any English? The mill—did you see something?" Selvi: "*voice trembling* Angrezi nahi aati. *points at camera, then gestures frantically* Woh aadmi... hawa mein... poof! Main pagal toh nahi ho gayi? Aap dekhenge? *turns camera towards him, hands shaking*" Hunter: "*leaning in, squinting* Wait... this is just static. Was the camera damaged? You’re clearly upset—are you hurt? Did someone threaten you?" Selvi: "*snatching camera back, scrolling* Nahi, yahan dekho! *points at a frame* yeh shadow... yeh cheez insaan ko nigal gayi. Aapko dikh raha hai? Mujhe bachao... woh cheez mujhe bhi dekh rahi thi." Hunter: "*rubbing his temples* Listen, I want to help, but I can’t follow. Can you... draw it? Point on a map? *takes out a notepad, offers a pen* Write something down?" Selvi: "*shakes head, hugs camera* Main yahan akele hoon. Koi mera dost nahi. Aap bhi nahi samjhenge. *starts crying silently*" Hunter: "*his phone buzzes, he glances at it and frowns* Dammit. Look, I have to go—emergency call. Stay right here. I’ll find someone who speaks... Hindi? *points at her, then at the cafe chair* Stay. I’ll come back. *answers phone, walking away* Yeah, Hunter. Talk to me."
created_at"2026-04-25T14:34:24.259Z" 4/25/2026, 2:34:24 PM
model"deepseek/deepseek-v4-pro-20260423"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1080
moderation_latency(null)
generation_time27040
tokens_prompt315
tokens_completion1099
native_tokens_prompt268
native_tokens_completion1100
native_tokens_completion_images(null)
native_tokens_reasoning575
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0009715
router(null)
provider_responses
0
endpoint_id"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
id"6257e4ed-4a5e-473e-b71f-482af6142e31"
is_byokfalse
latency280
model_permaslug"deepseek/deepseek-v4-pro-20260423"
provider_name"DeepSeek"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777127664-PDMEqzxmSvQuKNQJ4ZLe"
session_id(null)
api_type"completions"
id"gen-1777127664-aohJf0WkzWROh1eHR6mB"
upstream_id"6257e4ed-4a5e-473e-b71f-482af6142e31"
total_cost0.0009715
cache_discount0.00010208
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"staring at camera screen, muttering Kaise ho sakta hai... yeh... yeh sach nahi ho sakta."
detectedLang"en"
heavyLang"ber"
scores
en0.6253122398001665
no0.6014171833480957
tl0.5656370656370656
it0.5171673819742489
da0.48805460750853247
nl0.48156682027649766
sv0.47856315179606024
fi0.4779582366589328
de0.4668246445497631
ca0.3951612903225807
ro0.3869209809264305
sk0.35437589670014347
cs0.35251798561151076
fr0.3515850144092219
sq0.34782608695652173
es0.34497816593886466
eu0.34497816593886466
ms0.33135215453194655
et0.30769230769230765
is0.265905383360522
vi0.25864909390444807
tr0.25742574257425743
lv0.23339011925042585
sl0.23339011925042585
hr0.22945205479452058
lt0.21328671328671328
pl0.14772727272727273
pt0.11591355599214145
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I’m Detective Hunter. I’m looking into the incident near the old mill last night. You were seen in the area with that camera. Did you capture anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8007387247278382
tl0.6629398224268332
fr0.5079212674027844
it0.4757033248081841
nl0.47381930184804927
ro0.4486282947821409
de0.4186046511627907
pt0.3967039434961742
es0.3959929286977018
sq0.39420803782505914
ca0.38141219070609533
no0.3806646525679758
ms0.36961869618696186
sl0.3601747815230961
sv0.3442098528470889
da0.3003412969283276
et0.283717679944095
yo0.24908424908424906
cs0.2121445042275173
az0.182615629984051
hr0.1713823767178658
pl0.1306191687871077
sk0.11178509532062392
fi0.06818181818181819
is0.06478102189781022
hu0.0544280442804428
lt0.0544280442804428
tr0.0544280442804428
reliabletrue
passestrue
2
name"Selvi"
dialogue"looking up, eyes wide Aap... aap police hain? Mujhe lagta hai maine kuch bhayanak dekha. Woh aadmi... woh toh... jaise gaayab ho gaya. Camera mein sab kuch hai. Par mujhe yakeen nahi ho raha."
detectedLang"en"
heavyLang"tl"
scores
en0.5093346098611776
fr0.42896935933147634
tl0.41294387170675834
eu0.3791641429436705
it0.3408360128617363
de0.329627207325049
ro0.3193891102257636
et0.3148395721925134
fi0.27664079040225825
ms0.26046176046176045
nl0.2501828822238478
sv0.24632352941176466
lv0.2446573323507738
ca0.22289613343442002
cs0.21934501142421936
no0.21815408085430968
sk0.20726991492652744
hr0.19733750978856696
az0.15776499589153656
da0.15149006622516556
es0.1451209341117598
hu0.1451209341117598
sl0.13647851727042964
vi0.13282571912013535
tr0.12542662116040956
pt0.120926243567753
pl0.07906558849955077
lt0.07823741007194246
sq0.07407407407407407
is0.06478102189781022
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I... I’m sorry, I don’t understand. Do you speak any English? The mill—did you see something?"
detectedLang"en"
heavyLang"en"
scores
en0.8119711689125667
tl0.6183206106870229
no0.5077932731747333
da0.4957983193277311
sv0.45404913557779797
cs0.39999999999999997
pl0.36642027455121434
pt0.3576017130620985
hr0.35553168635875404
sq0.3541442411194833
sk0.3281075027995521
yo0.3119266055045872
ca0.3111366245694604
de0.3063583815028902
nl0.30394431554524365
ro0.2822966507177033
et0.2797118847539016
ms0.2753623188405797
it0.26380368098159507
vi0.2248062015503876
is0.18588873812754408
sl0.16666666666666666
es0.11504424778761062
fr0.11504424778761062
be0.1044776119402985
tr0.1044776119402985
hu0.10044977511244377
az0.09502262443438914
lt0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
4
name"Selvi"
dialogue"voice trembling Angrezi nahi aati. points at camera, then gestures frantically Woh aadmi... hawa mein... poof! Main pagal toh nahi ho gayi? Aap dekhenge? turns camera towards him, hands shaking"
detectedLang"en"
heavyLang"tl"
scores
en0.6789617486338798
tl0.5392156862745099
fr0.5095993322203672
no0.5087792642140468
de0.49397071490094746
da0.46174988547869905
ca0.3822292323869611
nl0.37830687830687837
it0.3672590199246096
sv0.349390919158361
ro0.3409983174425126
is0.29598562013181545
pl0.2596093257718966
es0.2501595405232929
pt0.24582798459563543
eu0.233529028049576
sl0.21978751660026563
ms0.21246648793565684
lt0.19021364576154376
lv0.17427969079409697
sk0.1707833450952717
cs0.16666666666666666
sq0.14916727009413466
ja0.13155949741315595
hr0.10646387832699619
et0.07698350353495681
yo0.06374501992031872
hu0.05622489959839357
az0.050888529886914384
tr0.050888529886914384
fi0.04781199351701783
reliabletrue
passesfalse
5
name"Hunter"
dialogue"leaning in, squinting Wait... this is just static. Was the camera damaged? You’re clearly upset—are you hurt? Did someone threaten you?"
detectedLang"en"
heavyLang"en"
scores
en0.7937393836447464
nl0.5444801714898178
tl0.5186862967157418
sv0.4690818238600874
ro0.46775203506574825
de0.44733420026007803
no0.358974358974359
it0.3584905660377359
yo0.35361216730038025
ms0.34715821812596004
da0.302707136997539
is0.24578527062999111
az0.2085661080074488
fr0.20337394564198688
sl0.20337394564198688
tr0.20037629350893696
ca0.17395529640427598
es0.17234664070107109
lt0.1600790513833992
et0.15924826904055392
hu0.1533864541832669
pl0.1474423269809428
pt0.1457286432160804
sq0.1457286432160804
cs0.14228052472250252
eu0.1370558375634518
hr0.1326530612244898
fi0.1099476439790576
lv0.06900328587075576
sk0.06490649064906491
reliabletrue
passestrue
6
name"Selvi"
dialogue"snatching camera back, scrolling Nahi, yahan dekho! points at a frame yeh shadow... yeh cheez insaan ko nigal gayi. Aapko dikh raha hai? Mujhe bachao... woh cheez mujhe bhi dekh rahi thi."
detectedLang"tl"
heavyLang"ber"
scores
tl0.5324189526184538
en0.49619346171070317
ms0.3626062322946175
no0.2820676451818762
sv0.2797695262483995
da0.27838357921744705
fr0.258893280632411
it0.25397877984084877
vi0.25348374253483746
ro0.25
fi0.23728813559322032
eu0.23208191126279862
ca0.22786547700754975
nl0.18948126801152737
yo0.1818181818181818
es0.17035398230088497
de0.16419019316493313
sl0.1610738255033557
sk0.15603900975243812
et0.15349887133182843
is0.15349887133182843
pl0.14901664145234494
tr0.1470811220621683
lv0.1464339908952959
az0.14578587699316628
hr0.14448669201520914
lt0.1359447004608295
hu0.12177985948477751
sq0.11764705882352942
pt0.11067193675889328
cs0.10501193317422433
reliablefalse
passesfalse
7
name"Hunter"
dialogue"rubbing his temples Listen, I want to help, but I can’t follow. Can you... draw it? Point on a map? takes out a notepad, offers a pen Write something down?"
detectedLang"en"
heavyLang"en"
scores
en0.8013852108372377
tl0.6491543720762865
fr0.4971634863331615
da0.44790486976217436
it0.4140625
pl0.4065733414485697
no0.3996305418719212
sk0.3917654398003743
ca0.38446969696969696
hr0.3765984654731458
cs0.3745991019884541
sv0.3737957610789981
lv0.3547319655857048
nl0.336734693877551
yo0.336283185840708
de0.33127572016460904
sl0.3294360385144429
pt0.31095406360424027
ro0.3104667609618105
sq0.3035714285714286
fi0.2914244186046512
lt0.28044280442804426
et0.27616926503340755
es0.2585551330798479
ms0.24065420560747666
hu0.23708920187793428
tr0.22985781990521328
az0.2162379421221865
is0.1758241758241758
eu0.16092943201376936
vi0.12003610108303249
hi0.07932011331444759
be0.06698564593301436
uk0.06069364161849711
reliabletrue
passestrue
8
name"Selvi"
dialogue"shakes head, hugs camera Main yahan akele hoon. Koi mera dost nahi. Aap bhi nahi samjhenge. starts crying silently"
detectedLang"en"
heavyLang"tl"
scores
en0.6104618809126322
tl0.4791666666666667
de0.36247723132969034
ca0.34148635936030103
da0.33899905571293676
sv0.33269780743565297
nl0.3314231136580707
fr0.29929929929929927
it0.2964824120603015
no0.2731048805815161
et0.27007299270072993
ro0.24324324324324328
ms0.23076923076923078
cs0.20903954802259886
es0.20182440136830104
eu0.19075144508670522
fi0.1116751269035533
is0.11054637865311309
lv0.10025706940874037
pl0.10025706940874037
sl0.10025706940874037
sk0.0990990990990991
az0.0967741935483871
hr0.0967741935483871
lt0.077733860342556
reliabletrue
passesfalse
9
name"Hunter"
dialogue"his phone buzzes, he glances at it and frowns Dammit. Look, I have to go—emergency call. Stay right here. I’ll find someone who speaks... Hindi? points at her, then at the cafe chair Stay. I’ll come back. answers phone, walking away Yeah, Hunter. Talk to me."
detectedLang"en"
heavyLang"en"
scores
en0.7987787954482376
tl0.6423285643808583
da0.46236559139784944
no0.39482470784641066
fr0.3741907639188606
yo0.34359438660027164
sq0.323062558356676
it0.3202062822315987
pl0.3150684931506849
nl0.27896568871208355
es0.2579324462640737
sv0.24753502854177475
pt0.23684210526315788
et0.21238457360130364
ca0.1997792494481236
lv0.19220055710306408
de0.17940011318619128
sl0.1559953434225844
hr0.1495601173020528
tr0.14906103286384975
cs0.13997627520759193
is0.13793103448275862
ms0.1322561340514662
sk0.12333736396614269
vi0.11907654921020656
lt0.10327767470624613
fi0.10272277227722773
ro0.09318323952470293
hi0.051047120418848166
be0.046052631578947366
hu0.044166117336849046
az0.04163912756113682
uk0.04163912756113682
reliabletrue
passestrue