Run: 2026-04-25-01KQ2F7T9PWZHB4XBKERCPBKB1

Run Details

Model:
DeepSeek V4 Pro (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
59.1s
Cost:
$0.002406
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
46.67% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (troubled, staring at her camera screen) "Kuchh bhayanak hua hai... maine dekha..." (Something terrible happened... I saw...) Hunter: "Ma'am, I'm Detective Hunter. I need to ask you a few questions about last night. Did you see anything unusual?" Selvi: (voice shaking) "Aap samajh nahi payenge... woh... woh chehra... mujhe yaad hai." (You won't understand... that... that face... I remember.) Hunter: (pausing, tilting his head) "I'm sorry, I don't understand. Do you speak English? ... English? No?" Selvi: (tapping her camera urgently) "Mere camera mein sab kuch hai. Andhera tha, lekin maine tasveer kheenchi." (It's all in my camera. It was dark, but I took a photo.) Hunter: "Camera? Can I see? May I look?" Selvi: (turning the display toward him, pointing) "Dekhiye! Yeh aadmi... woh uss raat wahan tha." (Look! This man... he was there that night.) Hunter: (studying the image) "Okay, I see a man. When was this? Last night? Where?" (he gestures toward the street) Selvi: "Haan, raat ko. Ped ke paas." (Yes, at night. Near the tree.) Hunter: "Tree? What tree? Where is this tree?" Selvi: (pointing east down the road) "Wahan, purani mill ke paas." (There, near the old mill.) Hunter: "Old mill? You mean the abandoned mill on Elm Street? Did you see something happen there?" Selvi: (throwing up her hands in frustration) "Mujhe aapki baat samajh nahi aati. Main kaise kahun? Woh aadmi kuch chhupa raha tha." (I don't understand you. How can I tell you? That man was hiding something.) Hunter: (sighs, reaching for his phone) "I'm not getting through. Let me try to..." (the phone rings; he holds up a finger) "Hold on. Hunter." (listens, his expression sharpens) "What? Right now? Alright, I'll be there." (hangs up, turns back to Selvi) "I have to go. Please, stay here in town. Don't leave. We'll find a translator. Stay." (he firmly mimes 'stay' with his hands) Selvi: (nodding slowly) "Theek hai. Main yahin hungi." (Okay. I'll be here.) Hunter: (gives a curt nod and exits the café)
created_at"2026-04-25T14:03:32.538Z" 4/25/2026, 2:03:32 PM
model"deepseek/deepseek-v4-pro-20260423"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency966
moderation_latency(null)
generation_time59035
tokens_prompt315
tokens_completion2710
native_tokens_prompt268
native_tokens_completion2749
native_tokens_completion_images(null)
native_tokens_reasoning2148
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00240613
router(null)
provider_responses
0
endpoint_id"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
id"5e49b322-ed4c-46f6-87aa-b544f1b81a56"
is_byokfalse
latency284
model_permaslug"deepseek/deepseek-v4-pro-20260423"
provider_name"DeepSeek"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777125812-riw9eeUxRHD1JhgoUm90"
session_id(null)
api_type"completions"
id"gen-1777125812-vDWjLJpVeM7jS0MB5Rxj"
upstream_id"5e49b322-ed4c-46f6-87aa-b544f1b81a56"
total_cost0.00240613
cache_discount0.00010208
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
46.67% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kuchh bhayanak hua hai... maine dekha..."
detectedLang"fr"
heavyLang"id"
scores
fr0.43064182194616984
ms0.4008714596949891
tl0.3764172335600907
en0.3721461187214612
et0.3721461187214612
fi0.3721461187214612
vi0.36342592592592593
de0.3483412322274882
ro0.3483412322274882
az0.298469387755102
it0.26666666666666666
eu0.2647058823529412
hu0.2647058823529412
lv0.24242424242424243
hr0.233983286908078
cs0.21875
pl0.21875
sk0.21875
tr0.21428571428571427
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, I'm Detective Hunter. I need to ask you a few questions about last night. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8083312036800409
tl0.5934959349593496
fr0.5173745173745175
it0.4845360824742268
ca0.46619217081850534
pt0.4541484716157206
et0.4513533284564741
no0.4257274119448699
da0.42528735632183906
ro0.4186046511627907
cs0.4085173501577287
es0.3816982687551525
sq0.37913907284768217
hr0.36655405405405406
yo0.3573264781491003
nl0.34325744308231176
pl0.32795698924731176
sv0.31066176470588236
sl0.31002759889604414
sk0.3081180811808118
de0.2944496707431797
ms0.2697176241480039
lv0.2537313432835821
lt0.2492492492492493
hu0.2291880781089414
tr0.21548117154811713
is0.15540540540540537
az0.1506228765571914
vi0.1506228765571914
be0.08536585365853659
eu0.08536585365853659
fi0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
2
name"Selvi"
dialogue"Aap samajh nahi payenge... woh... woh chehra... mujhe yaad hai."
detectedLang"no"
heavyLang"tl"
scores
no0.37137330754352027
da0.36893203883495146
eu0.336734693877551
vi0.3257261410788381
fr0.24418604651162787
et0.24242424242424243
fi0.24242424242424243
is0.2388758782201405
it0.23529411764705882
lv0.22985781990521328
tl0.22985781990521328
ca0.20924574209245742
sv0.19753086419753088
de0.18952618453865336
en0.18952618453865336
ms0.1792929292929293
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English? ... English? No?"
detectedLang"en"
heavyLang"en"
scores
en0.7998999499749875
no0.6082272282076395
da0.5614035087719298
tl0.5570321151716501
hr0.5192307692307693
pl0.51338199513382
sv0.51278928136419
cs0.5
pt0.49622166246851385
sk0.4897959183673469
it0.4244604316546763
ca0.40564635958395245
de0.39849624060150374
sq0.38556067588325654
ro0.3710691823899371
lv0.3265993265993266
nl0.3079584775086505
vi0.30313588850174217
yo0.2920353982300885
tr0.2831541218637993
es0.25512104283054005
is0.25512104283054005
sl0.23076923076923078
ms0.15254237288135594
be0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
et0.13606911447084233
lt0.13606911447084233
uk0.13606911447084233
reliabletrue
passestrue
4
name"Selvi"
dialogue"Mere camera mein sab kuch hai. Andhera tha, lekin maine tasveer kheenchi."
detectedLang"it"
heavyLang"nl"
scores
it0.44638694638694637
de0.42002442002442
ro0.391025641025641
fr0.3741765480895916
eu0.36412315930388217
fi0.3510928961748634
en0.33473389355742295
nl0.28892215568862273
et0.2554858934169279
da0.24960505529225907
vi0.24841772151898736
tl0.2448330683624801
sq0.19763513513513514
pt0.1810344827586207
ca0.17677642980935876
es0.17247386759581881
is0.15630550621669628
lv0.15630550621669628
sv0.14721723518850988
ms0.1316270566727605
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Camera? Can I see? May I look?"
detectedLang"en"
heavyLang"en"
scores
en0.794841735052755
ca0.644308943089431
tl0.622844827586207
it0.609375
ro0.5862884160756502
et0.571078431372549
sv0.5569620253164557
yo0.5138888888888888
vi0.4712990936555891
tr0.45652173913043476
no0.453125
az0.4444444444444444
da0.44267515923566875
hr0.44267515923566875
sq0.4336569579288026
pl0.4186046511627907
cs0.375
es0.3613138686131387
fr0.3027888446215139
nl0.3027888446215139
de0.29149797570850206
ms0.29149797570850206
sk0.29149797570850206
be0.2857142857142857
hu0.2768595041322314
is0.2647058823529412
lt0.2647058823529412
lv0.2647058823529412
uk0.2647058823529412
reliabletrue
passestrue
6
name"Selvi"
dialogue"Dekhiye! Yeh aadmi... woh uss raat wahan tha."
detectedLang"ms"
heavyLang"de"
scores
ms0.46911196911196906
tl0.3226600985221675
sq0.298469387755102
fi0.24242424242424243
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Okay, I see a man. When was this? Last night? Where?"
detectedLang"en"
heavyLang"en"
scores
en0.8274030801911842
tl0.6939736346516008
de0.582798459563543
da0.5602165087956699
no0.5409604519774012
nl0.5396600566572238
et0.5343839541547278
yo0.5303468208092486
sv0.5022970903522206
sq0.4663382594417077
ca0.4574290484140233
hr0.4357638888888889
lv0.4257950530035336
it0.4247787610619469
lt0.4237588652482269
cs0.4217081850533808
pl0.41546762589928055
ro0.4133574007220217
hu0.40693430656934304
sk0.38330170777988615
fr0.3701550387596899
tr0.3114406779661017
pt0.3010752688172043
is0.29805615550755943
az0.2903930131004367
vi0.2903930131004367
es0.28884026258205686
sl0.21686746987951808
be0.17721518987341772
eu0.17721518987341772
fi0.16237113402061853
ms0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan, raat ko. Ped ke paas."
detectedLang"yo"
heavyLang"af"
scores
yo0.5934959349593496
ms0.4827586206896552
tl0.471830985915493
sl0.45652173913043476
lv0.45054945054945056
eu0.4117647058823529
cs0.40711462450592883
lt0.3877551020408163
reliabletrue
passesfalse
9
name"Hunter"
dialogue"Tree? What tree? Where is this tree?"
detectedLang"en"
heavyLang"en"
scores
en0.8527968596663396
nl0.5145631067961165
hu0.506578947368421
yo0.4444444444444444
tl0.39999999999999997
is0.38016528925619836
de0.34210526315789475
sq0.34210526315789475
reliabletrue
passestrue
10
name"Selvi"
dialogue"Wahan, purani mill ke paas."
detectedLang"ms"
heavyLang"et"
scores
ms0.7628726287262872
tl0.4281045751633987
sl0.375
cs0.37050359712230213
hr0.36823104693140796
fi0.3346007604562738
yo0.3346007604562738
ca0.3
it0.3
sq0.3
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Old mill? You mean the abandoned mill on Elm Street? Did you see something happen there?"
detectedLang"en"
heavyLang"en"
scores
en0.7973755306831339
tl0.5986238532110092
et0.421806167400881
de0.39236111111111116
nl0.38524590163934425
fr0.38380281690140844
ca0.34863523573200994
no0.3312101910828026
sv0.3155149934810952
es0.3064729194187582
pt0.3064729194187582
da0.30463576158940403
sq0.2905405405405405
cs0.28765264586160105
yo0.25742574257425743
sk0.23469387755102045
ms0.2290748898678414
fi0.2222222222222222
hr0.21875
pl0.21875
it0.21052631578947367
az0.16666666666666666
hu0.1518578352180937
hi0.13793103448275862
sl0.12060301507537688
is0.10102739726027396
lt0.10102739726027396
lv0.10102739726027396
ro0.10102739726027396
reliabletrue
passestrue
12
name"Selvi"
dialogue"Mujhe aapki baat samajh nahi aati. Main kaise kahun? Woh aadmi kuch chhupa raha tha."
detectedLang"et"
heavyLang"tl"
scores
et0.3699885452462772
ms0.298469387755102
sq0.28292046936114734
fi0.2753623188405797
fr0.2637215528781794
en0.2434662998624484
eu0.23076923076923078
is0.15644171779141106
no0.15384615384615385
lv0.1499227202472952
tl0.1499227202472952
da0.13522012578616352
sv0.12698412698412698
de0.12420382165605094
reliablefalse
passesfalse
13
name"Hunter"
dialogue"I have to go. Please, stay here in town. Don't leave. We'll find a translator. Stay."
detectedLang"en"
heavyLang"en"
scores
en0.8109470651782499
pl0.569672131147541
da0.5664739884393063
tl0.5474137931034483
ro0.5462402765773552
yo0.49177153920619554
hr0.48326771653543305
sl0.4801980198019802
sq0.4631901840490798
it0.4615384615384615
no0.460431654676259
sv0.4491080797481637
cs0.4485294117647059
sk0.43058568329718006
nl0.4040862656072645
ca0.3993135011441648
de0.3986254295532647
lv0.38016528925619836
lt0.37574316290130794
pt0.34863523573200994
az0.3445692883895131
ms0.32950191570881227
et0.31906614785992216
hu0.2981283422459893
vi0.29624664879356566
tr0.2857142857142857
es0.284741144414169
fr0.27285318559556787
is0.2081447963800905
eu0.20694864048338368
be0.11764705882352942
fi0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue
14
name"Selvi"
dialogue"Theek hai. Main yahin hungi."
detectedLang"en"
heavyLang"rn"
scores
en0.49874686716791977
vi0.43977591036414565
ms0.3957703927492447
tl0.3957703927492447
nl0.3442622950819672
it0.3333333333333333
sq0.3333333333333333
fr0.3055555555555556
de0.2805755395683453
reliablefalse
passesfalse