Run: 2026-04-25-01KQ2EPN1EDA86FCWSW3JR7313

Run Details

Model:
DeepSeek V4 Pro (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 13s
Cost:
$0.002394
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Yeh kya hai? Maine aisa kuch pehle kabhi nahi dekha..." Hunter: "Excuse me, miss. I'm Detective Hunter. Do you have a moment? I need to ask you about the incident near the old mill yesterday." Selvi: "Cal mill? Haan, main vahaan thi! Ek aadmi... voh gir gaya... par kaise? Mujhe samajh nahi aa raha. Yeh sab bahut ajeeb tha." Hunter: "I'm sorry, I don't... I don't understand. Do you speak English? Can you tell me what you saw?" Selvi: "Mera camera... maine sab record kiya. Voh andhera tha, aur phir ek cheekh. Main darr gayi. Bahut bura sapna lagta hai." Hunter: "Camera? You took photos? Can I see? What did you see? Was there someone else there?" Selvi: "Yeh dekho. Yeh photo... vahan koi tha, lekin voh admi... voh hwa mein gayab ho gaya. Mumkin nahi hai, lekin maine dekha!" Hunter: "I see a blur... but I can't read this. Listen, is there someone who can translate? I really need to know what happened. People are missing." Selvi: "Log gayab ho rahe hain? Haan, mujhe pata hai! Maine suna. Isliye toh main dari hui hoon. Voh jagah... voh mill... kuch galat hai vahan." Hunter: "Hold on, that's my phone. Hunter here... Wait, what? Another one? I'll be right there. I'm sorry, I have to go. This is important. We'll find a way to communicate. Please, stay here—I'll send someone who speaks Hindi." Selvi: "Theek hai. Main yahin rahungi. Lekin jaldi aayiye!" Hunter: "I will. Just... stay safe."
created_at"2026-04-25T13:54:12.147Z" 4/25/2026, 1:54:12 PM
model"deepseek/deepseek-v4-pro-20260423"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency907
moderation_latency(null)
generation_time71131
tokens_prompt315
tokens_completion2579
native_tokens_prompt268
native_tokens_completion2618
native_tokens_completion_images(null)
native_tokens_reasoning2177
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00239424
router(null)
provider_responses
0
endpoint_id"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
id"33d8b55a-e91e-43be-ac5d-734d4ad91f4b"
is_byokfalse
latency275
model_permaslug"deepseek/deepseek-v4-pro-20260423"
provider_name"DeepSeek"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777125252-uvdsyaPxuyUqRYcg3TXe"
session_id(null)
api_type"completions"
id"gen-1777125252-GEUupRJe7yd05PZ5ztGk"
upstream_id"33d8b55a-e91e-43be-ac5d-734d4ad91f4b"
total_cost0.00239424
cache_discount(null)
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh kya hai? Maine aisa kuch pehle kabhi nahi dekha..."
detectedLang"fr"
heavyLang"la"
scores
fr0.37275985663082434
eu0.32038834951456313
en0.317738791423002
et0.317738791423002
fi0.317738791423002
vi0.30966469428007887
de0.29577464788732394
ro0.29577464788732394
it0.2222222222222222
lv0.2009132420091324
tl0.1898148148148148
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. Do you have a moment? I need to ask you about the incident near the old mill yesterday."
detectedLang"en"
heavyLang"en"
scores
en0.7983870967741935
tl0.588477366255144
fr0.5480225988700564
sq0.5449374288964732
ca0.5391705069124424
ro0.5383727639930755
cs0.530791788856305
da0.528023598820059
nl0.5246583481877599
no0.518362432269717
pt0.5095033721643164
it0.49558638083228246
sk0.477124183006536
pl0.47299077733860345
hr0.45799457994579945
sl0.45725915875169604
es0.4444444444444444
yo0.4248741912293314
sv0.4038748137108793
de0.3850883935434281
et0.37936384794414274
hu0.30131004366812225
az0.2988606485539001
lt0.2779783393501805
ms0.26199261992619927
lv0.24170616113744076
vi0.23371647509578544
tr0.2047713717693837
fi0.14712153518123666
is0.14712153518123666
be0.08045977011494253
eu0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue
2
name"Selvi"
dialogue"Cal mill? Haan, main vahaan thi! Ek aadmi... voh gir gaya... par kaise? Mujhe samajh nahi aa raha. Yeh sab bahut ajeeb tha."
detectedLang"fr"
heavyLang"tl"
scores
fr0.31255728689275897
no0.3081180811808118
et0.30102516309412863
fi0.2951127819548872
lv0.251497005988024
sq0.22839506172839508
tl0.21793534932221062
da0.19268030139935413
en0.19093851132686085
sv0.18743228602383533
ms0.18566775244299674
eu0.18032786885245902
vi0.1712707182320442
ca0.14869466515323496
tr0.12993039443155452
is0.11971830985915494
nl0.11764705882352942
de0.09420289855072464
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't... I don't understand. Do you speak English? Can you tell me what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.8053717399766447
no0.5515695067264574
da0.5059288537549407
tl0.4582881906825569
sv0.45711183496199786
cs0.4444444444444444
sq0.44382647385984425
pl0.40968122786304606
pt0.4075829383886255
hr0.3983152827918171
it0.3710691823899371
sk0.36948297604035313
de0.3464052287581699
nl0.3438320209973753
ms0.33862433862433866
ro0.3206521739130435
ca0.3006993006993007
sl0.2937853107344633
vi0.258160237388724
yo0.24812030075187969
et0.2401215805471125
tr0.22720247295208654
az0.21875
is0.21507064364207218
es0.16943521594684383
fr0.1539763113367174
fi0.13043478260869565
be0.12280701754385964
hu0.11816578483245149
lt0.11190053285968028
lv0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
4
name"Selvi"
dialogue"Mera camera... maine sab record kiya. Voh andhera tha, aur phir ek cheekh. Main darr gayi. Bahut bura sapna lagta hai."
detectedLang"en"
heavyLang"eo"
scores
en0.46454948301329396
ro0.44359171143514964
fr0.43447737909516376
it0.3561278863232682
tl0.30754536771728747
nl0.3055555555555556
ca0.2967992240543162
de0.29060665362035226
es0.2778884462151395
sq0.23442449841605068
sv0.2050438596491228
et0.18355855855855857
fi0.18355855855855857
vi0.17800453514739228
eu0.14705882352941177
tr0.13381123058542413
az0.12650602409638553
pt0.12121212121212122
lv0.1082410824108241
ms0.0903387703889586
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Camera? You took photos? Can I see? What did you see? Was there someone else there?"
detectedLang"en"
heavyLang"en"
scores
en0.8179091688089116
de0.5086705202312138
ca0.47724477244772445
tl0.41540577716643745
nl0.39801699716713884
it0.3911174785100286
fr0.37774524158125916
es0.37683284457478006
ro0.3684992570579495
et0.3541033434650456
sv0.3410852713178295
sq0.3328100470957614
cs0.30098684210526316
yo0.2904841402337229
pt0.27101200686106347
tr0.256993006993007
no0.25438596491228066
lt0.2517605633802817
az0.247787610619469
da0.24645390070921988
hr0.24645390070921988
lv0.23971377459749554
pl0.22867513611615245
hi0.1533864541832669
ms0.1448692152917505
sk0.1448692152917505
be0.1414141414141414
hu0.1361788617886179
is0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
6
name"Selvi"
dialogue"Yeh dekho. Yeh photo... vahan koi tha, lekin voh admi... voh hwa mein gayab ho gaya. Mumkin nahi hai, lekin maine dekha!"
detectedLang"tl"
heavyLang"eo"
scores
tl0.3821292775665399
fr0.37977099236641226
fi0.34673366834170855
en0.3394308943089431
eu0.32432432432432434
de0.29501084598698485
ms0.268018018018018
it0.24065420560747666
cs0.22985781990521328
et0.2004920049200492
vi0.19454770755885997
ro0.18444165621079048
ca0.15584415584415584
sq0.15254237288135594
no0.14586070959264125
sk0.14586070959264125
is0.11924119241192413
lv0.11924119241192413
hi0.10591471801925723
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I see a blur... but I can't read this. Listen, is there someone who can translate? I really need to know what happened. People are missing."
detectedLang"en"
heavyLang"en"
scores
en0.825279552715655
tl0.5528870720490547
no0.471937235968618
da0.4608749229821319
ro0.4380218368657675
hr0.42358366271409753
nl0.42358366271409753
de0.41976127320954904
it0.3973829201101928
ca0.3944636678200692
pl0.3944636678200692
et0.3898186889818689
cs0.3872549019607844
sk0.37410586552217456
sv0.3732091690544413
pt0.36823104693140796
sq0.35850439882697943
lv0.349925705794948
yo0.3460388639760837
hu0.3430930930930931
is0.3406179351921628
es0.33103975535168195
fr0.32432432432432434
az0.3121069182389937
sl0.3093922651933701
lt0.3022328548644338
tr0.28803905614320585
fi0.2732558139534884
ms0.24957118353344768
eu0.22497785651018598
vi0.20164233576642335
be0.07407407407407407
uk0.06716417910447761
reliabletrue
passestrue
8
name"Selvi"
dialogue"Log gayab ho rahe hain? Haan, mujhe pata hai! Maine suna. Isliye toh main dari hui hoon. Voh jagah... voh mill... kuch galat hai vahan."
detectedLang"ms"
heavyLang"tlh"
scores
ms0.39320388349514557
fr0.3483927019982624
tl0.336283185840708
et0.3181818181818182
ro0.28435114503816794
en0.258893280632411
fi0.25074925074925075
de0.23076923076923078
it0.21548117154811713
ca0.20634920634920634
tr0.1935483870967742
sv0.1891891891891892
lv0.17943107221006563
vi0.1730981256890849
eu0.15540540540540537
no0.1289198606271777
sk0.1289198606271777
cs0.12383177570093458
es0.09200968523002422
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Hold on, that's my phone. Hunter here... Wait, what? Another one? I'll be right there. I'm sorry, I have to go. This is important. We'll find a way to communicate. Please, stay here—I'll send someone who speaks Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.8098995695839312
tl0.631432545201669
da0.47316103379721675
fr0.44630171333054747
it0.4288793103448276
ro0.3933150183150183
ca0.3767638758231421
yo0.37617702448210927
pl0.35741998060135793
sq0.3447082096933729
no0.3427579365079365
nl0.33749999999999997
pt0.32877406281661603
et0.3051914001048768
es0.3037309511297951
sk0.29857067231339335
de0.29670912951167727
hr0.29030530262453136
cs0.2853290183387271
hu0.2715777899945025
lt0.2458736482640865
sv0.23498845265588916
is0.19842710223835452
tr0.17752948479205463
sl0.16927899686520376
vi0.1671904462602137
lv0.16139240506329114
fi0.13849154746423928
az0.13228552717747216
hi0.10894418291862812
ms0.08431237042156185
be0.05017921146953405
eu0.05017921146953405
uk0.045389048991354465
reliabletrue
passestrue
10
name"Selvi"
dialogue"Theek hai. Main yahin rahungi. Lekin jaldi aayiye!"
detectedLang"eu"
heavyLang"et"
scores
eu0.4195688225538972
et0.3783303730017762
is0.34210526315789475
vi0.30966469428007887
ms0.2723492723492723
tl0.2723492723492723
nl0.23076923076923078
it0.2222222222222222
en0.22048997772828507
fi0.21171171171171171
fr0.2009132420091324
de0.1822429906542056
reliablefalse
passesfalse
11
name"Hunter"
dialogue"I will. Just... stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8175182481751825
sv0.6575342465753424
ca0.6323529411764706
et0.5689655172413793
tl0.5503597122302158
no0.5370370370370371
da0.5265151515151516
hr0.5265151515151516
sq0.5173745173745175
pl0.50199203187251
it0.4791666666666667
de0.4588744588744588
cs0.45652173913043476
ro0.4186046511627907
yo0.410377358490566
sk0.3654822335025381
be0.358974358974359
tr0.358974358974359
hu0.34895833333333337
az0.33510638297872336
is0.33510638297872336
lt0.33510638297872336
lv0.33510638297872336
uk0.33510638297872336
vi0.33510638297872336
reliabletrue
passestrue