Run: 2026-09-03-01M1KD8TYF744S5J5QWG4VQND0

Run Details

Model:
DeepSeek V4 Pro 0813 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 13s
Cost:
$0.016084
Provider:
StreamLake

Evaluation summary

Score Evaluator
Details Link
55.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: (in Hindi) "Yeh nahi ho sakta... woh aadmi..." [This can't be... that man...] Hunter: "Ma'am. Detective Hunter. I need to ask you about the incident near the old train depot last night." Selvi: (in Hindi, startled) "Maaf kijiye... main Angrezi nahi jaanti." [I'm sorry... I don't know English.] Hunter: "You don't speak English. Okay. Camera—did you take photos there?" Selvi: (in Hindi) "Haan... maine tasveerein li... phir sab badal gaya." [Yes... I took photos... then everything changed.] Hunter: "I don't understand. Can you show me?" Selvi: (turns camera toward him, hands trembling) "Dekhiye... wahan dhundh hai... aur woh aadmi nahi hai." [Look... there is fog... and the man is not there.] Hunter: "Fog. The other witness mentioned fog. Is that the clock tower?" Selvi: (in Hindi) "Haan... ghanta ghar... uske peeche woh aadmi khada tha." [Yes... the clock tower... the man was standing behind it.] Hunter: "A man behind the tower. But there's no one in this shot." Selvi: (in Hindi) "Maine dekha... woh chillaaya... phir gaayab." [I saw... he screamed... then disappeared.] Hunter: "You're shaking. It's okay. I need to see these photos. Do you mind?" Selvi: (in Hindi) "Le lijiye... mujhe nahi chahiye." [Take it... I don't want it.] Hunter: "I'll get a translator. Did you see which way he went?" Selvi: (in Hindi) "Kahin nahi... woh dhundh mein mil gaya." [Nowhere... he disappeared into the fog.] Hunter: "Disappeared into fog. That matches the other reports." (phone buzzes) Hunter: "Excuse me. Hunter. Where? The cider barn? I'm on my way." Hunter: "I have to leave. Stay here in the cafe. Don't go anywhere. I'll be back with an interpreter." Selvi: (in Hindi) "Theek hai... jaldi aaiye... mujhe dar lag raha hai." [Okay... come quickly... I'm scared.] Hunter: "I'll be quick. Stay inside."
created_at"2026-09-03T10:33:12.424Z" 9/3/2026, 10:33:12 AM
model"deepseek/deepseek-v4-pro-20260813"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1336
moderation_latency(null)
generation_time72463
tokens_prompt302
tokens_completion4963
native_tokens_prompt347
native_tokens_completion4691
native_tokens_completion_images(null)
native_tokens_reasoning4147
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.016084068
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788431592-wuMoNce1VCsH5jBupf6f"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788431592-Jdf1BfI29Dgbsgd82mWD"
upstream_id"req-q7oyqi-1788431592738002103"
provider_responses
0
endpoint_id"072c1c23-c069-4242-bb6d-1b30ca5f4eb8"
id"req-q7oyqi-1788431592738002103"
is_byokfalse
latency1336
model_permaslug"deepseek/deepseek-v4-pro-20260813"
provider_name"StreamLake"
status200
total_cost0.016084068
cache_discount(null)
upstream_inference_cost0
provider_name"StreamLake"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
55.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh nahi ho sakta... woh aadmi..."
detectedLang"no"
heavyLang"ber"
scores
no0.48320413436692505
sq0.47506561679790027
eu0.4520547945205479
ca0.375
sk0.35691318327974275
cs0.3464052287581699
it0.3464052287581699
tr0.3265993265993266
is0.2753623188405797
sv0.2753623188405797
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am. Detective Hunter. I need to ask you about the incident near the old train depot last night."
detectedLang"en"
heavyLang"en"
scores
en0.7992266508030934
tl0.6506211180124224
fr0.55
ro0.5389344262295082
no0.5115774240231549
da0.5029455081001473
ca0.49664429530201337
nl0.4689221085759244
it0.4578313253012048
cs0.43133951137320975
sq0.41659464131374246
pt0.4094488188976378
de0.40476190476190477
sv0.38130155820348305
et0.3767313019390581
es0.37615526802218113
yo0.375
hr0.36079545454545453
sl0.3577545195052331
sk0.33035714285714285
pl0.3290258449304175
lt0.25083240843507215
az0.23556058890147225
tr0.23120728929384965
lv0.21511627906976746
ms0.1687192118226601
hu0.15730337078651685
eu0.15307402760351316
be0.09395973154362416
is0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue
2
name"Selvi"
dialogue"Maaf kijiye... main Angrezi nahi jaanti."
detectedLang"ro"
heavyLang"tl"
scores
ro0.43324937027707805
eu0.4230769230769231
de0.4094488188976378
et0.3679775280898876
it0.3263473053892215
en0.3055555555555556
no0.29467084639498436
da0.281150159744409
fr0.281150159744409
lt0.281150159744409
ms0.26229508196721313
lv0.25
cs0.22945205479452058
hr0.22945205479452058
sk0.22945205479452058
sl0.22945205479452058
sq0.22945205479452058
tl0.22945205479452058
tr0.22945205479452058
reliablefalse
passesfalse
3
name"Hunter"
dialogue"You don't speak English. Okay. Camera—did you take photos there?"
detectedLang"en"
heavyLang"en"
scores
en0.7972630511910795
tl0.5604395604395604
de0.49558638083228246
fr0.39209726443769
ro0.36507936507936506
es0.30915371329879104
ca0.3019197207678883
it0.2831541218637993
sv0.2779783393501805
nl0.2687385740402194
ms0.2647058823529412
no0.17012448132780084
lt0.16666666666666666
pt0.16666666666666666
cs0.16317991631799164
sl0.16317991631799164
sq0.16317991631799164
hi0.16142557651991615
da0.15254237288135594
hr0.15254237288135594
lv0.15074309978768577
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan... maine tasveerein li... phir sab badal gaya."
detectedLang"pl"
heavyLang"id"
scores
pl0.4495412844036697
de0.42857142857142855
ro0.42418426103646834
fr0.4094488188976378
ms0.39879759519038077
tl0.39271255060728744
ca0.38524590163934425
en0.35205183585313177
et0.35205183585313177
fi0.35205183585313177
eu0.27007299270072993
hr0.2518703241895262
is0.23857868020304565
lv0.22680412371134018
nl0.22680412371134018
cs0.21671018276762402
it0.21671018276762402
sk0.20424403183023873
sl0.20424403183023873
lt0.19786096256684493
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I don't understand. Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8097412480974124
no0.6807151979565772
da0.6376811594202898
sv0.5826377295492488
nl0.5755517826825127
tl0.5652173913043478
sq0.5300751879699248
cs0.5164410058027079
ca0.46236559139784944
pl0.44933920704845814
it0.43820224719101125
de0.43566591422121903
pt0.39759036144578314
ro0.3961352657004831
sk0.39172749391727496
et0.3872549019607844
tr0.37027707808564225
az0.358974358974359
hr0.3573264781491003
is0.3540051679586563
es0.28977272727272724
fr0.2668621700879765
sl0.26035502958579887
yo0.258160237388724
ms0.251497005988024
fi0.23076923076923078
be0.21875
hu0.21135646687697163
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
6
name"Selvi"
dialogue"Dekhiye... wahan dhundh hai... aur woh aadmi nahi hai."
detectedLang"ms"
heavyLang"de"
scores
ms0.44751381215469616
eu0.3548387096774194
vi0.3435448577680525
tl0.30394431554524365
ro0.25925925925925924
sq0.25925925925925924
it0.25
fi0.22680412371134018
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Fog. The other witness mentioned fog. Is that the clock tower?"
detectedLang"en"
heavyLang"en"
scores
en0.8072970195272353
tl0.6572212065813527
da0.5059288537549407
hu0.4820441988950276
nl0.45255474452554745
fr0.3951612903225807
yo0.37707641196013286
ms0.3206521739130435
sv0.3131868131868132
de0.3029739776951673
no0.29906542056074764
it0.29245283018867924
ca0.28842504743833014
ro0.28842504743833014
es0.26035502958579887
is0.19700214132762314
sq0.17218543046357618
cs0.16666666666666666
lv0.16666666666666666
fi0.1515837104072398
hr0.14772727272727273
pt0.14772727272727273
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan... ghanta ghar... uske peeche woh aadmi khada tha."
detectedLang"ro"
heavyLang"de"
scores
ro0.3737957610789981
pt0.37137330754352027
sq0.3564356435643564
yo0.24418604651162787
ca0.20147420147420148
es0.1875
it0.1875
tl0.1875
fi0.17721518987341772
en0.16237113402061853
hr0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
sl0.16237113402061853
sv0.16237113402061853
reliablefalse
passesfalse
9
name"Hunter"
dialogue"A man behind the tower. But there's no one in this shot."
detectedLang"en"
heavyLang"en"
scores
en0.8376623376623377
tl0.6838111298482294
de0.5341614906832298
nl0.5222929936305732
sv0.5
no0.48700410396716826
it0.484181568088033
pl0.4834710743801653
yo0.455732946298984
lv0.4517543859649123
hr0.4444444444444444
fr0.43009118541033436
ro0.42835365853658536
da0.42660550458715596
pt0.4257274119448699
ca0.4195046439628483
es0.41770186335403725
sl0.39418416801292405
sk0.37080536912751677
ms0.3654822335025381
eu0.36006825938566556
lt0.3194192377495462
tr0.3055555555555556
hu0.2937853107344633
az0.29111531190926276
sq0.2857142857142857
cs0.26035502958579887
is0.16666666666666666
vi0.15730337078651685
et0.14383561643835618
fi0.14383561643835618
reliabletrue
passestrue
10
name"Selvi"
dialogue"Maine dekha... woh chillaaya... phir gaayab."
detectedLang"fi"
heavyLang"de"
scores
fi0.5696400625978091
en0.492619926199262
fr0.43064182194616984
et0.3721461187214612
tl0.3648960739030023
de0.3483412322274882
ro0.3483412322274882
lv0.24242424242424243
es0.23822714681440443
it0.21652421652421652
reliablefalse
passesfalse
11
name"Hunter"
dialogue"You're shaking. It's okay. I need to see these photos. Do you mind?"
detectedLang"en"
heavyLang"en"
scores
en0.8149760557248585
tl0.5986779981114259
et0.519774011299435
cs0.5126146788990825
pl0.4873341375150784
hr0.46874999999999994
sq0.452319587628866
no0.4444444444444444
sk0.44152431011826543
pt0.4193989071038251
yo0.41540577716643745
lv0.37591776798825255
fr0.37315634218289084
lt0.3675595238095238
da0.36377245508982037
sl0.36186186186186187
it0.3359375
ca0.32965299684542587
sv0.32965299684542587
vi0.2904841402337229
nl0.2892976588628763
hu0.2672413793103448
de0.2621527777777778
is0.23971377459749554
ro0.17475728155339806
es0.15841584158415842
hi0.1533864541832669
be0.1414141414141414
tr0.1414141414141414
az0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
12
name"Selvi"
dialogue"Le lijiye... mujhe nahi chahiye."
detectedLang"fr"
heavyLang"tl"
scores
fr0.45652173913043476
eu0.4520547945205479
it0.42028985507246375
yo0.37888198757763975
es0.3730407523510972
sl0.36908517350157727
ro0.3630573248407643
hu0.3288590604026846
reliablefalse
passesfalse
13
name"Hunter"
dialogue"I'll get a translator. Did you see which way he went?"
detectedLang"en"
heavyLang"en"
scores
en0.8248248248248248
tl0.5035460992907801
et0.5021337126600285
ca0.4631901840490798
ro0.4615384615384615
es0.45567651632970446
pt0.445324881141046
cs0.4345718901453958
pl0.40878378378378377
hr0.40273037542662116
yo0.38704028021015763
sq0.3848857644991213
sl0.375
de0.36479128856624315
nl0.36363636363636365
fr0.360146252285192
da0.358974358974359
no0.3566176470588235
sk0.3554327808471455
it0.34944237918215615
ms0.3433395872420263
sv0.3433395872420263
is0.3333333333333333
vi0.3110236220472441
hu0.308300395256917
fi0.3055555555555556
lt0.2985971943887776
tr0.2857142857142857
eu0.2813141683778234
lv0.2813141683778234
az0.2693110647181628
reliabletrue
passestrue
14
name"Selvi"
dialogue"Kahin nahi... woh dhundh mein mil gaya."
detectedLang"tl"
heavyLang"de"
scores
tl0.6382636655948554
eu0.4230769230769231
de0.3571428571428572
sq0.3181818181818182
pt0.31402439024390244
ms0.30769230769230765
es0.29467084639498436
sk0.2834394904458599
ca0.2474916387959866
et0.2474916387959866
ro0.2474916387959866
sv0.2474916387959866
reliabletrue
passesfalse
15
name"Hunter"
dialogue"Disappeared into fog. That matches the other reports."
detectedLang"en"
heavyLang"en"
scores
en0.8127340823970037
tl0.6413934426229507
fr0.6013667425968109
sv0.4905385735080059
nl0.35064935064935066
de0.3371212121212121
ms0.3346007604562738
it0.317738791423002
es0.3110236220472441
da0.308300395256917
eu0.2842535787321063
hu0.2505353319057816
yo0.23413566739606126
no0.21348314606741572
ca0.19168591224018475
sq0.1822429906542056
lv0.17452830188679244
cs0.17061611374407584
pt0.17061611374407584
ro0.17061611374407584
reliabletrue
passestrue
16
name"Hunter"
dialogue"Excuse me. Hunter. Where? The cider barn? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7750449910017997
no0.5393120393120393
fr0.5324189526184538
tl0.5161290322580645
sq0.49186991869918695
da0.4673295454545454
sv0.4658119658119659
nl0.4509516837481699
et0.39903846153846156
de0.3980738362760835
fi0.375
ms0.37080536912751677
yo0.3267504488330341
pl0.3194192377495462
cs0.30037313432835816
sk0.30037313432835816
ca0.2964352720450282
pt0.2870722433460076
sl0.2816091954022989
it0.27606177606177607
ro0.25447316103379725
tr0.25447316103379725
es0.21383647798742136
hr0.19006479481641467
hi0.1830065359477124
is0.17035398230088497
az0.15540540540540537
reliabletrue
passestrue
17
name"Hunter"
dialogue"I have to leave. Stay here in the cafe. Don't go anywhere. I'll be back with an interpreter."
detectedLang"en"
heavyLang"en"
scores
en0.8051138135328968
tl0.5589273112208892
yo0.5283018867924528
de0.5199692780337941
da0.5035742652899127
sq0.4914564686737185
pl0.46120689655172414
no0.4560487380330722
ro0.4434550311665183
sv0.44196428571428575
ms0.41806331471135944
it0.40702087286527516
sl0.3996157540826129
nl0.39496611810261373
ca0.3830207305034551
fr0.37810945273631835
lt0.36289500509684
tr0.358974358974359
sk0.3563336766220391
hu0.35233160621761656
hr0.3509865005192108
cs0.3336886993603412
es0.32795698924731176
lv0.3024553571428571
vi0.2732558139534884
pt0.2681498829039813
az0.2550655542312277
et0.2368742368742369
eu0.22934648581997535
be0.10071942446043164
is0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
18
name"Selvi"
dialogue"Theek hai... jaldi aaiye... mujhe dar lag raha hai."
detectedLang"et"
heavyLang"is"
scores
et0.42196531791907516
nl0.3775933609958506
vi0.3435448577680525
ro0.29906542056074764
lt0.29577464788732394
eu0.26108374384236455
it0.25
no0.24623115577889448
is0.23857868020304565
es0.2366412213740458
pt0.2366412213740458
sv0.2366412213740458
de0.20424403183023873
reliablefalse
passesfalse
19
name"Hunter"
dialogue"I'll be quick. Stay inside."
detectedLang"en"
heavyLang"en"
scores
en0.7878787878787878
hu0.4006849315068493
lt0.3902439024390244
yo0.38596491228070173
it0.34210526315789475
et0.3320610687022901
tl0.32950191570881227
da0.3055555555555556
no0.3055555555555556
ca0.2886178861788618
es0.2886178861788618
fr0.2886178861788618
ms0.2886178861788618
pt0.2886178861788618
ro0.2886178861788618
reliabletrue
passestrue