Run: 2026-04-25-01KQ2E1P7TNKD1EB06HY1F7Y7W

Run Details

Model:
DeepSeek V4 Flash (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
10.6s
Cost:
$0.000211
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet – Scene: Cafe in Alborn, MN** **Selvi:** (looking down at her camera, scrolling through photos, murmuring to herself) "Yeh tasveer… woh raat… kuchh to galat hai." **Hunter:** (approaches, clears throat) "Excuse me. I’m Detective Hunter. I saw you at the apple festival last night. Did you happen to notice anything unusual? A woman in a blue scarf, maybe?" **Selvi:** (looks up, startled – hands tremble) "Woh aurat… haan, maine dekha tha. Uski aankhen… jaise koi darr tha. Aur phir woh gaayab ho gayi. Main kuchh nahi kar payi." **Hunter:** (frowns, leans in) "I’m sorry – I don’t understand. Do you speak any English? English?" (points to himself) "Hunter. Detective." **Selvi:** (nods frantically, then points at her camera) "Camera. Main photo le rahi thi. Lekin… woh aadmi bhi tha. Kala coat. Woh use le gaya." **Hunter:** (rubs his forehead, tries again) "Okay. Camera. Photo? Show me?" (gestures to the camera) **Selvi:** (hesitates, then turns the camera screen toward him – her hand shaking) "Yeh dekho. Uske peeche woh aadmi hai. Main us waqt samjhi nahi, par ab…" **Hunter:** (squints at the image – a dark figure in the background) "That’s… Is that him? Did you see his face?" **Selvi:** (tears welling up) "Nahi. Uski topi ne chhupa liya. Lekin main janti hoon – woh wahi hai. Bahut mushkil se dekha tha." **Hunter:** (phone buzzes, he glances at it) "I’m sorry, I have to take this. Stay here, okay? I’ll be right back." (points at her, then the chair) "You – stay." **Selvi:** (watches him leave, whispers) "Kya main woh photo dikha sakti hoon? Shayad woh samjhe…" **Hunter:** (into phone as he walks away) "Yeah, I’m on my way. Found a possible witness – language barrier though. I’ll update you in ten." **(End of scene)**
created_at"2026-04-25T13:42:43.198Z" 4/25/2026, 1:42:43 PM
model"deepseek/deepseek-v4-flash-20260423"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency950
moderation_latency(null)
generation_time10526
tokens_prompt315
tokens_completion680
native_tokens_prompt268
native_tokens_completion721
native_tokens_completion_images(null)
native_tokens_reasoning161
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.000210728
router(null)
provider_responses
0
endpoint_id"722e0746-2034-4d6e-a08f-e6271849ee9e"
id"0aa43dc3-5a94-4e07-9530-729a721b16af"
is_byokfalse
latency405
model_permaslug"deepseek/deepseek-v4-flash-20260423"
provider_name"DeepSeek"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777124563-ZfmOf80uwcx9bWx0hERL"
session_id(null)
api_type"completions"
id"gen-1777124563-tzRhO65SkVib2a0zVJIN"
upstream_id"0aa43dc3-5a94-4e07-9530-729a721b16af"
total_cost0.000210728
cache_discount0.000028672
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh tasveer… woh raat… kuchh to galat hai."
detectedLang"tl"
heavyLang"ber"
scores
tl0.4811320754716981
pl0.4353182751540041
sk0.4318181818181818
cs0.43064182194616984
lv0.4186046511627907
en0.3663594470046083
vi0.36342592592592593
ms0.3574766355140187
ro0.3544600938967136
yo0.3325242718446602
sl0.3055555555555556
nl0.298469387755102
hr0.2966751918158568
no0.2838541666666667
da0.2744063324538259
lt0.2744063324538259
it0.26666666666666666
es0.21652421652421652
ca0.21428571428571427
et0.21428571428571427
sv0.21428571428571427
tr0.21428571428571427
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me. I’m Detective Hunter. I saw you at the apple festival last night. Did you happen to notice anything unusual? A woman in a blue scarf, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.7900390625
tl0.6604548325963361
no0.5380318006016329
it0.5192307692307693
fr0.5122504537205081
da0.5020842982862437
ro0.4957786116322702
nl0.4934024505183789
es0.45925553319919515
sq0.451530612244898
cs0.4444444444444444
sv0.4315177154944474
pt0.430614406779661
ms0.42451820128479656
hr0.42359249329758714
de0.41765980498374866
sl0.4160782183595872
ca0.4007803790412486
yo0.3627741553052756
sk0.32854465958775764
et0.328125
pl0.32304785894206545
lv0.28902116402116407
hu0.26319396847155585
lt0.2586206896551724
az0.2375886524822695
fi0.20722713864306785
tr0.16081186572989853
is0.11376751854905194
vi0.11009933774834438
be0.061135371179039305
eu0.061135371179039305
uk0.05536028119507908
reliabletrue
passestrue
2
name"Selvi"
dialogue"Woh aurat… haan, maine dekha tha. Uski aankhen… jaise koi darr tha. Aur phir woh gaayab ho gayi. Main kuchh nahi kar payi."
detectedLang"fr"
heavyLang"de"
scores
fr0.4308943089430894
ro0.3314231136580707
en0.3269230769230769
et0.25611052072263546
de0.24324324324324328
ca0.23161361141602635
sq0.22308546059933407
sk0.21171171171171171
no0.20993227990970656
cs0.2072480181200453
tr0.2
eu0.19075144508670522
fi0.18887601390498263
ms0.18699186991869918
sl0.1822429906542056
nl0.14320685434516522
it0.1315136476426799
lv0.1116751269035533
tl0.10485933503836317
pl0.0990990990990991
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Hunter. Detective."
detectedLang"en"
heavyLang"de"
scores
en0.7937293729372937
ro0.713302752293578
tl0.7023809523809523
fr0.6794871794871795
ca0.6565934065934066
it0.6537396121883656
pt0.6508379888268158
es0.5874587458745875
de0.5791245791245792
da0.570446735395189
no0.558303886925795
sq0.5487364620938628
nl0.5370370370370371
sv0.5229007633587787
sl0.50199203187251
cs0.3654822335025381
hr0.34895833333333337
ms0.3206521739130435
tr0.3206521739130435
reliabletrue
passestrue
4
name"Selvi"
dialogue"Camera. Main photo le rahi thi. Lekin… woh aadmi bhi tha. Kala coat. Woh use le gaya."
detectedLang"fr"
heavyLang"de"
scores
fr0.5235707121364093
en0.5077720207253886
it0.38946015424164526
ro0.36412315930388217
tl0.3546195652173913
es0.31457431457431456
ms0.2658423493044822
vi0.24603174603174602
de0.24000000000000002
eu0.23633440514469453
yo0.20435510887772196
sl0.19763513513513514
sq0.19763513513513514
ca0.17677642980935876
hu0.17102966841186737
fi0.16520210896309317
cs0.15630550621669628
is0.15630550621669628
sv0.14721723518850988
hi0.1394927536231884
nl0.13793103448275862
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay. Camera. Photo? Show me?"
detectedLang"en"
heavyLang"en"
scores
en0.7097844112769487
fr0.6710526315789473
tl0.6704331450094161
it0.576271186440678
nl0.5752427184466019
es0.5345744680851064
pt0.4852941176470589
ro0.47447447447447455
ms0.4712990936555891
sq0.4582043343653251
ca0.36823104693140796
et0.35185185185185186
no0.34210526315789475
cs0.3346007604562738
sl0.3346007604562738
sv0.31906614785992216
hi0.3055555555555556
fi0.3
de0.29149797570850206
reliabletrue
passestrue
6
name"Selvi"
dialogue"Yeh dekho. Uske peeche woh aadmi hai. Main us waqt samjhi nahi, par ab…"
detectedLang"de"
heavyLang"ber"
scores
de0.3818681318681319
fr0.3401759530791789
en0.3119266055045872
sv0.2753623188405797
eu0.2682926829268293
vi0.25864909390444807
lv0.256198347107438
ro0.1891891891891892
it0.1818181818181818
da0.1712707182320442
tl0.15730337078651685
tr0.14772727272727273
ca0.14285714285714285
es0.14285714285714285
pt0.14285714285714285
reliablefalse
passesfalse
7
name"Hunter"
dialogue"That’s… Is that him? Did you see his face?"
detectedLang"en"
heavyLang"en"
scores
en0.8479823106688779
tl0.5080500894454383
nl0.48405253283302063
et0.3820224719101124
hu0.358974358974359
yo0.3037974683544304
ro0.289405684754522
it0.26666666666666666
sq0.26666666666666666
fr0.26273458445040215
is0.2506811989100818
cs0.22096317280453256
pt0.21875
reliabletrue
passestrue
8
name"Selvi"
dialogue"Nahi. Uski topi ne chhupa liya. Lekin main janti hoon – woh wahi hai. Bahut mushkil se dekha tha."
detectedLang"sq"
heavyLang"de"
scores
sq0.4618834080717489
it0.3963782696177062
sl0.35275080906148865
fr0.3435448577680525
hr0.3428258488499452
eu0.34210526315789475
ro0.3250843644544432
cs0.3220338983050847
fi0.3212669683257918
lt0.2490613266583229
ms0.23566878980891717
lv0.22879177377892032
ca0.21875
tr0.21156373193166886
vi0.2073976221928666
es0.1780821917808219
pt0.16550764951321278
yo0.15134370579915135
en0.14163090128755365
da0.13294797687861273
is0.12790697674418602
sv0.12536443148688048
hu0.12023460410557184
de0.11504424778761062
no0.1111111111111111
sk0.10044977511244377
tl0.10044977511244377
reliablefalse
passesfalse
9
name"Hunter"
dialogue"You – stay."
detectedLang"en"
heavyLang"en"
scores
en0.8281786941580757
cs0.609375
tl0.609375
reliablefalse
passestrue
10
name"Selvi"
dialogue"Kya main woh photo dikha sakti hoon? Shayad woh samjhe…"
detectedLang"tl"
heavyLang"de"
scores
tl0.460708782742681
fr0.44267515923566875
en0.43548387096774194
sq0.375
cs0.2009132420091324
de0.1822429906542056
hi0.18032786885245902
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Yeah, I’m on my way. Found a possible witness – language barrier though. I’ll update you in ten."
detectedLang"en"
heavyLang"en"
scores
en0.808293098551548
tl0.6392303580972741
fr0.528960223307746
ro0.4819646968534152
ca0.48156682027649766
de0.47141738449490994
cs0.44672131147540983
it0.44214876033057854
pl0.412532637075718
yo0.38130155820348305
nl0.3744207599629287
sk0.36619718309859156
et0.35344827586206895
pt0.33497536945812806
da0.32499999999999996
es0.3229689067201605
sl0.3202416918429003
eu0.2686890574214518
no0.267100977198697
sv0.266304347826087
lt0.26229508196721313
ms0.25
fi0.2398648648648649
hr0.2285714285714286
hi0.2077464788732394
is0.1906474820143885
hu0.18772563176895307
az0.18576598311218334
lv0.17682926829268292
tr0.10239361702127658
sq0.09638554216867469
vi0.09395973154362416
reliabletrue
passestrue