Run: 2026-04-25-01KQ2DZYWBXYZA7WV8JASE1QE1

Run Details

Model:
DeepSeek V4 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
9.2s
Cost:
$0.000201
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Scene:** A small café in Alborn, MN. Morning light filters through the frosted windows. SELVI (30, sipping chai, scrolling through photos on her camera) is visibly tense. HUNTER (35, trench coat, weary expression) approaches her table. --- **Hunter:** *[clears throat]* Excuse me, miss? You’re Selvi, right? The one staying at the B&B on Maple Street? **Selvi:** *[looks up, startled]* Haan, main hoon. Kya baat hai? *[Yes, I am. What’s the matter?]* **Hunter:** *[frowns, speaks slower]* I’m Detective Hunter. I’m looking into what happened at the apple festival last night. I was told you took photographs there. **Selvi:** *[hands trembling slightly]* Haan… maine dekha. Woh aadmi… woh gayab ho gaya. Mere saamne. Jaise… dhuan. *[Yes… I saw. That man… he disappeared. Right in front of me. Like… smoke.]* **Hunter:** *[confused, rubs his jaw]* I’m sorry, I don’t… uh, speak the language. Do you understand any English? **Selvi:** *[shakes head, voice cracking]* Nahin. Mujhe maaf karo. Main samajh nahin sakti. Lekin woh… woh darawana tha. *[No. I’m sorry. I can’t understand. But it… it was terrifying.]* **Hunter:** *[sighs, pulls out a notepad]* Okay, I’m gonna try something. Just nod or shake your head. Did you see the man in the red jacket? *[points to his own jacket]* **Selvi:** *[eyes wide, nods vigorously]* Haan! Laal jaket. Woh… *[she mimes a vanishing motion with her hands]* …ghoom. Kehti hai. *[Yes! Red jacket. He… *vanished*. Like that.]* **Hunter:** *[scribbles a note, looks up]* Vanished? Like—poof? **Selvi:** *[nods, tears welling]* Poof. *[whispers]* Koi nahin bach payega. *[No one will be saved.]* *Hunter’s phone buzzes. He glances at it, jaw tightens.* **Hunter:** *[pocketing notepad]* I have to go. There’s been another… event. I’ll find a translator. Stay in town, okay? **Selvi:** *[clutching her camera]* Aap ja rahe ho? *[You’re leaving?]* Kripya… dhyan rakhna. *[Please… take care.]* **Hunter:** *[pauses, gives a tired nod]* Yeah. You too. *[He turns and strides out, phone already to his ear.]* **Selvi:** *[stares at her camera screen, then whispers to herself]* Andhere mein kuch hai. *[Something is in the darkness.]* --- **END OF SCENE**
created_at"2026-04-25T13:41:46.511Z" 4/25/2026, 1:41:46 PM
model"deepseek/deepseek-v4-flash-20260423"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency941
moderation_latency(null)
generation_time8925
tokens_prompt315
tokens_completion600
native_tokens_prompt268
native_tokens_completion685
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.000200648
router(null)
provider_responses
0
endpoint_id"722e0746-2034-4d6e-a08f-e6271849ee9e"
id"b79a15c0-b206-4c11-9c37-00176c3f4b6a"
is_byokfalse
latency275
model_permaslug"deepseek/deepseek-v4-flash-20260423"
provider_name"DeepSeek"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777124506-yM3WoAhRhQQVkMvqQ1xN"
session_id(null)
api_type"completions"
id"gen-1777124506-wNYTfXOKUjlqkgvm92Qh"
upstream_id"b79a15c0-b206-4c11-9c37-00176c3f4b6a"
total_cost0.000200648
cache_discount0.000028672
upstream_inference_cost0
provider_name"DeepSeek"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss? You’re Selvi, right? The one staying at the B&B on Maple Street?"
detectedLang"en"
heavyLang"en"
scores
en0.7707378074197583
tl0.6543054682589567
no0.5350803043110736
da0.5084897229669348
fr0.5004541326067212
fi0.41737288135593226
nl0.4028230184581976
sq0.38478747203579416
yo0.3699885452462772
et0.358974358974359
hr0.3475682087781732
pl0.3475682087781732
ca0.29936305732484075
ms0.28664072632944226
sk0.2857142857142857
sl0.28478543563068925
de0.2753623188405797
it0.26861702127659576
sv0.26666666666666666
cs0.2597577388963661
es0.22644163150492264
pt0.2109038737446198
is0.18154761904761904
lt0.18154761904761904
ro0.17664670658682635
hi0.13249211356466878
tr0.11290322580645161
az0.09688013136288999
lv0.09688013136288999
reliabletrue
passestrue
1
name"Selvi"
dialogue"Haan, main hoon. Kya baat hai?"
detectedLang"vi"
heavyLang"nl"
scores
vi0.511400651465798
it0.39999999999999997
en0.39759036144578314
fr0.3697478991596639
de0.34210526315789475
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I’m Detective Hunter. I’m looking into what happened at the apple festival last night. I was told you took photographs there."
detectedLang"en"
heavyLang"en"
scores
en0.812473210458637
tl0.6571316614420063
fr0.5648930880159124
no0.5067643742953777
de0.4912790697674419
da0.4834710743801653
nl0.4779236276849642
it0.41937624419376246
sv0.4131455399061033
ca0.3998628257887517
sq0.3953006219765031
ro0.37230989956958394
es0.3695965417867435
pt0.36594202898550726
cs0.3356112376613516
hr0.3174726989079563
yo0.2886178861788618
ms0.2653232577665827
sl0.26346801346801346
et0.23043095866314864
sk0.1784037558685446
lt0.17763157894736845
pl0.17763157894736845
az0.17140151515151517
hu0.13280475718533202
is0.13280475718533202
tr0.12848605577689243
lv0.12587412587412586
hi0.08088235294117647
be0.07407407407407407
fi0.06716417910447761
uk0.06716417910447761
vi0.06716417910447761
reliabletrue
passestrue
3
name"Selvi"
dialogue"Haan… maine dekha. Woh aadmi… woh gayab ho gaya. Mere saamne. Jaise… dhuan."
detectedLang"et"
heavyLang"de"
scores
et0.4351961950059453
fr0.40025252525252525
fi0.36666666666666664
en0.3365921787709497
ms0.29629629629629634
tl0.2899850523168909
da0.24960505529225907
de0.23633440514469453
ro0.23633440514469453
ca0.20168067226890754
no0.18941979522184302
sk0.18941979522184302
cs0.18244406196213425
it0.18244406196213425
sq0.1739130434782609
lv0.15630550621669628
reliablefalse
passesfalse
4
name"Hunter"
dialogue"I’m sorry, I don’t… uh, speak the language. Do you understand any English?"
detectedLang"en"
heavyLang"en"
scores
en0.8062698133145473
tl0.6311200536552649
no0.5638382236320381
da0.5517522412387939
sv0.47569113441372735
ro0.434737923946557
cs0.42105263157894735
de0.3902439024390244
nl0.38820912124582874
pl0.38684503901895206
yo0.3785310734463277
hr0.37570942111237227
sq0.3742889647326508
sk0.3475682087781732
ca0.33008526187576126
pt0.3176178660049628
ms0.301143583227446
is0.28664072632944226
it0.28104575163398693
vi0.2403314917127072
fr0.21203438395415475
et0.2040520984081042
lt0.1863905325443787
sl0.1791044776119403
eu0.12420382165605094
be0.11290322580645161
tr0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
lv0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
5
name"Selvi"
dialogue"Nahin. Mujhe maaf karo. Main samajh nahin sakti. Lekin woh… woh darawana tha."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5426829268292682
eu0.4578313253012048
sq0.42084942084942084
ms0.3430656934306569
pl0.3171471927162367
fi0.3055555555555556
is0.296875
de0.2834394904458599
lt0.1891891891891892
et0.18772563176895307
no0.1818181818181818
en0.18032786885245902
lv0.1773308957952468
fr0.16356877323420074
da0.16044776119402984
sv0.15094339622641512
yo0.14448669201520914
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Okay, I’m gonna try something. Just nod or shake your head. Did you see the man in the red jacket?"
detectedLang"en"
heavyLang"en"
scores
en0.7874149659863946
tl0.6864024084295033
sv0.46259673258813416
et0.43438914027149317
nl0.4131455399061033
ms0.33083511777301927
da0.31091510474090406
de0.2961711711711712
it0.27829099307159355
sl0.2681498829039813
yo0.2378048780487805
no0.23218673218673216
es0.20584498094027956
fr0.1997439180537772
ro0.18513689700130379
fi0.15540540540540537
lv0.14733969986357437
lt0.13073713490959665
az0.11847672778561354
pl0.11847672778561354
cs0.11095305832147938
pt0.11095305832147938
sq0.11095305832147938
ca0.10968660968660969
hr0.10714285714285714
reliabletrue
passestrue
7
name"Selvi"
dialogue"Haan! Laal jaket. Woh… …ghoom. Kehti hai."
detectedLang"et"
heavyLang"fi"
scores
et0.47368421052631576
vi0.3857493857493857
fi0.32432432432432434
it0.2857142857142857
no0.258160237388724
de0.23547400611620795
sv0.23547400611620795
tr0.23547400611620795
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Vanished? Like—poof?"
detectedLang"en"
heavyLang"en"
scores
en0.7637051039697542
no0.5
da0.4444444444444444
reliabletrue
passestrue
9
name"Selvi"
dialogue"Poof. Koi nahin bach payega."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5689655172413793
eu0.45652173913043476
fr0.375
reliablefalse
passesfalse
10
name"Hunter"
dialogue"I have to go. There’s been another… event. I’ll find a translator. Stay in town, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8224212476837554
tl0.6565113500597372
da0.5916193181818182
pl0.5472440944881889
ro0.5184254606365158
nl0.4852282900626679
it0.48057813911472447
de0.4734432234432235
no0.4734432234432235
yo0.469067405355494
sv0.46361940298507465
hr0.4606003752345216
sl0.45754716981132076
cs0.4261477045908184
ca0.42557442557442554
sk0.40843621399176955
es0.40166493236212286
pt0.39217758985200846
sq0.38038793103448276
lv0.358974358974359
lt0.3546576879910213
fr0.35101580135440186
az0.32432432432432434
ms0.3097238895558223
et0.2996345919610231
hu0.27944862155388467
vi0.2776381909547738
tr0.267515923566879
is0.1935483870967742
eu0.19241573033707865
be0.10852713178294573
fi0.0987460815047022
uk0.0987460815047022
reliabletrue
passestrue
11
name"Selvi"
dialogue"Aap ja rahe ho? Kripya… dhyan rakhna."
detectedLang"ca"
heavyLang"fi"
scores
ca0.4780793319415449
sk0.43820224719101125
sq0.4186046511627907
et0.3811881188118812
fi0.3796526054590571
lv0.3150684931506849
no0.30747922437673125
cs0.29775280898876405
it0.29775280898876405
de0.26035502958579887
da0.24242424242424243
pl0.24242424242424243
sl0.24242424242424243
sv0.23076923076923078
yo0.23076923076923078
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Yeah. You too."
detectedLang"en"
heavyLang"en"
scores
en0.7807017543859649
cs0.5098039215686274
tl0.5098039215686274
reliabletrue
passestrue
13
name"Selvi"
dialogue"Andhere mein kuch hai."
detectedLang"de"
heavyLang"da"
scores
de0.6189024390243903
vi0.5567375886524822
en0.5155038759689923
it0.4444444444444444
sq0.3842364532019704
reliabletrue
passesfalse