Run: 2026-02-16-01KHM5W0A6EWJY4KGG8P12QHKV

Run Details

Model:
DeepSeek V3.1
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
13.5s
Cost:
$0.001170
Provider:
Fireworks

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Selvi:** (murmuring to herself in Hindi, not looking up from her camera's viewfinder) यह कैसे हुआ? फोटो में कुछ अजीब दिख रहा है... वो आदमी... वो गायब क्यों हो गया? (How did this happen? Something looks strange in the photo... that man... why did he disappear?) **Hunter:** (approaching the table, badge held politely in hand) Excuse me, miss? Detective Hunter, Alborn PD. Mind if I ask you a few questions? We're looking into the incident at the orchard last night. I understand you were there taking pictures? **Selvi:** (looks up, eyes wide and startled. She clutches her camera closer and speaks rapidly, her voice trembling with distress) माफ़ कीजिए, मैं समझी नहीं... वहाँ बहुत अंधेरा था... मैंने सिर्फ चाँद की तस्वीर लेनी चाही, लेकिन फिर वो आवाज़ आई... और अब वो आदमी गायब है! मुझे真的 डर लग रहा है। (I'm sorry, I don't understand... it was so dark there... I just wanted to take a picture of the moon, but then that sound came... and now that man is missing! I'm really scared.) **Hunter:** (squints, his no-nense demeanor faltering into pure confusion) I... sorry, I don't... do you speak English? The orchard? Last night? **Selvi:** (shakes her head, frustrated she can't make herself understood. She points to her camera and then makes a sweeping gesture towards the window in the direction of the orchard) कैमरा! मैंने देखा! तस्वीर... (Camera! I saw! Picture...) **Hunter:** (rubs his temple, trying to piece it together through gestures) Right. The camera. You took pictures. Okay. Maybe if I just... look at the... **(The distinct ringtone of Hunter's work phone blares from his jacket pocket.)** **Hunter:** (holds up a finger to Selvi) Hold that thought. Hunter. ...What? Where? ...On my way. Ten minutes. **(He shoves the phone back in his pocket and turns back to Selvi with an apologetic, yet frustrated look.)** **Hunter:** I have to go. We'll... we'll have to do this another time. With a translator. Don't... leave town. **(He gives her a curt nod and strides quickly out of the cafe, leaving Selvi staring after him, her anxiety now mixed with isolation.)**
created_at"2026-02-16T21:32:11.400639+00:00" 2/16/2026, 9:32:11 PM
model"deepseek/deepseek-chat-v3.1"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency786
moderation_latency(null)
generation_time13449
tokens_prompt332
tokens_completion678
native_tokens_prompt269
native_tokens_completion607
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0011704
router(null)
provider_responses
0
id"df9cb6ce-2e84-45c7-b868-a51a232d510a"
status200
is_byokfalse
latency786
endpoint_id"0c00f0d2-8aad-4700-bd36-11cb9a717fde"
provider_name"Fireworks"
model_permaslug"deepseek/deepseek-chat-v3.1"
api_type"completions"
id"gen-1771277517-R5i7obOMKI8oiKuJpnWd"
upstream_id"df9cb6ce-2e84-45c7-b868-a51a232d510a"
total_cost0.0011704
cache_discount(null)
upstream_inference_cost0
provider_name"Fireworks"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"यह कैसे हुआ? फोटो में कुछ अजीब दिख रहा है... वो आदमी... वो गायब क्यों हो गया?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8827772768259693
mr0.8741285824941906
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? Detective Hunter, Alborn PD. Mind if I ask you a few questions? We're looking into the incident at the orchard last night. I understand you were there taking pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7928420310296191
tl0.6216999356084997
fr0.5649759348389486
no0.5511841100076393
da0.5050547598989048
nl0.5023295213892419
ro0.4810070671378092
it0.47000451059990983
ca0.4695259593679459
de0.4678442028985507
sv0.4425996204933586
sq0.42003948667324775
pt0.41542288557213924
et0.36793975255513717
es0.34830837493067107
cs0.33690744920993226
sl0.30017867778439544
sk0.29471788715486197
pl0.2921686746987952
yo0.2477592829705506
hr0.24291237113402062
hu0.23948220064724918
tr0.19904567143830945
ms0.19465387251542154
is0.19410150891632372
az0.1913282863041982
fi0.1564967695620962
lv0.15528396836808053
lt0.14793328498912253
vi0.10168195718654435
be0.05622489959839357
eu0.05622489959839357
uk0.050888529886914384
reliabletrue
passestrue
2
name"Selvi"
dialogue"माफ़ कीजिए, मैं समझी नहीं... वहाँ बहुत अंधेरा था... मैंने सिर्फ चाँद की तस्वीर लेनी चाही, लेकिन फिर वो आवाज़ आई... और अब वो आदमी गायब है! मुझे真的 डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8746803069053708
mr0.8668188736681888
zh0.07894736842105263
reliabletrue
passestrue
3
name"Hunter"
dialogue"I... sorry, I don't... do you speak English? The orchard? Last night?"
detectedLang"en"
heavyLang"en"
scores
en0.8012160898035547
tl0.6640316205533597
no0.5256696428571429
da0.4606598984771573
yo0.4487678339818417
hr0.4378306878306878
sq0.43633952254641906
cs0.4264507422402159
sv0.4039270687237027
pl0.3876080691642651
pt0.37591776798825255
nl0.35703479576399394
fr0.34815950920245403
de0.34210526315789475
it0.3359375
sk0.32432432432432434
vi0.2904841402337229
ro0.27597955706984667
ms0.2608695652173913
et0.247787610619469
ca0.24511545293072823
sl0.22018348623853207
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
is0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
4
name"Selvi"
dialogue"कैमरा! मैंने देखा! तस्वीर..."
detectedLang"mr"
heavyLang"hi"
scores
mr0.8887990295188031
hi0.8883928571428571
reliabletrue
passestrue
5
name"Hunter"
dialogue"Right. The camera. You took pictures. Okay. Maybe if I just... look at the..."
detectedLang"en"
heavyLang"en"
scores
en0.807610089781958
tl0.6801705756929638
sv0.5596868884540117
no0.5454545454545454
da0.5445344129554657
ca0.5197438633938101
fr0.4827586206896552
ro0.47058823529411764
it0.3775933609958506
yo0.3732590529247911
et0.36886395511921455
nl0.3401759530791789
de0.3263473053892215
sq0.3202416918429003
cs0.2890995260663507
ms0.25
lv0.24496644295302009
hr0.23599320882852293
pl0.21875
es0.18032786885245902
sk0.13793103448275862
be0.1346153846153846
tr0.1346153846153846
hu0.12959381044487428
az0.12280701754385964
is0.12280701754385964
lt0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hold that thought. Hunter. ...What? Where? ...On my way. Ten minutes."
detectedLang"en"
heavyLang"en"
scores
en0.8255813953488372
tl0.5098039215686274
fr0.4827586206896552
pl0.4813278008298755
cs0.471830985915493
sk0.471830985915493
de0.4517543859649123
ca0.44933920704845814
et0.44196428571428575
da0.410377358490566
fi0.3718592964824121
nl0.36655405405405406
sq0.34782608695652173
lt0.2964352720450282
hr0.29245283018867924
no0.27884615384615385
sv0.27184466019417475
sl0.258893280632411
it0.25742574257425743
ro0.25595238095238093
pt0.251497005988024
ms0.23935091277890466
hi0.1830065359477124
yo0.16666666666666666
es0.1515837104072398
tr0.1359447004608295
reliabletrue
passestrue
7
name"Hunter"
dialogue"I have to go. We'll... we'll have to do this another time. With a translator. Don't... leave town."
detectedLang"en"
heavyLang"en"
scores
en0.8148148148148148
tl0.6067415730337079
pl0.5895230648944488
da0.5846518987341772
hr0.569672131147541
cs0.5161290322580645
sk0.5018975332068311
no0.49904580152671757
pt0.4980879541108987
yo0.4868035190615836
sq0.4723618090452261
sl0.4620901639344262
ro0.42622950819672134
ca0.3993135011441648
vi0.38739789964994165
lv0.38016528925619836
sv0.3794326241134752
lt0.37574316290130794
es0.37050359712230213
it0.36594202898550726
ms0.3320610687022901
et0.31906614785992216
hu0.2981283422459893
tr0.2857142857142857
de0.2768595041322314
nl0.27586206896551724
fr0.27285318559556787
az0.2677824267782427
is0.2081447963800905
eu0.20694864048338368
be0.11764705882352942
fi0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue