Run: 2026-03-11-01KKFFZR4TV958Q6GP0X0FTKEH

Run Details

Model:: Nemotron 3 Nano
Test:: Language Writing
Scenario:: Character dialogue (Hindi) in a story
Duration:: 5.6s
Cost:: $0.000186
Provider:: DeepInfra

Evaluation summary

Score	Evaluator	Details Link
100.00%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Selvi">
Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Hindi, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Hindi, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Selvi and Hunter as a voice sheet:

Selvi: "..."
Hunter: "..."

Model response

Selvi: "अरे... कुछ ठीक नहीं लग रहा है। एक लड़की रात को गायब हो गई थी, और मैं... मैं उसकी फ़ोटो ले रही थी।"
Hunter: "Excuse me? I'm sorry, I didn't catch that. Who is missing?"
Selvi: "वह... वह मेरे साथ कॉलेज से आई थी, फिर वह गाँव के बाहर चली गई, और अब वो गायब है। मुझे नहीं पता कि क्या करूँ।"
Hunter: "I see... I'm trying to understand. Can you tell me exactly when you last saw her?"
Selvi: "कल रात... लगभग दस बजे, כש मैं अपने शटरबग गार्ड पर फोटो ले रही थी, वह गायब हो गई।"
Hunter: "Wait, you said 'shutterbug'? That's... a camera? You were taking pictures?"
Selvi: "हाँ, [...] मैं हमेशा अपनी कैमरा लेती हूँ। वह रात भी वही कर रही थी, फिर अचानक वह not showing up।"
Hunter: "I'm sorry, I'm not familiar with that phrase. Are you saying she simply disappeared?"
Selvi: "हां... ठीक है... वह अचानक गायब हो गई, मैं बहुत डरी हुई हूँ।"
Hunter: "I need to step out for a moment. I'll be back shortly."   (opens his phone, listens briefly)   "Excuse me, I have an urgent call."  
Hunter: "I'll catch up with you later. Take care."   (ends call and exits)

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Parse dialogue

n/a

dialogue

name

"Selvi"

dialogue

"अरे... कुछ ठीक नहीं लग रहा है। एक लड़की रात को गायब हो गई थी, और मैं... मैं उसकी फ़ोटो ले रही थी।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8819362455726092
mr	0.868959868959869

reliable

true

passes

true

name

"Hunter"

dialogue

"Excuse me? I'm sorry, I didn't catch that. Who is missing?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.790356394129979
tl	0.5299647473560517
it	0.5209580838323353
nl	0.5115995115995116
sv	0.4482758620689655
no	0.44367176634214184
is	0.43422913719943423
sq	0.41348973607038125
da	0.41002949852507375
fr	0.38837920489296635
pt	0.3874425727411945
et	0.3579454253611557
hu	0.355877616747182
ca	0.3442622950819672
yo	0.34102141680395387
ms	0.3265993265993266
fi	0.2766726943942134
de	0.2687385740402194
hr	0.25788497217068646
az	0.24242424242424243
pl	0.23954372623574144
cs	0.2079207920792079
es	0.20318725099601595
ro	0.1836734693877551
sl	0.18032786885245902
sk	0.15254237288135594
be	0.14893617021276595
tr	0.14893617021276595
lt	0.13606911447084233
lv	0.13606911447084233
uk	0.13606911447084233
vi	0.13606911447084233

reliable

true

passes

true

name

"Selvi"

dialogue

"वह... वह मेरे साथ कॉलेज से आई थी, फिर वह गाँव के बाहर चली गई, और अब वो गायब है। मुझे नहीं पता कि क्या करूँ।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8829192142578379
mr	0.8741610738255033

reliable

true

passes

true

name

"Hunter"

dialogue

"I see... I'm trying to understand. Can you tell me exactly when you last saw her?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8199393479909022
no	0.6141348497156783
da	0.5836985100788782
tl	0.5118191161356629
et	0.46022727272727276
cs	0.4558991981672394
sv	0.4235436893203884
nl	0.4164619164619165
pl	0.4164619164619165
sk	0.3815104166666667
sq	0.3725231175693527
tr	0.36412315930388217
hr	0.3493150684931507
ro	0.33751743375174337
yo	0.32045779685264664
ca	0.3115942028985507
sl	0.3055555555555556
it	0.291044776119403
de	0.28892215568862273
lv	0.2803030303030303
ms	0.27921092564491656
es	0.27480916030534347
lt	0.2601246105919003
az	0.22764227642276424
is	0.2238562091503268
fr	0.1607773851590106
pt	0.15630550621669628
fi	0.13636363636363635
be	0.12844036697247707
hu	0.12361623616236161
uk	0.1171003717472119
vi	0.1171003717472119

reliable

true

passes

true

name

"Selvi"

dialogue

"कल रात... लगभग दस बजे, כש मैं अपने शटरबग गार्ड पर फोटो ले रही थी, वह गायब हो गई।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8747752376059594
mr	0.8645833333333334

reliable

true

passes

true

name

"Hunter"

dialogue

"Wait, you said 'shutterbug'? That's... a camera? You were taking pictures?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7691123653155464
tl	0.5526838966202784
fr	0.5033112582781457
ro	0.4994438264738598
ca	0.4755244755244755
et	0.43324937027707805
no	0.43037974683544306
nl	0.4155844155844156
de	0.39271255060728744
sv	0.3902439024390244
it	0.3860845839017735
da	0.3697478991596639
sq	0.35064935064935066
es	0.33920704845814975
pl	0.31921331316187596
pt	0.31921331316187596
cs	0.3181818181818182
sk	0.3087557603686636
tr	0.265905383360522
sl	0.26350245499181674
hu	0.25742574257425743
lv	0.2537313432835821
is	0.24496644295302009
fi	0.24114671163575044
ms	0.23076923076923078
yo	0.20913884007029876
hr	0.199288256227758
lt	0.15413533834586465
az	0.1346153846153846
eu	0.1346153846153846
vi	0.1346153846153846

reliable

true

passes

true

name

"Selvi"

dialogue

"हाँ, मैं हमेशा अपनी कैमरा लेती हूँ। वह रात भी वही कर रही थी, फिर अचानक वह not showing up।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8696105702364395
mr	0.8634128574030231
en	0.3966210780370072
tl	0.34554973821989526
nl	0.17218543046357618
tr	0.09420289855072464

reliable

true

passes

true

name

"Hunter"

dialogue

"I'm sorry, I'm not familiar with that phrase. Are you saying she simply disappeared?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7895139686184462
tl	0.5454545454545454
pt	0.4270833333333333
ro	0.42105263157894735
it	0.3792325056433409
es	0.3670886075949367
fr	0.3559718969555035
ca	0.3475682087781732
ms	0.31077694235588976
nl	0.30467762326169406
eu	0.2763157894736842
tr	0.2445054945054945
sq	0.2109038737446198
da	0.20863309352517986
cs	0.12420382165605094
no	0.12420382165605094
lt	0.1185897435897436
sv	0.1143317230273752
de	0.1085899513776337
hr	0.10569105691056911
sl	0.10569105691056911

reliable

true

passes

true

name

"Selvi"

dialogue

"हां... ठीक है... वह अचानक गायब हो गई, मैं बहुत डरी हुई हूँ।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8771355019892347
mr	0.8674911660777385

reliable

true

passes

true

name

"Hunter"

dialogue

"Excuse me, I have an urgent call."

detectedLang

"en"

heavyLang

"en"

scores

en	0.7530186608122942
ro	0.608695652173913
no	0.5802238805970149
ca	0.5714285714285714
da	0.5596868884540117
sq	0.5562130177514794
fr	0.5379876796714579
it	0.46428571428571425
yo	0.44581280788177335
es	0.4444444444444444
vi	0.43324937027707805
ms	0.42159383033419023
nl	0.4140625
et	0.412532637075718
tr	0.38524590163934425
hr	0.3818681318681319
sv	0.38016528925619836
de	0.3626062322946175
pl	0.358974358974359
cs	0.3181818181818182
eu	0.3161094224924012
pt	0.281150159744409
sl	0.281150159744409
fi	0.25
tl	0.25
sk	0.24242424242424243
be	0.23728813559322032
hu	0.22945205479452058
az	0.21875
is	0.21875
lt	0.21875
lv	0.21875
uk	0.21875

reliable

true

passes

true

name

"Hunter"

dialogue

"I'll catch up with you later. Take care."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8042286609240408
tl	0.654696132596685
nl	0.5344506517690875
de	0.4802494802494803
ro	0.4279176201372997
sv	0.414519906323185
fr	0.39320388349514557
da	0.2732558139534884
no	0.2668621700879765
cs	0.2378048780487805
ms	0.2378048780487805
sl	0.2378048780487805
hi	0.2331288343558282
pl	0.2331288343558282
it	0.23076923076923078
pt	0.22118380062305293

reliable

true

passes

true