Run: 2026-02-20-01KHXPKF9CF6FXQXGD1CRQ920C

Run Details

Model:
Mistral Small 3.2 24B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
8.0s
Cost:
$0.000300
Provider:
Mistral

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet: Scene at the Café** **Characters:** - Selvi: A 30-year-old college student from India, fluent in Hindi, no English. - Hunter: A 35-year-old detective investigating disappearances in Alborn, MN. **Setting:** A cozy café in Alborn, MN. The scent of freshly brewed coffee fills the air. Selvi is seated by the window, her camera in her hands, looking at the photos she's taken. Hunter approaches her table. --- **Hunter:** (approaching) Excuse me, miss? Do you mind if I ask you a few questions? **Selvi:** (looking up, startled) (in Hindi) "Haan, kya hai? (Yes, what is it?)" **Hunter:** (confused) Uh, I'm Detective Hunter. I'm investigating some recent events in town. I was wondering if you've seen or noticed anything unusual lately? **Selvi:** (in Hindi, troubled) "Main samajh nahi paa rahi hoon. Aap kya keh rahe hain? (I don't understand. What are you saying?)" **Hunter:** (frustrated) Right, of course. You don't speak English, do you? (pauses, thinking) Let me see if I can find someone who can help translate. **Selvi:** (in Hindi, shaken) "Mujhe lagta hai main kuch galat kar rahi hoon. (I feel like I'm doing something wrong.)" **Hunter:** (reassuring) No, no, you're not doing anything wrong. I just need to ask you some questions about what you might have seen around town. **Selvi:** (in Hindi) "Main sirf photos le rahi thi. Main kuch nahi dekh payi. (I was just taking photos. I didn't see anything.)" **Hunter:** (persistent) Are you sure? Even small details can be helpful. Maybe you saw something that seemed odd or out of place? **Selvi:** (in Hindi, thinking) "Main yahaan aaj hi aayi hoon. Main sirf apple festival dekhna chahti thi. (I just arrived here today. I only wanted to see the apple festival.)" **Hunter:** (nodding) Right, the apple festival. Have you seen anyone acting strangely or anything unusual happening during the festival? **Selvi:** (in Hindi, hesitant) "Main kuch nahi dekh payi. Lekin... (I didn't see anything. But...)" **Hunter:** (leaning in) Yes? **Selvi:** (in Hindi) "Ek ladki thi... usne mujhe ek strange cheez dikhaya. (There was a girl... she showed me something strange.)" **Hunter:** (interested) What was it? Can you describe it? **Selvi:** (in Hindi, struggling to find words) "Main nahi samajh paa rahi hoon. Usne mujhe ek photo dikhaya... lekin main samajh nahi paa rahi hoon kya hai woh. (I don't understand. She showed me a photo... but I don't understand what it is.)" **Hunter:** (frustrated) I wish I could understand you better. Maybe I can take a look at the photo? **Selvi:** (in Hindi) "Haan, main dikha deti hoon. (Yes, I'll show you.)" (She hands him her camera.) **Hunter:** (looking at the photo) Hmm, this is... (his phone rings) Hold on, I need to take this. (answers the phone) Hunter here. (listens) Right, I'll be there in a minute. (hangs up) I'm sorry, I have to go. But thank you for your help. (stands up to leave) **Selvi:** (in Hindi) "Kya ho gaya? (What happened?)" **Hunter:** (apologetic) Duty calls. But if you think of anything else, please let me know. (leaves the café) **Selvi:** (in Hindi, to herself) "Main kya kar sakti hoon? (What can I do?)" --- **End Scene**
created_at"2026-02-20T14:17:33.24Z" 2/20/2026, 2:17:33 PM
model"mistralai/mistral-small-3.2-24b-instruct-2506"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency335
moderation_latency(null)
generation_time7471
tokens_prompt315
tokens_completion845
native_tokens_prompt274
native_tokens_completion907
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0002995
router(null)
provider_responses
0
endpoint_id"23fd6b91-74d8-45fc-ac00-cf141ec7f4a5"
id"af9fa84536b841abace0fbb80d30ebc6"
is_byokfalse
latency335
model_permaslug"mistralai/mistral-small-3.2-24b-instruct-2506"
provider_name"Mistral"
status200
api_type"completions"
id"gen-1771597053-IjIUndfhMFsqjFWkopCI"
upstream_id"af9fa84536b841abace0fbb80d30ebc6"
total_cost0.0002995
cache_discount(null)
upstream_inference_cost0
provider_name"Mistral"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"A 30-year-old college student from India, fluent in Hindi, no English."
detectedLang"en"
heavyLang"en"
scores
en0.7849976110845676
tl0.7290788681517159
it0.6326530612244898
no0.608355091383812
nl0.5967741935483871
ro0.5871559633027523
de0.5531281032770605
fr0.5504495504495505
ca0.5238095238095238
sv0.49324324324324326
yo0.49324324324324326
sq0.4915254237288135
hr0.48335246842709534
pt0.4827586206896552
es0.4803695150115473
sk0.47613504074505236
pl0.4712103407755582
sl0.44581280788177335
ms0.4444444444444444
cs0.42820838627700125
da0.42528735632183906
lv0.4230769230769231
az0.39919893190921224
et0.3885869565217392
tr0.336283185840708
hu0.32330827067669177
lt0.31921331316187596
is0.27768860353130015
eu0.27184466019417475
hi0.14772727272727273
vi0.1346153846153846
fi0.12280701754385964
reliabletrue
passesfalse
1
name"Hunter"
dialogue"A 35-year-old detective investigating disappearances in Alborn, MN."
detectedLang"en"
heavyLang"en"
scores
en0.7722914669223394
tl0.6831220813875917
ro0.639331814730448
fr0.6385083713850837
pt0.6184738955823293
it0.6119281045751633
nl0.5758928571428571
ca0.5638200183654729
es0.5356793743890519
de0.5148110316649642
sv0.48030634573304154
sl0.4791666666666667
ms0.4508670520231214
hr0.44638694638694637
no0.4256348246674728
cs0.4128553770086526
sq0.37335092348284965
da0.3725231175693527
az0.36412315930388217
sk0.3606998654104979
lv0.31059506531204645
is0.309593023255814
lt0.30453879941434847
yo0.3035190615835778
et0.28785607196401797
pl0.2846385542168675
hu0.24722662440570525
fi0.20435510887772196
tr0.1394927536231884
eu0.12844036697247707
vi0.12844036697247707
reliabletrue
passestrue
2
name"Hunter"
dialogue"Excuse me, miss? Do you mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7949699289229087
pt0.5980707395498392
fr0.5972073039742213
it0.5941558441558442
sq0.5567375886524822
cs0.5443499392466585
tl0.5341614906832298
ca0.5259165613147914
pl0.4993324432576769
hr0.4973190348525469
sk0.4710860366713681
hu0.4533527696793003
es0.45255474452554745
et0.4517543859649123
no0.44933920704845814
sv0.44526627218934917
sl0.4427934621099554
yo0.43095599393019723
nl0.4038155802861685
vi0.39418416801292405
ro0.37913907284768217
da0.36006825938566556
ms0.2816091954022989
tr0.2816091954022989
lt0.27884615384615385
fi0.2690058479532163
is0.2690058479532163
az0.2618110236220473
lv0.2618110236220473
be0.15730337078651685
eu0.15730337078651685
de0.1515837104072398
uk0.14383561643835618
reliabletrue
passestrue
3
name"Selvi"
dialogue"Haan, kya hai?"
detectedLang"vi"
heavyLang"tl"
scores
vi0.6767241379310345
it0.5714285714285714
reliabletrue
passesfalse
4
name"Hunter"
dialogue"Uh, I'm Detective Hunter. I'm investigating some recent events in town. I was wondering if you've seen or noticed anything unusual lately?"
detectedLang"en"
heavyLang"en"
scores
en0.7978142076502732
nl0.5905267817618416
tl0.5890715237672146
ro0.5381927109335997
sv0.528061224489796
it0.5082402977139819
fr0.49508733624454143
de0.4849665924276169
pt0.4841048522030117
da0.4656268053148469
ca0.462521789657176
no0.4545990566037736
es0.40629011553273425
ms0.3664383561643836
sk0.3562978427279054
sq0.35269419174247724
hr0.338340486409156
sl0.336441893830703
cs0.32824981844589685
pl0.27734375
lv0.27394034536891676
et0.2430441898527005
az0.22268907563025211
yo0.22072451558550968
lt0.2141036533559898
is0.17850799289520428
fi0.1290018832391714
tr0.1223908918406072
hi0.07592407592407592
be0.07035175879396985
hu0.06754032258064516
uk0.06376518218623482
vi0.06376518218623482
reliabletrue
passestrue
5
name"Selvi"
dialogue"Main samajh nahi paa rahi hoon. Aap kya keh rahe hain?"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5024875621890548
no0.4140625
tl0.3963782696177062
et0.25742574257425743
fi0.25742574257425743
is0.2537313432835821
en0.24812030075187969
lv0.24433249370277077
fr0.22680412371134018
da0.2227979274611399
sv0.21052631578947367
de0.20634920634920634
ms0.19137466307277629
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Right, of course. You don't speak English, do you? Let me see if I can find someone who can help translate."
detectedLang"en"
heavyLang"en"
scores
en0.8212867355043686
tl0.5642349903163332
no0.4803695150115473
sq0.4569589702333065
da0.4375
cs0.41910499139414803
hr0.409965034965035
fr0.3967828418230563
ro0.3807339449541285
pt0.3732590529247911
et0.3644067796610169
sl0.3553008595988539
sv0.35344827586206895
yo0.3427458617332035
pl0.3343195266272189
it0.33035714285714285
de0.3048403707518023
ca0.3005181347150259
nl0.2879746835443038
sk0.2834394904458599
vi0.27961579509071505
es0.2757510729613734
ms0.24157303370786518
tr0.23728813559322032
az0.2276887871853547
is0.1837968561064087
lt0.16149068322981366
lv0.16149068322981366
fi0.09999999999999999
be0.09395973154362416
eu0.09029649595687331
hu0.09029649595687331
uk0.08536585365853659
reliabletrue
passestrue
7
name"Selvi"
dialogue"Mujhe lagta hai main kuch galat kar rahi hoon."
detectedLang"tr"
heavyLang"tlh"
scores
tr0.3684210526315789
tl0.3576017130620985
vi0.3435448577680525
sl0.34210526315789475
ro0.3348115299334811
it0.25
en0.24812030075187969
fr0.22680412371134018
de0.20634920634920634
es0.20212765957446807
lv0.20212765957446807
ms0.20212765957446807
ca0.2
et0.2
sv0.2
reliablefalse
passesfalse
8
name"Hunter"
dialogue"No, no, you're not doing anything wrong. I just need to ask you some questions about what you might have seen around town."
detectedLang"en"
heavyLang"en"
scores
en0.8339760068551844
tl0.5419621749408984
ca0.38831886345698496
da0.37449556093623887
no0.35416666666666663
it0.353628023352794
fr0.3525480367585631
hr0.31476569407603894
pl0.30243024302430244
lv0.2896425297891842
cs0.2883379247015611
pt0.28702851885924563
et0.28174235403151066
yo0.2777260018639329
sk0.2757009345794392
sv0.23645320197044337
tr0.23343224530168152
sq0.2319127849355798
vi0.21875
es0.21558704453441296
lt0.17728237791932058
ms0.17553191489361702
sl0.13504464285714288
ro0.10404624277456648
de0.08716136631330978
be0.08284023668639054
hu0.07957244655581948
az0.07517899761336516
is0.07517899761336516
uk0.07517899761336516
reliabletrue
passestrue
9
name"Selvi"
dialogue"Main sirf photos le rahi thi. Main kuch nahi dekh payi."
detectedLang"fr"
heavyLang"vi"
scores
fr0.6143057503506312
en0.4888475836431227
es0.41983122362869196
eu0.375
vi0.36046511627906974
de0.3514150943396226
it0.34523809523809523
yo0.30730478589420657
sl0.298469387755102
ro0.2930591259640103
hu0.26273458445040215
lt0.22535211267605632
pt0.22535211267605632
hi0.21875
tl0.21875
ca0.20520231213872833
lv0.20520231213872833
nl0.20520231213872833
reliabletrue
passesfalse
10
name"Hunter"
dialogue"Are you sure? Even small details can be helpful. Maybe you saw something that seemed odd or out of place?"
detectedLang"en"
heavyLang"en"
scores
en0.8181083265966046
tl0.5670301475304682
nl0.4115082824760244
no0.34782608695652173
ro0.3440233236151603
fr0.34210526315789475
cs0.24832962138084633
yo0.24832962138084633
de0.24665178571428573
es0.2407199100112486
pt0.23556058890147225
ca0.23469387755102045
ms0.20867526377491208
lt0.20400943396226415
da0.16974169741697415
tr0.16974169741697415
sv0.16149068322981366
hu0.14772727272727273
fi0.12790697674418602
is0.11649214659685864
az0.10239361702127658
pl0.10239361702127658
hr0.08288043478260869
sq0.08288043478260869
reliabletrue
passestrue
11
name"Selvi"
dialogue"Main yahaan aaj hi aayi hoon. Main sirf apple festival dekhna chahti thi."
detectedLang"fr"
heavyLang"tlh"
scores
fr0.49095022624434387
en0.46236559139784944
ca0.45188794153471373
es0.42675159235668786
de0.39999999999999997
it0.3844049247606019
fi0.3835616438356164
tl0.38271604938271603
nl0.3653032440056418
et0.34210526315789475
hr0.3087557603686636
pt0.3087557603686636
sv0.29906542056074764
cs0.293563579277865
da0.293563579277865
no0.293563579277865
sl0.293563579277865
ms0.28457869634340227
vi0.256198347107438
sq0.22413793103448276
lt0.21875
az0.2077464788732394
ro0.2077464788732394
sk0.2077464788732394
hu0.12959381044487428
lv0.12280701754385964
pl0.12280701754385964
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Right, the apple festival. Have you seen anyone acting strangely or anything unusual happening during the festival?"
detectedLang"en"
heavyLang"en"
scores
en0.806149732620321
tl0.6623195156031672
nl0.563515954244431
da0.551638837353123
no0.5390972663699937
fr0.5295262816353017
sv0.5071380013596193
ms0.4757772957339118
de0.46256486286137877
es0.4120032441200324
it0.3728373702422146
pt0.3706597222222222
sq0.33608058608058605
ro0.3330266789328427
hr0.3299445471349353
cs0.32432432432432434
sk0.2967992240543162
ca0.29406037000973706
lt0.28781925343811393
et0.2828882294757666
sl0.275
is0.2579324462640737
yo0.1997792494481236
az0.19623059866962306
pl0.16281755196304848
lv0.15501165501165504
hu0.0845959595959596
fi0.0799492385786802
tr0.07525510204081631
reliabletrue
passestrue
13
name"Selvi"
dialogue"Main kuch nahi dekh payi. Lekin..."
detectedLang"eu"
heavyLang"tl"
scores
eu0.6406570841889117
en0.3613138686131387
fi0.34944237918215615
fr0.3346007604562738
is0.3346007604562738
de0.308300395256917
reliabletrue
passesfalse
14
name"Hunter"
dialogue"Yes?"
detectedLang"en"
heavyLang"ber"
scores
en0.8076923076923077
reliablefalse
passestrue
15
name"Selvi"
dialogue"Ek ladki thi... usne mujhe ek strange cheez dikhaya."
detectedLang"en"
heavyLang"vi"
scores
en0.46546052631578944
nl0.4500846023688663
da0.37619961612284064
no0.36893203883495146
ms0.3564356435643564
de0.344758064516129
tr0.344758064516129
vi0.3229166666666667
fr0.3157894736842105
tl0.2903930131004367
hr0.214975845410628
sk0.21307506053268765
sl0.21307506053268765
cs0.2034313725490196
it0.2034313725490196
pl0.1935483870967742
ro0.1875
sv0.181360201511335
lv0.17721518987341772
is0.1709183673469388
lt0.1709183673469388
az0.15364583333333331
et0.15364583333333331
sq0.15364583333333331
reliablefalse
passesfalse
16
name"Hunter"
dialogue"What was it? Can you describe it?"
detectedLang"en"
heavyLang"en"
scores
en0.8353909465020576
es0.6023856858846919
ca0.4708994708994709
yo0.4490358126721763
tl0.4350282485875706
nl0.40119760479041916
de0.3730407523510972
pt0.33993399339933994
ro0.33993399339933994
lv0.3006993006993007
sq0.3006993006993007
cs0.2805755395683453
az0.2779783393501805
tr0.2779783393501805
fr0.27007299270072993
it0.27007299270072993
reliabletrue
passestrue
17
name"Selvi"
dialogue"Main nahi samajh paa rahi hoon. Usne mujhe ek photo dikhaya... lekin main samajh nahi paa rahi hoon kya hai woh."
detectedLang"eu"
heavyLang"de"
scores
eu0.3842364532019704
fr0.3573264781491003
tl0.3540051679586563
en0.35064935064935066
no0.29775280898876405
fi0.28366762177650434
is0.2753623188405797
ms0.2732558139534884
vi0.2389649923896499
tr0.1830065359477124
et0.17218543046357618
it0.16666666666666666
nl0.16666666666666666
lv0.1624790619765494
cs0.14965986394557826
da0.14675767918088736
sv0.13793103448275862
de0.13494809688581316
hi0.1334488734835355
reliablefalse
passesfalse
18
name"Hunter"
dialogue"I wish I could understand you better. Maybe I can take a look at the photo?"
detectedLang"en"
heavyLang"en"
scores
en0.8248686514886164
no0.6415770609318996
da0.6374184191443075
tl0.6136012364760433
sv0.5421245421245421
fr0.5348837209302325
cs0.49341438703140833
de0.4747899159663866
nl0.4588744588744588
ro0.43630214205186024
ca0.41245593419506466
yo0.3849938499384994
it0.38271604938271603
pl0.38195302843016066
sk0.3678887484197219
sq0.36224489795918363
hr0.3342210386151798
tr0.3093922651933701
hu0.3084370677731674
is0.29775280898876405
az0.29577464788732394
sl0.251497005988024
lt0.2248062015503876
ms0.21996879875195008
pt0.21875
lv0.21011058451816747
vi0.21011058451816747
es0.20886075949367086
et0.20127795527156547
hi0.1334488734835355
be0.12280701754385964
eu0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
19
name"Selvi"
dialogue"Haan, main dikha deti hoon."
detectedLang"sk"
heavyLang"nl"
scores
sk0.4545454545454546
tl0.4117647058823529
en0.39759036144578314
fr0.3697478991596639
de0.34210526315789475
reliablefalse
passesfalse
20
name"Hunter"
dialogue"Hmm, this is... Hold on, I need to take this. Hunter here. Right, I'll be there in a minute. I'm sorry, I have to go. But thank you for your help."
detectedLang"en"
heavyLang"en"
scores
en0.8195329087048833
tl0.6270293988591488
da0.5293466223698782
yo0.5106505469199769
pl0.4533762057877813
no0.451966473243069
de0.4498381877022654
it0.44841012329656066
sl0.4325767690253671
cs0.4121715076071923
hr0.4121715076071923
ro0.409312022237665
et0.39716312056737585
fr0.38091769847050255
nl0.37545922116091107
sq0.37315634218289084
ca0.3722304283604136
hu0.3675595238095238
sk0.36281859070464767
pt0.34715821812596004
sv0.34514637904468415
lt0.3328100470957614
ms0.28209459459459457
fi0.2511013215859031
vi0.24645390070921988
lv0.23076923076923078
is0.21296296296296297
az0.20337394564198688
tr0.19507575757575757
es0.18970448045757865
hi0.08993576017130622
be0.07608695652173912
eu0.07608695652173912
uk0.06900328587075576
reliabletrue
passestrue
21
name"Selvi"
dialogue"Kya ho gaya?"
detectedLang"ca"
heavyLang"tl"
scores
ca0.6153846153846154
tl0.5989304812834225
no0.5967741935483871
sk0.5967741935483871
cs0.5856353591160222
it0.5856353591160222
ms0.5714285714285714
reliabletrue
passesfalse
22
name"Hunter"
dialogue"Duty calls. But if you think of anything else, please let me know."
detectedLang"en"
heavyLang"en"
scores
en0.8204309656823623
tl0.5098039215686274
nl0.40789473684210525
de0.36619718309859156
sq0.3553008595988539
es0.303405572755418
sl0.3001555209953344
cs0.296875
no0.2913385826771654
fr0.28457869634340227
ms0.2647058823529412
yo0.20071047957371224
ro0.1818181818181818
sv0.1818181818181818
et0.17431192660550457
is0.16512059369202228
ca0.16356877323420074
pt0.16356877323420074
it0.15094339622641512
da0.14611005692599618
fi0.14285714285714285
reliabletrue
passestrue
23
name"Selvi"
dialogue"Main kya kar sakti hoon?"
detectedLang"sq"
heavyLang"af"
scores
sq0.5833333333333334
sl0.5098039215686274
tr0.39999999999999997
en0.39759036144578314
fr0.3697478991596639
de0.34210526315789475
reliablefalse
passesfalse