Run: 2026-10-07-01M4AT5GB9EPRVWYA0WJMY1QR2

Run Details

Model:
Mistral Large 4.0 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 32s
Cost:
$0.007875
Provider:
Mistral

Evaluation summary

Score Evaluator
Details Link
47.06% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Haan! Main kal raat wahan thi—Miller Orchard mein! Maine kuch ajeeb dekha!" *(Yes! I was there last night—at Miller Orchard! I saw something strange!)* Hunter: "Ma'am, slow down. I'm Detective Hunter. I'm looking into the disappearances. Were you at the orchard? Did you see someone?" Selvi: "Ek aadmi… woh pedon ke beech chhupa tha. Uski aankhein bahut dar hui thi. Usne mujhe dekha, aur turant bhaag gaya!" *(A man… he was hiding between the trees. His eyes were very scared. He saw me, and immediately ran!)* Hunter: "I'm sorry, I don't—do you speak English? Any English at all?" Selvi: "Nahi! Bilkul nahi! Main Hindi bolti hoon!" *(No! Not at all! I speak Hindi!)* Hunter: "Okay. Okay. Show me. Here—on my phone. Point to where you saw him. Near the apple festival tents?" Selvi: "Apple trees ke paas. Raat ko, lagbhag aath baje. Main photo lena chahti thi, lekin woh cheekha—ek zor se cheekh!" *(Near the apple trees. At night, around eight o'clock. I wanted to take a photo, but he screamed—a loud scream!)* Hunter: "You heard a scream? Was anyone else there? Did you see a car? A truck?" Selvi: "Nahi… sirf woh. Aur phir… woh kho gaya. Jaise zameen ne use nigal liya ho." *(No… only him. And then… he disappeared. Like the ground swallowed him.)* Hunter: "I need your statement. I need your contact information. Can you write down your number?" Selvi: "Main samajh nahi rahi… aap mujhe samajh nahi rahe hain!" *(I don't understand… you don't understand me!)* Hunter: "We'll find a translator. I promise. But I need to know—is he still out there? Is he hurt?" Selvi: "Mujhe dar lag raha hai! Woh aadmi pareshaan tha! Kripya… mujhe madad karo!" *(I'm scared! That man was in distress! Please… help me!)* Hunter: *(phone buzzing)* "I have to go. There's another lead. But I'm leaving my card. You call me tonight, okay? We'll find someone to help us talk." Selvi: "Theek hai. Jaldi aana. Main yahin intezaar karungi." *(Okay. Come quickly. I will wait here.)* Hunter: "Stay safe. Don't go back to the orchard alone. Please." Selvi: "Nahi. Main nahi jaungi. Ab nahi." *(No. I won't go. Not now.)*
created_at"2026-10-07T09:12:30.32Z" 10/7/2026, 9:12:30 AM
model"mistralai/mistral-large-4-0-20261006"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency573
moderation_latency(null)
generation_time91689
tokens_prompt302
tokens_completion3760
native_tokens_prompt276
native_tokens_completion3678
native_tokens_completion_images(null)
native_tokens_reasoning3208
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier"default"
usage0.0078747
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1791364350-m5QGNBfhKchttEvuKUWE"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1791364350-sSa28I41bGeeUoOEVhlv"
upstream_id"fad8e9be9ae7469bb3002c1d2003854a"
provider_responses
0
endpoint_id"19b3b5d7-23f6-4b63-8109-64a6cc37d996"
id"fad8e9be9ae7469bb3002c1d2003854a"
is_byokfalse
latency559
model_permaslug"mistralai/mistral-large-4-0-20261006"
provider_name"Mistral"
status200
total_cost0.0078747
cache_discount(null)
upstream_inference_cost0
provider_name"Mistral"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
47.06% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Haan! Main kal raat wahan thi—Miller Orchard mein! Maine kuch ajeeb dekha!"
detectedLang"de"
heavyLang"vi"
scores
de0.5618081180811808
fr0.5379377431906615
en0.5103092783505154
tl0.43720379146919436
fi0.4069912609238452
no0.37335092348284965
et0.3546195652173913
ms0.3384401114206128
da0.3065693430656934
ca0.27370030581039756
tr0.26127527216174184
nl0.24603174603174602
vi0.24603174603174602
ro0.23633440514469453
sv0.21096345514950168
az0.15780141843971632
hu0.15780141843971632
is0.15630550621669628
lv0.15630550621669628
es0.1532976827094474
it0.11380597014925374
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, slow down. I'm Detective Hunter. I'm looking into the disappearances. Were you at the orchard? Did you see someone?"
detectedLang"en"
heavyLang"en"
scores
en0.7930830623706769
tl0.5697602950215119
fr0.5339547270306259
no0.4479495268138801
pt0.43684633950120677
nl0.42196531791907516
da0.3744414655942806
ca0.35779816513761464
es0.33014354066985646
de0.3184031158714703
it0.3157380254154448
ro0.3076162215628091
sv0.29006085192697767
ms0.25133689839572193
sq0.24731182795698922
et0.19540229885057472
cs0.1764705882352941
sl0.15254237288135594
yo0.1325898389095415
lv0.09560723514211886
is0.0920881971465629
hr0.08735332464146023
tr0.077733860342556
reliabletrue
passestrue
2
name"Selvi"
dialogue"Ek aadmi… woh pedon ke beech chhupa tha. Uski aankhein bahut dar hui thi. Usne mujhe dekha, aur turant bhaag gaya!"
detectedLang"nl"
heavyLang"de"
scores
nl0.33774834437086093
ro0.2753623188405797
ms0.23076923076923078
sq0.2172211350293542
fr0.20159680638722555
en0.18781725888324874
tl0.1861648016276704
de0.18032786885245902
vi0.16230366492146597
lt0.13606911447084233
tr0.12280701754385964
ca0.11991199119911991
az0.11602209944751381
fi0.11602209944751381
cs0.11406423034330011
es0.10414333706606943
pt0.10414333706606943
yo0.0990990990990991
da0.08151549942594719
no0.08151549942594719
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm sorry, I don't—do you speak English? Any English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8117469879518071
tl0.6173469387755102
no0.5525059665871122
da0.507227332457293
hr0.4688385269121813
sq0.4627507163323783
cs0.4573082489146165
it0.4335347432024169
sv0.4292237442922375
ca0.4195046439628483
pl0.41770186335403725
pt0.40570522979397783
sk0.35233160621761656
vi0.3169398907103825
yo0.3055555555555556
ro0.30167597765363136
et0.2870722433460076
de0.2774566473988439
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi! Bilkul nahi! Main Hindi bolti hoon!"
detectedLang"tl"
heavyLang"id"
scores
tl0.5802238805970149
is0.5738636363636364
it0.5022123893805309
eu0.4230769230769231
en0.3055555555555556
et0.29467084639498436
fr0.281150159744409
sq0.27884615384615385
de0.25742574257425743
hi0.25742574257425743
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay. Okay. Show me. Here—on my phone. Point to where you saw him. Near the apple festival tents?"
detectedLang"en"
heavyLang"en"
scores
en0.7985170857511283
tl0.6518105849582173
fr0.6428571428571429
cs0.5101880877742947
nl0.5098039215686274
sq0.49186991869918695
da0.4885433715220949
ms0.4658119658119659
sk0.44982394366197187
no0.43541102077687444
pl0.4271310724106325
pt0.422365988909427
it0.41369606003752346
ca0.4120413922859831
es0.41148775894538603
hr0.39320388349514557
sl0.38785504407443677
de0.375
et0.3724899598393574
yo0.3379237288135593
fi0.3154435925520263
lv0.31091510474090406
sv0.30167597765363136
lt0.2690058479532163
ro0.23218673218673216
vi0.17546174142480211
az0.15881561238223418
hi0.11847672778561354
hu0.09682080924855492
reliabletrue
passestrue
6
name"Selvi"
dialogue"Apple trees ke paas. Raat ko, lagbhag aath baje. Main photo lena chahti thi, lekin woh cheekha—ek zor se cheekh!"
detectedLang"en"
heavyLang"de"
scores
en0.49201741654571846
fr0.44178628389154706
yo0.3918331885317115
cs0.3184031158714703
fi0.3055555555555556
es0.28716904276985744
sv0.27461139896373055
sl0.2693110647181628
eu0.2647058823529412
de0.24731182795698922
tr0.2366412213740458
et0.2324561403508772
tl0.23161361141602635
ca0.21875
it0.20454545454545453
nl0.19908466819221968
vi0.18128654970760233
ms0.16666666666666666
hr0.15966386554621848
lv0.149453219927096
ro0.14634146341463414
pt0.1452991452991453
sq0.13793103448275862
lt0.11949685534591195
da0.11616161616161616
is0.1116751269035533
hi0.0990990990990991
no0.0967741935483871
reliablefalse
passesfalse
7
name"Hunter"
dialogue"You heard a scream? Was anyone else there? Did you see a car? A truck?"
detectedLang"en"
heavyLang"en"
scores
en0.8247422680412372
tl0.6001881467544685
de0.5186862967157418
fr0.36281859070464767
et0.3541033434650456
ca0.3348982785602504
cs0.33070866141732286
yo0.3264659270998415
nl0.32432432432432434
hu0.2685025817555938
sq0.2608695652173913
pt0.247787610619469
ro0.24645390070921988
es0.236983842010772
sk0.23423423423423423
it0.22727272727272727
hr0.2085661080074488
pl0.19811320754716982
sl0.17475728155339806
lt0.16173570019723865
tr0.1533864541832669
is0.15
da0.1448692152917505
az0.1414141414141414
eu0.1414141414141414
lv0.1414141414141414
no0.1414141414141414
vi0.1414141414141414
fi0.1290983606557377
ms0.1290983606557377
sv0.1290983606557377
reliabletrue
passestrue
8
name"Selvi"
dialogue"Nahi… sirf woh. Aur phir… woh kho gaya. Jaise zameen ne use nigal liya ho."
detectedLang"tl"
heavyLang"de"
scores
tl0.4310575635876841
sk0.36472346786248133
sl0.3609022556390977
fr0.34715821812596004
en0.3431221020092735
fi0.3285939968404423
ro0.3275316455696203
it0.3134087237479806
ca0.3111831442463533
cs0.30668841761827076
eu0.2796610169491525
sq0.21150278293135436
hr0.2100371747211896
lt0.20708955223880596
no0.20708955223880596
lv0.19507575757575757
ms0.1904761904761905
nl0.1904761904761905
tr0.18111753371868977
hu0.16173570019723865
et0.1550695825049702
reliablefalse
passesfalse
9
name"Hunter"
dialogue"I need your statement. I need your contact information. Can you write down your number?"
detectedLang"en"
heavyLang"en"
scores
en0.8144531249999999
tl0.685638649900728
fr0.6692200557103064
da0.6230158730158729
sv0.6172441579371474
nl0.5984784446322908
no0.5785270629991127
et0.5705244122965641
it0.5697463768115942
ca0.5589600742804085
ro0.5581395348837209
de0.5544090056285178
sq0.5310957551826259
yo0.5020964360587002
sk0.5015739769150053
cs0.488697524219591
pl0.46509009009009006
hr0.46022727272727276
az0.4521337946943483
ms0.43720379146919436
pt0.43317422434367536
lt0.4290865384615385
es0.4235436893203884
sl0.40846824408468246
hu0.3725231175693527
tr0.3675099866844208
lv0.3606998654104979
is0.23387096774193547
eu0.22003284072249588
fi0.14721723518850988
zh0.1394927536231884
be0.12844036697247707
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
10
name"Selvi"
dialogue"Main samajh nahi rahi… aap mujhe samajh nahi rahe hain!"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5479204339963833
et0.2937853107344633
fi0.2937853107344633
is0.28977272727272724
no0.2857142857142857
en0.28366762177650434
lv0.2795389048991354
tl0.2795389048991354
fr0.26035502958579887
da0.25595238095238093
sv0.24242424242424243
de0.2378048780487805
ms0.22118380062305293
reliablefalse
passesfalse
11
name"Hunter"
dialogue"We'll find a translator. I promise. But I need to know—is he still out there? Is he hurt?"
detectedLang"en"
heavyLang"en"
scores
en0.8030085959885387
tl0.553208773354996
hr0.5382031905961376
da0.5327102803738317
cs0.5119787045252884
pl0.507168458781362
sq0.5067264573991032
yo0.5067264573991032
ro0.4940202391904324
no0.49355432780847147
et0.48550046772684746
ca0.4796594134342479
de0.4786729857819905
nl0.46859903381642515
sv0.4586614173228346
it0.4427558257345492
sl0.4216614090431125
sk0.41921858500527986
lv0.4142705005324814
lt0.41050375133976424
hu0.4066882416396979
is0.40540540540540543
es0.39759036144578314
pt0.39293598233995586
fr0.3902439024390244
ms0.3055555555555556
vi0.28664072632944226
tr0.2763157894736842
az0.25876010781671155
fi0.21875
eu0.19941775836972345
be0.11290322580645161
uk0.10277324632952692
reliabletrue
passestrue
12
name"Selvi"
dialogue"Mujhe dar lag raha hai! Woh aadmi pareshaan tha! Kripya… mujhe madad karo!"
detectedLang"et"
heavyLang"de"
scores
et0.4325346784363178
lt0.42233632862644416
sv0.36886395511921455
sq0.33035714285714285
tl0.31921331316187596
ro0.3001555209953344
fi0.293563579277865
es0.2890995260663507
pt0.27999999999999997
it0.27652733118971057
vi0.25864909390444807
no0.17883211678832117
lv0.16974169741697415
ca0.15413533834586465
de0.14611005692599618
nl0.14611005692599618
en0.13793103448275862
fr0.13793103448275862
reliablefalse
passesfalse
13
name"Hunter"
dialogue"I have to go. There's another lead. But I'm leaving my card. You call me tonight, okay? We'll find someone to help us talk."
detectedLang"en"
heavyLang"en"
scores
en0.8050551223447163
tl0.6494197292069632
da0.4696415508412582
no0.41104792851340366
pl0.38870151770657674
cs0.35555555555555557
yo0.34090909090909094
es0.3287037037037037
sk0.2857142857142857
sq0.28003972194637533
de0.2676767676767676
hr0.2602040816326531
fr0.25869120654396727
pt0.2494824016563147
ca0.22707889125799574
sl0.22376873661670238
it0.21195652173913043
lv0.2032967032967033
nl0.20066152149944874
lt0.18721973094170402
et0.17893544733861835
sv0.15990730011587484
ro0.11042944785276074
ms0.103831891223733
fi0.09375000000000001
be0.0880503144654088
tr0.0880503144654088
hu0.0845959595959596
az0.0799492385786802
is0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
14
name"Selvi"
dialogue"Theek hai. Jaldi aana. Main yahin intezaar karungi."
detectedLang"vi"
heavyLang"is"
scores
vi0.38596491228070173
tl0.37275985663082434
ms0.3613138686131387
en0.358974358974359
it0.358974358974359
eu0.34944237918215615
nl0.3482309124767225
fr0.3371212121212121
de0.3217054263565891
et0.29718875502008035
ro0.21875
es0.21700223713646533
pt0.21700223713646533
is0.21171171171171171
ca0.20993227990970656
lv0.19724770642201836
da0.1935483870967742
hr0.19168591224018475
pl0.1898148148148148
sq0.1898148148148148
no0.18604651162790697
sl0.18604651162790697
sv0.1822429906542056
cs0.18032786885245902
lt0.18032786885245902
sk0.1764705882352941
tr0.17061611374407584
hu0.16666666666666666
az0.1606714628297362
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Stay safe. Don't go back to the orchard alone. Please."
detectedLang"en"
heavyLang"en"
scores
en0.8158863755917939
tl0.6170678336980306
yo0.47839046199701935
pl0.47761194029850745
no0.44356120826709056
fr0.396551724137931
da0.34210526315789475
nl0.31237721021611
sk0.2738589211618257
cs0.2723492723492723
lv0.2584745762711864
sl0.25690021231422505
hr0.24892703862660948
lt0.2290748898678414
ro0.2222222222222222
it0.19908466819221968
ms0.1822429906542056
sq0.1822429906542056
sv0.1822429906542056
de0.1764705882352941
reliabletrue
passestrue
16
name"Selvi"
dialogue"Nahi. Main nahi jaungi. Ab nahi."
detectedLang"de"
heavyLang"tl"
scores
de0.5993589743589743
eu0.5689655172413793
lv0.5659722222222222
lt0.5300751879699248
ms0.51171875
en0.44196428571428575
fr0.4131455399061033
sv0.3842364532019704
tr0.3842364532019704
reliabletrue
passesfalse