Run: 2026-02-16-01KHK1XJ896RDSB8P6PRXRVYYF

Run Details

Model:
Qwen 3.5 Plus (2026-02-15)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
17.3s
Cost:
$0.001465
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
46.15% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet** Selvi: "Please, do not disturb. The light on the apple trees... it is perfect right now." Hunter: "Miss, I'm Detective Hunter with the Alborn PD. I'm not here about the photography. I need to ask you a few questions regarding the disappearance of Mr. Henderson near the orchard this morning. Did you happen to see anything unusual?" Selvi: "Kya? Main kuch samajh nahi rahi hoon. Aap mujhse kyun baat kar rahe hain? Mujhe dar lag raha hai, please chhod dijiye." Hunter: "Ma'am, I don't speak... whatever language that is. Is it Hindi? Look, I just need a yes or no. Did you see a man in a blue jacket running toward the woods?" Selvi: "Nahi, nahi! Maine kisi ko nahi dekha. Sirf ped aur suraj. Aap mujhe kyun dara rahe hain? Mera camera gir jayega!" Hunter: "Okay, okay, calm down. No one is going to drop your camera. You're shaking. Are you hurt? Do you need water?" Selvi: "Paani? Nahi... main bas ghar jaana chahti hoon. Yeh jagah mujhe ajeeb lag rahi hai. Sab log mujhe dekh rahe hain." Hunter: "I can't understand a word you're saying, and I don't have a translator on speed dial out here in the middle of nowhere. Look, just point if you saw someone go into the woods. Yes or no?" Selvi: "Maine kaha na, nahi! Koi nahi tha! Bas hawa aur patte. Aap meri baat kyun nahi samajh rahe? Kya main galat hoon?" Hunter: "This is going nowhere. You're upset, I'm confused, and we aren't getting anywhere. Just stay put, alright? Don't leave town yet." Selvi: "Kahan jaaungi main? Main toh bas yahan baithi hoon. Aap jaaiye, please." Hunter: "Hold on." *[Phone rings]* "Hunter here. Yeah? You found the jacket? Near the creek? Alright, I'm on my way. Keep the perimeter tight." *[To Selvi]* "I have to go, Miss. Stay here. I'll send someone who speaks your language later. Don't move." Selvi: "Jaiye... bas mujhe akela chhod dijiye."
created_at"2026-02-16T11:03:57.185914+00:00" 2/16/2026, 11:03:57 AM
model"qwen/qwen3.5-plus-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency799
moderation_latency(null)
generation_time17284
tokens_prompt315
tokens_completion484
native_tokens_prompt302
native_tokens_completion560
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0014648
router(null)
provider_responses
0
id"chatcmpl-174af17a-e744-9851-9920-22efc3b324e6"
status200
is_byokfalse
latency799
endpoint_id"71e0f6c3-7815-4734-92d3-8a04f3b0ca91"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-plus-20260216"
api_type"completions"
id"gen-1771239819-2udHnecelkQ0CEfuBQQu"
upstream_id"chatcmpl-174af17a-e744-9851-9920-22efc3b324e6"
total_cost0.0014648
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
46.15% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Please, do not disturb. The light on the apple trees... it is perfect right now."
detectedLang"en"
heavyLang"en"
scores
en0.8161088635527769
tl0.6392496392496393
fr0.536178107606679
yo0.5145631067961165
nl0.4780793319415449
sq0.4553376906318083
ca0.4110718492343934
ro0.39903846153846156
pt0.3857493857493857
es0.38271604938271603
de0.3718592964824121
sv0.36061381074168797
hr0.3548387096774194
no0.3394980184940555
et0.3368700265251989
it0.32523616734143057
pl0.31224209078404397
da0.30747922437673125
cs0.2937853107344633
sk0.29278642149929274
hu0.23547400611620795
fi0.23076923076923078
tr0.21996879875195008
sl0.1935483870967742
vi0.18166939443535188
is0.15540540540540537
lv0.14675767918088736
hi0.14383561643835618
ms0.13494809688581316
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Miss, I'm Detective Hunter with the Alborn PD. I'm not here about the photography. I need to ask you a few questions regarding the disappearance of Mr. Henderson near the orchard this morning. Did you happen to see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8011720385098368
tl0.604056682411781
fr0.5043478260869565
nl0.48068513119533524
no0.474169741697417
it0.4385342789598109
da0.43675889328063244
sv0.3649732620320856
sq0.3496120492925605
pt0.34603028912345113
ms0.3387470997679814
ca0.3384401114206128
ro0.3338008415147265
de0.331299859221023
yo0.3038593063019052
es0.29629629629629634
cs0.291044776119403
is0.2842792566549473
et0.27480916030534347
hr0.25703858185610007
sk0.24603174603174602
sl0.2191780821917808
pl0.20435510887772196
lt0.18664383561643835
hu0.1819747416762342
tr0.16617905207723815
lv0.1517857142857143
az0.08536585365853659
vi0.08536585365853659
hi0.05126498002663116
be0.04682274247491639
eu0.04682274247491639
fi0.04233870967741936
uk0.04233870967741936
reliabletrue
passestrue
2
name"Selvi"
dialogue"Kya? Main kuch samajh nahi rahi hoon. Aap mujhse kyun baat kar rahe hain? Mujhe dar lag raha hai, please chhod dijiye."
detectedLang"en"
heavyLang"tl"
scores
en0.3427458617332035
eu0.3098159509202454
et0.266304347826087
ro0.2524916943521595
no0.22680412371134018
tl0.22591743119266056
sv0.20400943396226415
vi0.18870192307692307
sl0.18772563176895307
de0.18674698795180722
lt0.15730337078651685
fi0.13350449293966624
is0.13127413127413126
it0.12903225806451613
tr0.12903225806451613
lv0.12564766839378239
es0.12109375000000001
pt0.12109375000000001
fr0.11533420707732633
da0.11300919842312747
nl0.10239361702127658
ms0.09517426273458446
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Ma'am, I don't speak... whatever language that is. Is it Hindi? Look, I just need a yes or no. Did you see a man in a blue jacket running toward the woods?"
detectedLang"en"
heavyLang"en"
scores
en0.8116760828625236
tl0.6743731683490719
sv0.4905756495160468
nl0.48213360952874157
no0.46780202235231505
yo0.423963133640553
da0.421631000578369
et0.4148624926857812
it0.36265137029955385
ro0.3581514762516046
is0.3429697766097241
pl0.3342210386151798
ca0.3270524899057874
lv0.31412894375857336
sq0.3136582017844887
de0.29428369795342274
fr0.29328621908127206
hu0.2737835875090778
hr0.26035502958579887
pt0.25925925925925924
cs0.23954372623574144
ms0.23254029163468917
lt0.23195084485407066
sk0.22660479505027067
es0.21197793538219067
sl0.19614147909967844
tr0.1902834008097166
az0.1783073130649137
eu0.1289198606271777
vi0.11738746690203002
hi0.07235621521335807
be0.06542056074766354
fi0.059266227657572904
uk0.059266227657572904
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi, nahi! Maine kisi ko nahi dekha. Sirf ped aur suraj. Aap mujhe kyun dara rahe hain? Mera camera gir jayega!"
detectedLang"ro"
heavyLang"tl"
scores
ro0.3961352657004831
eu0.39496611810261373
lv0.33226495726495725
tl0.3154435925520263
fr0.3124312431243124
en0.27662037037037035
yo0.26985981308411217
de0.259478672985782
sv0.23029556650246305
lt0.21679197994987467
ms0.20986093552465232
et0.20685279187817257
fi0.20685279187817257
it0.20178799489144317
sl0.1677762982689747
no0.15768194070080863
ca0.14030261348005504
es0.1367403314917127
hr0.1367403314917127
nl0.10841654778887304
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, okay, calm down. No one is going to drop your camera. You're shaking. Are you hurt? Do you need water?"
detectedLang"en"
heavyLang"en"
scores
en0.8028261583963194
tl0.6124031007751938
nl0.471830985915493
pl0.4230769230769231
pt0.42084942084942084
hr0.4140625
no0.3896236012207528
sk0.3717277486910995
cs0.3630573248407643
yo0.3582887700534759
ro0.33774834437086093
lv0.2966002344665885
sl0.286563614744352
sv0.28486293206197855
it0.2840095465393795
ca0.2831541218637993
es0.2822966507177033
de0.27884615384615385
fr0.2665036674816626
da0.24812030075187969
is0.21363040629095675
hu0.20424403183023873
ms0.2
et0.1880920162381597
sq0.16317991631799164
vi0.15611814345991562
lt0.14772727272727273
tr0.12790697674418602
reliabletrue
passestrue
6
name"Selvi"
dialogue"Paani? Nahi... main bas ghar jaana chahti hoon. Yeh jagah mujhe ajeeb lag rahi hai. Sab log mujhe dekh rahe hain."
detectedLang"et"
heavyLang"ber"
scores
et0.4247787610619469
eu0.3179433368310598
fi0.2605233219567691
ms0.23976608187134502
fr0.23529411764705882
sv0.22894424673784108
vi0.19454770755885997
de0.19254658385093168
tl0.1677336747759283
it0.13333333333333333
en0.1321762349799733
no0.13101604278074866
nl0.10591471801925723
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I can't understand a word you're saying, and I don't have a translator on speed dial out here in the middle of nowhere. Look, just point if you saw someone go into the woods. Yes or no?"
detectedLang"en"
heavyLang"en"
scores
en0.8195760036084799
tl0.5814440181374259
da0.4762112614578786
no0.45676776822091447
nl0.44725932749884845
sv0.4336951392166116
pl0.42556247008137865
yo0.3893129770992366
de0.36908517350157727
fr0.35691318327974275
ca0.3548387096774194
sq0.33665008291873966
ro0.33554817275747506
hr0.3197278911564626
cs0.30755914598961337
it0.3063583815028902
sk0.3023255813953488
et0.29494712103407755
pt0.2928697701826753
ms0.2665036674816626
es0.26108374384236455
tr0.2490613266583229
sl0.23273657289002556
lv0.2161985630306989
is0.2005329780146569
az0.18699186991869918
hu0.1567111735769501
vi0.15552427867698804
fi0.15074309978768577
lt0.1501416430594901
eu0.10246821241585638
hi0.06542056074766354
be0.05511811023622047
uk0.0498812351543943
reliabletrue
passestrue
8
name"Selvi"
dialogue"Maine kaha na, nahi! Koi nahi tha! Bas hawa aur patte. Aap meri baat kyun nahi samajh rahe? Kya main galat hoon?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.46428571428571425
fr0.45054945054945056
et0.4269340974212034
ro0.4017946161515453
en0.37629937629937626
de0.358974358974359
fi0.3079584775086505
lv0.30313588850174217
ms0.29161747343565525
sv0.28486293206197855
no0.2490613266583229
sq0.24433249370277077
da0.23175416133162616
it0.22580645161290325
eu0.21568627450980393
sk0.20424403183023873
pl0.20318725099601595
cs0.20212765957446807
sl0.20212765957446807
hr0.2
pt0.18699186991869918
nl0.15611814345991562
is0.1452991452991453
yo0.14285714285714285
lt0.1137370753323486
es0.11242603550295857
ca0.1111111111111111
tr0.1111111111111111
reliablefalse
passesfalse
9
name"Hunter"
dialogue"This is going nowhere. You're upset, I'm confused, and we aren't getting anywhere. Just stay put, alright? Don't leave town yet."
detectedLang"en"
heavyLang"en"
scores
en0.7922960725075529
tl0.45652173913043476
nl0.358974358974359
et0.29906542056074764
yo0.2620751341681575
it0.2506811989100818
hr0.24242424242424243
sv0.23540315106580167
ro0.22752808988764048
de0.2194891201513718
no0.21800947867298578
fr0.1791044776119403
ca0.17664670658682635
pt0.175
is0.16834677419354838
hu0.15730337078651685
fi0.11290322580645161
es0.11194833153928956
pl0.11099137931034482
ms0.09934497816593887
sq0.08637873754152825
da0.08231368186874304
lt0.0802675585284281
reliabletrue
passestrue
10
name"Selvi"
dialogue"Kahan jaaungi main? Main toh bas yahan baithi hoon. Aap jaaiye, please."
detectedLang"tl"
heavyLang"tlh"
scores
tl0.4851994851994852
ms0.4798439531859558
en0.46808510638297873
fr0.3333333333333333
eu0.2857142857142857
ro0.2
fi0.18032786885245902
de0.16317991631799164
reliablefalse
passesfalse
11
name"Hunter"
dialogue"I have to go, Miss. Stay here. I'll send someone who speaks your language later. Don't move."
detectedLang"en"
heavyLang"en"
scores
en0.8150530717272436
tl0.5313773431132844
da0.49825479930191974
pl0.4362745098039216
no0.4318181818181818
yo0.3876464323748669
nl0.33983926521239954
et0.32748538011695905
ro0.3251173708920188
hr0.3072289156626506
de0.29706601466992666
cs0.2909987669543773
sq0.28924598269468477
lt0.2857142857142857
sv0.28035043804755944
sk0.26187419768934533
lv0.24342105263157895
ms0.222972972972973
pt0.2058011049723757
is0.203601108033241
fr0.19692737430167598
ca0.1935483870967742
sl0.1738505747126437
it0.16666666666666666
es0.11944869831546708
eu0.11944869831546708
hi0.11674347158218126
be0.10852713178294573
tr0.10852713178294573
hu0.1043613707165109
az0.0987460815047022
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
12
name"Selvi"
dialogue"Jaiye... bas mujhe akela chhod dijiye."
detectedLang"fr"
heavyLang"tlh"
scores
fr0.289405684754522
ms0.26666666666666666
reliablefalse
passesfalse