Run: 2026-02-25-01KJBDNT17YSSPKFEFK9F5KEZQ

Run Details

Model:
Qwen 3.5 35B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
38.3s
Cost:
$0.013289
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
51.85% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "*Kya hua?* (What happened?) *Aap...* (You...) *Yahan kyun?* (Why here?)" Hunter: "Excuse me. Do you understand me? I'm Detective Hunter. Have you seen anything unusual around Alborn lately?" Selvi: "*Main nahi janti.* (I don't know.) *Par... maine kuch dekha.* (But... I saw something.) *Woh... woh gayab ho gayi.* (She... she disappeared.)" Hunter: "Who disappeared? A missing person report?" Selvi: "*Haan.* (Yes.) *Par... main nahi bol sakti English.* (But... I can't speak English.) *Main sirf Hindi bol sakti hoon.* (I can only speak Hindi.)" Hunter: "Okay, okay. I can't understand you, but I can see you're shaken. Are you a witness?" Selvi: "*Haan.* (Yes.) *Maine use kaha.* (I told her.) *Woh... woh jaldi jaane wali thi.* (She... she was leaving soon.) *Aur phir... khatam.* (And then... finished.)" Hunter: "Who is *you* talking about? What happened to her? Can you use hand gestures?" Selvi: "*Camera...* (Camera.) *Maine photo khinchi.* (I took a photo.) *Woh... wahan nahi hai.* (She... isn't there anymore.)" Hunter: "You took a photo of her? Where? Did you get a license plate? A name?" Selvi: "*Nahi.* (No.) *Sirf... photo.* (Just... photo.) *Mujhe dar lag raha hai.* (I'm scared.) *Woh... wapas nahi aayengi.* (They... won't come back.)" Hunter: "I know. I know you're scared. Listen, I need more than that. Do you have a phone? Can you call someone?" Selvi: "*Haan.* (Yes.) *Lekin... main nahi janti.* (But... I don't know.) *Kahan?* (Where?) *Kiske liye?* (For whom?)" Hunter: "Look, I'm the one calling for help. I need you to stay right here. Do you understand *here*?" Selvi: "*Yahan.* (Here.) *Haan.* (Yes.) *Main rahun.* (I will stay.)" Hunter: "Good. Because something isn't adding up. Three people in two weeks. Small town like this..." Selvi: "*Haan. Sab jante hain.* (Yes. Everyone knows.) *Par koi nahi.* (But no one.) *Mujhe dar hai.* (I am scared.)" Hunter: "I hear you. I'm on the case. But I have to move. My phone just rang." Selvi: "*Kya hua?* (What happened?) *Kya main...* (Can I...)" Hunter: "Stay put. Don't move. I'll come back." Selvi: "*Jaldi.* (Quickly.) *Please.*" Hunter: "I will. I promise." Selvi: "*Haan. Please.* (Yes. Please.)" Hunter: "Gotta go. Stay safe." Selvi: "*Bachao.* (Save.)" Hunter: "I'm working on it." Selvi: "*Haan.* (Yes.) *Chalo.* (Go.)"
created_at"2026-02-25T22:10:54.638Z" 2/25/2026, 10:10:54 PM
model"qwen/qwen3.5-35b-a3b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency404
moderation_latency(null)
generation_time37880
tokens_prompt315
tokens_completion6266
native_tokens_prompt300
native_tokens_completion6607
native_tokens_completion_images(null)
native_tokens_reasoning5829
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.013289
router(null)
provider_responses
0
endpoint_id"48c1210f-b7d2-4688-a340-f7424fc99d2b"
id"chatcmpl-c71f581c-d0e4-9acb-bf06-9ce8795eded4"
is_byokfalse
latency404
model_permaslug"qwen/qwen3.5-35b-a3b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772057454-UjKqwvKbQv0PWoXDO6Hk"
upstream_id"chatcmpl-c71f581c-d0e4-9acb-bf06-9ce8795eded4"
total_cost0.013289
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
51.85% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya hua? Aap... Yahan kyun?"
detectedLang"ms"
heavyLang"tl"
scores
ms0.4791666666666667
tl0.46619217081850534
fi0.3697478991596639
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me. Do you understand me? I'm Detective Hunter. Have you seen anything unusual around Alborn lately?"
detectedLang"en"
heavyLang"en"
scores
en0.779986962190352
tl0.4951383694839192
da0.47633824670287045
pt0.45077298616761596
no0.44717444717444715
sq0.4337248322147651
nl0.43324937027707805
de0.3951612903225807
ro0.36320754716981135
cs0.3522072936660269
es0.34593023255813954
fr0.3452958292919496
sv0.3401759530791789
sl0.33102081268582756
it0.31886982845610495
sk0.30698151950718683
ms0.30626927029804724
pl0.3055555555555556
ca0.2614879649890591
et0.2285714285714286
hr0.21693735498839908
fi0.1847826086956522
vi0.1412213740458015
yo0.10358565737051792
hi0.10119840213049268
is0.09879839786381843
tr0.08038147138964578
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main nahi janti. Par... maine kuch dekha. Woh... woh gayab ho gayi."
detectedLang"fr"
heavyLang"de"
scores
fr0.5398773006134969
lv0.4588744588744588
en0.4113029827315541
de0.375
it0.3644067796610169
ro0.36332767402376914
ms0.33035714285714285
sk0.3218806509945751
cs0.31569343065693434
eu0.3055555555555556
et0.3029739776951673
fi0.3029739776951673
tl0.28435114503816794
ca0.24242424242424243
no0.22839506172839508
da0.19871794871794873
sv0.19871794871794873
lt0.19006479481641467
hr0.1515837104072398
sl0.1515837104072398
sq0.1515837104072398
tr0.1515837104072398
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Who disappeared? A missing person report?"
detectedLang"en"
heavyLang"en"
scores
en0.7942386831275721
fr0.6282527881040892
nl0.6231155778894472
tl0.6098829648894668
sv0.6078431372549019
it0.5918367346938775
da0.5844875346260388
ms0.5844875346260388
pt0.5804195804195804
no0.5548961424332344
ca0.5542347696879644
ro0.5488721804511278
is0.546142208774584
de0.5398773006134969
cs0.5176848874598071
es0.5016611295681063
hu0.48805460750853247
sq0.48186528497409326
sk0.45255474452554745
et0.45054945054945056
pl0.4350282485875706
hr0.43396226415094336
eu0.4106090373280943
az0.39271255060728744
lt0.33920704845814975
sl0.33184855233853006
lv0.3258426966292135
tr0.32432432432432434
fi0.3197278911564626
yo0.2840095465393795
vi0.1891891891891892
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan. Par... main nahi bol sakti English. Main sirf Hindi bol sakti hoon."
detectedLang"en"
heavyLang"tl"
scores
en0.4897959183673469
tl0.48899371069182396
sq0.477491961414791
fr0.41651705565529623
da0.336734693877551
eu0.336734693877551
sv0.336734693877551
lv0.3229166666666667
de0.3157894736842105
sk0.3128964059196617
it0.2388758782201405
is0.2316784869976359
et0.2243436754176611
no0.20147420147420148
hi0.1935483870967742
hr0.181360201511335
ms0.181360201511335
ro0.181360201511335
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, okay. I can't understand you, but I can see you're shaken. Are you a witness?"
detectedLang"en"
heavyLang"en"
scores
en0.804204451772465
tl0.5822339489885664
no0.5622119815668203
da0.5527306967984934
sv0.5123203285420944
cs0.4994731296101159
ro0.4870410367170626
nl0.4385342789598109
ca0.42493946731234866
de0.4135802469135802
pl0.39413265306122447
et0.38391699092088194
sk0.37989556135770236
hr0.3457300275482094
it0.3356643356643356
tr0.32045779685264664
hu0.31948424068767906
is0.30858806404657935
az0.3065693430656934
lv0.30453879941434847
sq0.302496328928047
yo0.302496328928047
fr0.3014705882352941
lt0.23387096774193547
pt0.22764227642276424
vi0.21875
es0.21746293245469525
sl0.1592920353982301
be0.12844036697247707
eu0.12844036697247707
fi0.1171003717472119
ms0.1171003717472119
uk0.1171003717472119
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan. Maine use kaha. Woh... woh jaldi jaane wali thi. Aur phir... khatam."
detectedLang"et"
heavyLang"de"
scores
et0.48186528497409326
en0.43422913719943423
ro0.38650306748466257
fr0.34210526315789475
fi0.2895204262877442
vi0.27927927927927926
de0.2687385740402194
eu0.20948616600790515
is0.1902834008097166
lv0.18032786885245902
tl0.17012448132780084
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Who is you talking about? What happened to her? Can you use hand gestures?"
detectedLang"en"
heavyLang"en"
scores
en0.8314407381121361
nl0.519716885743175
tl0.4870410367170626
no0.44509345794392524
fr0.4193154034229829
de0.41430332922318125
ca0.41212871287128716
da0.38551099611901685
yo0.3510928961748634
is0.3384401114206128
sv0.326241134751773
cs0.3055555555555556
lv0.3014705882352941
tr0.2983751846381093
pt0.2543171114599686
hu0.2448330683624801
ro0.23387096774193547
pl0.22131147540983606
sk0.21746293245469525
sl0.2030201342281879
hr0.19627749576988157
lt0.17962003454231434
et0.17102966841186737
it0.1532976827094474
es0.14414414414414414
az0.1394927536231884
reliabletrue
passestrue
8
name"Selvi"
dialogue"Camera... Maine photo khinchi. Woh... wahan nahi hai."
detectedLang"fr"
heavyLang"vi"
scores
fr0.5932415519399249
en0.5578231292517007
it0.5409604519774012
tl0.5269286754002911
ms0.4921875
ro0.48412698412698413
fi0.4357638888888889
de0.4025735294117647
eu0.336734693877551
et0.3340163934426229
vi0.3257261410788381
ca0.2388758782201405
es0.23349056603773585
cs0.21307506053268765
lv0.21307506053268765
sv0.20147420147420148
hi0.19154228855721395
nl0.18952618453865336
reliabletrue
passesfalse
9
name"Hunter"
dialogue"You took a photo of her? Where? Did you get a license plate? A name?"
detectedLang"en"
heavyLang"en"
scores
en0.8186763372620127
fr0.5685005393743258
tl0.550561797752809
no0.5485327313769752
nl0.5067817509247842
de0.4845360824742268
ro0.4838709677419355
cs0.4805194805194805
pt0.47019867549668876
es0.4673768308921438
it0.4609164420485175
ca0.4350282485875706
sq0.41262848751835535
sk0.4117647058823529
da0.39759036144578314
is0.39759036144578314
tr0.394856278366112
hr0.38461538461538464
yo0.3670886075949367
pl0.2907801418439716
hu0.2805755395683453
sl0.27140255009107467
lt0.26062846580406657
sv0.25925925925925924
lv0.24953095684803
et0.23371647509578544
ms0.23371647509578544
hi0.16142557651991615
az0.14893617021276595
eu0.14893617021276595
vi0.14893617021276595
fi0.13606911447084233
reliabletrue
passestrue
10
name"Selvi"
dialogue"Nahi. Sirf... photo. Mujhe dar lag raha hai. Woh... wapas nahi aayengi."
detectedLang"es"
heavyLang"tl"
scores
es0.3397887323943662
pt0.3397887323943662
fr0.336283185840708
en0.3131868131868132
eu0.3055555555555556
vi0.2951127819548872
et0.2732558139534884
is0.258893280632411
ro0.25447316103379725
lt0.251497005988024
it0.21052631578947367
no0.20718816067653278
sv0.19871794871794873
cs0.19006479481641467
de0.17035398230088497
hi0.17035398230088497
nl0.17035398230088497
tl0.17035398230088497
reliablefalse
passesfalse
11
name"Hunter"
dialogue"I know. I know you're scared. Listen, I need more than that. Do you have a phone? Can you call someone?"
detectedLang"en"
heavyLang"en"
scores
en0.820085050703304
da0.5238095238095238
hr0.4878957169459963
cs0.4816211121583412
tl0.4549058473736373
pl0.44500504540867813
pt0.4427558257345492
no0.4167550371155886
sk0.4167550371155886
it0.4130202774813233
sq0.4123931623931624
vi0.4066882416396979
ro0.40217391304347827
sv0.39956331877729256
sl0.3936052921719956
ca0.3895671476137625
de0.3735763097949886
hu0.3552168815943728
tr0.3460166468489893
yo0.3405275779376499
es0.33171324422843257
et0.3251533742331288
fr0.32432432432432434
nl0.32182490752157833
fi0.31335830212234705
lv0.28478543563068925
az0.2763157894736842
is0.2744063324538259
eu0.2537313432835821
lt0.20863309352517986
be0.11290322580645161
ms0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
12
name"Selvi"
dialogue"Haan. Lekin... main nahi janti. Kahan? Kiske liye?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5341614906832298
ms0.5184590690208668
eu0.5098039215686274
fi0.3775933609958506
sk0.3644067796610169
no0.3071593533487298
da0.29906542056074764
it0.2665036674816626
en0.24812030075187969
fr0.22680412371134018
is0.22680412371134018
lt0.22680412371134018
de0.20634920634920634
sv0.20634920634920634
lv0.2
cs0.18256130790190736
hr0.18256130790190736
ro0.18256130790190736
sl0.18256130790190736
sq0.18256130790190736
tr0.18256130790190736
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Look, I'm the one calling for help. I need you to stay right here. Do you understand here?"
detectedLang"en"
heavyLang"en"
scores
en0.8309668695064233
no0.6639784946236559
da0.6589358799454297
tl0.6493688639551192
pl0.5322731524789522
cs0.5150339476236664
sv0.5126705653021443
yo0.491353001017294
hr0.4802494802494803
sq0.4617868675995694
de0.46062567421790723
sk0.4594594594594595
nl0.43117178612059154
pt0.32614555256064687
sl0.32523616734143057
et0.2877492877492877
lv0.27007299270072993
ms0.26144756277695713
vi0.258160237388724
lt0.25037481259370314
ro0.24698795180722888
fr0.2331288343558282
ca0.2163009404388715
is0.21507064364207218
it0.18699186991869918
es0.15824915824915825
be0.12280701754385964
tr0.12280701754385964
hu0.11816578483245149
az0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
14
name"Selvi"
dialogue"Yahan. Haan. Main rahun."
detectedLang"ms"
heavyLang"et"
scores
ms0.6674057649667406
et0.47368421052631576
tl0.46619217081850534
sq0.39999999999999997
en0.39759036144578314
fi0.3697478991596639
fr0.3697478991596639
de0.34210526315789475
reliabletrue
passesfalse
15
name"Hunter"
dialogue"Good. Because something isn't adding up. Three people in two weeks. Small town like this..."
detectedLang"en"
heavyLang"en"
scores
en0.8318385650224215
tl0.6387718242022877
nl0.470432480141218
no0.3939393939393939
ms0.2982456140350877
ro0.28741092636579574
de0.2805755395683453
it0.27184466019417475
da0.21875
pl0.21052631578947367
sl0.20424403183023873
sv0.15134370579915135
yo0.12790697674418602
fr0.12663755458515283
hu0.12663755458515283
az0.12280701754385964
es0.11504424778761062
pt0.11504424778761062
ca0.1137370753323486
is0.10714285714285714
sk0.10714285714285714
reliabletrue
passestrue
16
name"Selvi"
dialogue"Haan. Sab jante hain. Par koi nahi. Mujhe dar hai."
detectedLang"eu"
heavyLang"pt"
scores
eu0.5024875621890548
fr0.45255474452554745
ro0.42528735632183906
it0.42418426103646834
pt0.4186046511627907
es0.4174757281553398
vi0.3435448577680525
lv0.34065934065934067
lt0.29577464788732394
ms0.25925925925925924
tl0.25
da0.2366412213740458
sv0.2366412213740458
sq0.23273657289002556
de0.21052631578947367
no0.19137466307277629
reliablefalse
passesfalse
17
name"Hunter"
dialogue"I hear you. I'm on the case. But I have to move. My phone just rang."
detectedLang"en"
heavyLang"en"
scores
en0.8220640569395018
tl0.6475770925110133
da0.5758218451749735
cs0.5428571428571428
fr0.5370370370370371
pl0.5221027479091995
yo0.5037220843672456
sk0.477124183006536
no0.465954606141522
hr0.4616419919246299
et0.44367176634214184
sv0.4428969359331476
ca0.43977591036414565
sq0.3464052287581699
vi0.3288590604026846
it0.32432432432432434
lv0.3162393162393162
lt0.2945326278659612
ro0.2945326278659612
nl0.2844364937388193
fi0.2727272727272727
sl0.23224568138195778
hi0.17355371900826447
ms0.16317991631799164
de0.15789473684210525
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
is0.13606911447084233
uk0.13606911447084233
reliabletrue
passestrue
18
name"Selvi"
dialogue"Kya hua? Kya main..."
detectedLang"en"
heavyLang"tl"
scores
en0.5689655172413793
fr0.5398773006134969
de0.5098039215686274
reliablefalse
passesfalse
19
name"Hunter"
dialogue"Stay put. Don't move. I'll come back."
detectedLang"en"
heavyLang"en"
scores
en0.8050682261208577
it0.44751381215469616
hr0.38461538461538464
tl0.3333333333333333
reliabletrue
passestrue
20
name"Selvi"
dialogue"Jaldi. Please."
detectedLang"en"
heavyLang"en"
scores
en0.71671388101983
eu0.5145631067961165
ro0.5
tl0.5
is0.4845360824742268
et0.43820224719101125
reliabletrue
passesfalse
21
name"Hunter"
dialogue"I will. I promise."
detectedLang"en"
heavyLang"en"
scores
en0.7938144329896907
cs0.7183098591549296
ro0.7032640949554896
hr0.6894409937888198
tl0.6835443037974683
ca0.6721311475409836
et0.6632996632996633
sq0.658703071672355
pl0.6539792387543253
it0.6453900709219859
de0.6226415094339622
no0.5918367346938775
da0.5815899581589958
sv0.5798319327731093
yo0.46524064171123
pt0.42857142857142855
sk0.4186046511627907
be0.4117647058823529
es0.4117647058823529
sl0.4117647058823529
tr0.4117647058823529
fr0.40119760479041916
hu0.40119760479041916
az0.38650306748466257
is0.38650306748466257
lt0.38650306748466257
lv0.38650306748466257
uk0.38650306748466257
vi0.38650306748466257
ms0.3710691823899371
nl0.3710691823899371
reliabletrue
passestrue
22
name"Selvi"
dialogue"Haan. Please."
detectedLang"en"
heavyLang"en"
scores
en0.7713414634146342
ro0.5714285714285714
tl0.5714285714285714
reliabletrue
passesfalse
23
name"Hunter"
dialogue"Gotta go. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.7113163972286375
it0.6130030959752323
fi0.47257383966244726
hu0.46351931330472107
pl0.46351931330472107
sv0.3811881188118812
tl0.3811881188118812
yo0.3811881188118812
reliabletrue
passestrue
24
name"Selvi"
dialogue"Bachao."
detectedLang""
heavyLang"ga"
scores
reliablefalse
passestrue
25
name"Hunter"
dialogue"I'm working on it."
detectedLang"en"
heavyLang"en"
scores
en0.8389175257731959
tl0.7539370078740157
fr0.5901639344262295
et0.5519713261648745
yo0.5471014492753623
fi0.5454545454545454
nl0.44933920704845814
ca0.44196428571428575
hr0.4131455399061033
lv0.4075829383886255
no0.4075829383886255
sq0.4075829383886255
hi0.40191387559808617
pl0.40191387559808617
de0.3902439024390244
cs0.375
sk0.375
is0.36224489795918363
pt0.36224489795918363
sv0.36224489795918363
reliabletrue
passestrue
26
name"Selvi"
dialogue"Haan. Chalo."
detectedLang"en"
heavyLang"tlh"
scores
en0.6153846153846154
fr0.5714285714285714
reliabletrue
passesfalse