Run: 2026-02-25-01KJBDFBRWM7N0409JEE0005QD

Run Details

Model:
Qwen 3.5 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
32.2s
Cost:
$0.001967
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
47.06% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Maine kuch nahi dekha. Bas camera check kar rahi hoon. (I didn't see anything. Just checking the camera.)" Hunter: "Excuse me. I don't mean to disturb you. I'm Detective Hunter. Did you see anything near that orchard yesterday? The apple field?" Selvi: "The? No... Apple? Main wahan gayi thi. Par (I went there. But...)" Hunter: "You went where? Look, the weather's fine. But we're seeing people vanish in town. Have you seen a red truck? Or a blue one?" Selvi: "Red? Nahi. Blue bhi nahi. (Red? No. Not blue either.) Par... woh... (But... that...) Aankh... (Eyes...) Woh log gayab ho rahe hain. (Those people are disappearing.)" Hunter: "You're saying they disappeared? Ma'am, this is Minnesota. We don't get that kind of thing. I need specific details." Selvi: "Vahan... wahan nahi. (There... not there.) Main dekh gayi. (I saw myself [I saw it].) Darr lag raha hai. (I am scared.)" Hunter: "Okay. You're shaking. You saw what? Just point, or say a name. We're investigating a missing person case right now. It's serious." Selvi: "Serious? Haan. Bhi serious hai. (Serious? Yes. Very serious.) Main camera rakh rahi hoon. (I am keeping the camera down.) Please... (Please...)" Hunter: "I'm listening, but I don't speak— (Phone vibrates in pocket, pulls it out) Yeah? Dispatch. What is it? (Pauses, face hardens) I hear you. I'm on it now." Selvi: "Hunter? (Looks up, confused by the name) Kya hua? (What happened?)" Hunter: (Into phone) I need a patrol car at the Alborn Cafe immediately. (Hangs up, looks at Selvi, then around) We need to talk later. But not now. Selvi: "Wait! Wahan... woh... (Wait! There... that...)" Hunter: "I can't understand you, ma'am. But I'm following protocol. Stay here if you can, or go inside and be safe. I'll be back." Selvi: "Ruk jao! (Wait!) (She grips her camera strap tight, looking terrified.) Woh chali nahi gayi. (She didn't leave.)" Hunter: "Right. Okay. Just... hold up until— (Turns and walks away quickly, checking his gear.)" Selvi: (Alone again, whispering to herself) "Main dekh gayi. (I saw it.) Camera mein hai. (It's in the camera.)"
created_at"2026-02-25T22:07:23.426Z" 2/25/2026, 10:07:23 PM
model"qwen/qwen3.5-flash-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency412
moderation_latency(null)
generation_time32074
tokens_prompt315
tokens_completion4936
native_tokens_prompt300
native_tokens_completion4843
native_tokens_completion_images(null)
native_tokens_reasoning4205
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0019672
router(null)
provider_responses
0
endpoint_id"5f6b71b5-8672-4b27-8b2d-f674429f9e63"
id"chatcmpl-9aec4171-af4f-9a4f-b977-64e7e6680a98"
is_byokfalse
latency412
model_permaslug"qwen/qwen3.5-flash-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772057243-5rZQFE0cfEd0x7Nynumx"
upstream_id"chatcmpl-9aec4171-af4f-9a4f-b977-64e7e6680a98"
total_cost0.0019672
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
47.06% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Maine kuch nahi dekha. Bas camera check kar rahi hoon."
detectedLang"en"
heavyLang"tl"
scores
en0.56575682382134
fr0.5308310991957105
ro0.46564885496183206
tl0.42052980132450335
de0.3848857644991213
ms0.32950191570881227
eu0.32038834951456313
et0.317738791423002
fi0.317738791423002
it0.3110236220472441
sl0.308300395256917
ca0.22566371681415928
tr0.2222222222222222
es0.22048997772828507
lv0.2009132420091324
sv0.1898148148148148
nl0.1784037558685446
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me. I don't mean to disturb you. I'm Detective Hunter. Did you see anything near that orchard yesterday? The apple field?"
detectedLang"en"
heavyLang"en"
scores
en0.7907949790794979
tl0.5827196858124694
no0.4723774053382992
fr0.47073474470734744
nl0.44408109875735774
sq0.44408109875735774
it0.41460055096418735
es0.3795620437956204
sv0.3675595238095238
da0.36424831712789824
ro0.36329588014981273
ca0.34965570007651114
pt0.32486100079428115
de0.31945556445156126
hr0.31396287328490724
cs0.3122977346278317
sl0.2827004219409283
yo0.2802709568162574
et0.2784380305602716
ms0.26022628372497825
pl0.2349234923492349
sk0.1935483870967742
lv0.17874396135265702
lt0.16420845624385447
tr0.1317671092951992
fi0.08108108108108109
be0.07608695652173912
hu0.07306434023991276
az0.06900328587075576
is0.06900328587075576
uk0.06900328587075576
vi0.06900328587075576
reliabletrue
passestrue
2
name"Selvi"
dialogue"The? No... Apple? Main wahan gayi thi. Par"
detectedLang"en"
heavyLang"vi"
scores
en0.6621621621621622
fr0.656121045392022
ms0.5621716287215411
tl0.5575221238938053
es0.536178107606679
lv0.5335820895522388
sv0.494949494949495
de0.4791666666666667
no0.43438914027149317
da0.40617577197149646
it0.3946731234866829
nl0.3872549019607844
vi0.38271604938271603
pt0.3556701030927836
ca0.35064935064935066
yo0.299719887955182
hr0.2877492877492877
sk0.2668621700879765
fi0.26035502958579887
tr0.26035502958579887
sq0.2378048780487805
pl0.23076923076923078
reliabletrue
passesfalse
3
name"Hunter"
dialogue"You went where? Look, the weather's fine. But we're seeing people vanish in town. Have you seen a red truck? Or a blue one?"
detectedLang"en"
heavyLang"en"
scores
en0.821300929235168
tl0.6012759170653907
da0.3744787322768974
de0.3397887323943662
it0.33274021352313166
fr0.32493249324932494
sl0.2984097287184284
yo0.2951127819548872
nl0.29245283018867924
ro0.2725509214354995
pl0.2690058479532163
hr0.267578125
sv0.24849699398797598
no0.24395161290322584
sq0.2331288343558282
es0.22360248447204967
ms0.22360248447204967
ca0.2219917012448133
cs0.21875
hu0.17218543046357618
az0.17035398230088497
pt0.15730337078651685
sk0.14772727272727273
ja0.11764705882352942
lt0.0985576923076923
tr0.09310761789600969
is0.09090909090909091
eu0.08536585365853659
lv0.08536585365853659
vi0.08536585365853659
et0.07749077490774908
fi0.07749077490774908
reliabletrue
passestrue
4
name"Selvi"
dialogue"Red? Nahi. Blue bhi nahi. Par... woh... Aankh... Woh log gayab ho rahe hain."
detectedLang"eu"
heavyLang"de"
scores
eu0.4640122511485452
en0.3333333333333333
tl0.3333333333333333
da0.32432432432432434
lv0.3069306930693069
fr0.29149797570850206
ca0.25531914893617025
nl0.2505353319057816
no0.24078091106290672
sk0.24078091106290672
cs0.2324561403508772
it0.2324561403508772
ms0.23076923076923078
sv0.20993227990970656
es0.1935483870967742
hr0.1764705882352941
sl0.1764705882352941
reliablefalse
passesfalse
5
name"Hunter"
dialogue"You're saying they disappeared? Ma'am, this is Minnesota. We don't get that kind of thing. I need specific details."
detectedLang"en"
heavyLang"en"
scores
en0.7998498874155616
nl0.5313415348564734
tl0.47194719471947194
is0.3640699523052464
no0.32603201347935973
it0.3079584775086505
sv0.3061578490893322
hr0.300087489063867
sq0.29947460595446584
yo0.2857142857142857
ro0.2812219227313567
pl0.27732610659439927
de0.27206551410373064
et0.2694063926940639
da0.25023430178069356
tr0.22405431619786614
fr0.21645445641527913
hu0.21645445641527913
lt0.20318725099601595
ca0.1991991991991992
cs0.18032786885245902
ms0.18032786885245902
lv0.15164369034994699
eu0.14802981895633652
sk0.08256880733944955
be0.08045977011494253
es0.07727797001153403
az0.07300115874855156
uk0.07300115874855156
vi0.07300115874855156
pt0.07084785133565621
sl0.07084785133565621
reliabletrue
passestrue
6
name"Selvi"
dialogue"Vahan... wahan nahi. Main dekh gayi. Darr lag raha hai."
detectedLang"ms"
heavyLang"tl"
scores
ms0.46911196911196906
eu0.375
vi0.36342592592592593
de0.36046511627906974
et0.33894230769230765
tl0.3226600985221675
it0.26666666666666666
en0.2647058823529412
no0.26273458445040215
sv0.25271739130434784
fi0.24242424242424243
fr0.24242424242424243
nl0.21875
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Okay. You're shaking. You saw what? Just point, or say a name. We're investigating a missing person case right now. It's serious."
detectedLang"en"
heavyLang"en"
scores
en0.8080153587712983
tl0.6965098634294385
fr0.5492957746478874
nl0.49874686716791977
de0.49558638083228246
pt0.4936708860759494
da0.49206349206349204
sv0.4897959183673469
no0.48152948801036943
ro0.45909398242055444
it0.44521497919556174
ca0.4240460763138949
ms0.4223826714801444
is0.41605839416058393
cs0.3640699523052464
es0.35275080906148865
hr0.35170178282009723
et0.34318555008210183
sq0.3360995850622407
sk0.3254637436762226
az0.31682322801024765
lt0.2976294995610184
pl0.28507596067917784
hu0.27732610659439927
sl0.2558139534883721
lv0.21182266009852216
tr0.2023928215353938
fi0.2
yo0.19436052366565962
eu0.08045977011494253
vi0.08045977011494253
reliabletrue
passestrue
8
name"Selvi"
dialogue"Serious? Haan. Bhi serious hai. Main camera rakh rahi hoon. Please..."
detectedLang"en"
heavyLang"la"
scores
en0.6520342612419701
it0.5022970903522206
ro0.5022970903522206
tl0.4905956112852664
fr0.40693430656934304
de0.3959107806691449
ca0.34210526315789475
es0.3380855397148676
vi0.3257261410788381
sv0.3143459915611814
ms0.30406852248394006
nl0.2995689655172413
hu0.21307506053268765
no0.17721518987341772
pt0.1709183673469388
sq0.1709183673469388
da0.16237113402061853
pl0.16237113402061853
az0.15364583333333331
cs0.15364583333333331
hr0.15364583333333331
lt0.15364583333333331
sk0.15364583333333331
sl0.15364583333333331
tr0.15364583333333331
reliabletrue
passesfalse
9
name"Hunter"
dialogue"I'm listening, but I don't speak— Yeah? Dispatch. What is it? I hear you. I'm on it now."
detectedLang"en"
heavyLang"en"
scores
en0.8023343373493976
tl0.5793269230769231
fr0.49904580152671757
sv0.44678609062170704
ca0.4450317124735729
it0.44385593220338987
cs0.42622950819672134
yo0.40543601359003395
sq0.40136830102622584
sk0.3993135011441648
nl0.3958573072497123
is0.38953488372093026
da0.38596491228070173
no0.38596491228070173
hr0.3651753325272068
pl0.3453865336658354
ro0.3217054263565891
es0.3155149934810952
hu0.29624664879356566
et0.29245283018867924
fi0.2886178861788618
tr0.2866847826086956
de0.27884615384615385
pt0.2369186046511628
lv0.22106824925816024
hi0.13793103448275862
be0.11764705882352942
az0.10714285714285714
lt0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
sl0.10102739726027396
reliabletrue
passestrue
10
name"Selvi"
dialogue"Hunter? Kya hua?"
detectedLang"en"
heavyLang"tl"
scores
en0.6389891696750902
de0.46808510638297873
da0.45054945054945056
no0.43820224719101125
fr0.4186046511627907
sv0.4117647058823529
tl0.40119760479041916
it0.38650306748466257
nl0.38650306748466257
pt0.38650306748466257
ca0.3710691823899371
ms0.3710691823899371
ro0.3710691823899371
sl0.3710691823899371
sq0.3710691823899371
tr0.3710691823899371
reliabletrue
passesfalse
11
name"Hunter"
dialogue"I need a patrol car at the Alborn Cafe immediately. We need to talk later. But not now."
detectedLang"en"
heavyLang"en"
scores
en0.8015188125647221
tl0.6275906735751295
da0.5802919708029197
no0.5570107858243452
nl0.521630615640599
fr0.5176174496644296
pl0.5155855096882899
ca0.49428320140721194
sk0.49024822695035464
cs0.4753649635036496
ro0.4508118433619866
it0.4465832531280077
hr0.44228903976721634
yo0.4390243902439025
sv0.4244244244244244
et0.41446028513238287
es0.3876464323748669
sq0.37635574837310193
sl0.37431991294885747
de0.36743674367436746
tr0.3568232662192394
lv0.3532058492688414
lt0.35174746335963925
pt0.32273262661955243
ms0.2830423940149626
hu0.27944862155388467
fi0.19692737430167598
is0.1935483870967742
az0.18785310734463279
vi0.18785310734463279
hi0.11674347158218126
be0.10852713178294573
eu0.10852713178294573
uk0.0987460815047022
reliabletrue
passestrue
12
name"Selvi"
dialogue"Wait! Wahan... woh..."
detectedLang"ms"
heavyLang"en"
scores
ms0.7084548104956269
tl0.5670995670995671
en0.5121951219512195
fi0.46808510638297873
reliabletrue
passesfalse
13
name"Hunter"
dialogue"I can't understand you, ma'am. But I'm following protocol. Stay here if you can, or go inside and be safe. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.7981157469717362
tl0.5721620079863091
no0.43524096385542166
da0.43438914027149317
sv0.4038155802861685
yo0.3676222596964587
pl0.3333333333333333
cs0.32432432432432434
ca0.3231046931407942
it0.3218806509945751
nl0.2984097287184284
fr0.29044465468306524
ro0.2890995260663507
sq0.28639391056137015
de0.251497005988024
sk0.24471299093655588
lt0.24395161290322584
pt0.24318869828456105
et0.2323439099283521
hr0.22760041194644695
tr0.21875
az0.20969441517386725
hu0.19700214132762314
es0.1601343784994401
lv0.15730337078651685
is0.1544532130777903
ms0.14772727272727273
sl0.10071942446043164
be0.08536585365853659
eu0.08200734394124846
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
14
name"Selvi"
dialogue"Ruk jao! Woh chali nahi gayi."
detectedLang"eu"
heavyLang"de"
scores
eu0.4852941176470589
en0.4067796610169492
fr0.36363636363636365
az0.308300395256917
cs0.308300395256917
sk0.308300395256917
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Right. Okay. Just... hold up until—"
detectedLang"en"
heavyLang"en"
scores
en0.8035363457760314
tl0.6666666666666666
da0.48186528497409326
ca0.43342776203966005
no0.42857142857142855
et0.33774834437086093
sv0.33774834437086093
nl0.2805755395683453
es0.2753623188405797
pt0.2753623188405797
de0.27007299270072993
fr0.27007299270072993
yo0.27007299270072993
reliabletrue
passestrue
16
name"Selvi"
dialogue"Main dekh gayi. Camera mein hai."
detectedLang"de"
heavyLang"it"
scores
de0.6111111111111112
it0.5958429561200923
en0.5
fr0.48377581120943947
ro0.47447447447447455
vi0.4728915662650602
ca0.36823104693140796
es0.3613138686131387
sv0.31906614785992216
nl0.3027888446215139
ms0.29149797570850206
tl0.29149797570850206
reliabletrue
passesfalse