Run: 2026-02-16-01KHK12X8NK580MPFXGS8JFMSG

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 56s
Cost:
$0.015448
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
53.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "(In Hindi) Ye tasveer... maine kal yahin li thi. Kuch galat tha. (This photo... I took it right here yesterday. Something was wrong.)" Hunter: "Excuse me, miss. I'm Detective Hunter. I need to ask you about yesterday. Did you see anyone near the orchard?" Selvi: "(In Hindi) Main angrezi nahi bolti. Mujhe dar lag raha hai. Wahan ek aadmi tha. (I do not speak English. I am scared. There was a man there.)" Hunter: "I don't understand. Do you speak English? Spanish? Anything?" Selvi: "(In Hindi) Nahi. Sirf Hindi. Dekhiye, meri camera mein sab hai. (No. Only Hindi. Look, everything is in my camera.)" Hunter: "Camera? You have pictures of the suspect?" Selvi: "(In Hindi) Suspect? Mujhe nahi pata. Main bas photogrophy karti hoon. Par usne kuch kiya. (Suspect? I don't know. I only do photography. But he did something.)" Hunter: "Look, I need to understand you. People are missing in this town. If you have information, you need to tell me." Selvi: "(In Hindi) Main bataana chahti hoon. Par aap samajh nahi rahe. Mujhe jaana hai. (I want to tell you. But you are not understanding. I need to go.)" Hunter: "Wait, don't leave. We can find a translator. Just stay put." Selvi: "(In Hindi) Nahi. Yahan safe nahi hai. (No. It is not safe here.)" Hunter: "(Phone rings) Hold on. (Into phone) Hunter. Yeah? I'm on my way." Hunter: "I have to go. Stay in town. I'll find you later." Selvi: "(In Hindi) Kripya... madad karo. (Please... help.)" Hunter: "I'll be in touch."
created_at"2026-02-16T10:51:03.144742+00:00" 2/16/2026, 10:51:03 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency861
moderation_latency(null)
generation_time116038
tokens_prompt315
tokens_completion4344
native_tokens_prompt300
native_tokens_completion4241
native_tokens_completion_images(null)
native_tokens_reasoning3778
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0154476
router(null)
provider_responses
0
id"chatcmpl-50936bf7-69ec-9190-91e0-5f0e3cd2781c"
status200
is_byokfalse
latency861
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771238946-lEKLq5tkNm4H6hOmXv04"
upstream_id"chatcmpl-50936bf7-69ec-9190-91e0-5f0e3cd2781c"
total_cost0.0154476
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
53.33% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Ye tasveer... maine kal yahin li thi. Kuch galat tha."
detectedLang"tl"
heavyLang"vi"
scores
tl0.5205479452054795
ro0.515235457063712
et0.40476190476190477
fr0.37275985663082434
ca0.34701492537313433
tr0.3333333333333333
lv0.31906614785992216
en0.317738791423002
fi0.317738791423002
vi0.3069306930693069
de0.29577464788732394
yo0.2631578947368421
nl0.2505353319057816
sq0.2505353319057816
hr0.22394678492239467
cs0.19168591224018475
it0.19168591224018475
es0.1784037558685446
ms0.1784037558685446
sv0.1764705882352941
lt0.17452830188679244
pl0.17452830188679244
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I need to ask you about yesterday. Did you see anyone near the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.800228310502283
tl0.5770392749244713
no0.4901675163874727
nl0.4295028524857376
sq0.42244224422442245
fr0.4210090984284532
da0.4102780117944398
et0.4001713796058268
it0.381078691423519
ro0.3642143505903724
cs0.3554327808471455
ca0.35004642525533886
sv0.33523266856600187
sl0.32367149758454106
yo0.3210475266731329
hr0.3150684931506849
pt0.3143976493633692
es0.2857142857142857
pl0.27159209157127995
de0.2608236536430834
ms0.23995656894679696
sk0.22566371681415928
lv0.20903954802259886
lt0.19261822376009227
tr0.15560916767189384
fi0.0967741935483871
be0.09090909090909091
hu0.08735332464146023
az0.08256880733944955
is0.08256880733944955
uk0.08256880733944955
vi0.08256880733944955
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main angrezi nahi bolti. Mujhe dar lag raha hai. Wahan ek aadmi tha."
detectedLang"ms"
heavyLang"tl"
scores
ms0.35064935064935066
de0.34114202049780384
ro0.34114202049780384
it0.3333333333333333
is0.31297709923664124
no0.29906542056074764
nl0.2822966507177033
eu0.2682926829268293
vi0.25864909390444807
et0.23857868020304565
tl0.225473321858864
lt0.21875
sq0.20634920634920634
tr0.199288256227758
en0.18032786885245902
es0.1712707182320442
pt0.1712707182320442
sv0.1712707182320442
da0.16356877323420074
fi0.16356877323420074
fr0.16356877323420074
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I don't understand. Do you speak English? Spanish? Anything?"
detectedLang"en"
heavyLang"en"
scores
en0.8105216228265716
no0.586977648202138
da0.5783730158730159
sv0.541036717062635
sq0.5035046728971962
tl0.495249406175772
cs0.48484848484848486
de0.452319587628866
pl0.44948186528497414
hr0.4378306878306878
ro0.4264507422402159
sk0.40807799442896936
nl0.37774524158125916
vi0.2904841402337229
yo0.2796610169491525
pt0.2685025817555938
ms0.2608695652173913
ca0.24511545293072823
hu0.24511545293072823
is0.24377224199288253
sl0.22018348623853207
it0.21296296296296297
be0.1414141414141414
tr0.1414141414141414
az0.1290983606557377
et0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
4
name"Selvi"
dialogue"Nahi. Sirf Hindi. Dekhiye, meri camera mein sab hai."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5607613469985359
it0.5454545454545454
et0.39879759519038077
de0.3963782696177062
eu0.3548387096774194
ro0.34497816593886466
vi0.3435448577680525
ca0.2537313432835821
es0.24812030075187969
is0.24623115577889448
sq0.2248062015503876
sv0.21465968586387435
hi0.20634920634920634
en0.20212765957446807
fr0.20212765957446807
nl0.20212765957446807
ms0.1935483870967742
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Camera? You have pictures of the suspect?"
detectedLang"en"
heavyLang"en"
scores
en0.8104755341144039
tl0.6961325966850828
fr0.6428571428571429
ro0.6333333333333333
nl0.6126760563380281
ca0.555735056542811
da0.5192307692307693
no0.4869402985074627
sv0.4575936883629191
de0.45219123505976094
ms0.44668008048289737
yo0.4444444444444444
es0.3834080717488789
it0.3648960739030023
et0.26273458445040215
is0.2445054945054945
pt0.24242424242424243
lv0.23184357541899442
cs0.22096317280453256
sq0.22096317280453256
reliabletrue
passestrue
6
name"Selvi"
dialogue"Suspect? Mujhe nahi pata. Main bas photogrophy karti hoon. Par usne kuch kiya."
detectedLang"fr"
heavyLang"tl"
scores
fr0.6486686390532543
en0.5419479267116682
ms0.3528610354223433
ro0.3300423131170663
eu0.32814710042432815
da0.3252840909090909
sv0.31752873563218387
lv0.31457431457431456
tl0.27811550151975684
lt0.25196850393700787
de0.22889610389610393
tr0.22258592471358432
et0.2122719734660033
no0.2122719734660033
sq0.2122719734660033
pt0.15630550621669628
hi0.1394927536231884
it0.1394927536231884
nl0.1394927536231884
ca0.1316270566727605
es0.1316270566727605
az0.11048689138576778
cs0.11048689138576778
fi0.11048689138576778
hr0.11048689138576778
pl0.11048689138576778
sk0.11048689138576778
sl0.11048689138576778
reliabletrue
passesfalse
7
name"Hunter"
dialogue"Look, I need to understand you. People are missing in this town. If you have information, you need to tell me."
detectedLang"en"
heavyLang"en"
scores
en0.8335183129855716
da0.6632996632996633
tl0.6354799513973268
sv0.6235884567126726
no0.6073298429319371
nl0.5959595959595959
de0.5645863570391872
ro0.4991652754590985
pl0.4915254237288135
fr0.4889267461669506
it0.47689625108979944
cs0.47506561679790027
sl0.4510521500457456
et0.44649446494464945
yo0.44598337950138506
sq0.44547134935304994
sk0.4186046511627907
hr0.3969849246231156
ca0.3730407523510972
az0.3603411513859275
ms0.3562231759656652
lv0.35275080906148865
pt0.3442622950819672
lt0.3435448577680525
is0.3250843644544432
es0.2998833138856476
fi0.281437125748503
tr0.1891891891891892
eu0.18256130790190736
hu0.1780821917808219
zh0.1137370753323486
be0.1044776119402985
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
8
name"Selvi"
dialogue"Main bataana chahti hoon. Par aap samajh nahi rahe. Mujhe jaana hai."
detectedLang"et"
heavyLang"tlh"
scores
et0.464524765729585
fi0.4542974079126876
fr0.4318181818181818
eu0.3911719939117199
lv0.38650306748466257
tl0.33444259567387685
da0.30915371329879104
sv0.3019197207678883
vi0.28186714542190305
ms0.26335174953959484
is0.20318725099601595
it0.2
no0.2
en0.19839679358717435
de0.16317991631799164
ca0.15254237288135594
es0.15254237288135594
pt0.15254237288135594
ro0.15254237288135594
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Wait, don't leave. We can find a translator. Just stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8168050806057645
ca0.49324324324324326
hr0.49048913043478265
pl0.4791666666666667
nl0.46808510638297873
ro0.4444444444444444
da0.44113263785394935
et0.4318181818181818
sv0.4318181818181818
pt0.42835365853658536
sq0.3686868686868687
tr0.36655405405405406
sl0.358974358974359
es0.3578767123287671
az0.35456110154905335
tl0.35008665511265163
de0.34895833333333337
fr0.3444055944055944
no0.3409490333919156
sk0.3397887323943662
cs0.33745583038869253
it0.3339253996447602
ms0.32795698924731176
vi0.2964352720450282
hu0.2937853107344633
lt0.28435114503816794
eu0.267578125
lv0.267578125
yo0.24089068825910928
is0.16666666666666666
fi0.14383561643835618
reliabletrue
passestrue
10
name"Selvi"
dialogue"Nahi. Yahan safe nahi hai."
detectedLang"eu"
heavyLang"tl"
scores
eu0.5689655172413793
vi0.5567375886524822
ms0.5247148288973384
tl0.51171875
en0.45652173913043476
it0.4444444444444444
fi0.4131455399061033
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Hold on. Hunter. Yeah? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7929606625258799
tl0.531615925058548
da0.49238578680203043
fr0.47506561679790027
pl0.46808510638297873
cs0.44598337950138506
sk0.44598337950138506
ca0.441340782122905
et0.4350282485875706
fi0.42857142857142855
de0.3055555555555556
hr0.3055555555555556
hi0.29577464788732394
no0.2805755395683453
yo0.2727272727272727
sv0.25925925925925924
it0.23954372623574144
nl0.23954372623574144
pt0.23954372623574144
ms0.2277992277992278
ro0.2277992277992278
sl0.2277992277992278
sq0.2277992277992278
tr0.2277992277992278
reliabletrue
passestrue
12
name"Hunter"
dialogue"I have to go. Stay in town. I'll find you later."
detectedLang"en"
heavyLang"en"
scores
en0.8198198198198198
da0.660633484162896
pl0.6381182147165259
tl0.6163682864450128
yo0.5645863570391872
nl0.5488721804511278
no0.5348837209302325
sv0.5245641838351823
cs0.511400651465798
de0.5024875621890548
sl0.47826086956521735
it0.46619217081850534
hr0.4594594594594595
ro0.4360902255639098
sk0.40476190476190477
lv0.3814432989690722
lt0.3576017130620985
az0.3288590604026846
ca0.3150684931506849
sq0.3087557603686636
hi0.20212765957446807
ms0.2
fr0.19137466307277629
pt0.19137466307277629
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
et0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
13
name"Selvi"
dialogue"Kripya... madad karo."
detectedLang"tl"
heavyLang"hu"
scores
tl0.5155038759689923
et0.47257383966244726
lt0.45652173913043476
sq0.45652173913043476
sv0.45652173913043476
reliablefalse
passesfalse
14
name"Hunter"
dialogue"I'll be in touch."
detectedLang"en"
heavyLang"en"
scores
en0.8015873015873016
yo0.6130030959752323
nl0.5551601423487544
sl0.5519713261648745
de0.5404411764705882
it0.5404411764705882
ro0.5318352059925093
hu0.4834710743801653
fr0.47257383966244726
lt0.47257383966244726
sv0.46120689655172414
tl0.42660550458715596
az0.40191387559808617
pl0.40191387559808617
ms0.375
reliabletrue
passestrue