Run: 2026-02-16-01KHK2RV8NSC8DWY4R1K4FMPVK

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 52s
Cost:
$0.012820
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
47.37% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "(in Hindi) The light was fading. I was trying to capture the leaves turning red." Hunter: "Ma'am, I'm Detective Miller. I need to ask you about the disappearance near the orchard yesterday." Selvi: "(in Hindi) I saw a man. He was not picking apples. He was digging." Hunter: "You're shaking. Did you see something dangerous? Can you nod yes or no?" Selvi: "(in Hindi) Yes! Yes, I saw. He looked at me. He knew I was there." Hunter: "Okay... yes. You saw something. Do you know where he went?" Selvi: "(in Hindi) I have it on the screen. The camera. Look, the license plate is blurred but visible." Hunter: "You're pointing at the camera. You took a picture of him?" Selvi: "(in Hindi) Please, you must listen. He had a shovel. The ground was fresh." Hunter: "I don't speak... whatever language this is. Do you have anyone who can translate?" Selvi: "(in Hindi) No one. I am alone here. You are the only one who can help." Hunter: "Alright, show me the picture. Just... show me the screen." Selvi: "(in Hindi) Here. Look at the background. There is a black truck." Hunter: "I see a truck. Is this the location?" Selvi: "(in Hindi) Yes, near the old barn. Please, he is still there." Hunter: "(Phone rings) Hold on. This is Miller." Selvi: "(in Hindi) Don't leave. I am afraid." Hunter: "I have to take this. Stay put. I'm sending someone back." Selvi: "(in Hindi) Hurry. The shadows are moving again."
created_at"2026-02-16T11:20:25.664457+00:00" 2/16/2026, 11:20:25 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2189
moderation_latency(null)
generation_time111535
tokens_prompt315
tokens_completion3694
native_tokens_prompt300
native_tokens_completion3511
native_tokens_completion_images(null)
native_tokens_reasoning3111
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0128196
router(null)
provider_responses
0
id"chatcmpl-2ea2c7cc-d804-91e0-a847-10792273d276"
status200
is_byokfalse
latency2189
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771240713-HgMnfK3kVnwYv185Ae6E"
upstream_id"chatcmpl-2ea2c7cc-d804-91e0-a847-10792273d276"
total_cost0.0128196
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
47.37% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"The light was fading. I was trying to capture the leaves turning red."
detectedLang"en"
heavyLang"en"
scores
en0.813922942206655
tl0.6851851851851852
da0.6583601286173633
no0.6208742194469223
yo0.569838056680162
hr0.5298672566371682
nl0.5098039215686274
fr0.4946492271105826
sv0.49162679425837325
sq0.44589308996088656
sl0.44371727748691103
sk0.44078947368421056
pl0.4325767690253671
de0.4318181818181818
cs0.4097222222222222
es0.4097222222222222
it0.3795620437956204
is0.3656716417910448
lt0.3511450381679389
ca0.3348982785602504
pt0.33176100628930816
lv0.30327868852459017
ms0.2975206611570248
ro0.2647058823529412
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
et0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
fi0.121900826446281
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Ma'am, I'm Detective Miller. I need to ask you about the disappearance near the orchard yesterday."
detectedLang"en"
heavyLang"en"
scores
en0.78695509668961
tl0.5514147688060732
no0.5425756509500351
fr0.5199409158050221
da0.5105421686746987
nl0.4897959183673469
ca0.4333042720139495
it0.43231441048034935
cs0.4106980961015413
sv0.38679245283018865
de0.38446969696969696
yo0.375
hr0.36954413191076624
sq0.358974358974359
ro0.344758064516129
es0.33469805527123847
et0.3157894736842105
sk0.28806133625410735
pl0.2864983534577387
sl0.2785793562708102
tr0.268018018018018
pt0.2605233219567691
lv0.2215568862275449
ms0.21307506053268765
lt0.20440636474908203
hu0.1935483870967742
az0.18952618453865336
is0.18851435705368288
fi0.10344827586206896
be0.09722222222222222
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
2
name"Selvi"
dialogue"I saw a man. He was not picking apples. He was digging."
detectedLang"en"
heavyLang"en"
scores
en0.8074644549763033
tl0.6632124352331606
nl0.6471226927252987
no0.5967741935483871
sv0.5927318295739349
de0.5838668373879642
ca0.576271186440678
yo0.548611111111111
fr0.5283018867924528
da0.5112781954887218
it0.4984567901234568
es0.4715447154471545
pt0.4698205546492659
hr0.4357638888888889
lv0.4257950530035336
lt0.4237588652482269
ms0.4237588652482269
cs0.4217081850533808
pl0.41546762589928055
ro0.4133574007220217
tr0.40909090909090906
hu0.40693430656934304
is0.39138576779026213
sq0.3879472693032015
sk0.38330170777988615
fi0.32150313152400833
az0.2903930131004367
vi0.2903930131004367
et0.2793791574279379
sl0.21686746987951808
be0.17721518987341772
eu0.17721518987341772
uk0.16237113402061853
reliabletrue
passesfalse
3
name"Hunter"
dialogue"You're shaking. Did you see something dangerous? Can you nod yes or no?"
detectedLang"en"
heavyLang"en"
scores
en0.8127340823970037
tl0.5504495504495505
pt0.3894165535956581
fr0.3353028064992614
es0.32330827067669177
ca0.3202416918429003
no0.2890995260663507
et0.2741935483870968
tr0.2682926829268293
lv0.225473321858864
nl0.1847826086956522
hr0.18330308529945552
sk0.16820702402957485
lt0.16356877323420074
de0.15094339622641512
it0.15094339622641512
cs0.14772727272727273
ms0.14772727272727273
az0.14611005692599618
pl0.14285714285714285
is0.1362763915547025
sv0.1362763915547025
reliabletrue
passestrue
4
name"Selvi"
dialogue"Yes! Yes, I saw. He looked at me. He knew I was there."
detectedLang"en"
heavyLang"en"
scores
en0.8283752860411898
no0.5652173913043478
sq0.5454545454545454
tl0.5161290322580645
da0.511400651465798
de0.49748743718592964
yo0.4791666666666667
ca0.43289224952741023
nl0.42084942084942084
it0.3939393939393939
es0.38271604938271603
ms0.38016528925619836
fi0.3562231759656652
et0.34497816593886466
hr0.31662870159453305
sv0.3150684931506849
pl0.29577464788732394
cs0.25925925925925924
fr0.23273657289002556
ro0.23076923076923078
pt0.22680412371134018
sl0.22680412371134018
sk0.1935483870967742
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
is0.17355371900826447
lt0.17355371900826447
lv0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Okay... yes. You saw something. Do you know where he went?"
detectedLang"en"
heavyLang"en"
scores
en0.8176206509539842
tl0.5199409158050221
pt0.4186046511627907
cs0.39365671641791045
sq0.375
yo0.3564356435643564
ms0.3538767395626242
es0.33264887063655035
pl0.3055555555555556
sk0.28884026258205686
hr0.2696629213483146
sl0.2696629213483146
vi0.2545871559633027
ca0.21875
fi0.21875
de0.1935483870967742
reliabletrue
passestrue
6
name"Selvi"
dialogue"I have it on the screen. The camera. Look, the license plate is blurred but visible."
detectedLang"en"
heavyLang"en"
scores
en0.8026835043409629
tl0.6389891696750902
fr0.6034892942109437
ca0.5843724023275145
nl0.552772808586762
es0.5374653098982424
it0.5327102803738317
no0.5112414467253177
da0.5004995004995005
ro0.49186991869918695
yo0.48186528497409326
hr0.46351931330472107
sq0.4617868675995694
sv0.42857142857142855
et0.40688018979833923
pt0.37421777221526903
sk0.3726474278544542
lv0.3718592964824121
pl0.3498049414824447
cs0.33510638297872336
fi0.31880108991825606
hu0.3065187239944522
ms0.29478138222849076
lt0.2917847025495751
is0.2366412213740458
de0.22118380062305293
tr0.20508744038155804
hi0.14383561643835618
be0.12280701754385964
az0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
sl0.10554561717352416
reliabletrue
passesfalse
7
name"Hunter"
dialogue"You're pointing at the camera. You took a picture of him?"
detectedLang"en"
heavyLang"en"
scores
en0.8204667863554758
tl0.7280761386811693
ro0.5642701525054467
it0.5614035087719298
no0.5540691192865106
fr0.5500562429696289
nl0.5337995337995338
yo0.5061728395061729
da0.5006242197253433
de0.48253557567917205
ms0.4318181818181818
sv0.4310099573257468
hr0.39849624060150374
is0.37402190923317685
ca0.3730407523510972
es0.36608557844690964
sq0.355877616747182
cs0.3442622950819672
pt0.34102141680395387
pl0.32998324958123953
sl0.2982456140350877
lt0.29577464788732394
hu0.2805755395683453
sk0.24528301886792453
tr0.16142557651991615
az0.14893617021276595
eu0.14893617021276595
lv0.14893617021276595
vi0.14893617021276595
et0.13606911447084233
fi0.13606911447084233
reliabletrue
passestrue
8
name"Selvi"
dialogue"Please, you must listen. He had a shovel. The ground was fresh."
detectedLang"en"
heavyLang"en"
scores
en0.8159376353399741
tl0.6225577264653641
nl0.5636550308008214
yo0.49404761904761907
de0.46675031367628605
fr0.46338383838383834
no0.44661458333333337
fi0.44589308996088656
ca0.4348404255319149
da0.4310575635876841
sq0.42411924119241196
sv0.4186046511627907
ro0.41540577716643745
es0.3963068181818182
cs0.3911174785100286
it0.3813682678311499
hu0.35703479576399394
is0.3441358024691358
pt0.32324840764331214
sk0.3078175895765472
eu0.3055555555555556
hr0.3055555555555556
pl0.288107202680067
lv0.2685025817555938
sl0.2595818815331011
tr0.2530755711775044
ms0.24911660777385158
lt0.16173570019723865
az0.1414141414141414
vi0.1414141414141414
et0.1290983606557377
reliabletrue
passesfalse
9
name"Hunter"
dialogue"I don't speak... whatever language this is. Do you have anyone who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8251748251748252
tl0.5647236941710825
da0.47869446962828643
no0.4460500963391137
ro0.435721295387635
hr0.40843621399176955
nl0.40843621399176955
cs0.3947368421052632
yo0.3770314192849404
pl0.37089715536105033
sq0.3596881959910913
pt0.3488108720271801
ca0.33526011560693636
sv0.33139534883720934
sk0.31710213776722085
vi0.31302270011947436
it0.3055555555555556
is0.2936117936117936
fr0.27854454203262236
hu0.2776381909547738
tr0.267515923566879
et0.2580645161290322
az0.2571059431524548
lt0.25130208333333337
sl0.2374005305039788
de0.21124828532235942
ms0.20249653259361997
eu0.20138888888888887
lv0.1843971631205674
es0.11809815950920245
be0.10852713178294573
uk0.0987460815047022
reliabletrue
passestrue
10
name"Selvi"
dialogue"No one. I am alone here. You are the only one who can help."
detectedLang"en"
heavyLang"en"
scores
en0.8393021120293848
tl0.5478036175710594
ro0.513212795549374
pl0.5104895104895105
ca0.5
no0.4905385735080059
hr0.48301329394387
sq0.4712990936555891
it0.44620253164556967
tr0.40170940170940167
da0.38271604938271603
sv0.38162544169611307
lv0.3566176470588235
yo0.3566176470588235
cs0.3433395872420263
sk0.317738791423002
fr0.3069306930693069
az0.2857142857142857
pt0.2827868852459016
es0.2813141683778234
de0.2723492723492723
hi0.19908466819221968
nl0.1935483870967742
ms0.1822429906542056
be0.16666666666666666
hu0.1606714628297362
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Alright, show me the picture. Just... show me the screen."
detectedLang"en"
heavyLang"en"
scores
en0.7962510187449062
tl0.7191011235955056
fr0.5867768595041323
nl0.576271186440678
no0.5726495726495726
sq0.5429616087751371
yo0.50199203187251
et0.44071588366890374
sv0.4186046511627907
es0.414519906323185
sl0.40191387559808617
it0.39903846153846156
pt0.39759036144578314
ms0.39320388349514557
fi0.38875305623471884
da0.37810945273631835
de0.3670886075949367
hr0.25595238095238093
ro0.2378048780487805
ca0.23547400611620795
reliabletrue
passestrue
12
name"Selvi"
dialogue"Here. Look at the background. There is a black truck."
detectedLang"en"
heavyLang"en"
scores
en0.8325145154086646
tl0.67560553633218
de0.5253164556962026
da0.5167525773195877
fr0.48910081743869205
yo0.4798890429958391
sq0.4665718349928876
no0.4596541786743516
nl0.4549418604651163
hu0.45255474452554745
sv0.4028662420382166
ca0.36332767402376914
is0.3081180811808118
ms0.2732558139534884
pt0.27184466019417475
ro0.2704280155642024
cs0.26035502958579887
es0.26035502958579887
sk0.25742574257425743
it0.25
hr0.2299794661190965
pl0.21875
sl0.1935483870967742
lt0.17943107221006563
tr0.17035398230088497
az0.15730337078651685
eu0.15730337078651685
lv0.15730337078651685
vi0.15730337078651685
et0.14383561643835618
fi0.14383561643835618
reliabletrue
passesfalse
13
name"Hunter"
dialogue"I see a truck. Is this the location?"
detectedLang"en"
heavyLang"en"
scores
en0.8386150234741784
tl0.7456059204440333
yo0.6871444823663253
fr0.6776084407971864
nl0.6646341463414634
da0.6469833119383827
sv0.6391076115485563
ca0.6201657458563536
no0.5845921450151057
de0.5833333333333334
hu0.5782208588957055
sq0.5627980922098569
ro0.5506535947712418
it0.5462046204620462
et0.5183887915936953
hr0.47718631178707227
pt0.4701348747591522
cs0.462890625
pl0.45652173913043476
is0.4554455445544555
es0.4510978043912176
tr0.4410569105691057
sk0.4234800838574424
fi0.34523809523809523
lt0.34523809523809523
ms0.33894230769230765
az0.32598039215686275
lv0.32598039215686275
vi0.32598039215686275
sl0.24657534246575344
zh0.21875
be0.20289855072463767
eu0.20289855072463767
uk0.1863905325443787
reliabletrue
passestrue
14
name"Selvi"
dialogue"Yes, near the old barn. Please, he is still there."
detectedLang"en"
heavyLang"en"
scores
en0.8276776246023329
tl0.5383522727272727
yo0.5030581039755352
sv0.5
is0.49139280125195617
nl0.4881889763779528
no0.459234608985025
da0.43771626297577854
de0.4298245614035088
sq0.41546762589928055
hu0.32150313152400833
ro0.23529411764705882
ca0.21875
fi0.21875
es0.20537897310513448
fr0.1935483870967742
ms0.1935483870967742
hr0.1709183673469388
it0.1709183673469388
lt0.1709183673469388
lv0.1709183673469388
reliabletrue
passesfalse
15
name"Hunter"
dialogue"Hold on. This is Miller."
detectedLang"en"
heavyLang"en"
scores
en0.8291571753986333
da0.6822033898305085
fr0.6598639455782312
ca0.6495327102803737
et0.6268656716417911
tl0.620253164556962
hu0.6183206106870229
nl0.6143958868894601
fi0.6
no0.5810055865921787
yo0.5652173913043478
de0.5508982035928144
is0.5454545454545454
tr0.5283018867924528
sv0.45848375451263534
az0.3723849372384937
hr0.3697478991596639
es0.3644067796610169
hi0.358974358974359
pl0.358974358974359
cs0.3333333333333333
sk0.3333333333333333
it0.2890995260663507
reliabletrue
passestrue
16
name"Selvi"
dialogue"Don't leave. I am afraid."
detectedLang"en"
heavyLang"en"
scores
en0.7647058823529411
ro0.5249406175771971
no0.42028985507246375
da0.41002949852507375
hr0.41002949852507375
ca0.40828402366863903
sv0.40828402366863903
sq0.40119760479041916
de0.3957703927492447
pl0.38650306748466257
it0.36507936507936506
cs0.3442622950819672
hi0.30313588850174217
yo0.30313588850174217
tl0.2727272727272727
sk0.2647058823529412
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passesfalse
17
name"Hunter"
dialogue"I have to take this. Stay put. I'm sending someone back."
detectedLang"en"
heavyLang"en"
scores
en0.8228882833787466
da0.6372767857142857
tl0.6264367816091954
no0.5718050065876153
hr0.5390070921985816
sk0.459234608985025
pl0.44539249146757676
cs0.4206773618538324
is0.411231884057971
yo0.4080145719489982
ms0.385633270321361
sl0.37977099236641226
lv0.36274509803921573
pt0.3486973947895792
lt0.3394308943089431
tr0.30406852248394006
ca0.29805615550755943
sv0.29805615550755943
sq0.2919389978213508
it0.26136363636363635
nl0.25799086757990863
ro0.21686746987951808
eu0.21307506053268765
es0.1935483870967742
de0.181360201511335
be0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
et0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
18
name"Selvi"
dialogue"Hurry. The shadows are moving again."
detectedLang"en"
heavyLang"en"
scores
en0.7820401046207498
nl0.6044303797468354
tl0.5210727969348659
no0.4212962962962963
ro0.3718592964824121
eu0.3333333333333333
yo0.299719887955182
es0.2668621700879765
it0.251497005988024
pt0.251497005988024
da0.2378048780487805
de0.2378048780487805
fr0.2378048780487805
ms0.2378048780487805
sq0.2378048780487805
sv0.2378048780487805
tr0.2378048780487805
ca0.23076923076923078
reliabletrue
passesfalse