Run: 2026-02-16-01KHK29R5SJ6PXC270HYBWQ4V7

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
2m 7s
Cost:
$0.015966
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Posso aiutarla? (Can I help you?)" Hunter: "Excuse me, miss. I'm Detective Hunter with the Alborn PD." Isabella: "Mi dispiace, non parlo inglese. (I'm sorry, I don't speak English.)" Hunter: "Do you speak English? Any at all?" Isabella: "No, solo italiano. Sono qui per studio. (No, only Italian. I am here for study.)" Hunter: "Alright. I need to ask you about something you might have seen near the orchard yesterday. During the festival setup." Isabella: "Orchard? Ho solo scattato foto ai paesaggi. (Orchard? I only took photos of the landscapes.)" Hunter: "Photos? You have a camera. Did you photograph the area around the old barn?" Isabella: "Sì, ma... ho visto qualcosa che non va. (Yes, but... I saw something that is not right.)" Hunter: "What did you see? Can you show me?" Isabella: "Era un uomo. Trascinava qualcosa.ERO molto spaventata. (It was a man. He was dragging something. I was very scared.)" Hunter: "I don't understand what you're saying. You need to use words I know." Isabella: "Non capisce. È pericoloso. (He doesn't understand. It is dangerous.)" Hunter: "Look, I'm trying to find a missing person. If you have information, I need it now." Isabella: "Mi scusi. Non posso parlare qui. (I'm sorry. I cannot speak here.)" Hunter: "Why not? Is someone threatening you?" Isabella: "No. Troppa gente. Ho paura. (No. Too many people. I am afraid.)" Hunter: "Damn it. I can't help you if you won't talk to me." Isabella: "Lo so. Mi dispiace. (I know. I'm sorry.)" Hunter: "Hold on." Hunter: "This is Hunter. Yeah? I'm on my way." Hunter: "I have to go. But we aren't done here." Isabella: "Addio. (Goodbye.)"
created_at"2026-02-16T11:12:26.476958+00:00" 2/16/2026, 11:12:26 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency825
moderation_latency(null)
generation_time127213
tokens_prompt321
tokens_completion4619
native_tokens_prompt300
native_tokens_completion4385
native_tokens_completion_images(null)
native_tokens_reasoning3884
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.015966
router(null)
provider_responses
0
id"chatcmpl-194f735a-ff71-9062-8053-89318d4803eb"
status200
is_byokfalse
latency825
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771240218-G2Nvs11HPWRfH4uqdEmu"
upstream_id"chatcmpl-194f735a-ff71-9062-8053-89318d4803eb"
total_cost0.015966
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Posso aiutarla?"
detectedLang"it"
heavyLang"it"
scores
it0.8106060606060606
pt0.6612466124661246
tr0.5901639344262295
ca0.5791245791245792
es0.5614035087719298
az0.44933920704845814
en0.4444444444444444
fr0.4444444444444444
is0.3961352657004831
cs0.3654822335025381
tl0.3654822335025381
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter with the Alborn PD."
detectedLang"en"
heavyLang"en"
scores
en0.7473045822102427
tl0.60609243697479
fr0.5364647713226205
it0.5330012453300125
ro0.5229007633587787
sq0.50199203187251
no0.47844228094575797
pt0.46120689655172414
nl0.4549418604651163
ms0.44362017804154297
es0.42748091603053434
da0.39418416801292405
ca0.3892508143322475
sv0.3644067796610169
sl0.36332767402376914
de0.31444241316270566
yo0.2219917012448133
et0.20212765957446807
fi0.16666666666666666
cs0.1610738255033557
hr0.1515837104072398
tr0.1359447004608295
reliabletrue
passestrue
2
name"Isabella"
dialogue"Mi dispiace, non parlo inglese."
detectedLang"it"
heavyLang"it"
scores
it0.7851002865329513
es0.6616541353383458
fr0.6038732394366197
sk0.5879120879120879
ro0.5273109243697479
pt0.5161290322580645
en0.5140388768898488
ca0.5108695652173912
cs0.4874715261958998
yo0.4803695150115473
sl0.40789473684210525
hu0.40318302387267907
pl0.39189189189189183
hr0.38524590163934425
et0.3835616438356164
de0.3697478991596639
tr0.3679775280898876
sq0.3626062322946175
eu0.27884615384615385
az0.23728813559322032
lt0.21875
ms0.21875
nl0.21875
da0.2077464788732394
lv0.2077464788732394
no0.2077464788732394
sv0.2077464788732394
reliabletrue
passestrue
3
name"Hunter"
dialogue"Do you speak English? Any at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8271889400921658
tl0.6564885496183207
no0.5856353591160222
da0.5233050847457626
cs0.48394495412844035
hr0.460431654676259
sq0.45652173913043476
pt0.4094488188976378
de0.3902439024390244
sv0.3902439024390244
pl0.3885869565217392
ca0.3715083798882682
sk0.3697478991596639
sl0.34782608695652173
vi0.33035714285714285
et0.281150159744409
yo0.25742574257425743
it0.24242424242424243
ms0.24242424242424243
ro0.24242424242424243
reliabletrue
passestrue
4
name"Isabella"
dialogue"No, solo italiano. Sono qui per studio."
detectedLang"it"
heavyLang"it"
scores
it0.8185776487663279
es0.6987951807228916
ca0.6537396121883656
en0.6200607902735562
pt0.5934959349593496
fr0.5784148397976391
sq0.5711835334476844
no0.5551601423487544
hr0.552772808586762
nl0.5421245421245421
tl0.5335820895522388
de0.5327102803738317
lt0.500998003992016
sv0.46808510638297873
pl0.4646680942184154
lv0.44567627494456763
sk0.375
tr0.37027707808564225
ro0.3540051679586563
cs0.34895833333333337
sl0.3403693931398417
da0.32795698924731176
yo0.21875
az0.19093851132686085
fi0.19093851132686085
ms0.19093851132686085
reliabletrue
passestrue
5
name"Hunter"
dialogue"Alright. I need to ask you about something you might have seen near the orchard yesterday. During the festival setup."
detectedLang"en"
heavyLang"en"
scores
en0.7983310152990264
tl0.5592705167173252
da0.5396825396825397
no0.5261437908496731
nl0.45324283559577677
cs0.4086460032626427
hr0.3861134631668078
sv0.38192668371696503
ms0.3706597222222222
fr0.358974358974359
yo0.3584070796460177
lt0.35152057245080504
ca0.3217960710944809
sq0.32052483598875353
et0.30886558627264066
pl0.30886558627264066
sk0.30754536771728747
it0.3015414258188825
sl0.29816069699903197
de0.2933723196881091
pt0.2778884462151395
es0.2647058823529412
lv0.25488180883864336
ro0.2229367631296892
az0.1997792494481236
is0.1881298992161254
hu0.1559953434225844
be0.0880503144654088
tr0.0880503144654088
fi0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
6
name"Isabella"
dialogue"Orchard? Ho solo scattato foto ai paesaggi."
detectedLang"it"
heavyLang"it"
scores
it0.8013245033112583
no0.471830985915493
es0.38650306748466257
sk0.38271604938271603
tl0.37629937629937626
ca0.3736951983298539
ro0.3670886075949367
cs0.3548387096774194
de0.3150684931506849
nl0.3150684931506849
pt0.3135011441647597
sq0.3103448275862069
vi0.26108374384236455
lt0.22680412371134018
sl0.20424403183023873
en0.2
fr0.2
da0.1891891891891892
lv0.17355371900826447
pl0.17355371900826447
et0.16434540389972147
hr0.16434540389972147
reliabletrue
passestrue
7
name"Hunter"
dialogue"Photos? You have a camera. Did you photograph the area around the old barn?"
detectedLang"en"
heavyLang"en"
scores
en0.8106060606060606
tl0.6383363471971067
fr0.5802728226652676
da0.4897959183673469
it0.4743758212877792
sv0.4482758620689655
es0.43741209563994377
ca0.43582510578279265
nl0.42938659058487877
ro0.4261119081779053
no0.39209726443769
yo0.3610223642172524
pt0.3548387096774194
ms0.3474714518760196
cs0.3442622950819672
de0.3442622950819672
lt0.28825622775800713
hu0.2805755395683453
is0.2753623188405797
sq0.2727272727272727
lv0.26062846580406657
sk0.24528301886792453
hr0.21875
pl0.2079207920792079
sl0.1836734693877551
hi0.16142557651991615
tr0.16142557651991615
az0.14893617021276595
eu0.14893617021276595
vi0.14893617021276595
et0.13606911447084233
fi0.13606911447084233
reliabletrue
passestrue
8
name"Isabella"
dialogue"Sì, ma... ho visto qualcosa che non va."
detectedLang"it"
heavyLang"it"
scores
it0.8291925465838509
ca0.6278755074424898
fr0.5814307458143074
pt0.5089285714285715
es0.4954128440366973
sk0.4907407407407407
yo0.472168905950096
ro0.4387755102040817
no0.4123931623931624
en0.4008714596949891
ms0.375
tl0.367816091954023
lt0.3574766355140187
pl0.2801047120418848
cs0.27821522309711283
et0.26666666666666666
fi0.24242424242424243
sl0.24242424242424243
eu0.2403314917127072
de0.233983286908078
hu0.22969187675070027
vi0.22096317280453256
da0.207492795389049
is0.207492795389049
lv0.207492795389049
sq0.19117647058823528
reliabletrue
passestrue
9
name"Hunter"
dialogue"What did you see? Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8318924111431315
et0.6022727272727273
tl0.5070422535211268
pt0.4852941176470589
nl0.4791666666666667
sq0.4582043343653251
es0.36823104693140796
fr0.34210526315789475
no0.34210526315789475
sl0.3346007604562738
ms0.32432432432432434
it0.3137254901960784
cs0.308300395256917
az0.3055555555555556
ca0.3055555555555556
tr0.3055555555555556
fi0.3
reliabletrue
passestrue
10
name"Isabella"
dialogue"Era un uomo. Trascinava qualcosa.ERO molto spaventata."
detectedLang"it"
heavyLang"it"
scores
it0.7927031509121061
ca0.6421755725190839
ro0.5629370629370629
es0.5216836734693877
fr0.45809248554913296
pt0.42660550458715596
en0.39320388349514557
yo0.3676222596964587
lv0.3081180811808118
et0.29245283018867924
no0.27466150870406186
eu0.19006479481641467
da0.18655097613882862
sq0.18655097613882862
de0.1830065359477124
sl0.17218543046357618
hr0.17035398230088497
ms0.1610738255033557
cs0.1591928251121076
nl0.1591928251121076
pl0.1591928251121076
sk0.1591928251121076
reliabletrue
passestrue
11
name"Hunter"
dialogue"I don't understand what you're saying. You need to use words I know."
detectedLang"en"
heavyLang"en"
scores
en0.824150058616647
no0.5504495504495505
da0.5472837022132797
tl0.5202558635394456
cs0.4693396226415094
sv0.4367959949937422
pl0.4296577946768061
nl0.41709844559585496
sk0.3943472409152086
de0.3894165535956581
hr0.3617021276595745
yo0.33234421364985167
ca0.32330827067669177
et0.3098159509202454
lv0.2913385826771654
tr0.2741935483870968
lt0.2706645056726094
ro0.267100977198697
is0.23339011925042585
sq0.22945205479452058
sl0.2119089316987741
it0.20353982300884957
fr0.14611005692599618
be0.1346153846153846
hu0.12959381044487428
az0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
12
name"Isabella"
dialogue"Non capisce. È pericoloso."
detectedLang"it"
heavyLang"it"
scores
it0.8256972111553784
ro0.609375
fr0.6076233183856502
en0.580335731414868
ca0.5679012345679012
es0.4807121661721069
pt0.4631901840490798
yo0.44089456869009586
tl0.4281045751633987
eu0.3320610687022901
ms0.31906614785992216
sq0.3055555555555556
fi0.2857142857142857
no0.2857142857142857
da0.2647058823529412
nl0.2647058823529412
sv0.2647058823529412
et0.25213675213675213
hr0.25213675213675213
lt0.25213675213675213
lv0.25213675213675213
tr0.25213675213675213
reliabletrue
passestrue
13
name"Hunter"
dialogue"Look, I'm trying to find a missing person. If you have information, I need it now."
detectedLang"en"
heavyLang"en"
scores
en0.8288204170557111
da0.6858937749857225
tl0.660284126003706
sv0.6222527472527472
no0.582701062215478
fr0.5542949756888168
de0.5420482930890924
cs0.5416666666666666
sq0.5378151260504201
nl0.5266781411359724
yo0.5175438596491229
ca0.5145631067961165
pl0.5141342756183745
hr0.507168458781362
lv0.5036101083032491
it0.492151431209603
sk0.49168207024029575
et0.4816211121583412
pt0.4786729857819905
lt0.45972495088408644
ro0.4538232373386296
is0.4353182751540041
az0.41050375133976424
es0.40540540540540543
hu0.38820912124582874
sl0.38271604938271603
ms0.3707093821510297
tr0.3405275779376499
fi0.28848641655886154
eu0.27055702917771884
vi0.19472913616398244
zh0.12280701754385964
be0.11290322580645161
uk0.10277324632952692
reliabletrue
passestrue
14
name"Isabella"
dialogue"Mi scusi. Non posso parlare qui."
detectedLang"it"
heavyLang"it"
scores
it0.7958257713248639
fr0.6870653685674548
ca0.609375
pt0.5770676691729324
en0.5322245322245323
ro0.5202558635394456
sv0.4186046511627907
sl0.40789473684210525
hu0.40318302387267907
sk0.40318302387267907
es0.3951612903225807
cs0.39189189189189183
pl0.39189189189189183
no0.3869209809264305
hr0.38524590163934425
de0.3784530386740331
da0.3715083798882682
sq0.3715083798882682
tr0.3679775280898876
yo0.281150159744409
eu0.27884615384615385
az0.23728813559322032
et0.21875
lt0.21875
ms0.21875
nl0.21875
lv0.2077464788732394
reliabletrue
passestrue
15
name"Hunter"
dialogue"Why not? Is someone threatening you?"
detectedLang"en"
heavyLang"en"
scores
en0.8202731847591661
nl0.5894909688013136
tl0.5860927152317881
da0.4692144373673036
is0.4469026548672566
no0.43946188340807174
hu0.3811881188118812
cs0.37810945273631835
sv0.35233160621761656
yo0.32432432432432434
lt0.2492492492492493
es0.2378048780487805
pt0.2378048780487805
tr0.2378048780487805
et0.22839506172839508
sk0.22839506172839508
reliabletrue
passestrue
16
name"Isabella"
dialogue"No. Troppa gente. Ho paura."
detectedLang"it"
heavyLang"it"
scores
it0.8011928429423459
es0.6879875195007801
no0.649737302977233
pt0.6453900709219859
sk0.5780590717299579
ca0.5604395604395604
tl0.5545657015590201
sq0.4444444444444444
da0.43661971830985913
de0.43342776203966005
lv0.3957703927492447
sv0.358974358974359
cs0.3464052287581699
en0.34210526315789475
hr0.33554817275747506
fr0.32432432432432434
ro0.32432432432432434
nl0.3150684931506849
tr0.3055555555555556
eu0.2805755395683453
pl0.2727272727272727
reliabletrue
passestrue
17
name"Hunter"
dialogue"Damn it. I can't help you if you won't talk to me."
detectedLang"en"
heavyLang"en"
scores
en0.8043347381095726
tl0.5619946091644205
sq0.5310245310245311
no0.5149253731343284
cs0.49139280125195617
yo0.48
lv0.4546979865771812
pl0.44539249146757676
hr0.43965517241379315
da0.42781690140845074
sv0.4227353463587922
sl0.39138576779026213
sk0.385633270321361
it0.375
lt0.3394308943089431
et0.3271221532091097
ca0.29805615550755943
es0.2388758782201405
fr0.21875
ro0.21686746987951808
pt0.21307506053268765
ms0.20537897310513448
nl0.20537897310513448
fi0.1875
be0.17721518987341772
tr0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
is0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
18
name"Isabella"
dialogue"Lo so. Mi dispiace."
detectedLang"it"
heavyLang"it"
scores
it0.7345132743362832
sk0.7041420118343196
yo0.7005988023952096
es0.6835443037974683
ca0.6212121212121212
sl0.6183206106870229
en0.5652173913043478
de0.560117302052786
vi0.5588235294117647
pt0.5508982035928144
ro0.5468277945619335
fr0.5207667731629393
cs0.5016611295681063
no0.3697478991596639
tl0.3697478991596639
hu0.3617021276595745
hr0.34210526315789475
pl0.34210526315789475
tr0.32432432432432434
sq0.3150684931506849
reliabletrue
passestrue
19
name"Hunter"
dialogue"Hold on."
detectedLang"en"
heavyLang"da"
scores
en0.8245614035087719
et0.7549019607843137
fi0.75
da0.691358024691358
fr0.6855345911949685
ca0.6644295302013423
hr0.6376811594202898
hi0.6268656716417911
pl0.6268656716417911
tl0.6268656716417911
cs0.6
sk0.6
yo0.6
reliablefalse
passestrue
20
name"Hunter"
dialogue"This is Hunter. Yeah? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8164763458401305
tl0.592391304347826
nl0.49664429530201337
yo0.46428571428571425
fr0.44581280788177335
pl0.43890274314214467
cs0.41709844559585496
sk0.41709844559585496
ca0.412532637075718
et0.4063324538258575
hu0.4063324538258575
fi0.39999999999999997
is0.2902208201892744
de0.281150159744409
hr0.281150159744409
hi0.27184466019417475
da0.267100977198697
no0.25742574257425743
sv0.23728813559322032
it0.21875
pt0.21875
ms0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
sq0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
21
name"Hunter"
dialogue"I have to go. But we aren't done here."
detectedLang"en"
heavyLang"en"
scores
en0.8165810711665443
pl0.6537396121883656
da0.609375
tl0.609375
hr0.5667244367417678
no0.5659722222222222
yo0.5462794918330308
lt0.4887525562372188
cs0.48559670781893005
sq0.4834710743801653
sv0.45652173913043476
sk0.44933920704845814
lv0.42528735632183906
et0.39320388349514557
ro0.39320388349514557
ca0.3556701030927836
nl0.34210526315789475
sl0.32614555256064687
it0.3150684931506849
fr0.26035502958579887
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
22
name"Isabella"
dialogue"Addio."
detectedLang"en"
heavyLang"it"
scores
en0.6621621621621622
hu0.635036496350365
ca0.6062992125984252
it0.6062992125984252
reliablefalse
passestrue