Run: 2026-02-16-01KHK2QE99QZTQSFB6YVJDT5YT

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
2m 3s
Cost:
$0.014368
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Do you have a moment?" Maria: "¿Perdón? No... no entiendo." Hunter: "I'm Detective Hunter. I'm looking into the disappearance near the orchard. Did you see anything?" Maria: "¡Dios mío! No quiero hablar de eso." Hunter: "You're holding a camera. Were you taking pictures out there?" Maria: "¡No! Por favor, déjeme en paz. Vi algo terrible." Hunter: "I don't understand what you're saying. Do you speak English?" Maria: "No hablo inglés. Solo español. Por favor, váyase." Hunter: "Look, I'm not trying to scare you. I just need to know what you saw. Can you point to something?" Maria: "¡No! Es peligroso. No entienden." Hunter: "Dangerous? Who is dangerous? You need to give me something to work with." Maria: "Por favor... no quiero problemas. Solo soy estudiante." Hunter: "Student? Alright, look, stay calm. I need to get someone who can翻译—" Maria: "¿Qué? ¿A dónde va?" Hunter: "(Phone rings) Hold on. Detective Hunter. Yeah? I'm on my way. Now?" Maria: "¿Señor? ¡Espere!" Hunter: "I have to take this. Don't leave town. I'll be back." Maria: "¡No se vaya! ¡Por favor!"
created_at"2026-02-16T11:19:51.114832+00:00" 2/16/2026, 11:19:51 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency867
moderation_latency(null)
generation_time123040
tokens_prompt317
tokens_completion4133
native_tokens_prompt295
native_tokens_completion3942
native_tokens_completion_images(null)
native_tokens_reasoning3609
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0143682
router(null)
provider_responses
0
id"chatcmpl-1308e53d-c1e3-9ca4-8a3c-79e51841261a"
status200
is_byokfalse
latency867
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771240667-R3ew3chpTMQBrsCR37Qw"
upstream_id"chatcmpl-1308e53d-c1e3-9ca4-8a3c-79e51841261a"
total_cost0.0143682
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Do you have a moment?"
detectedLang"en"
heavyLang"en"
scores
en0.7448979591836735
sq0.6338215712383488
cs0.6313672922252012
pt0.6303763440860215
fr0.5997088791848617
sk0.5907738095238095
pl0.5845921450151057
ca0.555735056542811
es0.5393634840871022
nl0.5346869712351946
ro0.5291095890410958
sl0.5200698080279231
hr0.5175438596491229
it0.5132743362831859
da0.5098039215686274
yo0.4859813084112149
tl0.462890625
no0.4532803180914513
hu0.4433198380566802
de0.4294605809128631
vi0.39692982456140347
et0.3648960739030023
ms0.3483412322274882
fi0.3341404358353511
az0.32598039215686275
sv0.314214463840399
lt0.22969187675070027
tr0.21875
is0.21428571428571427
eu0.20289855072463767
lv0.20289855072463767
reliabletrue
passestrue
1
name"Maria"
dialogue"¿Perdón? No... no entiendo."
detectedLang"es"
heavyLang"es"
scores
es0.8125000000000001
pt0.7453310696095077
ca0.6746203904555313
it0.6551724137931034
fr0.6183206106870229
en0.5652173913043478
lv0.46619217081850534
ms0.40476190476190477
hr0.402390438247012
no0.39271255060728744
fi0.3775933609958506
sk0.3775933609958506
tr0.3697478991596639
lt0.35344827586206895
tl0.34782608695652173
et0.33920704845814975
nl0.33920704845814975
pl0.3333333333333333
sq0.32432432432432434
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm Detective Hunter. I'm looking into the disappearance near the orchard. Did you see anything?"
detectedLang"en"
heavyLang"en"
scores
en0.806136210384356
tl0.5956399437412095
fr0.5362903225806451
nl0.49781659388646293
no0.45133587786259544
de0.4041450777202072
sq0.40352697095435686
it0.3991640543364681
pt0.3869936034115139
ms0.35247747747747743
ro0.35101580135440186
da0.3480725623582766
sv0.3321718931475029
es0.2953431372549019
ca0.2936117936117936
cs0.27398989898989895
sl0.24738219895287958
et0.22818791946308725
yo0.22402159244264505
hr0.1797432239657632
is0.10990712074303406
sk0.09305993690851734
tr0.09305993690851734
reliabletrue
passestrue
3
name"Maria"
dialogue"¡Dios mío! No quiero hablar de eso."
detectedLang"es"
heavyLang"es"
scores
es0.8201438848920863
ca0.560546875
pt0.560546875
it0.5098039215686274
no0.4779582366589328
az0.4655581947743468
yo0.4630071599045346
tr0.45255474452554745
en0.4260204081632653
pl0.4186046511627907
tl0.40789473684210525
nl0.40476190476190477
fr0.39999999999999997
ro0.39839572192513373
lv0.3679775280898876
da0.34593023255813954
sv0.336283185840708
hr0.3098159509202454
hu0.30124223602484473
sk0.2879746835443038
sl0.2549668874172185
eu0.23728813559322032
de0.22945205479452058
ms0.21875
sq0.21875
reliabletrue
passestrue
4
name"Hunter"
dialogue"You're holding a camera. Were you taking pictures out there?"
detectedLang"en"
heavyLang"en"
scores
en0.8121131741821397
tl0.6626984126984127
de0.5246085011185682
fr0.5175936435868331
ro0.5137299771167049
nl0.5046620046620046
no0.49162679425837325
ca0.4897959183673469
sk0.4501940491591203
da0.44371727748691103
sv0.4039270687237027
it0.3997175141242938
tr0.358974358974359
ms0.3580060422960725
et0.3531202435312024
es0.35213414634146345
sq0.34210526315789475
is0.33903576982892686
pl0.33176100628930816
pt0.33176100628930816
cs0.33070866141732286
sl0.2747440273037543
hu0.2685025817555938
lv0.2647058823529412
fi0.2517605633802817
yo0.21875
hr0.2085661080074488
lt0.16173570019723865
az0.1414141414141414
eu0.1414141414141414
vi0.1414141414141414
reliabletrue
passestrue
5
name"Maria"
dialogue"¡No! Por favor, déjeme en paz. Vi algo terrible."
detectedLang"es"
heavyLang"es"
scores
es0.7587230883444692
pt0.688398849472675
ca0.6542553191489362
fr0.6216530849825379
no0.6012269938650306
da0.5625841184387618
sv0.5608108108108109
en0.5199409158050221
it0.5022970903522206
nl0.4672131147540984
sq0.4491525423728813
hr0.3925233644859813
tr0.37858508604206503
sk0.3551587301587301
tl0.32432432432432434
fi0.3055555555555556
sl0.3010752688172043
is0.2919389978213508
pl0.2919389978213508
lv0.2872807017543859
vi0.23529411764705882
cs0.2243436754176611
eu0.1875
ro0.181360201511335
az0.16237113402061853
de0.16237113402061853
et0.16237113402061853
hu0.16237113402061853
reliabletrue
passestrue
6
name"Hunter"
dialogue"I don't understand what you're saying. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8166522864538395
no0.5521601685985247
da0.5464247598719317
tl0.4988207547169811
sv0.49763593380614657
cs0.48484848484848486
pl0.44948186528497414
hr0.4378306878306878
sk0.40807799442896936
de0.38405797101449274
sq0.371301775147929
ro0.35703479576399394
nl0.2951907131011609
vi0.2904841402337229
tr0.2857142857142857
yo0.2796610169491525
pt0.2685025817555938
ca0.24511545293072823
is0.24377224199288253
sl0.22018348623853207
it0.21296296296296297
ms0.1448692152917505
be0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
et0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
7
name"Maria"
dialogue"No hablo inglés. Solo español. Por favor, váyase."
detectedLang"es"
heavyLang"es"
scores
es0.787621359223301
pt0.6373056994818653
ca0.5788206979542719
it0.5225102319236016
fr0.4186046511627907
sq0.35779816513761464
en0.3346007604562738
tr0.3217054263565891
no0.31640625
lv0.2723492723492723
eu0.2537313432835821
hu0.2273730684326711
hr0.22394678492239467
sk0.20634920634920634
tl0.18604651162790697
et0.18032786885245902
pl0.1764705882352941
ro0.17061611374407584
da0.1566265060240964
nl0.1566265060240964
sl0.1566265060240964
sv0.1566265060240964
reliabletrue
passestrue
8
name"Hunter"
dialogue"Look, I'm not trying to scare you. I just need to know what you saw. Can you point to something?"
detectedLang"en"
heavyLang"en"
scores
en0.8252911813643927
tl0.5714285714285714
da0.4299674267100977
pl0.4020501138952164
cs0.37425506555423127
it0.37275985663082434
et0.3667068757539204
ca0.3574051407588739
ro0.3502475247524753
hr0.3269230769230769
no0.32605905006418484
sv0.3137254901960784
tr0.3
yo0.29906542056074764
fr0.279835390946502
sk0.279835390946502
lv0.2605633802816902
ms0.2532005689900427
lt0.24132947976878616
az0.21052631578947367
sq0.2033383915022762
sl0.1873065015479876
es0.12935323383084577
pt0.12935323383084577
be0.11764705882352942
hu0.11317567567567569
is0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
9
name"Maria"
dialogue"¡No! Es peligroso. No entienden."
detectedLang"es"
heavyLang"es"
scores
es0.803921568627451
ca0.6466431095406361
pt0.6
de0.5771670190274841
lv0.5565410199556541
tr0.511002444987775
hu0.5073891625615764
nl0.504950495049505
en0.4936708860759494
fi0.48586118251928023
no0.4845360824742268
tl0.4708994708994709
fr0.44598337950138506
it0.441340782122905
da0.38080495356037153
sv0.33774834437086093
hr0.33554817275747506
lt0.3127147766323024
sk0.3127147766323024
sq0.2857142857142857
et0.2779783393501805
ms0.2779783393501805
pl0.2727272727272727
reliabletrue
passestrue
10
name"Hunter"
dialogue"Dangerous? Who is dangerous? You need to give me something to work with."
detectedLang"en"
heavyLang"en"
scores
en0.8342907644719398
tl0.5387453874538745
yo0.40664556962025317
nl0.39320388349514557
ms0.3902439024390244
et0.3842364532019704
da0.37913907284768217
cs0.3578767123287671
sl0.3578767123287671
no0.34782608695652173
lt0.33862433862433866
es0.32432432432432434
fr0.31066176470588236
pt0.30683918669131244
hu0.29111531190926276
sq0.2829827915869981
pl0.2647058823529412
sk0.26035502958579887
lv0.2454728370221328
hr0.23625254582484725
is0.19700214132762314
it0.1758241758241758
fi0.16666666666666666
reliabletrue
passestrue
11
name"Maria"
dialogue"Por favor... no quiero problemas. Solo soy estudiante."
detectedLang"es"
heavyLang"es"
scores
es0.8102981029810299
pt0.7202238209432454
it0.6538081107814044
ca0.6304118268215418
sq0.5430809399477807
tl0.5358090185676392
fr0.5231607629427792
no0.5091164095371669
ro0.48224852071005914
en0.4728915662650602
pl0.46236559139784944
lv0.453125
sl0.4336569579288026
hr0.40978077571669475
sk0.3934142114384749
de0.3805309734513274
lt0.3805309734513274
tr0.3794326241134752
da0.37163375224416517
nl0.3670886075949367
sv0.36363636363636365
ms0.32432432432432434
et0.3230174081237911
az0.30417495029821073
cs0.28716904276985744
hu0.15254237288135594
reliabletrue
passestrue
12
name"Hunter"
dialogue"Student? Alright, look, stay calm. I need to get someone who can翻译—"
detectedLang"en"
heavyLang"zh"
scores
en0.7686445291235711
no0.523542600896861
da0.51036866359447
pl0.4835965978128797
tl0.480440097799511
cs0.47073474470734744
sk0.4393139841688654
hr0.4385733157199472
yo0.4121715076071923
sq0.3911174785100286
et0.3902439024390244
sv0.38936781609195403
lv0.375
lt0.3580060422960725
ro0.3511450381679389
ca0.3410852713178295
fr0.3359375
de0.3275316455696203
it0.30327868852459017
sl0.2975206611570248
is0.2772108843537415
nl0.247787610619469
az0.24511545293072823
hu0.22867513611615245
es0.1550695825049702
pt0.1550695825049702
be0.1414141414141414
tr0.1414141414141414
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
13
name"Maria"
dialogue"¿Qué? ¿A dónde va?"
detectedLang"es"
heavyLang"es"
scores
es0.8221906116642959
ca0.7577519379844961
ro0.6882793017456359
it0.6397694524495676
fr0.638728323699422
hu0.5551601423487544
pt0.5283018867924528
en0.5173745173745175
cs0.5136186770428015
sk0.5098039215686274
yo0.4877049180327869
hr0.47257383966244726
pl0.45652173913043476
sl0.4186046511627907
lt0.3961352657004831
tr0.3811881188118812
is0.375
da0.3654822335025381
sq0.3654822335025381
tl0.3654822335025381
az0.358974358974359
eu0.358974358974359
lv0.358974358974359
nl0.358974358974359
no0.358974358974359
vi0.358974358974359
de0.34895833333333337
et0.33510638297872336
fi0.33510638297872336
ms0.33510638297872336
sv0.33510638297872336
reliabletrue
passestrue
14
name"Hunter"
dialogue"Hold on. Detective Hunter. Yeah? I'm on my way. Now?"
detectedLang"en"
heavyLang"en"
scores
en0.8021108179419525
tl0.6026490066225165
fr0.5548961424332344
ca0.5297805642633229
ro0.5090016366612111
da0.4809688581314879
it0.44029850746268656
cs0.4371482176360225
pt0.4371482176360225
es0.3723849372384937
pl0.3697478991596639
de0.3644067796610169
sk0.3492407809110629
no0.34497816593886466
hr0.34065934065934067
et0.33920704845814975
sq0.336283185840708
fi0.3333333333333333
nl0.3258426966292135
sv0.3135011441647597
sl0.29577464788732394
hi0.21875
yo0.2
ms0.16434540389972147
tr0.16434540389972147
reliabletrue
passestrue
15
name"Maria"
dialogue"¿Señor? ¡Espere!"
detectedLang"es"
heavyLang"es"
scores
es0.782608695652174
it0.6296296296296297
pt0.5305164319248826
ca0.5192307692307693
eu0.5098039215686274
yo0.46808510638297873
en0.45054945054945056
ro0.43820224719101125
no0.4186046511627907
tl0.4186046511627907
reliabletrue
passestrue
16
name"Hunter"
dialogue"I have to take this. Don't leave town. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8274030801911842
tl0.5757180156657963
da0.5454545454545454
yo0.5068285280728376
lt0.4619205298013245
pl0.44539249146757676
hr0.43965517241379315
no0.43868739205526774
cs0.4206773618538324
sk0.385633270321361
sl0.37977099236641226
lv0.36274509803921573
hu0.36149312377210213
ca0.29805615550755943
sv0.29805615550755943
sq0.2919389978213508
it0.26136363636363635
ro0.21686746987951808
be0.17721518987341772
tr0.17721518987341772
az0.16237113402061853
et0.16237113402061853
is0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
17
name"Maria"
dialogue"¡No se vaya! ¡Por favor!"
detectedLang"es"
heavyLang"es"
scores
es0.820574162679426
pt0.786628733997155
ca0.7175141242937854
sq0.6717724288840263
it0.6296296296296297
no0.6124031007751938
hr0.609375
sl0.5677233429394812
ro0.5614035087719298
fr0.5468277945619335
en0.5398773006134969
da0.511400651465798
sv0.5016611295681063
cs0.4755244755244755
lv0.46619217081850534
yo0.4163424124513619
fi0.40476190476190477
sk0.3775933609958506
tr0.3697478991596639
tl0.34782608695652173
pl0.3333333333333333
nl0.3023255813953488
reliabletrue
passestrue