Run: 2026-02-16-01KHK2TJGZ49H1WWPSE6TWKGD5

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
2m 3s
Cost:
$0.015016
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "¿Perdón? ¿Me habla a mí?" Hunter: "Excuse me, miss. I'm Detective Hunter. I need to ask you a few questions about yesterday." Maria: "No... no entiendo. No hablo inglés. Lo siento." Hunter: "You don't speak English? Not a word?" Maria: "No, nada. Solo español. ¿He hecho algo malo?" Hunter: "No, you're not in trouble. I'm looking into a disappearance. Did you see anyone near the orchards?" Maria: "¿Desaparición? Yo... solo estaba tomando fotos. Vi algo extraño." Hunter: "Strange? Can you show me? You have a camera there." Maria: "¿Mis fotos? Sí... mire. Aquí. ¿Ve eso? Entre los árboles." Hunter: "I'm looking at pictures of trees. I don't understand what you're pointing at." Maria: "¡No sé! Algo se movió. Tenía mucho miedo. Tiemblo." Hunter: "You're shaking. Okay. I need to get your name. In case we need to find you." Maria: "Maria. Me llamo Maria. Por favor, necesito un traductor." Hunter: "Maria. Okay. We'll figure it out. Just stay in town." Hunter: "Hold on. Yeah? Hunter. What? Now? I'm on my way." Hunter: "I have to go. Don't leave town. We'll talk later." Maria: "¿Se va? ¡Espere! ¡Por favor, no me deje sola!"
created_at"2026-02-16T11:21:33.350269+00:00" 2/16/2026, 11:21:33 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency842
moderation_latency(null)
generation_time122832
tokens_prompt317
tokens_completion4080
native_tokens_prompt295
native_tokens_completion4122
native_tokens_completion_images(null)
native_tokens_reasoning3772
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0150162
router(null)
provider_responses
0
id"chatcmpl-067bcc9e-bc80-9f76-b728-532b923d7a33"
status200
is_byokfalse
latency842
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771240770-uoE759BnxG4GoTmkxE8u"
upstream_id"chatcmpl-067bcc9e-bc80-9f76-b728-532b923d7a33"
total_cost0.0150162
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"¿Perdón? ¿Me habla a mí?"
detectedLang"es"
heavyLang"es"
scores
es0.8140276301806588
pt0.6464646464646464
it0.626068376068376
sq0.6252676659528907
fr0.6236559139784946
ms0.5872641509433962
yo0.5772946859903382
ca0.56575682382134
en0.5591939546599496
sl0.5042492917847025
tl0.49567723342939485
lt0.48377581120943947
no0.4791666666666667
et0.47447447447447455
hu0.4712990936555891
nl0.46808510638297873
ro0.44267515923566875
fi0.44089456869009586
cs0.4299674267100977
sk0.42622950819672134
hr0.3902439024390244
pl0.375
tr0.3055555555555556
is0.3
da0.29149797570850206
az0.2857142857142857
eu0.2857142857142857
lv0.2857142857142857
vi0.2857142857142857
de0.2768595041322314
sv0.2647058823529412
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I need to ask you a few questions about yesterday."
detectedLang"en"
heavyLang"en"
scores
en0.8022777602024675
fr0.5677731673582296
tl0.5653685674547984
it0.5567375886524822
ca0.51171875
pt0.503968253968254
no0.47829716193656097
ro0.46351931330472107
nl0.46259673258813416
cs0.4531933508311461
sq0.4473916887709991
es0.43845462713387245
da0.4349005424954792
hr0.4098205854579792
sl0.40476190476190477
pl0.3693239152371342
et0.3654822335025381
yo0.3543388429752066
sv0.3509865005192108
sk0.3482794577685088
lv0.28977272727272724
lt0.28489702517162474
de0.27662037037037035
hu0.26297169811320753
ms0.24789410348977134
tr0.24789410348977134
fi0.18086500655307994
is0.18086500655307994
az0.17546174142480211
vi0.17546174142480211
be0.10071942446043164
eu0.10071942446043164
uk0.09156976744186046
reliabletrue
passestrue
2
name"Maria"
dialogue"No... no entiendo. No hablo inglés. Lo siento."
detectedLang"es"
heavyLang"es"
scores
es0.8154362416107384
pt0.703023758099352
it0.6613300492610839
ca0.5852187028657617
fr0.4751908396946565
lt0.43298969072164945
en0.4148936170212766
sk0.4136460554371002
tl0.40347071583514105
tr0.3764172335600907
et0.358974358974359
yo0.3325242718446602
lv0.3226600985221675
hu0.2724867724867725
hr0.26861702127659576
no0.260752688172043
cs0.25474254742547425
fi0.2486338797814208
vi0.2486338797814208
nl0.21875
pl0.21428571428571427
reliabletrue
passestrue
3
name"Hunter"
dialogue"You don't speak English? Not a word?"
detectedLang"en"
heavyLang"en"
scores
en0.8263888888888888
tl0.5674740484429065
ro0.4577006507592191
cs0.45652173913043476
hr0.423963133640553
hu0.3842364532019704
tr0.38271604938271603
no0.37810945273631835
da0.3654822335025381
pt0.358974358974359
de0.3573264781491003
ca0.35233160621761656
ms0.35064935064935066
sv0.35064935064935066
es0.34554973821989526
sk0.34210526315789475
it0.3333333333333333
yo0.32249322493224936
fr0.31880108991825606
pl0.29577464788732394
sl0.2647058823529412
lt0.24698795180722888
is0.23076923076923078
sq0.22360248447204967
az0.21875
eu0.21875
lv0.21875
nl0.21875
vi0.21875
et0.20127795527156547
fi0.20127795527156547
reliabletrue
passestrue
4
name"Maria"
dialogue"No, nada. Solo español. ¿He hecho algo malo?"
detectedLang"es"
heavyLang"es"
scores
es0.8172757475083057
pt0.6760895170789163
ca0.555735056542811
en0.4649805447470817
it0.4532803180914513
hr0.4073275862068965
sk0.394273127753304
tl0.36046511627906974
lv0.3226600985221675
eu0.30203045685279184
yo0.27055702917771884
no0.260752688172043
sl0.25474254742547425
fr0.2506811989100818
fi0.2486338797814208
tr0.24242424242424243
pl0.21428571428571427
reliabletrue
passestrue
5
name"Hunter"
dialogue"No, you're not in trouble. I'm looking into a disappearance. Did you see anyone near the orchards?"
detectedLang"en"
heavyLang"en"
scores
en0.8068350668647847
tl0.5982694684796045
fr0.5296671490593343
nl0.5015337423312883
it0.4337979094076655
no0.4257950530035336
de0.3992606284658041
pt0.385633270321361
yo0.364613880742913
es0.3380855397148676
sv0.32920536635706915
ms0.3257261410788381
sl0.3207941483803553
da0.30703624733475476
ro0.3018259935553169
sk0.3010752688172043
cs0.2988133764832794
hr0.29501084598698485
ca0.2942453854505972
pl0.28884026258205686
tr0.27211646136618145
et0.2638731596828992
sq0.24330616996507565
lv0.236192714453584
hu0.1935483870967742
az0.19154228855721395
is0.18341708542713567
lt0.11202185792349727
eu0.09722222222222222
vi0.09722222222222222
fi0.08835904628330996
reliabletrue
passestrue
6
name"Maria"
dialogue"¿Desaparición? Yo... solo estaba tomando fotos. Vi algo extraño."
detectedLang"es"
heavyLang"es"
scores
es0.8089028776978419
pt0.6718146718146718
ca0.5825147347740668
it0.5052386495925495
sv0.4558258642765685
sk0.4370860927152318
en0.3656716417910448
tl0.36186186186186187
ro0.34006211180124224
nl0.3369734789391576
de0.33176100628930816
eu0.32539682539682535
da0.3210862619808307
no0.30327868852459017
fr0.2697594501718213
pl0.2621527777777778
lt0.2517605633802817
cs0.24242424242424243
lv0.23971377459749554
vi0.1904761904761905
yo0.18111753371868977
ms0.1533864541832669
tr0.1414141414141414
hr0.1361788617886179
sl0.1361788617886179
et0.1290983606557377
sq0.1290983606557377
az0.121900826446281
reliabletrue
passestrue
7
name"Hunter"
dialogue"Strange? Can you show me? You have a camera there."
detectedLang"en"
heavyLang"en"
scores
en0.8117942283563363
de0.6192893401015229
nl0.6119016817593791
tl0.6036988110964333
it0.5978552278820375
fr0.5912806539509536
da0.5804195804195804
ro0.5535714285714286
sq0.54337899543379
no0.5391705069124424
es0.5260663507109005
ca0.5121951219512195
pt0.5041322314049587
cs0.49409780775716694
ms0.4845360824742268
sl0.469964664310954
sk0.42084942084942084
et0.41972920696324956
sv0.41972920696324956
tr0.4152046783625731
az0.40711462450592883
hr0.40119760479041916
pl0.37888198757763975
hu0.34210526315789475
lt0.33184855233853006
is0.3212669683257918
lv0.3181818181818182
fi0.3150684931506849
yo0.2840095465393795
eu0.1891891891891892
vi0.1891891891891892
reliabletrue
passestrue
8
name"Maria"
dialogue"¿Mis fotos? Sí... mire. Aquí. ¿Ve eso? Entre los árboles."
detectedLang"es"
heavyLang"es"
scores
es0.7779751332149201
ca0.7077162899454403
fr0.5814732142857143
pt0.5059288537549407
it0.41588785046728977
yo0.3980738362760835
tr0.39418416801292405
en0.3811881188118812
de0.36115843270868825
nl0.36006825938566556
lv0.358974358974359
cs0.35344827586206895
et0.3409490333919156
ro0.33035714285714285
sq0.3093922651933701
az0.2816091954022989
lt0.27606177606177607
ms0.2378048780487805
hr0.1515837104072398
sk0.1515837104072398
sl0.1515837104072398
da0.1359447004608295
no0.1359447004608295
pl0.1359447004608295
sv0.1359447004608295
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'm looking at pictures of trees. I don't understand what you're pointing at."
detectedLang"en"
heavyLang"en"
scores
en0.8156218571907475
tl0.6440129449838188
no0.6288798920377867
da0.5811119573495811
nl0.5132743362831859
sv0.5098039215686274
de0.48015122873345933
ro0.4549058473736373
ca0.4258872651356994
is0.40347071583514105
fr0.4015233949945593
pl0.34988179669030733
et0.32182490752157833
it0.3193069306930693
hr0.2724867724867725
yo0.26666666666666666
cs0.2557510148849797
sk0.22644163150492264
lt0.21316165951359084
lv0.20977011494252876
pt0.2005813953488372
sq0.19590643274853803
ms0.1419656786271451
be0.11290322580645161
tr0.11290322580645161
hu0.1085899513776337
az0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
10
name"Maria"
dialogue"¡No sé! Algo se movió. Tenía mucho miedo. Tiemblo."
detectedLang"es"
heavyLang"es"
scores
es0.8178980228928201
pt0.5641344956413449
ca0.5218579234972678
it0.4905385735080059
hr0.4006849315068493
yo0.3554327808471455
sk0.35304990757855825
en0.34944237918215615
no0.32950191570881227
tl0.328214971209213
cs0.279835390946502
sl0.2738589211618257
lv0.2723492723492723
is0.26004228329809725
ro0.25531914893617025
sq0.24242424242424243
fr0.2374727668845316
fi0.22566371681415928
da0.2081447963800905
tr0.2009132420091324
sv0.19724770642201836
pl0.1764705882352941
reliabletrue
passestrue
11
name"Hunter"
dialogue"You're shaking. Okay. I need to get your name. In case we need to find you."
detectedLang"en"
heavyLang"en"
scores
en0.8194130925507901
tl0.6680497925311203
nl0.5381062355658198
pl0.5283018867924528
da0.4616419919246299
no0.4594594594594595
it0.4587280108254398
sv0.441340782122905
cs0.43977591036414565
yo0.43820224719101125
ro0.43582510578279265
de0.4326241134751773
sl0.4074074074074074
hr0.3893129770992366
is0.36908517350157727
sk0.33774834437086093
et0.33554817275747506
lv0.3162393162393162
lt0.2945326278659612
ms0.2766726943942134
az0.2687385740402194
ca0.25650557620817843
sq0.250936329588015
fr0.15074309978768577
pt0.15074309978768577
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
12
name"Maria"
dialogue"Maria. Me llamo Maria. Por favor, necesito un traductor."
detectedLang"es"
heavyLang"es"
scores
es0.7901510912143257
pt0.7
ca0.683277027027027
ro0.6772805507745266
it0.6518105849582173
en0.629080118694362
fr0.5906113537117904
sq0.5883644346871569
nl0.5679723502304147
tl0.5614035087719298
no0.4813278008298755
da0.46120689655172414
lv0.43524096385542166
sl0.43095599393019723
ms0.41770186335403725
sv0.39999999999999997
yo0.3902439024390244
et0.36655405405405406
fi0.3397887323943662
lt0.33510638297872336
de0.32553956834532377
eu0.27606177606177607
hr0.27466150870406186
pl0.251497005988024
sk0.251497005988024
cs0.2454728370221328
reliabletrue
passestrue
13
name"Hunter"
dialogue"Maria. Okay. We'll figure it out. Just stay in town."
detectedLang"en"
heavyLang"en"
scores
en0.7653429602888087
tl0.6107784431137725
ro0.5729303547963206
it0.5289855072463767
de0.5098039215686274
sv0.5075757575757576
ca0.4791666666666667
sq0.4706840390879479
nl0.4610281923714759
yo0.411231884057971
sl0.41016333938294003
pt0.40693430656934304
fr0.4003690036900369
es0.39365671641791045
no0.37858508604206503
ms0.37739463601532564
da0.375
et0.336734693877551
pl0.3172268907563025
lv0.30851063829787234
eu0.3055555555555556
lt0.2793791574279379
fi0.26636568848758463
az0.20537897310513448
hr0.1875
sk0.16237113402061853
cs0.15364583333333331
reliabletrue
passestrue
14
name"Hunter"
dialogue"Hold on. Yeah? Hunter. What? Now? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8097412480974124
tl0.47589098532494756
da0.4369369369369369
fr0.419953596287703
pl0.4131455399061033
cs0.39172749391727496
sk0.39172749391727496
ca0.3872549019607844
et0.3811881188118812
fi0.375
de0.26035502958579887
hr0.26035502958579887
hi0.251497005988024
no0.2378048780487805
yo0.23076923076923078
sv0.21875
it0.20127795527156547
nl0.20127795527156547
pt0.20127795527156547
ms0.19093851132686085
ro0.19093851132686085
sl0.19093851132686085
sq0.19093851132686085
tr0.19093851132686085
reliabletrue
passestrue
15
name"Hunter"
dialogue"I have to go. Don't leave town. We'll talk later."
detectedLang"en"
heavyLang"en"
scores
en0.8005698005698005
da0.580335731414868
pl0.559748427672956
tl0.5400788436268068
no0.49640287769784175
yo0.46236559139784944
hr0.42148760330578516
cs0.40273037542662116
sv0.3902439024390244
nl0.3738819320214669
sk0.36823104693140796
lv0.34579439252336447
lt0.3230174081237911
de0.308300395256917
ca0.2827868852459016
sq0.2768595041322314
sl0.25690021231422505
it0.24731182795698922
ro0.20454545454545453
hi0.1784037558685446
fr0.16864608076009502
pt0.16864608076009502
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
et0.15254237288135594
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
16
name"Maria"
dialogue"¿Se va? ¡Espere! ¡Por favor, no me deje sola!"
detectedLang"es"
heavyLang"es"
scores
es0.765358361774744
pt0.7327502429543246
it0.7199592668024439
ca0.7007616974972797
sq0.6232876712328766
ro0.5967741935483871
no0.5925925925925926
fr0.5775729646697388
en0.5571658615136876
sl0.5089285714285715
hr0.45972495088408644
yo0.4148936170212766
fi0.39159292035398224
da0.36342592592592593
tl0.3559718969555035
sv0.3544600938967136
nl0.3514150943396226
cs0.3309002433090025
lv0.3226600985221675
eu0.2744063324538259
et0.25675675675675674
sk0.2486338797814208
tr0.24242424242424243
ms0.233983286908078
pl0.21428571428571427
reliabletrue
passestrue