Run: 2026-02-16-01KHK2SGYPHH59KN3DM9RBTJK0

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
2m 16s
Cost:
$0.017176
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Pardon ? Je ne comprends pas." Hunter: "Excuse me, miss. I'm Detective Hunter. Do you speak English?" Marie: "Non. Je suis désolée. Je ne parle pas anglais." Hunter: "You don't... great. Okay. Do you understand 'police'? 'Detective'?" Marie: "Police ? Oui. Je comprends police." Hunter: "Okay. Good. Did you see anything last night? Near the apple festival?" Marie: "La nuit... oui. J'étais assise ici. Je prenais des photos." Hunter: "Photos? You were taking pictures? Did you capture anything unusual?" Marie: "Oui... quelque chose de terrible. Une voiture." Hunter: "A car? You're saying you saw a car?" Marie: "Oui. La voiture était noire. Elle est partie vite." Hunter: "Black car. Speeding. I don't... did you see who was driving?" Marie: "Non. Non, je n'ai pas vu. J'ai eu trop peur." Hunter: "Fear? You're scared? Why are you scared?" Marie: "Je ne peux pas parler ici. C'est dangereux." Hunter: "Dangerous? Who is dangerous? You need to come with me." Marie: "Non. S'il vous plaît. Je dois partir maintenant." Hunter: "Miss, wait. We aren't finished. I can't let you walk away." Hunter: "Hold on. Hunter. Yeah. I'm leaving now." Hunter: "Looks like I have to go. Stay put. I'll be back to find you." Marie: "Je suis désolée. Au revoir."
created_at"2026-02-16T11:21:12.00094+00:00" 2/16/2026, 11:21:12 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency774
moderation_latency(null)
generation_time135976
tokens_prompt316
tokens_completion4811
native_tokens_prompt295
native_tokens_completion4722
native_tokens_completion_images(null)
native_tokens_reasoning4349
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0171762
router(null)
provider_responses
0
id"chatcmpl-be30fece-e45c-94bb-86f2-e9141f537256"
status200
is_byokfalse
latency774
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771240735-3MsIhUFPZdypNTzegInF"
upstream_id"chatcmpl-be30fece-e45c-94bb-86f2-e9141f537256"
total_cost0.0171762
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Pardon ? Je ne comprends pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7695852534562212
lt0.6763754045307443
ca0.6460176991150443
cs0.6219281663516069
nl0.6062992125984252
sl0.6007984031936128
it0.5943204868154158
hr0.5867768595041323
tl0.5771670190274841
sq0.54337899543379
en0.5215311004784688
ro0.5169082125603864
es0.5085995085995086
yo0.4490358126721763
de0.43977591036414565
sk0.42028985507246375
pt0.37888198757763975
lv0.33993399339933994
tr0.3197278911564626
pl0.3127147766323024
fi0.3055555555555556
ms0.29577464788732394
hu0.2907801418439716
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7833152762730228
tl0.5889003083247688
pt0.5438996579247435
sq0.5104039167686658
ro0.4891443167305236
fr0.4708994708994709
sl0.4550408719346049
no0.4528043775649795
it0.441340782122905
cs0.4143484626647145
es0.4117647058823529
hr0.3930197268588771
de0.37888198757763975
ca0.37402190923317685
da0.3730407523510972
nl0.3640699523052464
ms0.34959349593495936
sv0.34318555008210183
pl0.26335174953959484
sk0.24812030075187969
vi0.2172211350293542
et0.1919191919191919
yo0.16317991631799164
fi0.15789473684210525
tr0.12854030501089325
reliabletrue
passestrue
2
name"Marie"
dialogue"Non. Je suis désolée. Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8015873015873016
sl0.6345919610231425
lt0.5850622406639004
it0.5683453237410072
sq0.5607613469985359
cs0.5535714285714286
hr0.5363214837712519
ca0.511400651465798
sk0.48805460750853247
nl0.4827586206896552
lv0.460431654676259
ro0.44751381215469616
en0.4307400379506641
yo0.35205183585313177
pl0.34497816593886466
tr0.33774834437086093
hu0.33184855233853006
ms0.3288590604026846
es0.3273542600896861
de0.3227990970654628
fi0.22680412371134018
eu0.2248062015503876
az0.1891891891891892
et0.17355371900826447
pt0.17355371900826447
da0.16434540389972147
no0.16434540389972147
sv0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"You don't... great. Okay. Do you understand 'police'? 'Detective'?"
detectedLang"en"
heavyLang"en"
scores
en0.7786304604486423
tl0.5330012453300125
ro0.5318352059925093
cs0.507227332457293
da0.506578947368421
no0.5013297872340425
sk0.4377811094452773
sv0.4257274119448699
de0.4248466257668711
hr0.41588785046728977
fr0.4085173501577287
sl0.4075829383886255
pl0.37080536912751677
sq0.358974358974359
nl0.3218806509945751
it0.3131868131868132
pt0.2937853107344633
vi0.22839506172839508
yo0.17218543046357618
is0.1648106904231626
reliabletrue
passestrue
4
name"Marie"
dialogue"Police ? Oui. Je comprends police."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7946009389671361
en0.6908127208480564
it0.6794871794871795
hr0.6595330739299611
sl0.6568627450980391
tl0.656188605108055
cs0.6527777777777778
nl0.6338912133891214
sk0.6331236897274634
ro0.6220302375809936
es0.6170678336980306
ca0.6102449888641426
de0.5752427184466019
pt0.5231607629427792
pl0.5056497175141244
lt0.4971264367816092
yo0.48224852071005914
eu0.34944237918215615
da0.33962264150943394
et0.3371212121212121
lv0.3371212121212121
no0.3371212121212121
sv0.3371212121212121
fi0.32432432432432434
ms0.31906614785992216
sq0.31906614785992216
az0.3
hu0.3
tr0.29149797570850206
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay. Good. Did you see anything last night? Near the apple festival?"
detectedLang"en"
heavyLang"en"
scores
en0.8011489173663279
tl0.6781115879828327
fr0.5253164556962026
nl0.4827586206896552
et0.45054945054945056
no0.44168734491315137
da0.4296577946768061
es0.42675159235668786
ms0.42675159235668786
sq0.4063324538258575
de0.3967828418230563
it0.3844049247606019
sv0.375
cs0.3706293706293706
ca0.31402439024390244
hr0.3087557603686636
pt0.3087557603686636
sl0.293563579277865
yo0.2868462757527734
lt0.21875
az0.2077464788732394
ro0.2077464788732394
sk0.2077464788732394
hu0.12959381044487428
fi0.12280701754385964
lv0.12280701754385964
pl0.12280701754385964
reliabletrue
passestrue
6
name"Marie"
dialogue"La nuit... oui. J'étais assise ici. Je prenais des photos."
detectedLang"fr"
heavyLang"fr"
scores
fr0.793046357615894
ca0.5941558441558442
pt0.5530393325387366
yo0.497991967871486
it0.4777158774373259
es0.4747899159663866
de0.4369369369369369
lt0.43524096385542166
lv0.4195046439628483
nl0.416796267496112
sl0.4131455399061033
hr0.4009584664536741
en0.39999999999999997
tl0.3822075782537067
sk0.375
ro0.29775280898876405
no0.29245283018867924
cs0.2816091954022989
pl0.19527896995708155
vi0.1830065359477124
sq0.17218543046357618
hi0.17035398230088497
sv0.1591928251121076
tr0.1591928251121076
reliabletrue
passestrue
7
name"Hunter"
dialogue"Photos? You were taking pictures? Did you capture anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7982914095870907
tl0.609375
fr0.5982986767485822
ca0.4272237196765499
pt0.4170096021947874
de0.4089012517385257
et0.39198855507868385
nl0.3656716417910448
sq0.36281859070464767
es0.3541033434650456
no0.27101200686106347
ms0.2672413793103448
lv0.2659758203799654
ro0.26343154246100525
sl0.2621527777777778
sv0.2517605633802817
pl0.19962335216572505
hr0.16829745596868884
it0.16829745596868884
tr0.16829745596868884
fi0.15841584158415842
lt0.15841584158415842
cs0.1550695825049702
hi0.1533864541832669
da0.1448692152917505
is0.1431451612903226
sk0.1431451612903226
yo0.1431451612903226
reliabletrue
passestrue
8
name"Marie"
dialogue"Oui... quelque chose de terrible. Une voiture."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8123827392120075
en0.6644295302013423
it0.5426829268292682
ca0.526813880126183
es0.5222929936305732
de0.48186528497409326
tl0.4350282485875706
pt0.42418426103646834
nl0.4230769230769231
sq0.40476190476190477
fi0.39999999999999997
da0.3775933609958506
sv0.3710691823899371
no0.3644067796610169
yo0.3548387096774194
hu0.34782608695652173
ro0.33184855233853006
az0.29577464788732394
tr0.24623115577889448
hr0.2227979274611399
sl0.21052631578947367
eu0.1891891891891892
et0.17355371900826447
ms0.17355371900826447
pl0.16434540389972147
reliabletrue
passestrue
9
name"Hunter"
dialogue"A car? You're saying you saw a car?"
detectedLang"en"
heavyLang"en"
scores
en0.823477493380406
tl0.5555555555555556
fr0.5475113122171946
cs0.5121951219512195
tr0.46949602122015915
ms0.4490358126721763
hu0.43820224719101125
pt0.4117647058823529
ro0.41002949852507375
ca0.40476190476190477
es0.39759036144578314
sk0.3939393939393939
it0.38461538461538464
yo0.3730407523510972
hr0.358974358974359
pl0.3442622950819672
sl0.3103448275862069
lt0.2907801418439716
is0.2727272727272727
da0.2647058823529412
sq0.2647058823529412
az0.25925925925925924
eu0.25925925925925924
lv0.25925925925925924
nl0.25925925925925924
no0.25925925925925924
vi0.25925925925925924
de0.250936329588015
et0.23954372623574144
fi0.23954372623574144
sv0.23954372623574144
reliabletrue
passestrue
10
name"Marie"
dialogue"Oui. La voiture était noire. Elle est partie vite."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8395061728395061
ro0.5932415519399249
it0.5149253731343284
sq0.4873817034700315
es0.453781512605042
ca0.4491525423728813
tl0.42882249560632685
no0.4186046511627907
yo0.4058500914076782
en0.3879472693032015
hr0.3200836820083682
de0.3172268907563025
sl0.3114406779661017
fi0.30257510729613735
pt0.22985781990521328
vi0.20537897310513448
az0.19753086419753088
eu0.19753086419753088
nl0.19154228855721395
da0.1875
lt0.1875
sv0.1875
lv0.181360201511335
et0.17721518987341772
ms0.17721518987341772
pl0.17721518987341772
tr0.1709183673469388
cs0.16237113402061853
hu0.16237113402061853
sk0.16237113402061853
reliabletrue
passestrue
11
name"Hunter"
dialogue"Black car. Speeding. I don't... did you see who was driving?"
detectedLang"en"
heavyLang"en"
scores
en0.8171010516689529
tl0.5893223819301848
no0.5469988674971688
nl0.5402298850574713
da0.48253557567917205
fr0.41944847605224966
de0.40476190476190477
et0.36808846761453395
hr0.3670886075949367
sv0.358974358974359
cs0.313893653516295
yo0.30313588850174217
ro0.2945326278659612
sk0.2647058823529412
ca0.25650557620817843
is0.2523364485981308
sq0.250936329588015
pl0.23954372623574144
it0.22330097087378642
ms0.20318725099601595
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
12
name"Marie"
dialogue"Non. Non, je n'ai pas vu. J'ai eu trop peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8021108179419525
nl0.5526838966202784
hr0.5222929936305732
sl0.5202558635394456
cs0.49209932279909707
sk0.4779582366589328
en0.43467336683417085
yo0.4201030927835051
de0.4155844155844156
it0.40318302387267907
sq0.3553008595988539
ca0.2879746835443038
lt0.2879746835443038
pl0.2879746835443038
eu0.27884615384615385
ms0.27184466019417475
pt0.267100977198697
ro0.26229508196721313
da0.25
sv0.25
fi0.2398648648648649
hu0.22945205479452058
no0.21328671328671328
reliabletrue
passestrue
13
name"Hunter"
dialogue"Fear? You're scared? Why are you scared?"
detectedLang"en"
heavyLang"en"
scores
en0.828030954428203
ro0.5305164319248826
it0.3055555555555556
cs0.2805755395683453
tl0.2805755395683453
reliabletrue
passestrue
14
name"Marie"
dialogue"Je ne peux pas parler ici. C'est dangereux."
detectedLang"fr"
heavyLang"fr"
scores
fr0.819277108433735
nl0.5555555555555556
sl0.5481927710843374
lt0.5405819295558958
hr0.5363214837712519
sq0.49748743718592964
cs0.49324324324324326
tr0.47643979057591623
ro0.45155393053016457
ca0.44751381215469616
de0.42084942084942084
sk0.4174757281553398
it0.3562231759656652
yo0.35205183585313177
lv0.35064935064935066
pl0.34497816593886466
da0.3333333333333333
hu0.33184855233853006
az0.33035714285714285
ms0.3288590604026846
en0.3197278911564626
no0.3087557603686636
fi0.22680412371134018
et0.17355371900826447
pt0.17355371900826447
es0.16434540389972147
sv0.16434540389972147
reliabletrue
passestrue
15
name"Hunter"
dialogue"Dangerous? Who is dangerous? You need to come with me."
detectedLang"en"
heavyLang"en"
scores
en0.83611442193087
yo0.48308270676691734
tl0.4701348747591522
nl0.46911196911196906
it0.46808510638297873
et0.45972495088408644
cs0.4318181818181818
sl0.4318181818181818
no0.42105263157894735
lt0.41113490364025695
fr0.3806306306306307
ms0.3707093821510297
hu0.358974358974359
sq0.34988179669030733
pl0.32926829268292684
sk0.32432432432432434
lv0.30730478589420657
hr0.2966751918158568
da0.2744063324538259
es0.27055702917771884
is0.2506811989100818
pt0.24242424242424243
fi0.21428571428571427
reliabletrue
passestrue
16
name"Marie"
dialogue"Non. S'il vous plaît. Je dois partir maintenant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7851002865329513
ca0.6226415094339622
en0.5850622406639004
pt0.5275590551181102
nl0.4809688581314879
it0.45750452079566006
sl0.4444444444444444
hr0.44237918215613387
tl0.441340782122905
de0.4360902255639098
yo0.42528735632183906
cs0.4117647058823529
sk0.4094488188976378
es0.38650306748466257
eu0.3576017130620985
ro0.3576017130620985
lt0.35064935064935066
pl0.3492407809110629
lv0.34782608695652173
no0.3288590604026846
et0.3212669683257918
fi0.22680412371134018
az0.21052631578947367
is0.20212765957446807
da0.2
sv0.2
sq0.1935483870967742
ms0.1891891891891892
tr0.18256130790190736
hu0.17355371900826447
reliabletrue
passestrue
17
name"Hunter"
dialogue"Miss, wait. We aren't finished. I can't let you walk away."
detectedLang"en"
heavyLang"en"
scores
en0.8002131060202451
tl0.53125
da0.4573082489146165
cs0.44029850746268656
pl0.37913907284768217
no0.36655405405405406
hr0.36006825938566556
sv0.358974358974359
it0.3578767123287671
et0.30167597765363136
ro0.30167597765363136
ca0.2690058479532163
lt0.2647058823529412
sq0.2632612966601179
nl0.25742574257425743
sl0.21875
yo0.1883116883116883
fr0.17218543046357618
sk0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
18
name"Hunter"
dialogue"Hold on. Hunter. Yeah. I'm leaving now."
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
tl0.5033112582781457
da0.4630071599045346
fr0.44581280788177335
no0.4230769230769231
nl0.41709844559585496
ca0.412532637075718
et0.4063324538258575
fi0.39999999999999997
de0.281150159744409
hr0.281150159744409
hi0.27184466019417475
pl0.27184466019417475
cs0.25
sk0.25
yo0.25
sv0.23728813559322032
it0.21875
pt0.21875
ms0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
sq0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
19
name"Hunter"
dialogue"Looks like I have to go. Stay put. I'll be back to find you."
detectedLang"en"
heavyLang"en"
scores
en0.8264749628160636
da0.5833333333333334
tl0.5442708333333333
yo0.5400788436268068
hr0.5205479452054795
no0.5198902606310014
pl0.513212795549374
cs0.4728915662650602
lt0.44356120826709056
sk0.36823104693140796
lv0.34579439252336447
hu0.3445692883895131
ca0.2827868852459016
sv0.2827868852459016
sq0.2768595041322314
sl0.25690021231422505
it0.24731182795698922
ro0.20454545454545453
be0.16666666666666666
tr0.16666666666666666
az0.15254237288135594
et0.15254237288135594
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
20
name"Marie"
dialogue"Je suis désolée. Au revoir."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8107852412488175
ro0.5565410199556541
sl0.54337899543379
hr0.5412844036697247
cs0.5145631067961165
sk0.5121951219512195
nl0.4884910485933504
yo0.4490358126721763
pl0.3127147766323024
de0.2857142857142857
ca0.24528301886792453
da0.24528301886792453
en0.24528301886792453
es0.24528301886792453
no0.24528301886792453
pt0.24528301886792453
sq0.24528301886792453
reliabletrue
passestrue