Run: 2026-02-16-01KHK34NQKJVG2QBBPJTPGN35K

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
1m 27s
Cost:
$0.009278
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "..." Hunter: "Excuse me, miss. Do you have a moment?" Marie: "Je... je ne comprends pas. Parlez-vous français ?" Hunter: "I'm asking if you speak English. I'm with the police." Marie: "Anglais? Non. Non, je ne parle pas. Je suis désolée." Hunter: "Great. Did you happen to be near the apple festival grounds yesterday evening?" Marie: "Hier... oui. J'étais là. Avec mon appareil." Hunter: "Apparatus? You mean a weapon?" Marie: "Non! Non... regardez. Les photos. J'ai vu..." Hunter: "Photos? You took pictures?" Marie: "Oui. C'était... terrible. Quelqu'un a disparu." Hunter: "Disparu? You saw someone disappear?" Marie: "Je ne sais pas. Je suis bouleversée." Hunter: "Look, I need to know what you saw. Can you show me?" Marie: "Je... je ne peux pas. C'est trop difficile." Hunter: "Miss, this is important. People are missing." Marie: "Je sais. Je suis désolée." Hunter: "Hold on." Hunter: "Detective Hunter. Yeah. I'm on my way." Hunter: "We're not done here. I'll find someone who can translate." Marie: "Au revoir..."
created_at"2026-02-16T11:26:28.273349+00:00" 2/16/2026, 11:26:28 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency870
moderation_latency(null)
generation_time86956
tokens_prompt316
tokens_completion2614
native_tokens_prompt295
native_tokens_completion2528
native_tokens_completion_images(null)
native_tokens_reasoning2213
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0092778
router(null)
provider_responses
0
id"chatcmpl-9a24e5af-7263-9c08-bbd4-17280eb651bf"
status200
is_byokfalse
latency870
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771241101-0M4LQWAUGLgT9FpTuMGS"
upstream_id"chatcmpl-9a24e5af-7263-9c08-bbd4-17280eb651bf"
total_cost0.0092778
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. Do you have a moment?"
detectedLang"en"
heavyLang"en"
scores
en0.7831743278404163
sq0.6556473829201103
cs0.6532593619972261
pt0.6522948539638386
fr0.622356495468278
sk0.6136012364760433
pl0.6075353218210361
ca0.5791245791245792
tl0.5741056218057922
es0.5629370629370629
nl0.558303886925795
ro0.552772808586762
sl0.5437956204379563
hr0.5412844036697247
it0.5370370370370371
da0.5335820895522388
yo0.5098039215686274
no0.4769874476987448
hu0.4669509594882729
de0.4529540481400437
vi0.419953596287703
et0.3872549019607844
ms0.37027707808564225
fi0.3556701030927836
az0.34725848563968675
sv0.33510638297872336
lt0.24698795180722888
tr0.23547400611620795
is0.23076923076923078
eu0.21875
lv0.21875
reliabletrue
passestrue
2
name"Marie"
dialogue"Je... je ne comprends pas. Parlez-vous français ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8063266623628148
ca0.6798292422625399
it0.6005326231691078
nl0.5978552278820375
sl0.5940460081190798
hr0.5856353591160222
sq0.5535714285714286
cs0.5468277945619335
ro0.5412844036697247
lt0.5391705069124424
en0.5370370370370371
pt0.5334370139968896
es0.5297805642633229
de0.4983277591973244
sk0.4889267461669506
yo0.44751381215469616
tl0.4392523364485981
pl0.4318181818181818
lv0.42418426103646834
hu0.42196531791907516
tr0.4186046511627907
ms0.40711462450592883
no0.3087557603686636
az0.3071593533487298
da0.29577464788732394
sv0.29577464788732394
fi0.22680412371134018
eu0.21052631578947367
et0.17355371900826447
is0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm asking if you speak English. I'm with the police."
detectedLang"en"
heavyLang"en"
scores
en0.8163841807909604
tl0.6621621621621622
sv0.5578231292517007
no0.5199409158050221
fr0.48899371069182396
ms0.4881889763779528
nl0.45561139028475717
cs0.4444444444444444
ro0.4328097731239092
da0.4247787610619469
hr0.4247787610619469
de0.41651705565529623
it0.3380855397148676
sl0.33264887063655035
sq0.3298969072164949
sk0.3257261410788381
pt0.30257510729613735
yo0.2476851851851852
eu0.2243436754176611
et0.214975845410628
lv0.214975845410628
pl0.21307506053268765
lt0.2111650485436893
fi0.20537897310513448
az0.1875
es0.1875
hu0.1875
ca0.181360201511335
tr0.181360201511335
is0.1792929292929293
reliabletrue
passestrue
4
name"Marie"
dialogue"Anglais? Non. Non, je ne parle pas. Je suis désolée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8015873015873016
sl0.6345919610231425
lt0.5850622406639004
it0.5683453237410072
sq0.5607613469985359
cs0.5535714285714286
hr0.5363214837712519
ca0.511400651465798
sk0.48805460750853247
nl0.4827586206896552
lv0.460431654676259
ro0.44751381215469616
en0.4307400379506641
yo0.35205183585313177
pl0.34497816593886466
tr0.33774834437086093
hu0.33184855233853006
ms0.3288590604026846
es0.3273542600896861
de0.3227990970654628
fi0.22680412371134018
eu0.2248062015503876
az0.1891891891891892
et0.17355371900826447
pt0.17355371900826447
da0.16434540389972147
no0.16434540389972147
sv0.16434540389972147
reliabletrue
passestrue
5
name"Hunter"
dialogue"Great. Did you happen to be near the apple festival grounds yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.8056537102473499
tl0.6206896551724138
nl0.5867768595041323
no0.5528455284552846
da0.5450785773366419
sv0.5431893687707641
fr0.492151431209603
es0.42827442827442824
cs0.4186046511627907
de0.40860215053763443
it0.39759036144578314
yo0.39159292035398224
lt0.3834080717488789
hr0.36562860438292966
sl0.358974358974359
ro0.35672514619883045
pt0.3460166468489893
hu0.3357487922705314
ms0.3184634448574969
sk0.3125
sq0.2744063324538259
ca0.2724867724867725
pl0.2647058823529412
lv0.25170068027210885
et0.18154761904761904
az0.17664670658682635
is0.16666666666666666
fi0.10277324632952692
reliabletrue
passestrue
6
name"Marie"
dialogue"Hier... oui. J'étais là. Avec mon appareil."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7794707297514034
nl0.39560439560439564
vi0.36342592592592593
lt0.30730478589420657
de0.2948717948717949
lv0.27055702917771884
it0.26273458445040215
pt0.25271739130434784
yo0.24242424242424243
da0.22096317280453256
hi0.22096317280453256
en0.21875
reliabletrue
passestrue
7
name"Hunter"
dialogue"Apparatus? You mean a weapon?"
detectedLang"en"
heavyLang"en"
scores
en0.7804610318331504
tl0.6363636363636364
it0.5975855130784709
fr0.5943204868154158
hr0.562363238512035
hu0.5495495495495496
ro0.5157384987893463
cs0.5121951219512195
ms0.4490358126721763
lt0.44751381215469616
tr0.4301994301994302
lv0.42857142857142855
et0.4269340974212034
nl0.42363112391930835
da0.41690962099125367
no0.41348973607038125
pt0.4117647058823529
sv0.4065281899109792
ca0.40476190476190477
fi0.40119760479041916
es0.39759036144578314
sk0.3939393939393939
yo0.3730407523510972
pl0.3442622950819672
sl0.3103448275862069
is0.2727272727272727
sq0.2647058823529412
az0.25925925925925924
eu0.25925925925925924
vi0.25925925925925924
de0.250936329588015
reliabletrue
passestrue
8
name"Marie"
dialogue"Non! Non... regardez. Les photos. J'ai vu..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7974797479747975
en0.6017699115044248
ca0.5746691871455577
es0.5322245322245323
it0.5011086474501109
nl0.4318181818181818
tl0.4015957446808511
no0.29245283018867924
eu0.27884615384615385
lt0.26229508196721313
pt0.26229508196721313
hi0.2549668874172185
ro0.2474916387959866
de0.2398648648648649
lv0.2398648648648649
reliabletrue
passestrue
9
name"Hunter"
dialogue"Photos? You took pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7995418098510881
fr0.6812386156648452
tl0.6369294605809128
ca0.5793269230769231
lv0.46808510638297873
ro0.4648318042813456
de0.4496855345911949
nl0.4496855345911949
et0.358974358974359
es0.3137254901960784
lt0.3137254901960784
pt0.3137254901960784
cs0.308300395256917
hi0.3055555555555556
da0.29149797570850206
no0.29149797570850206
sv0.29149797570850206
reliabletrue
passestrue
10
name"Marie"
dialogue"Oui. C'était... terrible. Quelqu'un a disparu."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7736768802228412
it0.5660881174899867
ca0.5566166439290586
es0.5529573590096286
en0.5467224546722455
pt0.4897959183673469
de0.46013289036544847
ro0.4196428571428571
hu0.4025735294117647
sq0.39365671641791045
cs0.3821292775665399
sk0.37977099236641226
pl0.33537832310838445
tl0.3128964059196617
nl0.29653679653679654
da0.2934782608695652
az0.2903930131004367
no0.2903930131004367
et0.2793791574279379
sv0.2793791574279379
fi0.27293064876957496
yo0.268018018018018
hr0.2562929061784897
sl0.21686746987951808
lt0.20147420147420148
tr0.19154228855721395
is0.1875
eu0.17721518987341772
lv0.17721518987341772
vi0.17721518987341772
ms0.16237113402061853
reliabletrue
passestrue
11
name"Hunter"
dialogue"Disparu? You saw someone disappear?"
detectedLang"en"
heavyLang"en"
scores
en0.7636554621848739
ms0.46808510638297873
it0.4485294117647059
pt0.44168734491315137
fr0.4375
es0.4360902255639098
cs0.3951612903225807
nl0.3181818181818182
ro0.29906542056074764
ca0.2857142857142857
tl0.25742574257425743
de0.23469387755102045
sk0.23469387755102045
sq0.23469387755102045
reliabletrue
passestrue
12
name"Marie"
dialogue"Je ne sais pas. Je suis bouleversée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7960108794197642
sl0.5722433460076045
nl0.5673076923076923
hr0.5579567779960707
sq0.5140388768898488
cs0.5044052863436124
lt0.4730679156908665
sv0.4318181818181818
no0.4230769230769231
ca0.4201030927835051
yo0.4201030927835051
sk0.39189189189189183
lv0.31402439024390244
ro0.3119266055045872
tr0.29467084639498436
da0.29245283018867924
pl0.2879746835443038
fi0.281150159744409
it0.281150159744409
ms0.27184466019417475
hu0.267100977198697
de0.26229508196721313
pt0.2549668874172185
reliabletrue
passestrue
13
name"Hunter"
dialogue"Look, I need to know what you saw. Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8308733087330873
no0.5564516129032259
tl0.5550161812297735
cs0.533106960950764
et0.5192307692307693
sq0.5062836624775583
pl0.4869402985074627
hr0.4811320754716981
da0.46911196911196906
yo0.44889779559118237
ca0.4387755102040817
sl0.4318181818181818
sk0.4258872651356994
it0.4148936170212766
lv0.40217391304347827
ms0.4008714596949891
lt0.3778280542986425
pt0.375
nl0.3692660550458715
tr0.3483412322274882
az0.3373493975903614
sv0.3341404358353511
es0.27055702917771884
fr0.2486338797814208
ro0.24657534246575344
fi0.21428571428571427
be0.20289855072463767
hu0.19590643274853803
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
14
name"Marie"
dialogue"Je... je ne peux pas. C'est trop difficile."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8305084745762712
it0.6081504702194357
sl0.5462794918330308
hr0.5318352059925093
ca0.4887525562372188
sq0.4877049180327869
cs0.4780793319415449
nl0.4646680942184154
lt0.4469026548672566
en0.4331065759637188
ro0.4318181818181818
yo0.3946731234866829
sk0.3670886075949367
lv0.2917847025495751
tr0.2732558139534884
pl0.2668621700879765
fi0.26035502958579887
es0.25595238095238093
ms0.251497005988024
hu0.24698795180722888
de0.24242424242424243
reliabletrue
passestrue
15
name"Hunter"
dialogue"Miss, this is important. People are missing."
detectedLang"en"
heavyLang"en"
scores
en0.8353293413173652
tl0.6981339187705818
ro0.6060171919770774
nl0.5961820851688693
fr0.5749613601236476
ca0.5736434108527132
da0.5018115942028986
pt0.4878957169459963
it0.4859813084112149
is0.4701348747591522
no0.4455645161290322
es0.41737288135593226
sv0.3721461187214612
hu0.358974358974359
yo0.3037974683544304
ms0.2857142857142857
tr0.22535211267605632
fi0.22096317280453256
de0.207492795389049
lt0.20520231213872833
sq0.19590643274853803
az0.19117647058823528
et0.19117647058823528
reliabletrue
passestrue
16
name"Marie"
dialogue"Je sais. Je suis désolée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.80719794344473
sl0.5356037151702787
hr0.5327102803738317
yo0.5207667731629393
cs0.494949494949495
sk0.4915254237288135
nl0.45652173913043476
pl0.3775933609958506
de0.34782608695652173
reliabletrue
passestrue
17
name"Hunter"
dialogue"Hold on."
detectedLang"en"
heavyLang"da"
scores
en0.8245614035087719
et0.7549019607843137
fi0.75
da0.691358024691358
fr0.6855345911949685
ca0.6644295302013423
hr0.6376811594202898
hi0.6268656716417911
pl0.6268656716417911
tl0.6268656716417911
cs0.6
sk0.6
yo0.6
reliablefalse
passestrue
18
name"Hunter"
dialogue"Detective Hunter. Yeah. I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7950819672131147
tl0.6453900709219859
fr0.5993589743589743
ca0.5748299319727891
ro0.5543672014260249
it0.48559670781893005
cs0.48240165631469983
pt0.48240165631469983
es0.41588785046728977
pl0.4131455399061033
de0.4075829383886255
da0.39903846153846156
sk0.39172749391727496
no0.3872549019607844
hr0.38271604938271603
et0.3811881188118812
sq0.37810945273631835
fi0.375
nl0.3670886075949367
sv0.3540051679586563
sl0.33510638297872336
hi0.251497005988024
yo0.23076923076923078
ms0.19093851132686085
tr0.19093851132686085
reliabletrue
passestrue
19
name"Hunter"
dialogue"We're not done here. I'll find someone who can translate."
detectedLang"en"
heavyLang"en"
scores
en0.8089519650655022
tr0.38380281690140844
tl0.38162544169611307
sq0.32950191570881227
ro0.3230174081237911
da0.317738791423002
pt0.3110236220472441
es0.3069306930693069
ca0.3027888446215139
hr0.2827868852459016
it0.2827868852459016
no0.2827868852459016
az0.279835390946502
vi0.2009132420091324
fr0.18604651162790697
pl0.16666666666666666
de0.1606714628297362
eu0.1606714628297362
lt0.1606714628297362
lv0.1606714628297362
nl0.15254237288135594
sk0.15254237288135594
cs0.14425427872860636
et0.14425427872860636
ms0.14425427872860636
sl0.14425427872860636
sv0.14425427872860636
reliabletrue
passestrue
20
name"Marie"
dialogue"Au revoir..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8166259168704157
ro0.7699386503067485
ca0.46428571428571425
cs0.46428571428571425
da0.46428571428571425
en0.46428571428571425
es0.46428571428571425
hr0.46428571428571425
nl0.46428571428571425
no0.46428571428571425
pt0.46428571428571425
sk0.46428571428571425
sl0.46428571428571425
sq0.46428571428571425
reliabletrue
passestrue