Run: 2026-02-25-01KJBHQSQ1N2QR1T2RNPBK1QNY

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
59.7s
Cost:
$0.010538
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, Miss. I'm Detective Hunter. I need to ask you a few questions." Marie: "Je ne comprends pas. Que voulez-vous?" Hunter: "Do you speak English? I'm investigating something that happened near the woods." Marie: "Non. Je suis française. Les bois?" Hunter: "Yes, the woods. You were there yesterday, weren't you? Taking photos?" Marie: "Oui. J'étais là. Pour mes photos." Hunter: "Did you see anyone else around? Anyone suspicious?" Marie: "Je ne sais pas. Il y avait... du bruit. Des pas." Hunter: "Footsteps? Were they following you?" Marie: "Je pense... oui. Ils me regardaient." Hunter: "They were watching you? Did you get a picture of them?" Marie: "Non. C'était sombre. J'ai peur." Hunter: "I understand. I just need to look at your camera to be sure." Marie: "Attendez! S'il vous plaît. C'est... dangereux." Hunter: "I know it is. That's why I'm here. Please stay calm." Marie: "Ne partez pas. S'il vous plaît." Hunter: "I'm not going anywhere. I just..." Hunter: "Sorry, I have to take this call." Marie: "Ne partez pas." Hunter: "I'll be right back."
created_at"2026-02-25T23:21:54.151Z" 2/25/2026, 11:21:54 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency522
moderation_latency(null)
generation_time59655
tokens_prompt316
tokens_completion4253
native_tokens_prompt295
native_tokens_completion4354
native_tokens_completion_images(null)
native_tokens_reasoning4039
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0105381
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-adb2674e-5b3c-9dfa-8f90-4e1c8707533f"
is_byokfalse
latency522
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772061714-WPmQHSdOdTNXSQvaJ0sv"
upstream_id"chatcmpl-adb2674e-5b3c-9dfa-8f90-4e1c8707533f"
total_cost0.0105381
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, Miss. I'm Detective Hunter. I need to ask you a few questions."
detectedLang"en"
heavyLang"en"
scores
en0.8000799680127949
fr0.6214988644965935
tl0.6191926884996192
it0.6108949416342413
ca0.5670995670995671
pt0.5594713656387665
no0.5340167753960857
ro0.5192307692307693
cs0.5088408644400786
sq0.5029821073558649
es0.4939271255060729
da0.490316004077472
hr0.4646680942184154
sl0.4594594594594595
nl0.44382647385984425
pl0.42263279445727486
et0.4186046511627907
yo0.40688018979833923
sv0.4033412887828162
sk0.4004796163069544
lv0.33774834437086093
lt0.33244325767690247
de0.3234100135317997
hu0.3084370677731674
ms0.2917847025495751
tr0.2917847025495751
fi0.2163009404388715
is0.2163009404388715
az0.21011058451816747
vi0.21011058451816747
be0.12280701754385964
eu0.12280701754385964
uk0.11190053285968028
reliabletrue
passestrue
1
name"Marie"
dialogue"Je ne comprends pas. Que voulez-vous?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8156342182890856
ca0.6847414880201765
es0.6075353218210361
nl0.5519713261648745
sl0.5462794918330308
pt0.5404411764705882
it0.5395948434622468
lt0.5353159851301116
hr0.5318352059925093
sq0.4877049180327869
cs0.4780793319415449
en0.4658119658119659
ro0.46120689655172414
tl0.40191387559808617
yo0.3946731234866829
de0.3857493857493857
sk0.3670886075949367
lv0.2917847025495751
tr0.2732558139534884
pl0.2668621700879765
fi0.26035502958579887
ms0.251497005988024
hu0.24698795180722888
reliabletrue
passestrue
2
name"Hunter"
dialogue"Do you speak English? I'm investigating something that happened near the woods."
detectedLang"en"
heavyLang"en"
scores
en0.8221791141286776
tl0.6481126039667306
pt0.492151431209603
hr0.4186046511627907
ms0.40987124463519314
ro0.4092373791621912
no0.40796555435952636
sv0.3902439024390244
cs0.38271604938271603
nl0.3648960739030023
sq0.3626882966396292
fr0.3483412322274882
de0.3357487922705314
da0.3341404358353511
sk0.32926829268292684
sl0.30904522613065327
es0.29214929214929214
it0.28292046936114734
yo0.25170068027210885
ca0.2109038737446198
pl0.20634920634920634
is0.2005813953488372
et0.18998527245949925
lt0.1863905325443787
az0.17664670658682635
vi0.16792738275340394
lv0.11290322580645161
fi0.09688013136288999
reliabletrue
passestrue
3
name"Marie"
dialogue"Non. Je suis française. Les bois?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8257839721254355
ca0.6370235934664247
hr0.5535714285714286
sl0.5535714285714286
yo0.5485327313769752
en0.54337899543379
it0.5370370370370371
cs0.5203836930455635
sk0.5203836930455635
nl0.5012468827930174
es0.46524064171123
no0.45652173913043476
eu0.4550408719346049
pl0.44598337950138506
de0.441340782122905
pt0.441340782122905
et0.2805755395683453
sq0.2727272727272727
hu0.25925925925925924
ro0.25925925925925924
da0.250936329588015
sv0.250936329588015
tl0.250936329588015
az0.23954372623574144
tr0.23954372623574144
is0.2277992277992278
lv0.2277992277992278
ms0.2277992277992278
reliabletrue
passestrue
4
name"Hunter"
dialogue"Yes, the woods. You were there yesterday, weren't you? Taking photos?"
detectedLang"en"
heavyLang"en"
scores
en0.7980997624703088
tl0.5600414078674948
nl0.5595854922279793
fr0.4378306878306878
de0.43633952254641906
sq0.34815950920245403
no0.29867986798679863
pt0.2621527777777778
sv0.2595818815331011
yo0.20112781954887218
pl0.19962335216572505
tr0.16829745596868884
es0.15841584158415842
fi0.15841584158415842
lt0.15841584158415842
cs0.1550695825049702
da0.1550695825049702
ms0.1550695825049702
hi0.1533864541832669
ca0.1431451612903226
et0.1431451612903226
is0.1431451612903226
lv0.1431451612903226
sk0.1431451612903226
sl0.1431451612903226
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui. J'étais là. Pour mes photos."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7941445562671546
lt0.5778611632270169
lv0.43467336683417085
pt0.43467336683417085
es0.43324937027707805
en0.42159383033419023
ca0.4201030927835051
vi0.4109947643979057
sq0.30769230769230765
yo0.281150159744409
hi0.2549668874172185
tl0.2549668874172185
de0.2398648648648649
nl0.2398648648648649
reliabletrue
passestrue
6
name"Hunter"
dialogue"Did you see anyone else around? Anyone suspicious?"
detectedLang"en"
heavyLang"en"
scores
en0.8129251700680273
tl0.6483375959079284
et0.3820224719101124
hu0.24242424242424243
pt0.24242424242424243
ro0.24242424242424243
cs0.22096317280453256
ca0.207492795389049
es0.207492795389049
fr0.207492795389049
ms0.207492795389049
reliabletrue
passestrue
7
name"Marie"
dialogue"Je ne sais pas. Il y avait... du bruit. Des pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8253783469150174
nl0.5774647887323944
ca0.5562130177514794
de0.5222929936305732
sl0.5008319467554077
lt0.4983277591973244
hr0.4863013698630137
ro0.4746059544658494
it0.4614003590664273
sq0.44237918215613387
cs0.43289224952741023
vi0.3963782696177062
pl0.3951612903225807
tr0.3723849372384937
es0.3670886075949367
yo0.35205183585313177
sk0.3258426966292135
eu0.3212669683257918
da0.29577464788732394
en0.29411764705882354
az0.27710843373493976
sv0.27710843373493976
no0.25742574257425743
lv0.2555831265508685
fi0.22680412371134018
ms0.21875
hu0.21465968586387435
reliabletrue
passestrue
8
name"Hunter"
dialogue"Footsteps? Were they following you?"
detectedLang"en"
heavyLang"en"
scores
en0.8173701298701299
tl0.5967741935483871
nl0.4094488188976378
cs0.25742574257425743
de0.25742574257425743
fr0.25742574257425743
it0.25742574257425743
no0.25742574257425743
reliabletrue
passestrue
9
name"Marie"
dialogue"Je pense... oui. Ils me regardaient."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7969130787977254
nl0.6339677891654465
en0.5867768595041323
ca0.5826377295492488
es0.5697074010327022
pt0.5652173913043478
it0.5503597122302158
sl0.5107632093933464
no0.4703389830508474
ro0.46351931330472107
hr0.40617577197149646
et0.39903846153846156
yo0.3946731234866829
az0.3902439024390244
de0.38271604938271603
sq0.3718592964824121
cs0.37027707808564225
ms0.3670886075949367
sk0.3670886075949367
tl0.3654822335025381
da0.3438320209973753
tr0.2732558139534884
pl0.2668621700879765
fi0.23076923076923078
lv0.22118380062305293
lt0.21135646687697163
sv0.19614147909967844
reliabletrue
passestrue
10
name"Hunter"
dialogue"They were watching you? Did you get a picture of them?"
detectedLang"en"
heavyLang"en"
scores
en0.8419260700389105
tl0.6153846153846154
yo0.482484076433121
de0.4791666666666667
it0.4791666666666667
is0.44821731748726656
fr0.4133574007220217
ro0.4003690036900369
cs0.3925233644859813
hr0.37858508604206503
nl0.37619961612284064
sl0.34343434343434337
no0.33537832310838445
hu0.32432432432432434
sq0.3055555555555556
ms0.30257510729613735
pt0.3010752688172043
ca0.29501084598698485
es0.28884026258205686
sk0.2857142857142857
pl0.24418604651162787
lt0.20147420147420148
tr0.19154228855721395
da0.181360201511335
az0.17721518987341772
eu0.17721518987341772
lv0.17721518987341772
vi0.17721518987341772
et0.16237113402061853
fi0.16237113402061853
sv0.16237113402061853
reliabletrue
passestrue
11
name"Marie"
dialogue"Non. C'était sombre. J'ai peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8060135790494666
it0.5661605206073753
es0.3710691823899371
ca0.35275080906148865
en0.3174061433447099
tl0.3150684931506849
eu0.30313588850174217
reliabletrue
passestrue
12
name"Hunter"
dialogue"I understand. I just need to look at your camera to be sure."
detectedLang"en"
heavyLang"en"
scores
en0.8102981029810299
da0.6725912067352665
no0.6682464454976302
tl0.6510468594217349
sv0.6036240090600227
pl0.49201741654571846
yo0.4883040935672514
ro0.4791666666666667
cs0.47761194029850745
ca0.47526236881559225
et0.4648318042813456
sk0.45567651632970446
lt0.44356120826709056
it0.43820224719101125
de0.4308943089430894
hr0.42148760330578516
nl0.42052980132450335
lv0.34579439252336447
hu0.3445692883895131
ms0.3
is0.2813141683778234
sq0.2768595041322314
sl0.25690021231422505
es0.22048997772828507
fr0.1784037558685446
be0.16666666666666666
tr0.16666666666666666
az0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
13
name"Marie"
dialogue"Attendez! S'il vous plaît. C'est... dangereux."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8044328552803129
ca0.4800693240901213
en0.46428571428571425
no0.4186046511627907
it0.3775933609958506
da0.36575052854122625
nl0.36575052854122625
es0.3603411513859275
de0.3548387096774194
lt0.22680412371134018
pt0.22077922077922074
tl0.20424403183023873
lv0.20212765957446807
ro0.2
et0.1780821917808219
sv0.1780821917808219
tr0.1780821917808219
reliabletrue
passestrue
14
name"Hunter"
dialogue"I know it is. That's why I'm here. Please stay calm."
detectedLang"en"
heavyLang"en"
scores
en0.8233695652173912
sq0.5637583892617449
yo0.46546052631578944
tl0.4357638888888889
hu0.40476190476190477
ro0.36893203883495146
nl0.3285123966942149
is0.3229166666666667
lv0.3143459915611814
no0.30851063829787234
da0.2995689655172413
hr0.2995689655172413
ca0.29805615550755943
sv0.29805615550755943
pl0.2793791574279379
it0.26136363636363635
cs0.24418604651162787
sk0.181360201511335
be0.17721518987341772
tr0.17721518987341772
az0.16237113402061853
et0.16237113402061853
lt0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
15
name"Marie"
dialogue"Ne partez pas. S'il vous plaît."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7874601487778958
ca0.6557659208261618
sq0.6078431372549019
lt0.5807127882599581
ro0.49622166246851385
sl0.4936708860759494
it0.48586118251928023
hr0.47368421052631576
lv0.4666666666666667
nl0.45652173913043476
tr0.44598337950138506
ms0.4350282485875706
cs0.42028985507246375
hu0.42028985507246375
es0.3265993265993266
pt0.3265993265993266
en0.3103448275862069
fi0.3055555555555556
az0.2857142857142857
de0.2857142857142857
eu0.2857142857142857
tl0.2857142857142857
da0.2727272727272727
sv0.2727272727272727
no0.2647058823529412
et0.25925925925925924
pl0.25925925925925924
sk0.23954372623574144
yo0.2277992277992278
reliabletrue
passestrue
16
name"Hunter"
dialogue"I'm not going anywhere. I just..."
detectedLang"en"
heavyLang"en"
scores
en0.81044650379107
tl0.5292887029288702
sv0.5161290322580645
ca0.4886363636363637
sq0.4851258581235698
et0.4230769230769231
tr0.3967828418230563
no0.39189189189189183
da0.3818681318681319
hr0.3818681318681319
pl0.358974358974359
it0.3382352941176471
cs0.3181818181818182
ro0.2857142857142857
yo0.27884615384615385
de0.25742574257425743
sk0.24242424242424243
be0.23728813559322032
hu0.22945205479452058
az0.21875
is0.21875
lt0.21875
lv0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
17
name"Hunter"
dialogue"Sorry, I have to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.8237885462555066
tl0.6879875195007801
da0.6610169491525424
pl0.5661605206073753
hr0.5604395604395604
no0.5594713656387665
cs0.5412844036697247
yo0.5283018867924528
it0.5180722891566265
sk0.504950495049505
sl0.49874686716791977
lv0.4805194805194805
lt0.4550408719346049
ca0.40828402366863903
sv0.40828402366863903
sq0.40119760479041916
pt0.3333333333333333
ro0.3103448275862069
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
18
name"Marie"
dialogue"Ne partez pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7802197802197802
sq0.7560975609756098
lt0.7347480106100795
ca0.7191011235955056
ro0.6632996632996633
sl0.6610169491525424
it0.6539792387543253
hr0.6428571428571429
lv0.6363636363636364
nl0.6268656716417911
tr0.6168582375478927
ms0.6062992125984252
cs0.5918367346938775
hu0.5918367346938775
es0.49238578680203043
pt0.49238578680203043
en0.47368421052631576
fi0.46808510638297873
az0.4444444444444444
de0.4444444444444444
eu0.4444444444444444
tl0.4444444444444444
da0.42857142857142855
sv0.42857142857142855
no0.4186046511627907
et0.4117647058823529
pl0.4117647058823529
sk0.38650306748466257
yo0.3710691823899371
reliabletrue
passestrue
19
name"Hunter"
dialogue"I'll be right back."
detectedLang"en"
heavyLang"en"
scores
en0.8100303951367781
tl0.7065727699530516
yo0.5954692556634305
hu0.4834710743801653
lt0.47257383966244726
da0.3718592964824121
de0.3718592964824121
fr0.3718592964824121
no0.3718592964824121
reliabletrue
passestrue