Run: 2026-02-25-01KJBFMV74XNCARH9DVPC60M15

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
54.9s
Cost:
$0.012302
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Bonjour... Je suis Marie." Hunter: "Marie. I'm Detective Hunter. I need to ask you a few questions about the recent disappearances." Marie: "Les disparitions? Oh non. J'ai vu quelque chose hier. Je suis effrayée." Hunter: "Yesterday? You saw something yesterday? Where?" Marie: "Derrière la grange. Il y avait un bruit. Un homme..." Hunter: "A man? Did you see his face?" Marie: "Non. Il portait un manteau noir. Il a pris quelque chose. J'ai peur." Hunter: "He took something? Are you in danger right now?" Marie: "Je ne sais pas. Mais il a disparu. Comme les autres." Hunter: "Like the others? You think he's one of the missing?" Marie: "Oui. S'il vous plaît, aidez-moi. Je ne comprends pas." Hunter: "I'm trying. I'll get someone to help you. Can you stay here?" Marie: "Oui. Attendez! Ne partez pas." Hunter: "Excuse me. I have to take this call. I'll be back." Marie: "S'il vous plaît..." Hunter: "Hold tight. I'm not going far."
created_at"2026-02-25T22:45:20.233Z" 2/25/2026, 10:45:20 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency535
moderation_latency(null)
generation_time54810
tokens_prompt316
tokens_completion5211
native_tokens_prompt295
native_tokens_completion5089
native_tokens_completion_images(null)
native_tokens_reasoning4807
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0123021
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-77db0b54-6f0e-99e1-b85c-2d614d413cb6"
is_byokfalse
latency535
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772059520-NQjcx1JQukmnmClHQJ9B"
upstream_id"chatcmpl-77db0b54-6f0e-99e1-b85c-2d614d413cb6"
total_cost0.0123021
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Bonjour... Je suis Marie."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8023715415019763
hr0.6212121212121212
sl0.620253164556962
yo0.601063829787234
sk0.5810055865921787
cs0.5786516853932584
nl0.5575221238938053
ro0.5440729483282675
it0.5207667731629393
pl0.512987012987013
no0.4915254237288135
de0.48805460750853247
da0.4863013698630137
sv0.4863013698630137
tl0.33920704845814975
pt0.32432432432432434
ca0.3181818181818182
es0.3087557603686636
lt0.3087557603686636
en0.29577464788732394
et0.29577464788732394
eu0.29577464788732394
ms0.29577464788732394
sq0.29577464788732394
fi0.2822966507177033
lv0.2822966507177033
reliabletrue
passestrue
1
name"Hunter"
dialogue"Marie. I'm Detective Hunter. I need to ask you a few questions about the recent disappearances."
detectedLang"en"
heavyLang"en"
scores
en0.8079561042524005
fr0.6687174633222905
tl0.597006332757628
it0.5942028985507246
ca0.5918367346938775
pt0.5555555555555556
ro0.5507060333761232
da0.5295698924731184
nl0.5115143056524772
sv0.5091164095371669
cs0.5077355836849508
no0.5077355836849508
es0.4636015325670498
hr0.4496855345911949
sk0.43865276663993585
yo0.42291838417147576
pl0.4176372712146422
sq0.4161801501251043
sl0.40273037542662116
lv0.3566176470588235
lt0.35125115848007415
ms0.34024505183788883
et0.31906614785992216
de0.3013972055888224
hu0.24160346695557963
tr0.2273730684326711
is0.16467780429594273
az0.15966386554621848
eu0.15966386554621848
vi0.15966386554621848
fi0.1484184914841849
be0.09090909090909091
uk0.08256880733944955
reliabletrue
passestrue
2
name"Marie"
dialogue"Les disparitions? Oh non. J'ai vu quelque chose hier. Je suis effrayée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7785547785547785
en0.6196957566052843
de0.47687224669603523
ca0.45150115473441105
it0.4398584905660377
nl0.42702050663449936
es0.38946015424164526
cs0.31259044862518093
sk0.31059506531204645
tl0.27480916030534347
sl0.2669753086419753
hr0.2647058823529412
yo0.2554858934169279
pt0.1739130434782609
ro0.16812609457092817
no0.16373239436619716
pl0.1607773851590106
eu0.15480427046263345
da0.13636363636363635
sv0.13636363636363635
sq0.12683823529411764
reliabletrue
passestrue
3
name"Hunter"
dialogue"Yesterday? You saw something yesterday? Where?"
detectedLang"en"
heavyLang"en"
scores
en0.8114630467571644
ms0.41588785046728977
tl0.4075829383886255
nl0.3573264781491003
cs0.2378048780487805
de0.2378048780487805
es0.2378048780487805
pt0.2378048780487805
sq0.2378048780487805
reliabletrue
passestrue
4
name"Marie"
dialogue"Derrière la grange. Il y avait un bruit. Un homme..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.819364161849711
es0.6373307543520309
it0.5997865528281751
ca0.5972073039742213
nl0.5906113537117904
ro0.5870044052863436
no0.48840381991814463
en0.4427934621099554
da0.44029850746268656
yo0.4140625
tl0.375
vi0.3267504488330341
pl0.3181818181818182
et0.3131868131868132
lv0.3081180811808118
pt0.29906542056074764
de0.28977272727272724
sq0.267578125
az0.23469387755102045
tr0.1830065359477124
fi0.17218543046357618
hr0.1515837104072398
sv0.1515837104072398
cs0.1359447004608295
lt0.1359447004608295
sk0.1359447004608295
sl0.1359447004608295
reliabletrue
passestrue
5
name"Hunter"
dialogue"A man? Did you see his face?"
detectedLang"en"
heavyLang"en"
scores
en0.8341232227488151
ro0.5892018779342723
tl0.5853080568720379
et0.571078431372549
pt0.5535714285714286
fr0.5512820512820513
cs0.5454545454545454
da0.5345744680851064
sv0.5205479452054795
de0.5111731843575419
lv0.5042492917847025
lt0.5014245014245015
nl0.49275362318840576
no0.48377581120943947
hu0.4712990936555891
ca0.4372990353697749
es0.4299674267100977
sk0.42622950819672134
it0.41666666666666663
yo0.40476190476190477
hr0.3902439024390244
pl0.375
sl0.33962264150943394
tr0.3055555555555556
is0.3
sq0.29149797570850206
az0.2857142857142857
eu0.2857142857142857
vi0.2857142857142857
fi0.2647058823529412
ms0.2647058823529412
reliabletrue
passestrue
6
name"Marie"
dialogue"Non. Il portait un manteau noir. Il a pris quelque chose. J'ai peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8129967274427302
it0.6901626646010844
ca0.5824634655532359
ro0.5758218451749735
en0.5712754555198285
es0.5299647473560517
lv0.4897959183673469
pt0.4490358126721763
tr0.4244604316546763
yo0.4186046511627907
az0.37888198757763975
da0.3630573248407643
hu0.35379644588045234
de0.34210526315789475
no0.33993399339933994
sv0.332220367278798
sk0.3254637436762226
cs0.32318104906937395
hr0.30434782608695654
pl0.3006993006993007
sl0.28825622775800713
eu0.28186714542190305
sq0.26199261992619927
lt0.26062846580406657
nl0.24953095684803
et0.23371647509578544
ms0.23371647509578544
is0.15789473684210525
tl0.15254237288135594
vi0.14893617021276595
fi0.13606911447084233
reliabletrue
passestrue
7
name"Hunter"
dialogue"He took something? Are you in danger right now?"
detectedLang"en"
heavyLang"en"
scores
en0.8355263157894737
tl0.6247113163972287
de0.5030581039755352
ro0.4715447154471545
yo0.44821731748726656
nl0.4347826086956522
fr0.4257950530035336
sv0.3902439024390244
no0.3821292775665399
da0.37977099236641226
es0.33264887063655035
sl0.32150313152400833
ms0.3200836820083682
it0.3114406779661017
ca0.21875
fi0.21875
lt0.21307506053268765
az0.20537897310513448
pl0.20537897310513448
cs0.1935483870967742
pt0.1935483870967742
reliabletrue
passestrue
8
name"Marie"
dialogue"Je ne sais pas. Mais il a disparu. Comme les autres."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8296007789678674
ca0.6846846846846848
it0.6272630457933972
pt0.5823389021479713
cs0.5512820512820513
ro0.5501285347043702
hr0.5308310991957105
sl0.5276653171390013
nl0.5231607629427792
sq0.5198902606310014
en0.4971264367816092
sk0.49567723342939485
es0.4852941176470589
lt0.4479495268138801
yo0.44620253164556967
tl0.44089456869009586
no0.42244224422442245
tr0.42148760330578516
hu0.40476190476190477
de0.38162544169611307
pl0.358974358974359
az0.34579439252336447
da0.34210526315789475
lv0.33078393881453155
fi0.3013972055888224
ms0.29577464788732394
et0.2857142857142857
is0.1764705882352941
eu0.16666666666666666
vi0.16666666666666666
sv0.15254237288135594
reliabletrue
passestrue
9
name"Hunter"
dialogue"Like the others? You think he's one of the missing?"
detectedLang"en"
heavyLang"en"
scores
en0.8443983402489627
tl0.6621621621621622
nl0.6183206106870229
no0.569583931133429
is0.44547134935304994
yo0.4230769230769231
da0.41972920696324956
ms0.38524590163934425
sv0.3670886075949367
de0.34065934065934067
fr0.3333333333333333
hr0.2248062015503876
pl0.2248062015503876
cs0.20634920634920634
fi0.20634920634920634
sq0.20634920634920634
ca0.1935483870967742
az0.1780821917808219
et0.1780821917808219
it0.1780821917808219
pt0.1780821917808219
reliabletrue
passestrue
10
name"Marie"
dialogue"Oui. S'il vous plaît, aidez-moi. Je ne comprends pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7987349051178838
ca0.5833333333333334
nl0.46808510638297873
sl0.46236559139784944
it0.45567651632970446
lt0.4514106583072101
es0.44881889763779526
hr0.4479495268138801
sq0.40476190476190477
cs0.3955094991364421
en0.38380281690140844
ro0.3794326241134752
pt0.36363636363636365
tl0.32432432432432434
yo0.317738791423002
de0.30966469428007887
sk0.29292929292929293
eu0.2374727668845316
lv0.2273730684326711
tr0.21171171171171171
pl0.20634920634920634
fi0.2009132420091324
ms0.1935483870967742
hu0.1898148148148148
reliabletrue
passestrue
11
name"Hunter"
dialogue"I'm trying. I'll get someone to help you. Can you stay here?"
detectedLang"en"
heavyLang"en"
scores
en0.8207391064533922
tl0.4500846023688663
cs0.39138576779026213
yo0.29653679653679654
pl0.2934782608695652
sk0.28884026258205686
lv0.27293064876957496
sl0.2713004484304933
hr0.2630385487528345
no0.2511520737327189
da0.24242424242424243
lt0.24242424242424243
is0.23529411764705882
sq0.23529411764705882
es0.1935483870967742
pt0.1935483870967742
az0.19154228855721395
ca0.19154228855721395
tr0.19154228855721395
reliabletrue
passestrue
12
name"Marie"
dialogue"Oui. Attendez! Ne partez pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7797356828193832
ca0.6710526315789473
it0.649737302977233
sq0.6078431372549019
lt0.5807127882599581
en0.576271186440678
es0.5708154506437768
lv0.5565410199556541
nl0.5515695067264574
tr0.5305164319248826
no0.5157384987893463
ro0.49622166246851385
sl0.4936708860759494
pt0.47643979057591623
hr0.47368421052631576
de0.4594594594594595
da0.43977591036414565
tl0.43977591036414565
ms0.4350282485875706
cs0.42028985507246375
hu0.42028985507246375
sv0.4117647058823529
et0.40298507462686567
fi0.3055555555555556
az0.2857142857142857
eu0.2857142857142857
pl0.25925925925925924
sk0.23954372623574144
yo0.2277992277992278
reliabletrue
passestrue
13
name"Hunter"
dialogue"Excuse me. I have to take this call. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.7997329773030708
tl0.5951417004048583
da0.5652173913043478
no0.5348837209302325
yo0.526813880126183
sl0.4889267461669506
sq0.4845360824742268
lt0.48186528497409326
pl0.46524064171123
hr0.4594594594594595
cs0.44029850746268656
sk0.40476190476190477
it0.3939393939393939
lv0.3814432989690722
hu0.38016528925619836
et0.34497816593886466
ca0.3150684931506849
sv0.3150684931506849
es0.2537313432835821
fr0.23273657289002556
ro0.23076923076923078
pt0.22680412371134018
ms0.21875
nl0.21875
fi0.2
be0.1891891891891892
tr0.1891891891891892
az0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
14
name"Marie"
dialogue"S'il vous plaît..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7942386831275721
ca0.5555555555555556
reliabletrue
passestrue
15
name"Hunter"
dialogue"Hold tight. I'm not going far."
detectedLang"en"
heavyLang"en"
scores
en0.8048780487804879
da0.5771670190274841
tl0.47229551451187335
no0.4301994301994302
it0.3174061433447099
tr0.2805755395683453
de0.27007299270072993
fr0.27007299270072993
yo0.27007299270072993
reliabletrue
passestrue