Run: 2026-02-25-01KJBGWBRDM71EY17BKW58ZKRH

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
41.7s
Cost:
$0.008522
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Miss?" Marie: "Oui? Je vous écoute." Hunter: "I'm Detective Hunter. I'm asking about the recent disappearances in Alborn." Marie: "Les disparitions? Oh, mon Dieu..." Hunter: "You've seen something?" Marie: "Non... mais j'ai peur. Très peur." Hunter: "Scared? Why?" Marie: "La nuit. Dans les pommes." Hunter: "The orchard?" Marie: "Oui. Là-bas." Hunter: "Alright. Keep your eyes open." Marie: "Je vais le faire." Hunter: "Hold on." Hunter: "Yeah... I'm on my way." Hunter: "Sorry. Duty calls." Marie: "Au revoir. Bon courage." Hunter: "Thanks."
created_at"2026-02-25T23:06:55.124Z" 2/25/2026, 11:06:55 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency568
moderation_latency(null)
generation_time41595
tokens_prompt316
tokens_completion3633
native_tokens_prompt295
native_tokens_completion3514
native_tokens_completion_images(null)
native_tokens_reasoning3331
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0085221
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-3a9bae97-650d-96b0-a227-044473acd9fa"
is_byokfalse
latency568
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772060815-EJVTvgkpGPSYDIIugbRo"
upstream_id"chatcmpl-3a9bae97-650d-96b0-a227-044473acd9fa"
total_cost0.0085221
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Miss?"
detectedLang"en"
heavyLang"es"
scores
en0.6527777777777778
sq0.5967741935483871
es0.504950495049505
tl0.5
et0.48717948717948717
fr0.47643979057591623
no0.47643979057591623
pt0.46808510638297873
sl0.46808510638297873
ms0.45652173913043476
nl0.45652173913043476
it0.4444444444444444
fi0.42857142857142855
reliabletrue
passestrue
1
name"Marie"
dialogue"Oui? Je vous écoute."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8366013071895425
nl0.6200607902735562
sl0.5805369127516778
hr0.5777027027027027
yo0.5659722222222222
cs0.5404411764705882
sk0.5370370370370371
pl0.4212962962962963
de0.3902439024390244
en0.3842364532019704
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm Detective Hunter. I'm asking about the recent disappearances in Alborn."
detectedLang"en"
heavyLang"en"
scores
en0.7860635696821516
fr0.6247319513938527
nl0.5908028059236166
tl0.5869394177812746
ro0.5299910474485229
sv0.5165745856353591
pt0.5161290322580645
it0.5070422535211268
ca0.5018975332068311
de0.4318181818181818
sl0.3951612903225807
no0.39236111111111116
da0.38668224299065423
es0.38596491228070173
ms0.37125748502994016
sq0.30463576158940403
cs0.29245283018867924
yo0.27083333333333337
pl0.22566371681415928
sk0.2222222222222222
hr0.1984732824427481
az0.13793103448275862
lv0.12353923205342236
is0.1191275167785235
lt0.10714285714285714
tr0.10102739726027396
reliabletrue
passestrue
3
name"Marie"
dialogue"Les disparitions? Oh, mon Dieu..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7837837837837838
en0.6884735202492211
ca0.6615905245346869
es0.49748743718592964
tl0.47368421052631576
de0.4444444444444444
da0.43342776203966005
nl0.38461538461538464
pt0.3333333333333333
it0.32432432432432434
ro0.32432432432432434
no0.3174061433447099
hi0.2805755395683453
sv0.2727272727272727
cs0.25650557620817843
sk0.25650557620817843
sq0.25650557620817843
reliabletrue
passestrue
4
name"Hunter"
dialogue"You've seen something?"
detectedLang"en"
heavyLang"en"
scores
en0.7910863509749304
tl0.38524590163934425
es0.34210526315789475
ms0.34210526315789475
pt0.34210526315789475
reliabletrue
passestrue
5
name"Marie"
dialogue"Non... mais j'ai peur. Très peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8434237995824635
pt0.5327102803738317
it0.5033112582781457
ca0.42748091603053434
en0.38271604938271603
eu0.3670886075949367
reliabletrue
passestrue
6
name"Hunter"
dialogue"Scared? Why?"
detectedLang"en"
heavyLang"en"
scores
en0.8166259168704157
it0.5398773006134969
ro0.5098039215686274
reliabletrue
passestrue
7
name"Marie"
dialogue"La nuit. Dans les pommes."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8312710911136107
ca0.6881496881496882
es0.6470588235294117
da0.5426829268292682
no0.5412844036697247
ro0.5145631067961165
it0.512987012987013
et0.4117647058823529
yo0.38016528925619836
tl0.358974358974359
vi0.358974358974359
en0.34210526315789475
sq0.34210526315789475
reliabletrue
passestrue
8
name"Hunter"
dialogue"The orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7754491017964071
tl0.7262773722627737
no0.6938775510204083
nl0.6794871794871795
fr0.6710526315789473
yo0.5879120879120879
da0.5098039215686274
ms0.5098039215686274
sq0.5098039215686274
sv0.5098039215686274
de0.5
reliabletrue
passestrue
9
name"Marie"
dialogue"Oui. Là-bas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8081841432225064
vi0.6767241379310345
ms0.5714285714285714
yo0.5398773006134969
reliabletrue
passestrue
10
name"Hunter"
dialogue"Alright. Keep your eyes open."
detectedLang"en"
heavyLang"en"
scores
en0.788135593220339
tl0.6287128712871286
no0.4983277591973244
nl0.3775933609958506
ms0.34210526315789475
sk0.3333333333333333
sv0.3333333333333333
da0.33035714285714285
de0.33035714285714285
fr0.33035714285714285
yo0.33035714285714285
reliabletrue
passestrue
11
name"Marie"
dialogue"Je vais le faire."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8399487836107554
sl0.6987951807228916
yo0.6951219512195121
nl0.6428571428571429
hr0.5777027027027027
cs0.5404411764705882
it0.5370370370370371
sk0.5370370370370371
es0.4877049180327869
ro0.4769874476987448
hu0.43946188340807174
pl0.4212962962962963
ca0.4131455399061033
de0.3902439024390244
en0.3842364532019704
tl0.3842364532019704
reliabletrue
passestrue
12
name"Hunter"
dialogue"Hold on."
detectedLang"en"
heavyLang"da"
scores
en0.8245614035087719
et0.7549019607843137
fi0.75
da0.691358024691358
fr0.6855345911949685
ca0.6644295302013423
hr0.6376811594202898
hi0.6268656716417911
pl0.6268656716417911
tl0.6268656716417911
cs0.6
sk0.6
yo0.6
reliablefalse
passestrue
13
name"Hunter"
dialogue"Yeah... I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7964169381107492
pl0.584717607973422
cs0.5629370629370629
sk0.5629370629370629
tl0.5614035087719298
et0.5519713261648745
fi0.5454545454545454
fr0.4658119658119659
ca0.44196428571428575
hr0.4131455399061033
hi0.40191387559808617
yo0.375
reliabletrue
passestrue
14
name"Hunter"
dialogue"Sorry. Duty calls."
detectedLang"en"
heavyLang"en"
scores
en0.7016706443914081
de0.5860927152317881
it0.4444444444444444
pt0.4444444444444444
tl0.4444444444444444
es0.4292237442922375
ca0.4131455399061033
reliabletrue
passestrue
15
name"Marie"
dialogue"Au revoir. Bon courage."
detectedLang"fr"
heavyLang"fr"
scores
fr0.813200498132005
ro0.6822033898305085
en0.6385542168674699
ca0.5412844036697247
tl0.5145631067961165
da0.4755244755244755
hr0.4755244755244755
nl0.4755244755244755
de0.38524590163934425
it0.3212669683257918
cs0.3023255813953488
es0.3023255813953488
no0.3023255813953488
pt0.3023255813953488
sk0.3023255813953488
sl0.3023255813953488
sq0.3023255813953488
reliabletrue
passestrue
16
name"Hunter"
dialogue"Thanks."
detectedLang"en"
heavyLang"en"
scores
en0.8175182481751825
vi0.7435897435897436
nl0.691358024691358
reliablefalse
passestrue