Run: 2026-02-25-01KJBF4BS6F3JER7P2FEBEJY2G

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
48.7s
Cost:
$0.010786
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Detective Hunter. I need to ask you a few questions." Melanie: "Was wollen Sie? Ich bin hier nur für die Fotos." (What do you want? I am here only for the photos.) Hunter: "Ma'am, do you speak English? I'm investigating the disappearances." Melanie: "Nein. Ich verstehe nicht. Warum kommen Sie zu mir?" (No. I don't understand. Why are you coming to me?) Hunter: "You were near the orchard during the festival. Did you see anything unusual?" Melanie: "Ja. Gestern. Es war dunkel. Ich habe... ich habe Angst." (Yes. Yesterday. It was dark. I have... I am afraid.) Hunter: "Okay. What did you see? Can you tell me in English?" Melanie: "Ich spreche kein Englisch. Bitte. Jemand hat mich beobachtet." (I speak no English. Please. Someone was watching me.) Hunter: "I need you to stay put. I'll find a translator." Melanie: "Warten Sie nicht. Es ist gefährlich hier." (Don't wait. It is dangerous here.) Hunter: "I have to take this call. Stay right there."
created_at"2026-02-25T22:36:20.143Z" 2/25/2026, 10:36:20 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency499
moderation_latency(null)
generation_time48622
tokens_prompt319
tokens_completion4640
native_tokens_prompt299
native_tokens_completion4457
native_tokens_completion_images(null)
native_tokens_reasoning4182
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0107865
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-9790f3bc-c3bf-98d8-9e02-bd21617740b8"
is_byokfalse
latency499
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772058980-Dd4as5nH4MUe9a1rQzlg"
upstream_id"chatcmpl-9790f3bc-c3bf-98d8-9e02-bd21617740b8"
total_cost0.0107865
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Detective Hunter. I need to ask you a few questions."
detectedLang"en"
heavyLang"en"
scores
en0.7996438112199465
fr0.6459480723839497
it0.6356275303643725
tl0.6130696474634566
ca0.5927601809954751
pt0.5852534562211982
no0.560117302052786
ro0.5454545454545454
cs0.5351239669421488
sq0.5292887029288702
es0.5202558635394456
da0.5166487647690655
hr0.49095022624434387
sl0.48571428571428565
nl0.469964664310954
pl0.4485294117647059
et0.4444444444444444
yo0.4325346784363178
sv0.4289340101522843
sk0.4260204081632653
lv0.3617021276595745
lt0.3562231759656652
de0.34687953555878087
hu0.33135215453194655
ms0.31402439024390244
tr0.31402439024390244
fi0.23469387755102045
is0.23469387755102045
az0.22813036020583194
vi0.22813036020583194
be0.1346153846153846
eu0.1346153846153846
uk0.12280701754385964
reliabletrue
passestrue
1
name"Melanie"
dialogue"Was wollen Sie? Ich bin hier nur für die Fotos."
detectedLang"de"
heavyLang"de"
scores
de0.8405103668261563
nl0.6828752642706131
en0.49324324324324326
pl0.48805460750853247
sk0.3890020366598778
ms0.38524590163934425
yo0.3684210526315789
fr0.358974358974359
sv0.3548387096774194
tr0.34497816593886466
no0.34210526315789475
da0.3258426966292135
es0.3227990970654628
lt0.3227990970654628
pt0.3227990970654628
ca0.3087557603686636
lv0.3087557603686636
sq0.3087557603686636
hu0.23857868020304565
fi0.21052631578947367
cs0.18256130790190736
hr0.18256130790190736
sl0.18256130790190736
et0.17355371900826447
it0.17355371900826447
az0.16434540389972147
ro0.16434540389972147
reliabletrue
passestrue
2
name"Hunter"
dialogue"Ma'am, do you speak English? I'm investigating the disappearances."
detectedLang"en"
heavyLang"en"
scores
en0.782708142726441
tl0.5933219178082192
pt0.5646196150320807
fr0.5609981515711645
nl0.4698660714285714
ms0.4583808437856328
hr0.4546498277841562
ro0.44509345794392524
no0.44379391100702575
sv0.4256348246674728
cs0.41789215686274506
sq0.39720812182741116
it0.3902439024390244
ca0.38551099611901685
de0.36918990703851257
da0.3675099866844208
sk0.36241610738255037
sl0.34119278779472956
es0.3338008415147265
yo0.2803030303030303
lv0.23263327948303714
pl0.2313915857605178
is0.22512234910277326
et0.21357615894039736
lt0.2096505823627288
az0.19898819561551434
vi0.18941979522184302
fi0.11048689138576778
reliabletrue
passestrue
3
name"Melanie"
dialogue"Nein. Ich verstehe nicht. Warum kommen Sie zu mir?"
detectedLang"de"
heavyLang"de"
scores
de0.8446515756768752
da0.4992846924177396
pl0.49201741654571846
nl0.4807121661721069
no0.460708782742681
sv0.4444444444444444
hu0.3069306930693069
sk0.26160337552742613
et0.24078091106290672
fi0.2324561403508772
cs0.2222222222222222
hr0.2222222222222222
lt0.18032786885245902
it0.17061611374407584
is0.1606714628297362
en0.15254237288135594
es0.15254237288135594
fr0.15254237288135594
pt0.15254237288135594
az0.14425427872860636
ca0.14425427872860636
ro0.14425427872860636
sq0.14425427872860636
reliabletrue
passestrue
4
name"Hunter"
dialogue"You were near the orchard during the festival. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8008849557522124
tl0.593128390596745
ms0.5283018867924528
no0.5145631067961165
nl0.506578947368421
et0.46871310507674147
da0.4617224880382775
fr0.42455242966751916
sv0.40789473684210525
sq0.4063324538258575
pt0.3818681318681319
cs0.3706293706293706
es0.36619718309859156
de0.3353028064992614
lt0.3343195266272189
ca0.31402439024390244
hr0.3087557603686636
it0.3055555555555556
sl0.293563579277865
az0.2077464788732394
ro0.2077464788732394
sk0.2077464788732394
yo0.19210053859964096
hu0.12959381044487428
fi0.12280701754385964
lv0.12280701754385964
pl0.12280701754385964
reliabletrue
passestrue
5
name"Melanie"
dialogue"Ja. Gestern. Es war dunkel. Ich habe... ich habe Angst."
detectedLang"de"
heavyLang"de"
scores
de0.8191978961209732
nl0.5655608214849921
ca0.5542949756888168
lv0.4607843137254902
da0.45972495088408644
es0.45219123505976094
en0.4364754098360656
sk0.43064182194616984
pl0.4148936170212766
sv0.3861607142857143
et0.358974358974359
no0.358974358974359
fi0.3574766355140187
hu0.27055702917771884
lt0.2486338797814208
pt0.2486338797814208
it0.23822714681440443
fr0.22535211267605632
is0.22535211267605632
sl0.22535211267605632
tl0.21875
sq0.21428571428571427
yo0.21428571428571427
ro0.20520231213872833
reliabletrue
passestrue
6
name"Hunter"
dialogue"Okay. What did you see? Can you tell me in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8191978961209732
tl0.5009074410163339
et0.4907407407407407
sl0.46808510638297873
nl0.46601941747572817
ms0.45652173913043476
it0.45219123505976094
de0.4433198380566802
ro0.4376278118609407
sv0.394273127753304
no0.3861607142857143
az0.3692660550458715
sq0.34988179669030733
es0.27055702917771884
fr0.2486338797814208
pt0.24242424242424243
yo0.24242424242424243
pl0.233983286908078
cs0.22096317280453256
ca0.21875
tr0.21875
fi0.21428571428571427
da0.207492795389049
hr0.207492795389049
reliabletrue
passestrue
7
name"Melanie"
dialogue"Ich spreche kein Englisch. Bitte. Jemand hat mich beobachtet."
detectedLang"de"
heavyLang"de"
scores
de0.8086124401913876
nl0.5540691192865106
da0.4405594405594406
ro0.38650306748466257
en0.37597503900156004
no0.36908517350157727
sk0.3254637436762226
ms0.2857142857142857
hr0.27140255009107467
it0.2647058823529412
sq0.23076923076923078
pl0.22330097087378642
et0.2202729044834308
sl0.21568627450980393
lt0.1836734693877551
hu0.18032786885245902
yo0.18032786885245902
tr0.16317991631799164
fr0.15789473684210525
sv0.15254237288135594
is0.14712153518123666
reliabletrue
passestrue
8
name"Hunter"
dialogue"I need you to stay put. I'll find a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8081841432225064
hr0.6724890829694322
da0.6424314660309893
cs0.6273291925465838
pl0.62640099626401
no0.5989304812834225
tl0.5962314939434724
sk0.569583931133429
ro0.5652173913043478
et0.5620437956204379
sq0.5405819295558958
ca0.5377503852080123
yo0.5334370139968896
sl0.5245641838351823
lv0.5176848874598071
sv0.5169082125603864
lt0.512987012987013
it0.5024875621890548
pt0.48364888123924266
hu0.4263862332695985
vi0.42418426103646834
tr0.4117647058823529
es0.4106090373280943
de0.40119760479041916
nl0.39999999999999997
fr0.3963782696177062
az0.3902439024390244
ms0.37888198757763975
is0.3150684931506849
eu0.3135011441647597
be0.1891891891891892
fi0.17355371900826447
uk0.17355371900826447
reliabletrue
passestrue
9
name"Melanie"
dialogue"Warten Sie nicht. Es ist gefährlich hier."
detectedLang"de"
heavyLang"de"
scores
de0.8505231689088192
nl0.5253164556962026
ca0.41972920696324956
es0.41972920696324956
pl0.4174757281553398
tr0.35344827586206895
lv0.2857142857142857
hi0.26108374384236455
hu0.2537313432835821
cs0.25
no0.24050632911392408
da0.23469387755102045
lt0.23273657289002556
sv0.22879177377892032
fr0.22680412371134018
eu0.21875
fi0.21875
ms0.20634920634920634
reliabletrue
passestrue
10
name"Hunter"
dialogue"I have to take this call. Stay right there."
detectedLang"en"
heavyLang"en"
scores
en0.8441926345609065
tl0.6634026927784578
da0.6278755074424898
no0.5439469320066335
yo0.5200698080279231
pl0.4869402985074627
hr0.4811320754716981
de0.47817836812144215
cs0.461839530332681
sq0.4353182751540041
sk0.4258872651356994
sl0.41983122362869196
lv0.40217391304347827
lt0.3778280542986425
ca0.3341404358353511
sv0.3341404358353511
it0.2948717948717949
ro0.24657534246575344
fr0.21203438395415475
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue