Run: 2026-02-16-01KHK33GM5C855MHG5JCBXTCKK

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
1m 40s
Cost:
$0.012816
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "(Chi sei? Per favore, lasciami stare.) [Who are you? Please, leave me alone.]" Hunter: "Excuse me, miss. I'm Detective Hunter. Do you have a moment?" Isabella: "(Non parlo inglese... sono confusa.) [I don't speak English... I am confused.]" Hunter: "I saw you taking photographs near the orchard yesterday. Around noon." Isabella: "(No. Italiano. Solo italiano.) [No. Italian. Only Italian.]" Hunter: "English. Do you speak English?" Isabella: "(Ho visto un uomo... vicino ai filari. Era strano.) [I saw a man... near the rows. He was strange.]" Hunter: "Okay. Look, this is about the girl who disappeared. Did you see anything?" Isabella: "(Sì, guarda. Qui. L'ombra tra gli alberi.) [Yes, look. Here. The shadow between the trees.]" Hunter: "Can you show me the pictures? On the camera?" Isabella: "(Non è solo un'ombra! C'era qualcuno!) [It's not just a shadow! There was someone!]" Hunter: "I can't make heads or tails of this. It's just blur." Isabella: "(Per favore, non andare. Ho paura.) [Please, don't go. I am afraid.]" Hunter: "Hold on. I need to call this in." Isabella: "(Aspetta! Detective! Ascoltami!) [Wait! Detective! Listen to me!]" Hunter: "My phone is ringing. I have to take it. Stay right here."
created_at"2026-02-16T11:26:03.20882+00:00" 2/16/2026, 11:26:03 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency830
moderation_latency(null)
generation_time99573
tokens_prompt321
tokens_completion3606
native_tokens_prompt300
native_tokens_completion3510
native_tokens_completion_images(null)
native_tokens_reasoning3145
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.012816
router(null)
provider_responses
0
id"chatcmpl-00f733c8-180e-9020-84b3-a6ceb13f1be5"
status200
is_byokfalse
latency830
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771241063-EGSZUABydDllzFVdV9Il"
upstream_id"chatcmpl-00f733c8-180e-9020-84b3-a6ceb13f1be5"
total_cost0.012816
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. Do you have a moment?"
detectedLang"en"
heavyLang"en"
scores
en0.7882477501323452
pt0.6370235934664247
fr0.6285979572887651
tl0.6124031007751938
sq0.6108949416342413
ro0.6078431372549019
ca0.5930824008138352
cs0.5758218451749735
it0.5680345572354212
es0.5555555555555556
nl0.5354239256678281
da0.5305164319248826
sl0.5145631067961165
sk0.4981179422835634
pl0.49174078780177893
no0.4910941475826972
de0.4865211810012837
hr0.47506561679790027
sv0.39668174962292607
yo0.3939393939393939
hu0.35379644588045234
ms0.33993399339933994
vi0.31153184165232356
et0.2831541218637993
fi0.25650557620817843
tr0.2537313432835821
az0.24953095684803
lt0.17012448132780084
is0.15789473684210525
eu0.14893617021276595
lv0.14893617021276595
reliabletrue
passestrue
1
name"Hunter"
dialogue"I saw you taking photographs near the orchard yesterday. Around noon."
detectedLang"en"
heavyLang"en"
scores
en0.7824095281722401
tl0.6471025260029718
fr0.5254745254745254
no0.45776255707762553
nl0.4571428571428572
sv0.3766404199475065
sq0.37335092348284965
pl0.32814710042432815
da0.31358381502890176
yo0.2899850523168909
cs0.27811550151975684
ms0.2725880551301685
tr0.24722662440570525
de0.24603174603174602
sk0.2313915857605178
hr0.2263843648208469
ca0.22512234910277326
et0.22003284072249588
is0.22003284072249588
it0.19491525423728812
ro0.1592920353982301
fi0.14414414414414414
hi0.1394927536231884
pt0.13003663003663005
sl0.13003663003663005
be0.12844036697247707
hu0.12361623616236161
az0.1171003717472119
lt0.1171003717472119
lv0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
2
name"Hunter"
dialogue"English. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8175182481751825
cs0.5844875346260388
hr0.5614035087719298
tl0.5426829268292682
pt0.5098039215686274
pl0.48805460750853247
sk0.46808510638297873
sl0.4444444444444444
sq0.43820224719101125
vi0.42528735632183906
no0.35344827586206895
yo0.34210526315789475
da0.32432432432432434
de0.32432432432432434
ms0.32432432432432434
ro0.32432432432432434
sv0.32432432432432434
reliabletrue
passestrue
3
name"Hunter"
dialogue"Okay. Look, this is about the girl who disappeared. Did you see anything?"
detectedLang"en"
heavyLang"en"
scores
en0.828023171614772
tl0.5501893939393939
nl0.42284325637910086
ms0.3484224965706447
yo0.3233618233618234
sq0.2725880551301685
et0.26356589147286824
fr0.24603174603174602
hu0.2448330683624801
eu0.2263843648208469
no0.16666666666666666
is0.16225749559082892
it0.15480427046263345
cs0.1410488245931284
da0.1410488245931284
sv0.1410488245931284
reliabletrue
passestrue
4
name"Hunter"
dialogue"Can you show me the pictures? On the camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8020158387329014
tl0.6828143021914649
fr0.6650426309378806
ca0.6196403872752421
nl0.5883233532934131
et0.5578778135048231
ro0.5299145299145299
no0.48405253283302063
it0.46393762183235865
ms0.45972495088408644
sv0.4575936883629191
sq0.4510978043912176
fi0.45
es0.4222689075630252
yo0.3982494529540482
pt0.375
cs0.3574766355140187
da0.3529411764705882
de0.3436754176610978
hr0.24242424242424243
sl0.24242424242424243
hi0.233983286908078
pl0.233983286908078
lv0.23184357541899442
az0.21875
tr0.21875
sk0.21428571428571427
reliabletrue
passestrue
5
name"Hunter"
dialogue"I can't make heads or tails of this. It's just blur."
detectedLang"en"
heavyLang"en"
scores
en0.8101952277657266
tl0.521203830369357
fr0.42622950819672134
sv0.4067796610169492
no0.4057724957555179
ca0.3805309734513274
nl0.3670886075949367
yo0.36363636363636365
et0.32038834951456313
de0.3137254901960784
is0.3027888446215139
da0.2842535787321063
hr0.2842535787321063
sq0.2768595041322314
pl0.2647058823529412
it0.24731182795698922
cs0.23076923076923078
ro0.20454545454545453
sk0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hold on. I need to call this in."
detectedLang"en"
heavyLang"en"
scores
en0.8442367601246106
tl0.6875
pl0.6820349761526232
yo0.6592844974446337
et0.6402877697841727
da0.6396396396396397
hr0.6316758747697975
cs0.6086105675146771
sk0.5824634655532359
sl0.5789473684210527
it0.5670995670995671
no0.5594713656387665
sv0.550561797752809
ca0.5423340961098398
ro0.5370370370370371
lv0.4805194805194805
lt0.4550408719346049
nl0.43820224719101125
fi0.42857142857142855
az0.42363112391930835
de0.42363112391930835
sq0.40119760479041916
fr0.35275080906148865
hi0.29577464788732394
ms0.2727272727272727
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
is0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
7
name"Hunter"
dialogue"My phone is ringing. I have to take it. Stay right here."
detectedLang"en"
heavyLang"en"
scores
en0.8220218319886095
tl0.6811224489795917
da0.624248496993988
yo0.5684695051783659
no0.5659722222222222
pl0.48489010989010994
nl0.4827586206896552
cs0.46197991391678617
sq0.460431654676259
sk0.4360902255639098
lv0.4195046439628483
hr0.40476190476190477
sv0.3718592964824121
hu0.37080536912751677
sl0.3466898954703833
vi0.34325744308231176
it0.336283185840708
lt0.3081180811808118
ms0.29906542056074764
fr0.2964352720450282
is0.29245283018867924
et0.29111531190926276
de0.28435114503816794
ca0.2690058479532163
ro0.1935483870967742
be0.15730337078651685
tr0.15730337078651685
az0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue