Run: 2026-02-16-01KHK1E68K3KYX1RSEE3NHYMA7

Run Details

Model:
Qwen 3.5 397B A17B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
2m 6s
Cost:
$0.015973
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Maine wahan kuch buraa dekha... log gayab ho rahe hain." (I saw something bad there... people are disappearing.) Hunter: "I'm sorry, I don't understand. Do you speak English?" Selvi: "Nahi... mujhe angrezi nahi aati. Main dar gayi hoon." (No... I don't know English. I am scared.) Hunter: "Okay. Show me. Your camera. Show me what you saw." Selvi: "Haan... dekhiye. Ye tasveer hai." (Yes... look. This is the picture.) Hunter: "I can't make out the details. Was this yesterday?" Selvi: "Kal... shaam ko." (Yesterday... in the evening.) Hunter: "Yesterday evening. Did you see a car? A truck?" Selvi: "Gaadi... haan, ek purani truck thi." (Car... yes, there was an old truck.) Hunter: "Truck. Okay. Can you write down the license plate?" Selvi: "Main likh nahi sakti... maine sirf photo liya." (I cannot write... I only took a photo.) Hunter: "Alright. Stay here. I need to process this." Selvi: "Kahan ja rahe hain? Mujhe mat chhodiye." (Where are you going? Don't leave me.) Hunter: "Hold on. (Phone rings) Hunter. Yeah. I'm at the cafe. I'm coming now." Hunter: "I have to go. Stay here." Selvi: "Rukiye... wapas aaiyega?" (Wait... will you come back?)
created_at"2026-02-16T10:57:21.883052+00:00" 2/16/2026, 10:57:21 AM
model"qwen/qwen3.5-397b-a17b-20260216"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency785
moderation_latency(null)
generation_time125649
tokens_prompt315
tokens_completion4454
native_tokens_prompt300
native_tokens_completion4387
native_tokens_completion_images(null)
native_tokens_reasoning4009
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0159732
router(null)
provider_responses
0
id"chatcmpl-da9ec121-2e25-9064-8011-5aa5d9913d62"
status200
is_byokfalse
latency785
endpoint_id"180484a2-e24b-495a-ba41-b34b680d5a9f"
provider_name"Alibaba"
model_permaslug"qwen/qwen3.5-397b-a17b-20260216"
api_type"completions"
id"gen-1771239315-GB0vXjmgT4o9G4cfTums"
upstream_id"chatcmpl-da9ec121-2e25-9064-8011-5aa5d9913d62"
total_cost0.0159732
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Maine wahan kuch buraa dekha... log gayab ho rahe hain."
detectedLang"fi"
heavyLang"fi"
scores
fi0.48700410396716826
ms0.4813278008298755
tl0.36224489795918363
fr0.3567753001715266
en0.3029739776951673
et0.3029739776951673
de0.2816091954022989
ro0.2816091954022989
az0.2704280155642024
eu0.2690058479532163
tr0.25742574257425743
ca0.24242424242424243
no0.22839506172839508
sk0.22839506172839508
cs0.2203742203742204
it0.2203742203742204
lv0.19006479481641467
reliablefalse
passesfalse
1
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.5161290322580645
pl0.4806094182825485
hr0.4688385269121813
sk0.438622754491018
de0.4140625
pt0.40570522979397783
sq0.4009584664536741
ro0.3862520458265139
it0.3644067796610169
nl0.3218806509945751
vi0.3169398907103825
yo0.3055555555555556
ca0.2690058479532163
is0.267578125
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi... mujhe angrezi nahi aati. Main dar gayi hoon."
detectedLang"ro"
heavyLang"tl"
scores
ro0.48240165631469983
eu0.39759036144578314
de0.3842364532019704
lt0.33510638297872336
en0.28366762177650434
no0.2732558139534884
es0.2711370262390671
pt0.2711370262390671
da0.26035502958579887
fr0.26035502958579887
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Okay. Show me. Your camera. Show me what you saw."
detectedLang"en"
heavyLang"en"
scores
en0.7724974721941354
tl0.6590909090909091
ms0.5974955277280859
it0.5140388768898488
nl0.512987012987013
es0.471830985915493
fr0.4260204081632653
pt0.4230769230769231
ro0.412532637075718
sq0.3967828418230563
ca0.3119266055045872
et0.296875
no0.2879746835443038
sl0.281150159744409
sv0.267100977198697
cs0.25742574257425743
fi0.25
de0.24242424242424243
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan... dekhiye. Ye tasveer hai."
detectedLang"vi"
heavyLang"nl"
scores
vi0.4728915662650602
yo0.41666666666666663
nl0.4006849315068493
it0.36363636363636365
tr0.36363636363636365
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I can't make out the details. Was this yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.8199445983379501
nl0.6036585365853658
tl0.5751633986928104
no0.48083067092651754
yo0.46369636963696376
da0.4610281923714759
sv0.46013289036544847
sq0.45652173913043476
de0.4415807560137457
hr0.38095238095238093
ca0.37977099236641226
fr0.3229166666666667
ro0.3172268907563025
tr0.2872807017543859
pl0.2793791574279379
lt0.27616926503340755
it0.26136363636363635
cs0.24418604651162787
ms0.1935483870967742
sk0.181360201511335
be0.17721518987341772
es0.1709183673469388
hu0.1709183673469388
az0.16237113402061853
et0.16237113402061853
is0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
pt0.15803108808290156
reliabletrue
passestrue
6
name"Selvi"
dialogue"Kal... shaam ko."
detectedLang"tl"
heavyLang"af"
scores
tl0.5726495726495726
yo0.5670995670995671
sl0.5575221238938053
lv0.5515695067264574
eu0.5121951219512195
nl0.5121951219512195
lt0.48717948717948717
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Yesterday evening. Did you see a car? A truck?"
detectedLang"en"
heavyLang"en"
scores
en0.8056994818652848
tl0.615877080665813
nl0.5756718528995757
da0.47643979057591623
sv0.471830985915493
no0.46524064171123
fr0.44649446494464945
et0.4371482176360225
de0.43396226415094336
pt0.43396226415094336
ro0.4296577946768061
ca0.4163424124513619
cs0.4117647058823529
es0.4106090373280943
it0.40828402366863903
is0.3814432989690722
hu0.34210526315789475
sk0.3023255813953488
yo0.2840095465393795
hr0.27184466019417475
pl0.25925925925925924
sl0.23076923076923078
lt0.21465968586387435
tr0.20424403183023873
sq0.1935483870967742
az0.1891891891891892
eu0.1891891891891892
lv0.1891891891891892
vi0.1891891891891892
fi0.17355371900826447
ms0.17355371900826447
reliabletrue
passestrue
8
name"Selvi"
dialogue"Gaadi... haan, ek purani truck thi."
detectedLang"ms"
heavyLang"vi"
scores
ms0.4444444444444444
en0.4094488188976378
tl0.4094488188976378
vi0.40789473684210525
ca0.40476190476190477
et0.34210526315789475
tr0.33234421364985167
sl0.3181818181818182
hr0.3119266055045872
nl0.30769230769230765
de0.29467084639498436
it0.25
sq0.25
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Truck. Okay. Can you write down the license plate?"
detectedLang"en"
heavyLang"en"
scores
en0.7945638432364096
tl0.6440306681270538
fr0.5323741007194245
ca0.5015337423312883
ro0.4992295839753467
no0.482484076433121
it0.4706840390879479
sk0.41651705565529623
nl0.40476190476190477
es0.4025735294117647
pt0.3981481481481482
sq0.39138576779026213
de0.33537832310838445
sv0.3229166666666667
et0.3172268907563025
cs0.3157894736842105
da0.3128964059196617
hr0.29805615550755943
ms0.29653679653679654
tr0.29501084598698485
lt0.2872807017543859
sl0.2872807017543859
yo0.2476851851851852
az0.19154228855721395
lv0.16237113402061853
pl0.15364583333333331
reliabletrue
passestrue
10
name"Selvi"
dialogue"Main likh nahi sakti... maine sirf photo liya."
detectedLang"fr"
heavyLang"tl"
scores
fr0.6386333771353482
en0.6115819209039548
de0.45
sq0.43298969072164945
eu0.375
et0.3721461187214612
fi0.3721461187214612
tl0.3663594470046083
ro0.3483412322274882
cs0.24242424242424243
lv0.24242424242424243
hi0.21875
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Alright. Stay here. I need to process this."
detectedLang"en"
heavyLang"en"
scores
en0.8168498168498168
tl0.6671105193075899
da0.6087636932707355
lv0.5748299319727891
pl0.5697074010327022
no0.5674740484429065
hr0.5667244367417678
cs0.5559502664298401
sq0.5462794918330308
yo0.5437956204379563
sk0.5164410058027079
lt0.48665297741273095
sv0.47257383966244726
ca0.4600431965442765
et0.4469026548672566
it0.4279176201372997
sl0.4186046511627907
ro0.4004796163069544
fr0.3842364532019704
pt0.2492492492492493
nl0.23547400611620795
es0.23076923076923078
de0.22839506172839508
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
12
name"Selvi"
dialogue"Kahan ja rahe hain? Mujhe mat chhodiye."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5018115942028986
fi0.4670542635658915
ms0.4364754098360656
sk0.3663594470046083
et0.358974358974359
sv0.3529411764705882
eu0.3341404358353511
tr0.3125
lv0.2948717948717949
ca0.2838541666666667
de0.24242424242424243
is0.233983286908078
da0.22535211267605632
pl0.22535211267605632
sl0.22535211267605632
lt0.21428571428571427
no0.21428571428571427
sq0.21428571428571427
yo0.21428571428571427
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Hold on. Hunter. Yeah. I'm at the cafe. I'm coming now."
detectedLang"en"
heavyLang"en"
scores
en0.7966101694915254
tl0.6437054631828979
da0.6385542168674699
fr0.5862068965517241
no0.572039942938659
ca0.45652173913043476
nl0.44547134935304994
yo0.3775933609958506
de0.35064935064935066
it0.3435448577680525
pt0.3435448577680525
ro0.3435448577680525
et0.33920704845814975
fi0.3333333333333333
sv0.33035714285714285
ms0.3135011441647597
sq0.3135011441647597
es0.2518703241895262
hr0.22680412371134018
hi0.21875
pl0.21875
cs0.2
sk0.2
sl0.16434540389972147
tr0.16434540389972147
reliabletrue
passestrue
14
name"Hunter"
dialogue"I have to go. Stay here."
detectedLang"en"
heavyLang"en"
scores
en0.8353457738748629
da0.7222222222222222
pl0.7109826589595376
yo0.6674057649667406
hr0.6296296296296297
no0.6287128712871286
tl0.6153846153846154
cs0.6113989637305699
sq0.609375
sk0.576271186440678
lv0.5522388059701493
lt0.526813880126183
ca0.4791666666666667
sv0.4791666666666667
sl0.44649446494464945
it0.43396226415094336
ro0.375
be0.3181818181818182
tr0.3181818181818182
hu0.3087557603686636
az0.29577464788732394
et0.29577464788732394
is0.29577464788732394
uk0.29577464788732394
vi0.29577464788732394
reliabletrue
passestrue
15
name"Selvi"
dialogue"Rukiye... wapas aaiyega?"
detectedLang"tr"
heavyLang"tl"
scores
tr0.4845360824742268
es0.39999999999999997
pt0.39999999999999997
reliablefalse
passesfalse