Run: 2026-02-25-01KJBDF4JZQVZPKZSM9FHFKSV0

Run Details

Model:
Qwen 3.5 122B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
24.6s
Cost:
$0.012082
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
56.25% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Maine... maine usse dekha tha. Paani ke kinare." (I saw... I saw him. By the water.) Hunter: "Excuse me? I didn't catch that. Do you speak English?" Selvi: "Nahi. Mujhe English nahi aati. Kripya, mujhe chhod do." (No. I don't know English. Please, leave me alone.) Hunter: "I'm a detective. I'm investigating the disappearances. Did you see anyone near the lake recently?" Selvi: "Haan. Do din pehle. Andhera tha. Woh... woh cheekh raha tha." (Yes. Two days ago. It was dark. He... he was screaming.) Hunter: "I'm sorry, I still don't understand. Can you write it down? Show me?" Selvi: "Camera... meri camera mein hai. Main dikhana chahti hoon." (Camera... it's in my camera. I want to show.) Hunter: "You have photos? Of the missing person?" Selvi: "Haan... par mujhe darr lag raha hai. Koi dekh raha hai." (Yes... but I am scared. Someone is watching.) Hunter: "Look, I just need to know if you have evidence. I can help you." Selvi: "Maine kaha, mujhe darr lag raha hai. Yahan mat raho." (I said, I am scared. Don't stay here.) Hunter: "Ma'am, please. I'm trying to help. Just tell me—" *Hunter's phone buzzes loudly in his pocket.* Hunter: "Excuse me." *Answers phone* "Hunter here. ... Yeah, I'm on it. On my way." Hunter: "I have to go. Stay safe." Selvi: "Savdhan rahiye. Bhagwan aapki raksha kare." (Be careful. May God protect you.) Hunter: "Right. Stay here." *Turns and walks away quickly.*
created_at"2026-02-25T22:07:16.069Z" 2/25/2026, 10:07:16 PM
model"qwen/qwen3.5-122b-a10b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency399
moderation_latency(null)
generation_time24488
tokens_prompt315
tokens_completion3768
native_tokens_prompt300
native_tokens_completion3738
native_tokens_completion_images(null)
native_tokens_reasoning3284
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0120816
router(null)
provider_responses
0
endpoint_id"33d466d1-d2f7-45ed-8ff3-fda7d2e32351"
id"chatcmpl-35b054f4-e117-9884-890b-5f12da9d4346"
is_byokfalse
latency399
model_permaslug"qwen/qwen3.5-122b-a10b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772057236-GrBkotOFS44jvumaEtcb"
upstream_id"chatcmpl-35b054f4-e117-9884-890b-5f12da9d4346"
total_cost0.0120816
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
56.25% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Maine... maine usse dekha tha. Paani ke kinare."
detectedLang"tl"
heavyLang"vi"
scores
tl0.5627980922098569
et0.5115452930728241
ro0.46808510638297873
ms0.46601941747572817
fr0.43064182194616984
sq0.41113490364025695
en0.3721461187214612
fi0.3721461187214612
de0.3483412322274882
sv0.2763157894736842
cs0.2724867724867725
it0.27055702917771884
lv0.24242424242424243
yo0.24242424242424243
no0.233983286908078
hr0.21428571428571427
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me? I didn't catch that. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7960848287112561
tl0.5330012453300125
sq0.5155038759689923
hr0.4688385269121813
no0.4588744588744588
cs0.4573082489146165
sv0.44526627218934917
it0.4186046511627907
pl0.41770186335403725
pt0.39418416801292405
da0.36006825938566556
sl0.3567753001715266
sk0.35233160621761656
fr0.3267504488330341
vi0.3169398907103825
yo0.3055555555555556
ro0.30167597765363136
et0.2964352720450282
ms0.2937853107344633
de0.2816091954022989
ca0.2690058479532163
es0.21383647798742136
nl0.1830065359477124
fi0.16666666666666666
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
2
name"Selvi"
dialogue"Nahi. Mujhe English nahi aati. Kripya, mujhe chhod do."
detectedLang"en"
heavyLang"tl"
scores
en0.5370370370370371
sq0.44668008048289737
hr0.41113490364025695
eu0.375
pt0.36194895591647336
pl0.34210526315789475
cs0.32598039215686275
sk0.32432432432432434
sl0.3037974683544304
vi0.28756476683937826
no0.22969187675070027
yo0.22096317280453256
da0.207492795389049
de0.207492795389049
ms0.207492795389049
ro0.207492795389049
sv0.207492795389049
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I'm a detective. I'm investigating the disappearances. Did you see anyone near the lake recently?"
detectedLang"en"
heavyLang"en"
scores
en0.808399754751686
tl0.6184371184371183
fr0.6122828784119108
pt0.5805369127516778
ro0.5519713261648745
ca0.5225362872421696
it0.5181187355435621
nl0.5070977917981072
es0.49433656957928807
sv0.4712351945854484
no0.46259673258813416
cs0.4318181818181818
da0.42343173431734316
de0.4196843082636954
hr0.4164332399626517
ms0.38605108055009824
et0.36676798378926034
sq0.36612576064908725
sl0.3563336766220391
sk0.34623430962343094
lt0.3024553571428571
az0.2961711711711712
yo0.26556991774383076
lv0.2550655542312277
is0.2541766109785203
hu0.1997439180537772
fi0.16331994645247658
pl0.14383561643835618
tr0.10968660968660969
eu0.10071942446043164
vi0.10071942446043164
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan. Do din pehle. Andhera tha. Woh... woh cheekh raha tha."
detectedLang"sq"
heavyLang"de"
scores
sq0.43820224719101125
en0.4129158512720157
ro0.3464052287581699
pt0.34210526315789475
pl0.3227990970654628
et0.3197278911564626
cs0.3071593533487298
sk0.3055555555555556
eu0.29411764705882354
tl0.29245283018867924
hr0.2857142857142857
sl0.2857142857142857
vi0.27007299270072993
da0.2537313432835821
sv0.2248062015503876
yo0.20634920634920634
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I'm sorry, I still don't understand. Can you write it down? Show me?"
detectedLang"en"
heavyLang"en"
scores
en0.804204451772465
no0.5666058394160584
da0.5264207377866401
tl0.5133196721311476
sv0.5098039215686274
sq0.4825708061002179
it0.4774477447744775
nl0.46083995459704885
is0.3725231175693527
cs0.35983827493261455
pt0.3581081081081081
de0.35374149659863946
ro0.3466299862448418
et0.3448275862068966
sk0.3384401114206128
lv0.31259044862518093
ca0.3115942028985507
hr0.302496328928047
pl0.3004418262150221
lt0.2983751846381093
fr0.2554858934169279
yo0.2554858934169279
sl0.25196850393700787
tr0.23633440514469453
az0.22764227642276424
es0.17677642980935876
ms0.15026833631484796
fi0.13636363636363635
be0.12844036697247707
hu0.12361623616236161
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
6
name"Selvi"
dialogue"Camera... meri camera mein hai. Main dikhana chahti hoon."
detectedLang"de"
heavyLang"tlh"
scores
de0.5
it0.48405253283302063
et0.4410569105691057
en0.3888888888888889
ms0.38478747203579416
fr0.3735763097949886
ro0.3648960739030023
vi0.36342592592592593
fi0.289405684754522
ca0.27055702917771884
yo0.26666666666666666
es0.2647058823529412
sv0.22969187675070027
nl0.21652421652421652
tl0.207492795389049
reliablefalse
passesfalse
7
name"Hunter"
dialogue"You have photos? Of the missing person?"
detectedLang"en"
heavyLang"en"
scores
en0.8256624825662483
tl0.7113163972286375
nl0.680306905370844
da0.6719160104986877
no0.6323529411764706
fr0.6246246246246246
is0.6
de0.5980707395498392
sv0.5769881556683587
pt0.5309568480300189
ms0.5247148288973384
ca0.48240165631469983
sq0.4747899159663866
yo0.46808510638297873
es0.40191387559808617
it0.3796526054590571
lt0.37810945273631835
lv0.3686868686868687
cs0.3540051679586563
az0.3315508021390375
et0.3315508021390375
ro0.251497005988024
fi0.2378048780487805
hi0.23547400611620795
tr0.21135646687697163
hu0.20127795527156547
hr0.19093851132686085
pl0.19093851132686085
sk0.19093851132686085
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan... par mujhe darr lag raha hai. Koi dekh raha hai."
detectedLang"sv"
heavyLang"fi"
scores
sv0.42660550458715596
vi0.3857493857493857
lv0.38271604938271603
fr0.3654822335025381
et0.36061381074168797
it0.2857142857142857
no0.2816091954022989
da0.2711370262390671
de0.23547400611620795
nl0.23547400611620795
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Look, I just need to know if you have evidence. I can help you."
detectedLang"en"
heavyLang"en"
scores
en0.8338870431893688
cs0.573170731707317
da0.527027027027027
ca0.5098039215686274
sv0.49275362318840576
lv0.48377581120943947
tl0.4814814814814815
no0.47839046199701935
et0.4648318042813456
yo0.453978159126365
sk0.44089456869009586
pl0.42716857610474634
hr0.42148760330578516
pt0.3805309734513274
tr0.3794326241134752
sq0.36479128856624315
it0.360146252285192
sl0.358974358974359
fr0.3482309124767225
lt0.3230174081237911
ro0.31640625
es0.3110236220472441
az0.2857142857142857
be0.16666666666666666
hu0.1606714628297362
nl0.1606714628297362
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
10
name"Selvi"
dialogue"Maine kaha, mujhe darr lag raha hai. Yahan mat raho."
detectedLang"et"
heavyLang"tl"
scores
et0.4833068362480127
fi0.4357638888888889
de0.4080145719489982
ms0.3959107806691449
tl0.3959107806691449
fr0.3902439024390244
no0.34738955823293177
sv0.34077079107505076
en0.3340163934426229
vi0.3257261410788381
ro0.3114406779661017
it0.23529411764705882
lv0.21307506053268765
is0.20537897310513448
nl0.19154228855721395
lt0.1875
sk0.1875
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Ma'am, please. I'm trying to help. Just tell me—"
detectedLang"en"
heavyLang"en"
scores
en0.799866577718479
tl0.4897959183673469
sl0.4106090373280943
no0.39999999999999997
et0.3963782696177062
sq0.33035714285714285
yo0.3135011441647597
pl0.3103448275862069
sk0.3055555555555556
cs0.30394431554524365
lv0.2890995260663507
hr0.27884615384615385
da0.25742574257425743
lt0.25742574257425743
es0.2537313432835821
sv0.2537313432835821
ro0.25
fr0.23273657289002556
pt0.22680412371134018
ms0.21875
nl0.21875
it0.21052631578947367
ca0.20424403183023873
fi0.2
reliabletrue
passestrue
12
name"Hunter"
dialogue"Hunter here. ... Yeah, I'm on it. On my way."
detectedLang"en"
heavyLang"en"
scores
en0.8073630136986302
tl0.5738636363636364
sq0.5212765957446809
fr0.44581280788177335
pl0.43890274314214467
cs0.41709844559585496
sk0.41709844559585496
ca0.412532637075718
et0.4063324538258575
yo0.4015957446808511
fi0.39999999999999997
de0.281150159744409
hr0.281150159744409
lv0.27652733118971057
hi0.27184466019417475
da0.267100977198697
no0.25742574257425743
sv0.23728813559322032
it0.21875
nl0.21875
pt0.21875
ms0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
13
name"Hunter"
dialogue"I have to go. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8306997742663657
da0.7222222222222222
pl0.7109826589595376
yo0.6674057649667406
hr0.6296296296296297
no0.6287128712871286
tl0.6153846153846154
cs0.6113989637305699
sk0.576271186440678
lv0.5522388059701493
lt0.526813880126183
ca0.4791666666666667
sv0.4791666666666667
sq0.471830985915493
sl0.44649446494464945
it0.43396226415094336
ro0.375
be0.3181818181818182
tr0.3181818181818182
hu0.3087557603686636
az0.29577464788732394
et0.29577464788732394
is0.29577464788732394
uk0.29577464788732394
vi0.29577464788732394
reliabletrue
passestrue
14
name"Selvi"
dialogue"Savdhan rahiye. Bhagwan aapki raksha kare."
detectedLang"lv"
heavyLang"lv"
scores
lv0.3436754176610978
ms0.2763157894736842
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Right. Stay here."
detectedLang"en"
heavyLang"en"
scores
en0.8313659359190556
tl0.6677740863787376
sq0.5
da0.42528735632183906
de0.42528735632183906
fr0.42528735632183906
no0.42528735632183906
yo0.42528735632183906
reliabletrue
passestrue