Run: 2026-02-25-01KJBE0CGJT3EMZ9XD16DX8CNM

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
47.0s
Cost:
$0.010242
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Kya... kya ho raha hai? Main samajh nahi pa rahi hoon." (What... what is happening? I don't understand.) Hunter: "Excuse me, ma'am. I'm Detective Hunter. I need to ask you a few questions about last night near the orchard." Selvi: "Orchard? Haan... main wahan thi. Landscape ke liye." (Orchard? Yes... I was there. For the landscape.) Hunter: "Did you see anyone? Anyone suspicious? We've had disappearances around the festival grounds." Selvi: "Haan. Ek aadmi. Woh... woh ajeeb tha. Woh meri camera ki taraf dekh raha tha." (Yes. A man. He... he was strange. He was looking at my camera.) Hunter: "Did he say anything to you? What did he look like?" Selvi: "Nahi... woh koi shabd nahi bola. Bas dekh raha tha. Main darri hoon." (No... he didn't say any words. Just looking. I am scared.) Hunter: "Okay. Okay, I understand you're scared. I just need to know if you took any photos. Did you see his face?" Selvi: "Haan. Photo hai. Par... par main abhi nahi dekh sakti. Mera haath kaanp raha hai." (Yes. There is a photo. But... but I can't look now. My hand is shaking.) Hunter: "That's fine. I'll take the camera to the lab. I'll be back with a translator. Can you tell me your name again?" Selvi: "Selvi. Selvi Sharma. Kripya jaldi aaiye." (Selvi. Selvi Sharma. Please come quickly.) Hunter: "Selvi. I'll be back soon. Just stay here." Selvi: "Haan. Main yahin rahungi." (Yes. I will stay here.) Hunter: "Detective Hunter."
created_at"2026-02-25T22:16:41.241Z" 2/25/2026, 10:16:41 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency517
moderation_latency(null)
generation_time46920
tokens_prompt315
tokens_completion4214
native_tokens_prompt300
native_tokens_completion4230
native_tokens_completion_images(null)
native_tokens_reasoning3781
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.010242
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-ee90b560-1b06-9c44-9dc9-da0a2bdaa580"
is_byokfalse
latency517
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772057801-fY0xx5to2FnJqgtY4sxp"
upstream_id"chatcmpl-ee90b560-1b06-9c44-9dc9-da0a2bdaa580"
total_cost0.010242
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya... kya ho raha hai? Main samajh nahi pa rahi hoon."
detectedLang"et"
heavyLang"tl"
scores
et0.47115384615384615
tl0.46808510638297873
no0.434156378600823
it0.42827442827442824
lv0.4246861924686192
eu0.375
vi0.36342592592592593
sl0.3529411764705882
ca0.3037974683544304
sk0.28756476683937826
hr0.2819843342036553
cs0.27821522309711283
sq0.27821522309711283
fi0.2744063324538259
yo0.2724867724867725
is0.27055702917771884
en0.2647058823529412
fr0.24242424242424243
da0.23822714681440443
lt0.23184357541899442
sv0.22535211267605632
de0.22096317280453256
ms0.20520231213872833
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am. I'm Detective Hunter. I need to ask you a few questions about last night near the orchard."
detectedLang"en"
heavyLang"en"
scores
en0.7968580715059588
tl0.6153846153846154
fr0.5828698553948832
no0.5213784301212508
it0.511400651465798
ca0.46619217081850534
nl0.45848375451263534
pt0.45848375451263534
da0.4577006507592191
sq0.4377811094452773
ro0.4186046511627907
yo0.4113029827315541
cs0.4085173501577287
es0.39418416801292405
et0.36815501263689976
hr0.36655405405405406
sl0.3617021276595745
sv0.3567753001715266
de0.3409490333919156
pl0.32795698924731176
sk0.3081180811808118
ms0.27466150870406186
lv0.2537313432835821
lt0.2492492492492493
hu0.2291880781089414
tr0.21548117154811713
fi0.15540540540540537
is0.15540540540540537
az0.1506228765571914
vi0.1506228765571914
be0.08536585365853659
eu0.08536585365853659
uk0.07749077490774908
reliabletrue
passestrue
2
name"Selvi"
dialogue"Orchard? Haan... main wahan thi. Landscape ke liye."
detectedLang"ms"
heavyLang"vi"
scores
ms0.601593625498008
en0.54337899543379
tl0.49664429530201337
de0.4495412844036697
no0.38016528925619836
nl0.3617021276595745
fr0.35205183585313177
vi0.34065934065934067
is0.2753623188405797
da0.2628992628992629
sv0.25742574257425743
cs0.2555831265508685
fi0.22680412371134018
yo0.22680412371134018
eu0.21875
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Did you see anyone? Anyone suspicious? We've had disappearances around the festival grounds."
detectedLang"en"
heavyLang"en"
scores
en0.7861724875267284
tl0.6341463414634145
fr0.5558845299777943
nl0.46380697050938335
pt0.42857142857142855
ca0.41690962099125367
ms0.4157740993184031
es0.3644067796610169
et0.3273542600896861
it0.3220338983050847
no0.3197278911564626
sv0.3135011441647597
cs0.3063583815028902
da0.3063583815028902
sq0.25742574257425743
ro0.2555831265508685
hr0.250936329588015
sl0.2376111817026684
hu0.2052980132450331
lv0.18588873812754408
lt0.17355371900826447
az0.16434540389972147
sk0.16434540389972147
yo0.15134370579915135
de0.1044776119402985
fi0.09502262443438914
pl0.09502262443438914
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan. Ek aadmi. Woh... woh ajeeb tha. Woh meri camera ki taraf dekh raha tha."
detectedLang"tr"
heavyLang"de"
scores
tr0.5238095238095238
ms0.3957703927492447
et0.38080495356037153
ro0.3710691823899371
nl0.3055555555555556
it0.2831541218637993
az0.2805755395683453
sl0.2766726943942134
hu0.23224568138195778
sq0.2263056092843327
yo0.2202729044834308
ca0.20318725099601595
es0.19839679358717435
sv0.17012448132780084
en0.15966386554621848
fr0.15966386554621848
de0.15254237288135594
tl0.15254237288135594
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Did he say anything to you? What did he look like?"
detectedLang"en"
heavyLang"en"
scores
en0.8401162790697675
tl0.6126760563380281
yo0.4649805447470817
no0.45972495088408644
cs0.4318181818181818
pl0.32926829268292684
sk0.32432432432432434
lv0.30730478589420657
sl0.3055555555555556
hr0.2966751918158568
da0.2744063324538259
lt0.2744063324538259
sq0.26666666666666666
ca0.2486338797814208
fi0.2486338797814208
es0.233983286908078
ms0.22096317280453256
reliabletrue
passestrue
6
name"Selvi"
dialogue"Nahi... woh koi shabd nahi bola. Bas dekh raha tha. Main darri hoon."
detectedLang"eu"
heavyLang"de"
scores
eu0.45482866043613707
ca0.3996569468267582
fr0.36363636363636365
ms0.3566176470588235
sq0.3566176470588235
et0.28716904276985744
sk0.2324561403508772
en0.22048997772828507
de0.1822429906542056
pt0.1822429906542056
is0.18032786885245902
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Okay. Okay, I understand you're scared. I just need to know if you took any photos. Did you see his face?"
detectedLang"en"
heavyLang"en"
scores
en0.8175761421319797
no0.4893428063943161
sv0.4893428063943161
da0.48614834673815904
tl0.46161048689138573
et0.451858913250715
ca0.42152917505030174
cs0.40904419321685515
ro0.38105489773950485
pl0.37089715536105033
sk0.33755760368663595
fr0.32748538011695905
de0.3146603098927294
lv0.30806257521058966
hr0.3072289156626506
nl0.3021844660194175
lt0.3004866180048662
yo0.28035043804755944
it0.2609254498714653
pt0.2144808743169399
is0.19241573033707865
sq0.18899858956276447
sl0.1738505747126437
es0.12213740458015267
hi0.11809815950920245
be0.10852713178294573
tr0.10852713178294573
hu0.1043613707165109
az0.0987460815047022
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan. Photo hai. Par... par main abhi nahi dekh sakti. Mera haath kaanp raha hai."
detectedLang"fr"
heavyLang"la"
scores
fr0.4982290436835891
en0.38848920863309355
sq0.33070866141732286
sv0.3178170144462279
tl0.29983525535420097
eu0.2796610169491525
vi0.2697594501718213
lv0.2672413793103448
et0.24911660777385158
it0.1904761904761905
da0.17953667953667954
cs0.17153996101364524
de0.1550695825049702
hi0.1533864541832669
reliablefalse
passesfalse
9
name"Hunter"
dialogue"That's fine. I'll take the camera to the lab. I'll be back with a translator. Can you tell me your name again?"
detectedLang"en"
heavyLang"en"
scores
en0.8062015503875969
tl0.58416500332668
nl0.5360059391239792
ms0.47829716193656097
no0.47523089840470195
sq0.4658119658119659
it0.45793581960104074
sl0.4429590017825312
yo0.4307832422586521
ro0.4228993536472761
da0.4212962962962963
fr0.41424554826616683
es0.3961352657004831
cs0.3902439024390244
ca0.3842364532019704
pl0.37624750499001997
pt0.37122736418511065
lt0.3686868686868687
hr0.3602865916069601
de0.3596311475409836
sv0.3543388429752066
sk0.34210526315789475
et0.3078626799557032
hu0.3040089086859688
lv0.29298642533936653
tr0.2577197149643705
az0.24789410348977134
vi0.20178799489144317
fi0.18086500655307994
eu0.17979002624671916
is0.10714285714285714
reliabletrue
passestrue
10
name"Selvi"
dialogue"Selvi. Selvi Sharma. Kripya jaldi aaiye."
detectedLang"sq"
heavyLang"is"
scores
sq0.4212962962962963
da0.3093922651933701
fi0.3055555555555556
eu0.29775280898876405
en0.2816091954022989
is0.2732558139534884
no0.2711370262390671
tl0.258160237388724
cs0.2378048780487805
et0.2378048780487805
it0.2378048780487805
tr0.2378048780487805
ca0.23547400611620795
ms0.23547400611620795
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Selvi. I'll be back soon. Just stay here."
detectedLang"en"
heavyLang"en"
scores
en0.7624076029567054
ca0.4063324538258575
hu0.34210526315789475
da0.33234421364985167
lt0.33234421364985167
fi0.3283582089552239
yo0.3283582089552239
et0.3119266055045872
sv0.3119266055045872
ja0.30769230769230765
sq0.30769230769230765
tl0.30769230769230765
no0.29245283018867924
reliabletrue
passestrue
12
name"Selvi"
dialogue"Haan. Main yahin rahungi."
detectedLang"et"
heavyLang"et"
scores
et0.47368421052631576
ms0.46619217081850534
tl0.46619217081850534
en0.39759036144578314
fr0.3697478991596639
de0.34210526315789475
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Detective Hunter."
detectedLang"en"
heavyLang"de"
scores
en0.7937293729372937
ro0.713302752293578
tl0.7023809523809523
fr0.6794871794871795
ca0.6565934065934066
it0.6537396121883656
pt0.6508379888268158
es0.5874587458745875
de0.5791245791245792
da0.570446735395189
no0.558303886925795
sq0.5487364620938628
nl0.5370370370370371
sv0.5229007633587787
sl0.50199203187251
cs0.3654822335025381
hr0.34895833333333337
ms0.3206521739130435
tr0.3206521739130435
reliabletrue
passestrue