Run: 2026-02-25-01KJBHRDC736Y54GMF4WH76X96

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
48.4s
Cost:
$0.008005
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
70.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. Detective Hunter." Selvi: "Namaste. (Hello.)" Hunter: "I'm investigating the disappearances in Alborn. Did you see anything near the orchards yesterday?" Selvi: "Kya? (What?)" Hunter: "The woods. Near the festival grounds." Selvi: "Main... main wahan gayi thi. (I... I went there.)" Hunter: "And?" Selvi: (Shaken) "Maine kisi ko dekha. Woh... woh wahan nahi tha. (I saw someone. They... they weren't there.)" Hunter: "I'm sorry, I don't speak Hindi. Who did you see?" Selvi: "Koi aadmi. Woh chup raha. (Some man. He stayed quiet.)" Hunter: "Did he have a weapon? A vehicle?" Selvi: "Camera... dekho. (Camera... look.)" Hunter: "Wait, let me see that." Selvi: "Yeh... yeh khatra hai. (This... this is danger.)" Hunter: "Okay, okay. Just stay calm." Selvi: "Mujhe darr lag raha hai. (I am feeling scared.)" Hunter: "I know. I'll get someone to translate. But I need to take this call." Selvi: "Haan. Jaayein. (Yes. Go.)" Hunter: "Thank you. I'll be back." Selvi: "Kripya. (Please.)"
created_at"2026-02-25T23:22:14.284Z" 2/25/2026, 11:22:14 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency527
moderation_latency(null)
generation_time48311
tokens_prompt315
tokens_completion3294
native_tokens_prompt300
native_tokens_completion3298
native_tokens_completion_images(null)
native_tokens_reasoning2948
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0080052
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-da592b8c-b820-9e0a-bc38-a4bdba52e0c6"
is_byokfalse
latency527
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772061734-jlQuCa7FMiHYLpG0XbBm"
upstream_id"chatcmpl-da592b8c-b820-9e0a-bc38-a4bdba52e0c6"
total_cost0.0080052
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
70.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss. Detective Hunter."
detectedLang"en"
heavyLang"en"
scores
en0.7483221476510067
tl0.6370967741935484
fr0.612736660929432
pt0.5879120879120879
it0.5841035120147875
ro0.5802238805970149
sq0.5714285714285714
es0.5544554455445544
no0.5253164556962026
ca0.5150862068965517
nl0.5044052863436124
sl0.4874715261958998
de0.43324937027707805
da0.42455242966751916
ms0.3885869565217392
sv0.3784530386740331
et0.296875
fi0.25
cs0.24242424242424243
hr0.22945205479452058
tr0.2077464788732394
reliabletrue
passestrue
1
name"Selvi"
dialogue"Namaste."
detectedLang"tl"
heavyLang"lt"
scores
tl0.7448979591836735
et0.673202614379085
sv0.6710526315789473
no0.635036496350365
az0.609375
lt0.609375
da0.5798319327731093
en0.5798319327731093
fr0.5798319327731093
hr0.5798319327731093
nl0.5798319327731093
ro0.5798319327731093
sl0.5798319327731093
sq0.5798319327731093
reliablefalse
passestrue
2
name"Hunter"
dialogue"I'm investigating the disappearances in Alborn. Did you see anything near the orchards yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.7788335517693316
tl0.5614035087719298
nl0.5147375988497483
fr0.5083758193736344
ms0.41709844559585496
pt0.40528634361233484
it0.4005328596802842
ro0.4005328596802842
de0.38803263825929285
sv0.3644067796610169
no0.3553008595988539
et0.30698151950718683
ca0.30626927029804724
sq0.3048403707518023
sl0.29319371727748694
da0.29245283018867924
es0.2606790799561884
cs0.23556058890147225
hr0.23208191126279862
az0.2303306727480046
yo0.22413793103448276
lv0.1758241758241758
is0.16974169741697415
sk0.16974169741697415
lt0.15730337078651685
pl0.11067193675889328
fi0.08038147138964578
reliabletrue
passestrue
3
name"Selvi"
dialogue"Kya?"
detectedLang""
heavyLang"tl"
scores
reliablefalse
passestrue
4
name"Hunter"
dialogue"The woods. Near the festival grounds."
detectedLang"en"
heavyLang"en"
scores
en0.8014121800529568
tl0.7130102040816326
fr0.6192893401015229
no0.5562130177514794
sv0.5490981963927856
nl0.5445344129554657
da0.5408163265306122
ms0.533195020746888
sq0.4803695150115473
ca0.4779582366589328
hr0.471830985915493
pt0.471830985915493
it0.46808510638297873
cs0.4538834951456311
sl0.4538834951456311
es0.4485294117647059
lt0.358974358974359
et0.3515850144092219
az0.3440233236151603
ro0.3440233236151603
sk0.3440233236151603
yo0.32228915662650603
de0.23728813559322032
hu0.22945205479452058
fi0.21875
lv0.21875
pl0.21875
reliabletrue
passestrue
5
name"Selvi"
dialogue"Main... main wahan gayi thi."
detectedLang"ms"
heavyLang"vi"
scores
ms0.6603260869565218
vi0.5535714285714286
tl0.51171875
en0.44196428571428575
fi0.4131455399061033
fr0.4131455399061033
de0.3842364532019704
reliabletrue
passesfalse
6
name"Hunter"
dialogue"And?"
detectedLang"en"
heavyLang"en"
scores
en0.8774509803921569
tl0.8161764705882353
yo0.7983870967741935
reliablefalse
passestrue
7
name"Selvi"
dialogue"Maine kisi ko dekha. Woh... woh wahan nahi tha."
detectedLang"tl"
heavyLang"de"
scores
tl0.5578778135048231
eu0.4954128440366973
fi0.47718631178707227
ms0.46911196911196906
lv0.434156378600823
fr0.43064182194616984
en0.3721461187214612
et0.3721461187214612
de0.3483412322274882
ro0.3483412322274882
yo0.3226600985221675
sl0.314214463840399
sq0.298469387755102
lt0.25675675675675674
reliablefalse
passesfalse
8
name"Hunter"
dialogue"I'm sorry, I don't speak Hindi. Who did you see?"
detectedLang"en"
heavyLang"en"
scores
en0.790167865707434
tl0.6548323471400395
et0.48301329394387
it0.47526236881559225
sq0.38704028021015763
cs0.3433395872420263
is0.3150684931506849
no0.29292929292929293
da0.2842535787321063
hr0.2842535787321063
ca0.2827868852459016
sv0.2827868852459016
pl0.2647058823529412
pt0.2222222222222222
ro0.20454545454545453
yo0.19908466819221968
hi0.1822429906542056
sk0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
9
name"Selvi"
dialogue"Koi aadmi. Woh chup raha."
detectedLang"et"
heavyLang"de"
scores
et0.4845360824742268
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Did he have a weapon? A vehicle?"
detectedLang"en"
heavyLang"en"
scores
en0.8111425873465533
ca0.6747967479674797
fr0.5859213250517599
tl0.5689655172413793
hu0.5495495495495496
yo0.5249406175771971
da0.522673031026253
ro0.5203836930455635
es0.5192307692307693
fi0.4350282485875706
pt0.4117647058823529
cs0.39759036144578314
sk0.3939393939393939
it0.38461538461538464
hr0.358974358974359
pl0.3442622950819672
sl0.3103448275862069
lt0.2907801418439716
tr0.2779783393501805
is0.2727272727272727
sq0.2647058823529412
az0.25925925925925924
eu0.25925925925925924
lv0.25925925925925924
nl0.25925925925925924
no0.25925925925925924
vi0.25925925925925924
de0.250936329588015
et0.23954372623574144
ms0.23954372623574144
sv0.23954372623574144
reliabletrue
passestrue
11
name"Selvi"
dialogue"Camera... dekho."
detectedLang"it"
heavyLang"vi"
scores
it0.6124031007751938
ro0.6124031007751938
ca0.504950495049505
es0.49748743718592964
sv0.45054945054945056
en0.4318181818181818
fr0.4318181818181818
nl0.4318181818181818
de0.4186046511627907
ms0.4186046511627907
tl0.4186046511627907
reliabletrue
passesfalse
12
name"Hunter"
dialogue"Wait, let me see that."
detectedLang"en"
heavyLang"en"
scores
en0.8246844319775596
et0.6794871794871795
sl0.6069182389937107
sq0.5421245421245421
cs0.47257383966244726
es0.44933920704845814
tl0.4444444444444444
fr0.4212962962962963
no0.4212962962962963
pt0.4131455399061033
ms0.40191387559808617
nl0.40191387559808617
it0.3902439024390244
da0.3811881188118812
fi0.375
reliabletrue
passestrue
13
name"Selvi"
dialogue"Yeh... yeh khatra hai."
detectedLang"vi"
heavyLang"ber"
scores
vi0.6108949416342413
it0.5
hr0.46524064171123
lv0.4350282485875706
ro0.4350282485875706
sq0.4350282485875706
reliablefalse
passesfalse
14
name"Hunter"
dialogue"Okay, okay. Just stay calm."
detectedLang"en"
heavyLang"en"
scores
en0.6845425867507886
tl0.5121951219512195
et0.504950495049505
sv0.504950495049505
ca0.4350282485875706
reliabletrue
passestrue
15
name"Selvi"
dialogue"Mujhe darr lag raha hai."
detectedLang"vi"
heavyLang"tlh"
scores
vi0.511400651465798
et0.4845360824742268
it0.39999999999999997
no0.3951612903225807
sv0.38271604938271603
de0.33920704845814975
nl0.33920704845814975
reliablefalse
passesfalse
16
name"Hunter"
dialogue"I know. I'll get someone to translate. But I need to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.8178727537639632
tl0.5976394849785408
hr0.51171875
no0.5110821382007823
pl0.4688385269121813
da0.44933920704845814
cs0.44029850746268656
sk0.41588785046728977
et0.410377358490566
sl0.4075829383886255
ro0.40664556962025317
it0.4028662420382166
lv0.40191387559808617
lt0.3842364532019704
yo0.37395659432387307
ca0.36224489795918363
sq0.35456110154905335
sv0.3444055944055944
fr0.3093922651933701
is0.3029739776951673
pt0.2964352720450282
es0.29245283018867924
vi0.2870722433460076
tr0.2618110236220473
az0.2454728370221328
be0.15730337078651685
de0.1515837104072398
eu0.1515837104072398
hu0.1515837104072398
nl0.14383561643835618
uk0.14383561643835618
ms0.1359447004608295
reliabletrue
passestrue
17
name"Selvi"
dialogue"Haan. Jaayein."
detectedLang""
heavyLang"nl"
scores
reliablefalse
passestrue
18
name"Hunter"
dialogue"Thank you. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.80719794344473
tl0.5426829268292682
vi0.4915254237288135
hu0.43820224719101125
lt0.42748091603053434
yo0.4230769230769231
cs0.34210526315789475
reliabletrue
passestrue
19
name"Selvi"
dialogue"Kripya."
detectedLang"sq"
heavyLang"tlh"
scores
sq0.6774193548387096
reliablefalse
passestrue