Run: 2026-04-27-01KQ78EMHV08YYG5C9MJYESDXN

Run Details

Model:
Qwen 3.6 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
30.4s
Cost:
$0.006982
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "[In Hindi] Maine kal shaam ko jheel ke kinaare kuch ajeeb notice kiya. Woh aawazein… woh parchhaiyan… mujhe bahut ghabrahat ho rahi hai." (I noticed something strange near the lake yesterday evening. Those sounds… those shadows… I'm really overwhelmed.) Hunter: "Ma’am, I’m Detective Hunter. I’m asking about the incident near Miller’s Creek last night. Do you understand English?" Selvi: "[In Hindi] Main samajh nahi pa rahi. Par haan, kal jab main photograph le rahi thi, mera camera kuch alag record kar gaya. Woh jagah… woh log… ghane fog jaise gayab ho gaye." (I can’t understand you. But yes, last night when I was taking photographs, my camera recorded something different. That place… those people… they vanished like thick fog.) Hunter: "I’m sorry, I don’t speak Hindi. Can you try pointing out exactly where this was?" Selvi: "[In Hindi] Haan. Dekhiye. Is screen mein kuch dhundhla sa dikh raha hai. Jaise koi chehra, ya parinda? Pata nahi. Par woh thandi hawa ab bhi yaad hai. Yahan har taraf kuch gum ho raha hai." (Yes. Please look. On this screen, something blurry is showing. Like a face, or a bird? I don’t know. But that cold air is still in my memory. Something is disappearing everywhere around here.) Hunter: "Right. Blurry figure. We’ve had three people report missing within a week, all near the creek bed. The town’s going nuts over it. Even with the apple festival decorations up, nobody’s sleeping." Selvi: "[In Hindi] Festival ki roshni mein bhi andhera chupa hai. Main roz aati hoon, apna camera hamesha saath rakhti hoon. Par mujhe lagta hai koi dekh raha hai, koi chupa hua hai." (Even in the festival light, darkness is hiding. I come every day, I always keep my camera with me. But I feel like someone is watching, someone is lurking.) Hunter: "You’re saying the whole town is putting on a bright face while people keep vanishing. Noted. I appreciate you looking out, Miss Selvi." Selvi: "[In Hindi] Kripya savdhan rahein. Camera lens… usme kuch reflect ho raha hai. Main wapas jaunga nahi, par aap ja rahe hain na? Apna khayal rakhein." (Please be careful. The camera lens… something is reflecting in it. I won’t go back, but you are going, right? Take care of yourself.) Hunter: "I will. Stay where it’s bright, okay? And keep that camera close. I’ll run the development through the lab." Selvi: "[In Hindi] Theek hai. Khayal rakhein. Main ab chalti hoon." (Alright. Take care. I’m leaving now.) Hunter: "Thank you for your patience. Stay safe, and don’t wander near the orchard after dark." Selvi: "[In Hindi] Haan, Detective. Shukriya." (Yes, Detective. Thank you.) Hunter: "Take care, Ms. Selvi."
created_at"2026-04-27T10:41:08.162Z" 4/27/2026, 10:41:08 AM
model"qwen/qwen3.6-flash"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency651
moderation_latency(null)
generation_time30297
tokens_prompt315
tokens_completion4693
native_tokens_prompt300
native_tokens_completion4605
native_tokens_completion_images(null)
native_tokens_reasoning3871
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0069825
router(null)
provider_responses
0
endpoint_id"2435bec9-c808-4f27-9fc8-12f3460d7b66"
id"chatcmpl-4c4f8774-82ee-9f09-a47c-e89c4a9d25fc"
is_byokfalse
latency651
model_permaslug"qwen/qwen3.6-flash"
provider_name"Alibaba"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777286468-ZjT2DNnP2s7G6U30ZWEJ"
session_id(null)
api_type"completions"
id"gen-1777286468-chbJyp8bvkNbRc1O9FjP"
upstream_id"chatcmpl-4c4f8774-82ee-9f09-a47c-e89c4a9d25fc"
total_cost0.0069825
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Maine kal shaam ko jheel ke kinaare kuch ajeeb notice kiya. Woh aawazein… woh parchhaiyan… mujhe bahut ghabrahat ho rahi hai."
detectedLang"tl"
heavyLang"de"
scores
tl0.4277305428384566
fr0.3430930930930931
it0.29718875502008035
ro0.28042763157894735
en0.27805280528052806
yo0.2774566473988439
lv0.2738589211618257
ms0.2653232577665827
cs0.2508561643835616
et0.24763542562338778
de0.22839506172839508
fi0.21454219030520644
eu0.2081447963800905
nl0.1935483870967742
ca0.1822429906542056
sk0.17452830188679244
pt0.1618773946360153
az0.15784408084696824
es0.15784408084696824
vi0.15213178294573643
sl0.12587412587412586
no0.1125760649087221
sq0.10714285714285714
lt0.0979381443298969
hr0.08759124087591241
tr0.07991587802313353
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma’am, I’m Detective Hunter. I’m asking about the incident near Miller’s Creek last night. Do you understand English?"
detectedLang"en"
heavyLang"en"
scores
en0.7935435435435435
tl0.6386333771353482
no0.547945205479452
nl0.5439469320066335
da0.5192307692307693
de0.4907407407407407
fr0.48948019801980197
ro0.4518272425249169
sv0.43376801647220314
pt0.41654879773691655
ca0.3986880466472303
es0.38478747203579416
cs0.374051593323217
sq0.36046511627906974
it0.3488555643251776
sl0.3125
sk0.2978723404255319
hr0.27821522309711283
et0.2692648361381754
pl0.260752688172043
yo0.23892988929889297
az0.22096317280453256
is0.22022684310018903
ms0.20212765957446807
hu0.15210688591983554
tr0.14596273291925466
vi0.1185897435897436
fi0.08333333333333334
lt0.0667420814479638
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main samajh nahi pa rahi. Par haan, kal jab main photograph le rahi thi, mera camera kuch alag record kar gaya. Woh jagah… woh log… ghane fog jaise gayab ho gaye."
detectedLang"fr"
heavyLang"de"
scores
fr0.5123879810226674
en0.4434416365824308
tl0.4204260651629073
it0.37373053486797564
sv0.3321299638989169
ro0.32234432234432236
ca0.3153219837157661
sl0.31379821958456966
es0.3008314436885865
lv0.2790335151987529
ms0.27336999214454044
yo0.26294820717131473
et0.24118129614438064
nl0.19143356643356643
hu0.18859649122807018
no0.1857394366197183
tr0.18141592920353983
da0.1621376811594203
eu0.15137614678899083
vi0.14351851851851852
de0.13953488372093023
sk0.10714285714285714
hr0.10454985479186835
cs0.10281280310378274
sq0.10281280310378274
fi0.10106899902818271
is0.09931840311587146
pt0.0975609756097561
lt0.08234126984126985
hi0.07684630738522955
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I’m sorry, I don’t speak Hindi. Can you try pointing out exactly where this was?"
detectedLang"en"
heavyLang"en"
scores
en0.8094633216894253
tl0.7161778618732261
it0.43396226415094336
nl0.358974358974359
ro0.3413830954994512
sq0.3325917686318131
de0.31584948688711517
is0.2822966507177033
no0.2762364294330519
pl0.2665036674816626
sv0.2665036674816626
ca0.26380368098159507
da0.26380368098159507
hr0.2555831265508685
cs0.23371647509578544
yo0.2248062015503876
pt0.21773142112125163
et0.2073976221928666
lt0.19893190921228304
tr0.19678714859437751
az0.1891891891891892
fr0.1501416430594901
ms0.13169319826338638
es0.11504424778761062
hi0.11504424778761062
sk0.10714285714285714
be0.1044776119402985
hu0.10044977511244377
lv0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan. Dekhiye. Is screen mein kuch dhundhla sa dikh raha hai. Jaise koi chehra, ya parinda? Pata nahi. Par woh thandi hawa ab bhi yaad hai. Yahan har taraf kuch gum ho raha hai."
detectedLang"tl"
heavyLang"de"
scores
tl0.38875305623471884
en0.3718592964824121
sv0.35275080906148865
et0.350227420402859
tr0.33642999336429996
no0.3265993265993266
ms0.3220338983050847
fr0.3065187239944522
it0.3050729673384294
is0.2401215805471125
nl0.23838537699923837
da0.2366412213740458
vi0.23195084485407066
de0.22660479505027067
yo0.2260061919504644
ro0.21813917122752147
sq0.2107340173638516
sk0.21011058451816747
eu0.2006394884092726
fi0.19484702093397743
es0.16317991631799164
az0.15325994919559696
pt0.14965986394557826
hr0.1423670668953688
lv0.1341991341991342
hu0.1334488734835355
ca0.10714285714285714
cs0.09584086799276673
sl0.05571293673276676
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Right. Blurry figure. We’ve had three people report missing within a week, all near the creek bed. The town’s going nuts over it. Even with the apple festival decorations up, nobody’s sleeping."
detectedLang"en"
heavyLang"en"
scores
en0.7961743493258074
tl0.592348698651615
nl0.5482974287699791
fr0.5296671490593343
no0.4318181818181818
da0.4265549183943538
ca0.3939393939393939
it0.39280709948622144
sv0.38417811463761253
es0.3800667620410109
pt0.37349397590361444
ro0.37319189971070393
sq0.36399217221135033
de0.3599212210733629
ms0.33299127757824526
et0.3055555555555556
cs0.2571428571428571
yo0.2243436754176611
hr0.22248803827751198
sl0.20537897310513448
sk0.19103920348475423
hu0.18238993710691823
fi0.1725015913430936
az0.16291049581455247
tr0.15966386554621848
pl0.1530944625407166
is0.14865749836280287
lv0.14417379855167875
lt0.13793103448275862
eu0.10897875257025359
vi0.051094890510948905
reliabletrue
passestrue
6
name"Selvi"
dialogue"Festival ki roshni mein bhi andhera chupa hai. Main roz aati hoon, apna camera hamesha saath rakhti hoon. Par mujhe lagta hai koi dekh raha hai, koi chupa hua hai."
detectedLang"fr"
heavyLang"en"
scores
fr0.35756240822320123
it0.3425995492111195
et0.29605792437650846
az0.29207119741100324
en0.29149797570850206
de0.2827868852459016
sl0.279835390946502
ca0.26035502958579887
sv0.2508561643835616
es0.24373379429559205
da0.24242424242424243
ro0.23979148566463945
nl0.2297535211267606
ms0.22291296625222026
tl0.22291296625222026
sq0.21171171171171171
lv0.19945105215004574
hr0.18680297397769516
pt0.18680297397769516
tr0.17917448405253283
hu0.17685794920037629
cs0.1760828625235405
no0.1760828625235405
fi0.16347992351816445
vi0.15213178294573643
lt0.12587412587412586
eu0.125
sk0.11883182275931521
yo0.11437246963562754
pl0.06716417910447761
reliablefalse
passesfalse
7
name"Hunter"
dialogue"You’re saying the whole town is putting on a bright face while people keep vanishing. Noted. I appreciate you looking out, Miss Selvi."
detectedLang"en"
heavyLang"en"
scores
en0.8112457778660839
tl0.5666058394160584
fr0.4314781567923399
no0.40513462742642453
yo0.37989556135770236
it0.3782722513089006
nl0.3524199045671438
pt0.3488690884167238
sv0.3470790378006873
ro0.342560553633218
hr0.3370551290997907
da0.3333333333333333
ca0.32142857142857145
cs0.291044776119403
hu0.28409947249434814
de0.2835595776772248
is0.2835595776772248
sq0.2753623188405797
et0.2731446059678654
tr0.2543171114599686
fi0.2537313432835821
es0.2513790386130812
pl0.24901185770750986
ms0.24603174603174602
sk0.22575387123064386
lv0.2030201342281879
lt0.1324200913242009
az0.12280701754385964
vi0.12280701754385964
sl0.08653846153846154
hi0.08123791102514508
be0.06862745098039216
eu0.06862745098039216
uk0.06219151036525173
reliabletrue
passestrue
8
name"Selvi"
dialogue"Kripya savdhan rahein. Camera lens… usme kuch reflect ho raha hai. Main wapas jaunga nahi, par aap ja rahe hain na? Apna khayal rakhein."
detectedLang"it"
heavyLang"tl"
scores
it0.3548387096774194
lv0.35117599351175993
ca0.3371996685998343
en0.3079584775086505
sk0.30374238468233244
de0.300087489063867
sq0.293909973521624
sv0.2895204262877442
tl0.28698752228163993
pt0.28186714542190305
fr0.2779783393501805
eu0.2747053490480508
et0.2694063926940639
es0.2558139534883721
cs0.2438563327032136
ro0.2263056092843327
pl0.22555663117134558
sl0.2248062015503876
lt0.21414538310412573
nl0.1894630192502533
yo0.1794871794871795
da0.1778006166495375
vi0.16405433646812956
fi0.16054564533053514
hr0.15789473684210525
ms0.15611814345991562
no0.12184412733260154
reliablefalse
passesfalse
9
name"Hunter"
dialogue"I will. Stay where it’s bright, okay? And keep that camera close. I’ll run the development through the lab."
detectedLang"en"
heavyLang"en"
scores
en0.8164175190138997
tl0.711101939744119
yo0.4304312449145647
de0.4152046783625731
nl0.38704028021015763
fr0.3854258121158911
sq0.38271604938271603
ro0.3744414655942806
no0.3524514338575393
hr0.3408662900188324
sv0.34024505183788883
ca0.3383742911153119
da0.3383742911153119
it0.2805755395683453
pl0.21612541993281076
pt0.20454545454545453
cs0.1935483870967742
zh0.18032786885245902
ms0.1764705882352941
lt0.16567342073897498
sk0.16167664670658682
hu0.1566265060240964
az0.15254237288135594
es0.12390488110137672
sl0.10600255427841634
be0.09090909090909091
tr0.09090909090909091
et0.08256880733944955
is0.08256880733944955
lv0.08256880733944955
uk0.08256880733944955
vi0.08256880733944955
reliabletrue
passestrue
10
name"Selvi"
dialogue"Theek hai. Khayal rakhein. Main ab chalti hoon."
detectedLang"de"
heavyLang"tr"
scores
de0.49324324324324326
en0.42196531791907516
fr0.38524590163934425
vi0.3435448577680525
nl0.25925925925925924
et0.25
it0.25
ro0.25
sv0.20634920634920634
tr0.20634920634920634
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Thank you for your patience. Stay safe, and don’t wander near the orchard after dark."
detectedLang"en"
heavyLang"en"
scores
en0.8109315916122378
tl0.6654501216545012
no0.5542949756888168
da0.542809642560266
nl0.4816211121583412
fr0.47668886774500474
sv0.41983122362869196
de0.38547486033519557
yo0.38547486033519557
pt0.30203045685279184
cs0.22752808988764048
es0.22425952045133993
lv0.22096317280453256
ms0.22096317280453256
sq0.20863309352517986
vi0.20863309352517986
ca0.20634920634920634
tr0.1935483870967742
lt0.15644171779141106
sl0.12
reliabletrue
passestrue
12
name"Selvi"
dialogue"Haan, Detective. Shukriya."
detectedLang"en"
heavyLang"fi"
scores
en0.6346555323590815
ro0.5901639344262295
tl0.56575682382134
fr0.5244565217391305
ca0.5070422535211268
es0.5042492917847025
it0.4971264367816092
pt0.49275362318840576
az0.4006849315068493
sq0.34701492537313433
da0.32432432432432434
de0.32432432432432434
nl0.31906614785992216
no0.3137254901960784
cs0.29149797570850206
hr0.2768595041322314
sl0.2768595041322314
sv0.2768595041322314
reliabletrue
passesfalse
13
name"Hunter"
dialogue"Take care, Ms. Selvi."
detectedLang"en"
heavyLang"en"
scores
en0.7030878859857482
ro0.5993589743589743
tl0.5551601423487544
da0.47257383966244726
fi0.46808510638297873
no0.42660550458715596
sk0.3842364532019704
sl0.3842364532019704
ca0.3811881188118812
reliabletrue
passestrue