Run: 2026-02-25-01KJBFMNYF7E0FYDPGY6V4QH7P

Run Details

Model:
Qwen 3.5 27B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
57.6s
Cost:
$0.012440
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
47.06% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Kya... kya ho raha hai? Kya hua?" (What... what is happening? What happened?) Hunter: "Excuse me, miss. I'm Detective Hunter. I need to ask you a few questions." Selvi: "Police? Main samajh nahi pa rahi. Kahan gaye wo log?" (Police? I don't understand. Where did those people go?) Hunter: "I know this is confusing. We're looking into some disappearances. Have you seen anything strange?" Selvi: "Ghayab? Haan... maine kuch dekha. Bas... dar lagta hai." (Missing? Yes... I saw something. Just... I feel scared.) Hunter: "Okay. Can you tell me where you saw it? Use your hands, point if you need to." Selvi: "Wahan... pahadiyon ke paas. Maine camera se khincha tha." (There... near the hills. I took it with my camera.) Hunter: "You took a photo? That's great. Can you show me?" Selvi: "Haan, haan. Lekin... koi nahi samjhega." (Yes, yes. But... no one will understand.) Hunter: "I'll find a way to understand. Just give me the camera, please." Selvi: "Nahi. Yeh mera hai. Main... main apne professor ko call kar sakti hoon." (No. This is mine. I... I can call my professor.) Hunter: "That's a good idea. I'll wait here." Selvi: "Theek hai. Rukiye." (Okay. Wait.) Hunter: "I'm sorry, I have to take this call." Selvi: "Koi baat nahi. Main yahan hoon." (It's okay. I am here.) Hunter: "Thank you. I'll be back." Selvi: "Ji. Jaldi aana." (Yes. Come back soon.)
created_at"2026-02-25T22:45:14.835Z" 2/25/2026, 10:45:14 PM
model"qwen/qwen3.5-27b-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency509
moderation_latency(null)
generation_time57545
tokens_prompt315
tokens_completion5173
native_tokens_prompt300
native_tokens_completion5146
native_tokens_completion_images(null)
native_tokens_reasoning4702
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0124404
router(null)
provider_responses
0
endpoint_id"f3f88554-0c22-4d57-973b-0dec948808e8"
id"chatcmpl-5d6ba32b-63f6-91cf-9b34-cb8a98d65113"
is_byokfalse
latency509
model_permaslug"qwen/qwen3.5-27b-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772059514-mrXw7M1ELIKISwSKpGKf"
upstream_id"chatcmpl-5d6ba32b-63f6-91cf-9b34-cb8a98d65113"
total_cost0.0124404
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
47.06% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya... kya ho raha hai? Kya hua?"
detectedLang"it"
heavyLang"tl"
scores
it0.622356495468278
vi0.5567375886524822
et0.5300751879699248
ca0.4897959183673469
no0.4703389830508474
sk0.4703389830508474
cs0.4588744588744588
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, miss. I'm Detective Hunter. I need to ask you a few questions."
detectedLang"en"
heavyLang"en"
scores
en0.8000799680127949
fr0.6214988644965935
tl0.6191926884996192
it0.6108949416342413
ca0.5670995670995671
pt0.5594713656387665
no0.5340167753960857
ro0.5192307692307693
cs0.5088408644400786
sq0.5029821073558649
es0.4939271255060729
da0.490316004077472
hr0.4646680942184154
sl0.4594594594594595
nl0.44382647385984425
pl0.42263279445727486
et0.4186046511627907
yo0.40688018979833923
sv0.4033412887828162
sk0.4004796163069544
lv0.33774834437086093
lt0.33244325767690247
de0.3234100135317997
hu0.3084370677731674
ms0.2917847025495751
tr0.2917847025495751
fi0.2163009404388715
is0.2163009404388715
az0.21011058451816747
vi0.21011058451816747
be0.12280701754385964
eu0.12280701754385964
uk0.11190053285968028
reliabletrue
passestrue
2
name"Selvi"
dialogue"Police? Main samajh nahi pa rahi. Kahan gaye wo log?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.6782178217821783
ms0.5492371705963939
sl0.4897959183673469
lv0.473257698541329
de0.46546052631578944
fi0.459234608985025
hr0.459234608985025
en0.45561139028475717
yo0.45561139028475717
eu0.44349315068493156
fr0.4347826086956522
et0.3725868725868726
no0.367704280155642
sq0.36647173489278756
cs0.358974358974359
da0.3512974051896207
ro0.3512974051896207
lt0.34343434343434337
sv0.34210526315789475
it0.3380855397148676
sk0.3257261410788381
is0.2388758782201405
pl0.21307506053268765
nl0.20924574209245742
az0.1875
es0.1875
hu0.1875
ca0.181360201511335
tr0.181360201511335
pt0.17721518987341772
reliabletrue
passesfalse
3
name"Hunter"
dialogue"I know this is confusing. We're looking into some disappearances. Have you seen anything strange?"
detectedLang"en"
heavyLang"en"
scores
en0.8156028368794326
tl0.5672436750998668
fr0.5340501792114696
nl0.5174461766889383
da0.4610281923714759
no0.436741767764298
it0.37739463601532564
ca0.37439846005774785
is0.3608652900688299
ms0.3493493493493494
pt0.34343434343434337
sq0.3107104984093319
sv0.3018259935553169
ro0.2927094668117519
cs0.2903930131004367
de0.2785793562708102
hr0.25968109339407747
hu0.2537313432835821
lv0.2415402567094516
yo0.2415402567094516
pl0.2388758782201405
es0.22894424673784108
sk0.19753086419753088
lt0.16666666666666666
tr0.16559691912708602
az0.15803108808290156
et0.15803108808290156
sl0.11924119241192413
be0.09722222222222222
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
4
name"Selvi"
dialogue"Ghayab? Haan... maine kuch dekha. Bas... dar lagta hai."
detectedLang"fr"
heavyLang"tlh"
scores
fr0.496124031007752
ro0.4583333333333333
en0.3340163934426229
et0.3340163934426229
fi0.3340163934426229
vi0.3257261410788381
de0.3114406779661017
lt0.2793791574279379
it0.23529411764705882
ms0.23529411764705882
es0.22248803827751198
pt0.22248803827751198
lv0.21307506053268765
tl0.20147420147420148
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay. Can you tell me where you saw it? Use your hands, point if you need to."
detectedLang"en"
heavyLang"en"
scores
en0.8211446740858506
tl0.6059544658493871
fr0.49664429530201337
da0.49324324324324326
no0.4532199270959903
sq0.4094488188976378
pl0.4015957446808511
sv0.3844049247606019
nl0.36886395511921455
ms0.3679775280898876
de0.35988620199146515
et0.34210526315789475
yo0.3212669683257918
cs0.3171471927162367
sl0.3171471927162367
lv0.3161094224924012
is0.2902208201892744
sk0.22680412371134018
hr0.2049469964664311
eu0.20071047957371224
lt0.18772563176895307
es0.1847826086956522
pt0.16356877323420074
it0.15094339622641512
az0.14611005692599618
ca0.14611005692599618
tr0.14611005692599618
fi0.14285714285714285
ro0.12959381044487428
reliabletrue
passestrue
6
name"Selvi"
dialogue"Wahan... pahadiyon ke paas. Maine camera se khincha tha."
detectedLang"ms"
heavyLang"vi"
scores
ms0.5910577971646674
tl0.5629370629370629
fi0.5341614906832298
ro0.53125
fr0.51171875
es0.4710860366713681
it0.40476190476190477
et0.3902439024390244
cs0.3892508143322475
en0.3892508143322475
sq0.37913907284768217
de0.3686868686868687
ca0.34554973821989526
yo0.34210526315789475
sv0.3093922651933701
hr0.2618110236220473
sl0.26035502958579887
pt0.24089068825910928
tr0.2299794661190965
da0.19700214132762314
lv0.19006479481641467
nl0.16851441241685144
no0.16666666666666666
reliabletrue
passesfalse
7
name"Hunter"
dialogue"You took a photo? That's great. Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8240469208211144
fr0.5702005730659025
tl0.5230524642289348
sq0.5161290322580645
pt0.5041322314049587
cs0.4983277591973244
ro0.4434137291280148
es0.43820224719101125
nl0.4350282485875706
ca0.4152046783625731
it0.40594059405940597
sl0.3723849372384937
no0.3492407809110629
et0.34497816593886466
hu0.34210526315789475
tr0.33920704845814975
az0.3288590604026846
ms0.3288590604026846
fi0.3150684931506849
sk0.3023255813953488
yo0.2840095465393795
hr0.27184466019417475
pl0.25925925925925924
lt0.21465968586387435
hi0.20424403183023873
is0.2
da0.1935483870967742
eu0.1891891891891892
lv0.1891891891891892
vi0.1891891891891892
de0.18256130790190736
sv0.17355371900826447
reliabletrue
passestrue
8
name"Selvi"
dialogue"Haan, haan. Lekin... koi nahi samjhega."
detectedLang"eu"
heavyLang"tl"
scores
eu0.609375
pt0.3442622950819672
fi0.3197278911564626
is0.3055555555555556
reliabletrue
passesfalse
9
name"Hunter"
dialogue"I'll find a way to understand. Just give me the camera, please."
detectedLang"en"
heavyLang"en"
scores
en0.8064828253507499
da0.6610169491525424
no0.623352165725047
sv0.5726495726495726
tl0.5584988962472406
nl0.5515695067264574
ro0.5407577497129736
it0.47575360419397117
yo0.47575360419397117
fr0.47506561679790027
sk0.4673768308921438
cs0.464524765729585
es0.4542974079126876
de0.453551912568306
pl0.4428969359331476
ca0.4405594405594406
sl0.42775393419170243
sq0.4269340974212034
ms0.4261119081779053
et0.3939393939393939
hr0.3630573248407643
pt0.3630573248407643
lv0.32432432432432434
lt0.3174061433447099
hu0.2805755395683453
is0.27140255009107467
fi0.25650557620817843
tr0.16142557651991615
az0.14893617021276595
eu0.14893617021276595
vi0.14893617021276595
reliabletrue
passestrue
10
name"Selvi"
dialogue"Nahi. Yeh mera hai. Main... main apne professor ko call kar sakti hoon."
detectedLang"en"
heavyLang"en"
scores
en0.5454545454545454
sl0.4791666666666667
sv0.4517543859649123
sq0.4292237442922375
eu0.4186046511627907
it0.40476190476190477
pt0.39710610932475876
fr0.3961352657004831
ca0.3832236842105263
de0.36115843270868825
da0.35233160621761656
no0.35233160621761656
az0.34782608695652173
tl0.3397887323943662
lv0.336283185840708
lt0.3055555555555556
tr0.3029739776951673
vi0.2951127819548872
yo0.258893280632411
nl0.25742574257425743
et0.251497005988024
ro0.16666666666666666
es0.1610738255033557
hr0.1515837104072398
cs0.14383561643835618
ms0.14383561643835618
pl0.14383561643835618
sk0.14383561643835618
fi0.1359447004608295
hu0.1359447004608295
reliablefalse
passesfalse
11
name"Hunter"
dialogue"That's a good idea. I'll wait here."
detectedLang"en"
heavyLang"en"
scores
en0.8084291187739464
sq0.576271186440678
es0.522673031026253
ca0.5157384987893463
tl0.46236559139784944
hu0.43820224719101125
ms0.4117647058823529
pt0.4117647058823529
ro0.41002949852507375
cs0.39759036144578314
sk0.3939393939393939
it0.38461538461538464
yo0.3730407523510972
fr0.36908517350157727
hr0.358974358974359
pl0.3442622950819672
sl0.3103448275862069
lt0.2907801418439716
tr0.2779783393501805
is0.2727272727272727
da0.2647058823529412
az0.25925925925925924
eu0.25925925925925924
lv0.25925925925925924
nl0.25925925925925924
no0.25925925925925924
vi0.25925925925925924
de0.250936329588015
et0.23954372623574144
fi0.23954372623574144
sv0.23954372623574144
reliabletrue
passestrue
12
name"Selvi"
dialogue"Theek hai. Rukiye."
detectedLang"vi"
heavyLang"rn"
scores
vi0.5567375886524822
tr0.5300751879699248
nl0.45652173913043476
it0.4444444444444444
reliablefalse
passesfalse
13
name"Hunter"
dialogue"I'm sorry, I have to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.8221343873517788
tl0.6621621621621622
da0.6341463414634145
pl0.5370370370370371
hr0.53125
no0.5302713987473904
cs0.5119305856832972
yo0.49888641425389757
it0.4886363636363637
sk0.4755244755244755
sl0.4693396226415094
lv0.45121951219512196
lt0.4260204081632653
ca0.38016528925619836
sv0.38016528925619836
sq0.3732590529247911
pt0.30769230769230765
ro0.2857142857142857
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
et0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
14
name"Selvi"
dialogue"Koi baat nahi. Main yahan hoon."
detectedLang"eu"
heavyLang"tl"
scores
eu0.4852941176470589
ms0.44089456869009586
tl0.4281045751633987
en0.3613138686131387
fi0.3346007604562738
fr0.3346007604562738
de0.308300395256917
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Thank you. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.80719794344473
tl0.5426829268292682
vi0.4915254237288135
hu0.43820224719101125
lt0.42748091603053434
yo0.4230769230769231
cs0.34210526315789475
reliabletrue
passestrue
16
name"Selvi"
dialogue"Ji. Jaldi aana."
detectedLang"lt"
heavyLang"is"
scores
lt0.5305164319248826
eu0.5145631067961165
cs0.5073891625615764
sl0.49748743718592964
is0.4845360824742268
et0.43820224719101125
reliablefalse
passesfalse