Run: 2026-02-25-01KJBGDQFEMVTNYGVJCEZ3F06E

Run Details

Model:
Qwen 3.5 Flash
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
42.3s
Cost:
$0.002193
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
53.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "(In Hindi) 'Tum yahan kyun khade ho? Main bas apni tasveerein dekh rahi hoon.'" (Translation: Why are you standing here? I am just looking at my pictures.) Hunter: "Ma'am, I didn't mean to startle you. I'm Detective Hunter with the Alborn PD. Could you tell me what you have on those?" (He points to her camera lens) Selvi: "(In Hindi) 'Koi janta nahi hai. Woh kamra hawa mein gayab ho gaye.'" (Translation: No one knows. They disappeared into the air.) (She lowers her voice, trembling) Hunter: "Wait, I'm sorry. English? Does anyone know English? I need to know what you're talking about. Are you talking about a disappearance?" Selvi: "(In Hindi) 'Maine use dekh liya. Paital ke paas. Jab ped ke nishaan the.'" (Translation: I saw it. By the orchard. When the tree marks were there.) (She thrusts the camera forward, showing a specific photo of the apple trees.) Hunter: "Okay, okay. The orchard. The one near Miller's Lane?" (He leans in slightly, trying to gauge the location.) Selvi: "(In Hindi) 'Nahi. Wahan ke nishaan kya hain? Tumhe pata hai?' (She shakes her head, eyes wide.) No one speaks here. Only me." Hunter: "I understand the urgency, Miss...?" (He pauses, waiting for a name) "...you're safe, but I need more context." Selvi: "(In Hindi) 'Mera naam Selvi hai. Yeh mera ghar hai, par yeh jhoot hai. Tumhara koi raasta nahi hai.'" (Translation: My name is Selvi. This is my home, but it is a lie. There is no way through.) Hunter: "Selvi. Got it. Listen, I'm going to need to see those photos again. But I can't stand here all day." Selvi: "(In Hindi) 'Tum wapas aayenge? Ya nahi?'" (Translation: Will you come back? Or not?) Hunter: "I gotta go. Call came in. If you see anything else, give my number to the waitress. I'll be back." Selvi: "(In Hindi) 'Jab tak tum aaoge, woh khali rahega.'" (Translation: Until you come, it will remain empty.) Hunter: "I'll be back. Stay right there." (He turns to leave, then stops and looks back, confused by her words.) Selvi: "(In Hindi) 'Chaliye jao.'" (Translation: Go away.) (She pulls her camera close to her chest, watching him leave.)
created_at"2026-02-25T22:59:01.155Z" 2/25/2026, 10:59:01 PM
model"qwen/qwen3.5-flash-20260224"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency448
moderation_latency(null)
generation_time36694
tokens_prompt315
tokens_completion5532
native_tokens_prompt300
native_tokens_completion5407
native_tokens_completion_images(null)
native_tokens_reasoning4786
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0021928
router(null)
provider_responses
0
endpoint_id"5f6b71b5-8672-4b27-8b2d-f674429f9e63"
id"chatcmpl-6c072413-4736-9c84-87b8-cb916f541ef9"
is_byokfalse
latency447
model_permaslug"qwen/qwen3.5-flash-20260224"
provider_name"Alibaba"
status200
api_type"completions"
id"gen-1772060341-XFxH2tNyd9C1Y1Rg7LOG"
upstream_id"chatcmpl-6c072413-4736-9c84-87b8-cb916f541ef9"
total_cost0.0021928
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"

Evaluation details

Result Evaluator Details Meta Data
53.33% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"'Tum yahan kyun khade ho? Main bas apni tasveerein dekh rahi hoon.'"
detectedLang"ms"
heavyLang"tl"
scores
ms0.358974358974359
fr0.32
nl0.3122977346278317
de0.2685025817555938
tl0.23561151079136694
ca0.22018348623853207
no0.20708955223880596
sk0.20708955223880596
cs0.19962335216572505
it0.19962335216572505
en0.18893129770992365
is0.18111753371868977
fi0.17153996101364524
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, I didn't mean to startle you. I'm Detective Hunter with the Alborn PD. Could you tell me what you have on those?"
detectedLang"en"
heavyLang"en"
scores
en0.7973520670089165
tl0.5356037151702787
fr0.5241116751269036
da0.484181568088033
no0.4747899159663866
sq0.44933920704845814
it0.44526627218934917
ro0.43095599393019723
cs0.41905499612703334
hr0.39271255060728744
ca0.38825448613376834
sv0.36494496189669773
pl0.36061381074168797
sl0.355116079105761
yo0.35121107266435986
nl0.33804060017652254
et0.33095450490633366
sk0.3218806509945751
pt0.299719887955182
ms0.2850333651096282
es0.27184466019417475
lv0.2596248766041461
de0.2492492492492493
lt0.23155737704918034
fi0.23076923076923078
is0.16666666666666666
tr0.14675767918088736
hi0.10071942446043164
be0.08536585365853659
hu0.08200734394124846
az0.07749077490774908
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
2
name"Selvi"
dialogue"'Koi janta nahi hai. Woh kamra hawa mein gayab ho gaye.'"
detectedLang"it"
heavyLang"de"
scores
it0.42835365853658536
ca0.35008665511265163
eu0.3055555555555556
vi0.2951127819548872
de0.25
no0.22839506172839508
sk0.22839506172839508
cs0.2203742203742204
ms0.21875
ro0.19181034482758622
es0.16666666666666666
pt0.16666666666666666
tl0.16666666666666666
fi0.15730337078651685
en0.14383561643835618
hr0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
sl0.14383561643835618
sq0.14383561643835618
sv0.14383561643835618
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Wait, I'm sorry. English? Does anyone know English? I need to know what you're talking about. Are you talking about a disappearance?"
detectedLang"en"
heavyLang"en"
scores
en0.818889187013684
tl0.5140388768898488
no0.44942903752039154
cs0.4318181818181818
hr0.42455242966751916
it0.4186046511627907
da0.39999999999999997
ro0.39946619217081847
yo0.3732590529247911
sk0.3679775280898876
pt0.35406698564593303
pl0.3515850144092219
fr0.3503368623676612
sv0.33758586849852795
nl0.33234421364985167
de0.29467084639498436
ca0.2887249736564805
sl0.2887249736564805
et0.28191489361702127
sq0.28191489361702127
lv0.2741935483870968
lt0.2694805194805195
ms0.2566079295154185
hu0.24832962138084633
is0.23642533936651583
es0.22413793103448276
tr0.17883211678832117
az0.1646039603960396
vi0.1646039603960396
be0.09395973154362416
eu0.09395973154362416
fi0.08536585365853659
uk0.08536585365853659
reliabletrue
passestrue
4
name"Selvi"
dialogue"'Maine use dekh liya. Paital ke paas. Jab ped ke nishaan the.'"
detectedLang"en"
heavyLang"en"
scores
en0.5619158878504673
ms0.44113263785394935
fi0.4318181818181818
fr0.4131455399061033
yo0.34210526315789475
tl0.3267504488330341
no0.2964352720450282
ro0.27884615384615385
da0.2732558139534884
sq0.2732558139534884
sv0.2732558139534884
de0.2690058479532163
cs0.21548117154811713
et0.19527896995708155
nl0.1830065359477124
es0.17943107221006563
pt0.17943107221006563
ca0.17218543046357618
tr0.14383561643835618
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, okay. The orchard. The one near Miller's Lane?"
detectedLang"en"
heavyLang"en"
scores
en0.7348886532343584
tl0.6438746438746439
no0.50199203187251
fr0.4908350305498982
nl0.38875305623471884
de0.3857493857493857
da0.3842364532019704
yo0.299719887955182
ja0.2857142857142857
et0.2816091954022989
ca0.2711370262390671
az0.2625368731563422
hu0.2625368731563422
is0.26035502958579887
hr0.258160237388724
pl0.258160237388724
es0.25595238095238093
tr0.24698795180722888
ms0.2378048780487805
sq0.2378048780487805
sv0.2378048780487805
fi0.23076923076923078
it0.19614147909967844
reliabletrue
passestrue
6
name"Selvi"
dialogue"'Nahi. Wahan ke nishaan kya hain? Tumhe pata hai?' No one speaks here. Only me."
detectedLang"en"
heavyLang"en"
scores
en0.6186117467581999
ms0.4829369183040331
tl0.44320712694877507
fi0.34895833333333337
it0.34210526315789475
sq0.3315508021390375
es0.3234100135317997
et0.31880108991825606
pt0.3112947658402204
hr0.2732558139534884
no0.2732558139534884
pl0.24471299093655588
vi0.2389649923896499
eu0.2163009404388715
ca0.2125984251968504
lv0.20760697305863707
cs0.17081260364842457
fr0.1539763113367174
sk0.1539763113367174
sl0.14965986394557826
tr0.14965986394557826
yo0.14965986394557826
nl0.14383561643835618
reliabletrue
passesfalse
7
name"Hunter"
dialogue"...you're safe, but I need more context."
detectedLang"en"
heavyLang"en"
scores
en0.8215701823949246
ca0.5360824742268042
it0.5202558635394456
tl0.512987012987013
hr0.49095022624434387
fr0.48394495412844035
ro0.48156682027649766
et0.4730679156908665
no0.39189189189189183
da0.3818681318681319
sv0.38016528925619836
sq0.3732590529247911
pt0.3679775280898876
pl0.358974358974359
es0.3553008595988539
cs0.3181818181818182
nl0.296875
sl0.281150159744409
yo0.27884615384615385
ms0.25742574257425743
sk0.24242424242424243
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
is0.21875
lt0.21875
lv0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
8
name"Selvi"
dialogue"'Mera naam Selvi hai. Yeh mera ghar hai, par yeh jhoot hai. Tumhara koi raasta nahi hai.'"
detectedLang"sv"
heavyLang"ber"
scores
sv0.4164619164619165
it0.33473389355742295
ca0.3338008415147265
ms0.3319268635724332
lv0.32142857142857145
nl0.3185078909612626
fi0.3065693430656934
da0.3014705882352941
es0.2770167427701674
eu0.2578125
vi0.24841772151898736
ro0.24242424242424243
fr0.23263327948303714
tl0.22131147540983606
no0.16373239436619716
et0.15780141843971632
de0.1316270566727605
is0.1316270566727605
pl0.12844036697247707
pt0.1171003717472119
tr0.1171003717472119
hr0.11048689138576778
lt0.11048689138576778
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Selvi. Got it. Listen, I'm going to need to see those photos again. But I can't stand here all day."
detectedLang"en"
heavyLang"en"
scores
en0.8067563698826223
no0.5305980528511822
tl0.5112237509051412
da0.5072992700729927
sq0.47633824670287045
nl0.44942903752039154
fr0.42748091603053434
de0.424061433447099
et0.40528634361233484
sv0.3935309973045822
lv0.38803263825929285
hr0.37902483900643974
pl0.3784530386740331
cs0.3565300285986654
sk0.3316831683168317
it0.31886982845610495
lt0.3119266055045872
yo0.30769230769230765
fi0.30626927029804724
ro0.3005181347150259
ca0.2976066597294485
is0.2887249736564805
sl0.2741935483870968
tr0.23208191126279862
hu0.17883211678832117
es0.17481662591687042
pt0.17481662591687042
az0.15730337078651685
eu0.14772727272727273
hi0.10239361702127658
be0.09395973154362416
uk0.08536585365853659
vi0.08536585365853659
ms0.08038147138964578
reliabletrue
passestrue
10
name"Selvi"
dialogue"'Tum wapas aayenge? Ya nahi?'"
detectedLang"es"
heavyLang"tl"
scores
es0.5238095238095238
eu0.4520547945205479
az0.35275080906148865
tr0.3464052287581699
da0.34210526315789475
pt0.3333333333333333
no0.3150684931506849
ca0.3006993006993007
yo0.3006993006993007
de0.2753623188405797
en0.2753623188405797
tl0.2753623188405797
reliablefalse
passesfalse
11
name"Hunter"
dialogue"I gotta go. Call came in. If you see anything else, give my number to the waitress. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8071788786710176
tl0.6128648004764741
yo0.544179523141655
sv0.5357142857142857
da0.47791164658634533
pl0.45606694560669453
no0.4362532523850824
cs0.4180841539838854
it0.41441441441441446
et0.4122965641952984
hu0.36954413191076624
sk0.35194416749750745
sl0.34210526315789475
nl0.3394308943089431
ms0.33127572016460904
sq0.32432432432432434
de0.30997876857749473
lt0.30032292787944026
hr0.281767955801105
ro0.2630385487528345
az0.2476851851851852
lv0.2215568862275449
fr0.18238993710691823
is0.18238993710691823
ca0.1751269035532995
fi0.14698162729658792
be0.09722222222222222
tr0.09722222222222222
es0.09344490934449094
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
12
name"Selvi"
dialogue"'Jab tak tum aaoge, woh khali rahega.'"
detectedLang"cs"
heavyLang"tlh"
scores
cs0.43064182194616984
sk0.42827442827442824
ms0.4258872651356994
pl0.30730478589420657
pt0.2763157894736842
az0.22096317280453256
reliablefalse
passesfalse
13
name"Hunter"
dialogue"I'll be back. Stay right there."
detectedLang"en"
heavyLang"en"
scores
en0.8230088495575221
tl0.6007984031936128
de0.5575221238938053
yo0.4791666666666667
hu0.36908517350157727
lt0.358974358974359
sq0.2805755395683453
da0.27007299270072993
fr0.27007299270072993
no0.27007299270072993
reliabletrue
passestrue
14
name"Selvi"
dialogue"'Chaliye jao.'"
detectedLang"az"
heavyLang"sr"
scores
az0.5353159851301116
tr0.45652173913043476
reliablefalse
passestrue