Run: 2026-04-27-01KQ738YRT24WDJXDMM4KZB8Z7

Run Details

Model:
Qwen 3.6 35B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 8s
Cost:
$0.013331
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
46.15% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Kya aap wahan the? Kal raat, kheton ke beech. Mainne usse dekha... woh ghooma bhi nahi, bas... gayab. Meri camera ki screen par sirf faslon ke daane dikhe, bas itna hi. Please, mujhe yahan se jaane do. Yeh shahar... yeh bahut khatarnaak hai." Hunter: "Ma'am, I need you to calm down. What exactly did you see? Did you get a face? A vehicle?" Selvi: "Main English nahi jaanti. Sirf Hindi. Aur haan, maine kheton mein kuch kharab dekha. Hawa mein ek saaya. Camera ki battery bhi wahi gayab ho gayi. Jaise hawa ne kha liya ho. Please, aap bhi jaaiye." Hunter: "Okay, Ma'am. I'm Detective Hunter. I'm just trying to understand. Can you point to something? Or use your phone to translate? I can't read Hindi." Selvi: "Koi translate nahi karega. Main bas tasveerein khinchtii hoon, shanti dhundti hoon. Par Alborn... yeh dikhawa hai. Har saal seb festival, har hafte koi aur ghayab. Kal raat meri lens ne bhi dekh liya. Woh deewaaron se bahar aata hai, aur phir... dhuan ban kar udd jaata hai." Hunter: "Dhuan? Smoke? Ma'am, I'm going to need you to focus. We've lost three people near the orchard district. If you saw smoke, or a person, I need a clear description. I don't understand the language, but I can read your fear." Selvi: "Mujhe dar lagta hai. Par main jaan-boojh kar nahi khadi thi. Main photography karta hoon, waqt ko capture karta hoon. Par kal raat ne mujhe kuch aur dikhaya. Andar se... kuch bahar nikal raha hai. Aap detective hain? Toh aapko pata hona chahiye. Yeh sirf do log nahi hain jo chupe hain." Hunter: "I am a detective. And I appreciate you trying to tell me, but we're hitting a wall here. Literally and figuratively. Look, if you can write your name, or point to where you were standing, I can work with that. I'm trying to help." Selvi: "Main Selvi hoon. Main yahan ek study abroad program mein hoon. Sirf do mahine rehne aayi thi. Par ab main chhodna chahati hoon. Aapki investigation... shayad khatam ho gayi hai, kisi aur ne shuru ki hai. Camera dekho. Screen par sirf ek shabd hai... 'Peecho hato'." Hunter: "Selvi. Got it. 'Step back.' Interesting. I'm gonna need a translator to get the full story, but I can't stay here. Dispatch is calling. I'm losing a lead on the third disappearance. Stay put. Don't touch that camera. I'll be back as soon as I can." Selvi: "Rukiye... please. Aaj shaam ko warehouse ke paas mat jaana. Hawa tez hogi. Aur kal subah tak... kisi ko bhi alag mat dekhna." Hunter: "I hear you, Selvi. I'll be careful. And I will be back. Thank you for your time." Selvi: "Khuda hafiz, Detective. Main ab jaati hoon... lekin meri camera hamesha raat ko dekhegi."
created_at"2026-04-27T09:10:39.137Z" 4/27/2026, 9:10:39 AM
model"qwen/qwen3.6-35b-a3b-20260415"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency314
moderation_latency(null)
generation_time67545
tokens_prompt315
tokens_completion6049
native_tokens_prompt300
native_tokens_completion6613
native_tokens_completion_images(null)
native_tokens_reasoning5373
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.013331
router(null)
provider_responses
0
endpoint_id"57ebdffc-b059-4d92-a1ac-94436bae3d31"
id"chatcmpl-a4e90deafec144c5"
is_byokfalse
latency314
model_permaslug"qwen/qwen3.6-35b-a3b-20260415"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777281039-FK40jlD7VNrnMDaqBykQ"
session_id(null)
api_type"completions"
id"gen-1777281039-Z6yOXhB4p8VuBbPBDmS6"
upstream_id"chatcmpl-a4e90deafec144c5"
total_cost0.013331
cache_discount(null)
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
46.15% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Kya aap wahan the? Kal raat, kheton ke beech. Mainne usse dekha... woh ghooma bhi nahi, bas... gayab. Meri camera ki screen par sirf faslon ke daane dikhe, bas itna hi. Please, mujhe yahan se jaane do. Yeh shahar... yeh bahut khatarnaak hai."
detectedLang"en"
heavyLang"tl"
scores
en0.4071954210956664
tl0.34507678410117437
ms0.33729433272394876
fr0.2964580300824842
sq0.2673067205659424
sv0.25411522633744854
yo0.2537313432835821
sl0.24987066735644073
ro0.23684210526315788
fi0.2364402317008952
et0.22168545356951155
cs0.20417124039517012
ca0.20022062879205735
it0.19667590027700832
no0.19444444444444445
hr0.1903964265773311
es0.1733181299885975
pt0.15942028985507248
vi0.1559953434225844
da0.15353181552831288
nl0.1495601173020528
lv0.14353219137625514
de0.1322561340514662
tr0.12597950572634117
eu0.10216718266253869
az0.09713574097135741
pl0.08976773383553045
sk0.08343868520859672
hu0.07702100572883515
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am, I need you to calm down. What exactly did you see? Did you get a face? A vehicle?"
detectedLang"en"
heavyLang"en"
scores
en0.8019366197183099
ro0.5248152059134107
ca0.506578947368421
cs0.49776785714285715
et0.4915254237288135
hr0.4492044063647491
pl0.4485294117647059
yo0.4325346784363178
sk0.4260204081632653
no0.4186046511627907
da0.4117647058823529
tl0.4102228047182176
fr0.402390438247012
lv0.3617021276595745
lt0.3562231759656652
it0.34782608695652173
is0.34593023255813954
hu0.33135215453194655
pt0.3253373313343328
sl0.31921331316187596
es0.3181818181818182
sq0.31402439024390244
sv0.3087557603686636
tr0.24623115577889448
az0.22813036020583194
vi0.22813036020583194
be0.1346153846153846
eu0.1346153846153846
nl0.1346153846153846
de0.12959381044487428
fi0.12280701754385964
ms0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main English nahi jaanti. Sirf Hindi. Aur haan, maine kheton mein kuch kharab dekha. Hawa mein ek saaya. Camera ki battery bhi wahi gayab ho gayi. Jaise hawa ne kha liya ho. Please, aap bhi jaaiye."
detectedLang"en"
heavyLang"la"
scores
en0.4815148782687105
ro0.39505523408732246
fr0.37295528898582336
it0.3646408839779005
tl0.3546576879910213
de0.33139534883720934
et0.28836633663366334
sq0.250814332247557
tr0.24688932547478712
sl0.23230974632843793
ca0.203601108033241
lv0.18785310734463279
cs0.18149466192170818
hr0.1797432239657632
fi0.17915774446823698
ms0.16302765647743814
hu0.15003695491500368
lt0.14751667902149743
no0.14370811615785556
sk0.13403614457831325
nl0.13273001508295626
eu0.12547528517110268
az0.11944869831546708
sv0.11809815950920245
da0.11402157164869028
yo0.0894695170229612
pl0.08874801901743265
es0.07926341072858287
is0.07852564102564104
hi0.06351791530944625
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Okay, Ma'am. I'm Detective Hunter. I'm just trying to understand. Can you point to something? Or use your phone to translate? I can't read Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.7901542649727767
tl0.6582933136313261
da0.5197300103842161
no0.4779909706546276
fr0.4345965770171149
sv0.41157760814249367
ro0.40970006381620927
ca0.3958197256694971
it0.38984168865435354
cs0.3638239339752407
de0.354050279329609
pl0.35133239831697055
nl0.33261183261183264
hr0.3321299638989169
sq0.3248175182481752
pt0.29711246200607905
sk0.2779078844652615
es0.2647058823529412
et0.25583266291230894
sl0.24857839155158404
vi0.23490488006617036
ms0.2285237698081735
tr0.2252931323283082
lv0.2141036533559898
is0.20258620689655174
lt0.2018981880931838
yo0.1949521322889469
az0.17704626334519571
hi0.0777666999002991
be0.07035175879396985
eu0.06754032258064516
hu0.06754032258064516
uk0.06376518218623482
reliabletrue
passestrue
4
name"Selvi"
dialogue"Koi translate nahi karega. Main bas tasveerein khinchtii hoon, shanti dhundti hoon. Par Alborn... yeh dikhawa hai. Har saal seb festival, har hafte koi aur ghayab. Kal raat meri lens ne bhi dekh liya. Woh deewaaron se bahar aata hai, aur phir... dhuan ban kar udd jaata hai."
detectedLang"fr"
heavyLang"la"
scores
fr0.3484657419083648
sl0.34626739772248
ms0.33760683760683763
sq0.334192439862543
tl0.33103150625809236
hr0.32667245873153783
it0.3201754385964912
ro0.30462090623598026
cs0.28931682714351215
es0.2783985102420857
da0.27671488567428837
no0.26400759734093066
en0.2629576795054684
tr0.2615531205335874
ca0.25301204819277107
sv0.2493946731234867
de0.24131179637787564
pt0.23494570582428428
et0.23418972332015808
lv0.23000496770988574
nl0.22149673530889002
lt0.20185375901132854
vi0.1876310272536688
fi0.18549658434051497
az0.14127423822714683
hu0.13793103448275862
sk0.13793103448275862
eu0.13019079685746351
pl0.0790255496137849
yo0.06457453228726615
is0.057177615571776155
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Dhuan? Smoke? Ma'am, I'm going to need you to focus. We've lost three people near the orchard district. If you saw smoke, or a person, I need a clear description. I don't understand the language, but I can read your fear."
detectedLang"en"
heavyLang"en"
scores
en0.7997923772801424
tl0.559973924380704
no0.471830985915493
fr0.46
da0.4351464435146444
de0.414570685169124
sv0.40789473684210525
ro0.38130155820348305
ca0.36320754716981135
es0.3280238924838228
nl0.3236472945891784
yo0.3098159509202454
sq0.3073370959466393
ms0.3055555555555556
cs0.3037648272305312
it0.293563579277865
sk0.2905937992643195
pl0.27145169994603346
hr0.2674986435160065
pt0.25783397471137987
is0.24157303370786518
et0.22945205479452058
lt0.2214532871972318
lv0.19642857142857142
tr0.1773308957952468
hu0.17481662591687042
az0.16615194564546018
sl0.13516976297245356
eu0.09879839786381843
fi0.09698996655518395
vi0.08968307484828052
zh0.053959355290819896
be0.04929577464788732
uk0.0445859872611465
reliabletrue
passestrue
6
name"Selvi"
dialogue"Mujhe dar lagta hai. Par main jaan-boojh kar nahi khadi thi. Main photography karta hoon, waqt ko capture karta hoon. Par kal raat ne mujhe kuch aur dikhaya. Andar se... kuch bahar nikal raha hai. Aap detective hain? Toh aapko pata hona chahiye. Yeh sirf do log nahi hain jo chupe hain."
detectedLang"sl"
heavyLang"ber"
scores
sl0.43011958146487295
fr0.4279819954988747
en0.4188262195121951
pt0.35735356089338394
ro0.3375325803649
sq0.32551968155683325
it0.3195002231146809
tl0.31828341528833265
es0.3133723547951373
hr0.3058716431497497
ca0.30205949656750575
eu0.2978821362799263
ms0.2916860195076637
lv0.2903676128431829
lt0.280999528524281
yo0.2675312199807877
cs0.2632850241545894
sv0.2266734279918864
tr0.22549517521584558
no0.22154160285860133
da0.21994884910485935
vi0.21714579055441477
fi0.190552016985138
et0.16666666666666666
de0.16254805052169138
pl0.14804469273743018
sk0.11130536130536131
is0.09869976359338062
az0.08243080625752107
hu0.051026757934038575
nl0.051026757934038575
hi0.048064918851435705
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I am a detective. And I appreciate you trying to tell me, but we're hitting a wall here. Literally and figuratively. Look, if you can write your name, or point to where you were standing, I can work with that. I'm trying to help."
detectedLang"en"
heavyLang"en"
scores
en0.8193539246245396
tl0.6111619396157365
ro0.4831779489258208
fr0.4731404958677685
it0.4691923397169026
no0.4393139841688654
da0.4348404255319149
sq0.4267086330935252
de0.4011272898074213
ca0.3896601244614648
nl0.3816682832201746
sk0.37895762299074526
sv0.3765281173594132
es0.3511450381679389
pt0.3444730077120822
pl0.3434603501544799
cs0.3383497664763882
hr0.336283185840708
sl0.3324607329842932
lt0.3163538873994638
ms0.30327868852459017
is0.2959690778575373
et0.2651296829971182
yo0.25742574257425743
tr0.2508813160987074
az0.23971377459749554
lv0.19760855884203904
eu0.1600790513833992
hu0.14886515353805072
fi0.09766454352441614
vi0.09446022727272727
hi0.06387665198237885
be0.05204460966542751
uk0.04708520179372198
reliabletrue
passestrue
8
name"Selvi"
dialogue"Main Selvi hoon. Main yahan ek study abroad program mein hoon. Sirf do mahine rehne aayi thi. Par ab main chhodna chahati hoon. Aapki investigation... shayad khatam ho gayi hai, kisi aur ne shuru ki hai. Camera dekho. Screen par sirf ek shabd hai... 'Peecho hato'."
detectedLang"en"
heavyLang"en"
scores
en0.4881750794211084
tl0.4740660137830976
fr0.4093686354378818
de0.36653560506771515
sl0.3603881782090869
ro0.35925762262483424
it0.34210526315789475
hr0.32808155699721964
sv0.3217960710944809
no0.31732580037664787
cs0.3118177503559563
sq0.30886558627264066
da0.30588798468166584
nl0.29782082324455206
tr0.29714008725157537
ca0.28921568627450983
sk0.2867683226758485
pt0.28039702233250624
es0.2691532258064516
ms0.2620865139949109
fi0.26058133605303413
lv0.24596983879355175
vi0.22584089695675386
lt0.2093784078516903
az0.2050438596491228
pl0.19399666481378544
hu0.19265033407572385
yo0.1637831603229527
et0.1555037856726849
zh0.0504256712508186
eu0.04163912756113682
is0.04163912756113682
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Selvi. Got it. 'Step back.' Interesting. I'm gonna need a translator to get the full story, but I can't stay here. Dispatch is calling. I'm losing a lead on the third disappearance. Stay put. Don't touch that camera. I'll be back as soon as I can."
detectedLang"en"
heavyLang"en"
scores
en0.789355427608482
tl0.6031746031746031
no0.478804725503822
it0.4582881906825569
nl0.4460856720827179
da0.43267776096822996
fr0.4263862332695985
sv0.4204018547140649
sq0.41566030385664204
ca0.4040524433849821
yo0.3949173053650666
hr0.39418416801292405
de0.38875305623471884
ro0.3867538838920687
ms0.37290969899665555
pt0.37027707808564225
sk0.3567753001715266
cs0.34810951760104303
es0.34554973821989526
pl0.32795698924731176
et0.3270524899057874
hu0.3212669683257918
lt0.30037313432835816
sl0.29577464788732394
lv0.2757122163206181
is0.2697176241480039
fi0.25484351713859915
tr0.19311457772996235
az0.1830065359477124
eu0.16154276131917272
vi0.1591928251121076
ja0.0625
hi0.05303030303030303
be0.0445859872611465
uk0.04030710172744722
reliabletrue
passestrue
10
name"Selvi"
dialogue"Rukiye... please. Aaj shaam ko warehouse ke paas mat jaana. Hawa tez hogi. Aur kal subah tak... kisi ko bhi alag mat dekhna."
detectedLang"tl"
heavyLang"la"
scores
tl0.38766891891891886
ms0.36625874125874125
en0.32683379758588665
nl0.2494824016563147
tr0.2494824016563147
cs0.2432150313152401
yo0.23199152542372883
ro0.2204301075268817
sk0.21875
lt0.18994413407821228
de0.15501165501165504
et0.1530373831775701
sl0.14806110458284372
lv0.14504716981132076
pl0.14403778040141677
fi0.13895486935866982
az0.13381123058542413
eu0.12650602409638553
fr0.1082410824108241
is0.103831891223733
no0.09375000000000001
sv0.09375000000000001
reliablefalse
passesfalse
11
name"Hunter"
dialogue"I hear you, Selvi. I'll be careful. And I will be back. Thank you for your time."
detectedLang"en"
heavyLang"en"
scores
en0.8036951501154734
tl0.6513535684987695
da0.532967032967033
no0.5256696428571429
yo0.41054091539528437
ro0.39544807965860596
hr0.3441358024691358
ca0.3359375
vi0.3285939968404423
hu0.30213464696223313
cs0.30098684210526316
lt0.2916666666666667
pt0.2857142857142857
sv0.24511545293072823
sq0.23971377459749554
pl0.22867513611615245
it0.21296296296296297
fi0.20560747663551404
de0.19962335216572505
ms0.1550695825049702
es0.15169660678642716
fr0.15169660678642716
sk0.1448692152917505
be0.1414141414141414
tr0.1414141414141414
az0.1290983606557377
et0.1290983606557377
is0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
12
name"Selvi"
dialogue"Khuda hafiz, Detective. Main ab jaati hoon... lekin meri camera hamesha raat ko dekhegi."
detectedLang"en"
heavyLang"rn"
scores
en0.45445920303605314
tl0.4301288404360753
ro0.41624365482233505
fr0.3830472103004292
de0.37363834422657954
it0.3653421633554084
ca0.3290548424737456
es0.3251173708920188
eu0.3047158403869408
sv0.2830423940149626
et0.267515923566879
sq0.2561448900388098
sl0.25130208333333337
is0.23435419440745675
pt0.22818791946308725
nl0.21555252387448842
tr0.213406292749658
ms0.20689655172413793
yo0.18555240793201136
lv0.17621776504297992
lt0.1417910447761194
fi0.14050822122571002
da0.1274658573596358
no0.12213740458015267
cs0.11128284389489954
hr0.1043613707165109
reliablefalse
passesfalse