Run: 2026-09-02-01M1H9H86PS47TYWRE1BQ87CPX

Run Details

Model:
Qwen 3.7 Flash (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
39.1s
Cost:
$0.000643
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Darakhthon ke paas… sirf woh laal jacket pada tha. Bina kisi ke. Maine bas dekha tha, inspector sahab." Hunter: "I’m sorry, I don’t speak Hindi. Can you tell me what you saw near the west ridge?" Selvi: "Mujhe nahi pata aap kya keh rahe hain. Par wahin kuch gayab ho gaya. Raat ko jab main apne shots check kar rahi thi, toh camera screen par sirf khali sadkeen thi… aur peeche chhupa hua koi." Hunter: "Empty streets? And someone hiding behind you? Wait, are you saying your camera caught movement when your eyes didn’t?" Selvi: "Haan. Aur har taraf wahi halki si aawaz… jaise koi pedon ke beech saans le raha ho. Main ghabra gayi hoon. Har mod pe lagta hai koi dekh raha hai." Hunter: "Okay, listen. I appreciate you sharing this, but I need specifics. Times? Locations? Anyone you recognized?" Selvi: "Seb ke bagiche ke end par. Kal shaam tak sab theek tha. Phir achanak… khatam. Meri tasveeron mein bhi woh dikhai dene laga hai." Hunter: "So, after the orchards, you started seeing anomalies in your photos? That aligns with the last two missing persons reports. Both were near the tree lines." Selvi: "Main bas sach batana chahti hoon. Please, dhyan dein. Yeh sheher ab safe nahi lagta. Log raaton ko udhar-chhaph ho jaate hain." Hunter: "People go quiet when they’re scared. I get it. But staring at screens won’t solve this. We need witnesses on the ground. Have you told anyone else at your university?" Selvi: "Unhein kaise bataun? English nahi aati mujhe, aur ve bhi dare hue hain. Main akeli hoon yahan. Bas yeh camera mere saath hai. Par ab woh bhi shayad kisi ne hataya ho." Hunter: "Keep it close. And stay in populated areas. If you see that jacket again, don’t touch it. Call dispatch instead." Selvi: "Ji. Dhanyavaad. Aap accha kaam kar rahe hain. Unhein dhoondne ke liye." Hunter: "We’re doing our best. Look, I—(his phone starts ringing loudly)—hold on." Selvi: "Kya hua? Koi aur mil gaya?" Hunter: "Negative. New tip. Festival grounds. North quadrant. Gotta roll." Selvi: "Wapas aana. Apna khayal rakhna. Jaldi safai se lautna." Hunter: "I will. Stay clear of the woods. And… thanks for trying to communicate. I know it wasn’t easy." Selvi: "Theek hai. Jaldi aana." Hunter: "On my way."
created_at"2026-09-02T14:49:24.96Z" 9/2/2026, 2:49:24 PM
model"qwen/qwen3.7-flash-20260727"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency547
moderation_latency(null)
generation_time38987
tokens_prompt302
tokens_completion4623
native_tokens_prompt300
native_tokens_completion4879
native_tokens_completion_images(null)
native_tokens_reasoning4200
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00064327
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788360564-R10J6C5wtRsHru45h8qP"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788360564-wgbUvQSNlfYuYl8GmCN3"
upstream_id"chatcmpl-00213205-ca62-9224-9d7c-444655b07a86"
provider_responses
0
endpoint_id"5a9a0ee6-874a-4d03-92be-e5094c0df4e7"
id"chatcmpl-00213205-ca62-9224-9d7c-444655b07a86"
is_byokfalse
latency547
model_permaslug"qwen/qwen3.7-flash-20260727"
provider_name"Alibaba"
status200
total_cost0.00064327
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Darakhthon ke paas… sirf woh laal jacket pada tha. Bina kisi ke. Maine bas dekha tha, inspector sahab."
detectedLang"ms"
heavyLang"de"
scores
ms0.5437262357414449
en0.49324324324324326
tl0.45404913557779797
fr0.4350282485875706
ro0.40828402366863903
yo0.3428258488499452
et0.3181818181818182
ca0.2982456140350877
es0.29411764705882354
de0.29161747343565525
nl0.26199261992619927
pt0.26199261992619927
tr0.25
sv0.23371647509578544
cs0.21671018276762402
fi0.21363040629095675
lv0.19678714859437751
hr0.18588873812754408
da0.1780821917808219
hu0.16317991631799164
sq0.16317991631799164
eu0.12536443148688048
lt0.08952959028831564
no0.08952959028831564
pl0.08952959028831564
reliablefalse
passesfalse
1
name"Hunter"
dialogue"I’m sorry, I don’t speak Hindi. Can you tell me what you saw near the west ridge?"
detectedLang"en"
heavyLang"en"
scores
en0.7967479674796748
tl0.670461354104254
sq0.448345035105316
it0.41921858500527986
no0.37570942111237227
nl0.3276283618581907
ms0.3226600985221675
et0.314214463840399
da0.28292046936114734
sv0.2819843342036553
ca0.28104575163398693
yo0.260752688172043
pt0.25474254742547425
cs0.24965893587994542
fr0.23504867872044508
is0.22644163150492264
tr0.2109038737446198
az0.20289855072463767
hr0.20174165457184323
pl0.1863905325443787
es0.15644171779141106
ro0.140625
sl0.13793103448275862
hi0.12420382165605094
fi0.12
sk0.11575562700964631
be0.11290322580645161
hu0.1085899513776337
lt0.10277324632952692
lv0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
2
name"Selvi"
dialogue"Mujhe nahi pata aap kya keh rahe hain. Par wahin kuch gayab ho gaya. Raat ko jab main apne shots check kar rahi thi, toh camera screen par sirf khali sadkeen thi… aur peeche chhupa hua koi."
detectedLang"tl"
heavyLang"tlh"
scores
tl0.3863393810032017
en0.33371958285052145
eu0.3187203791469194
ro0.24242424242424243
fr0.21124828532235942
ms0.2008339124391939
sl0.19692737430167598
lv0.19467787114845939
it0.18670438472418668
fi0.1660623640319072
ca0.16180758017492713
sk0.14115011202389843
no0.13922155688622756
cs0.13793103448275862
sv0.1320754716981132
es0.1314199395770393
nl0.12944738834216502
vi0.11877394636015325
de0.11538461538461538
yo0.10226385636221702
tr0.07999999999999999
lt0.07630522088353413
da0.07481898632341111
az0.06351791530944625
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Empty streets? And someone hiding behind you? Wait, are you saying your camera caught movement when your eyes didn’t?"
detectedLang"en"
heavyLang"en"
scores
en0.8043712898003238
tl0.5552147239263804
ro0.3813993174061433
nl0.36010591350397175
fr0.3403093721565059
no0.2926829268292683
ca0.28711897738446407
it0.2828882294757666
de0.2814667988107037
da0.27644710578842313
ms0.2579324462640737
es0.250258531540848
sk0.23361522198731502
sv0.2229367631296892
cs0.21621621621621623
tr0.21621621621621623
hr0.2050438596491228
yo0.1826381059751973
sl0.1751990898748578
pt0.16474654377880185
eu0.16281755196304848
is0.1530373831775701
pl0.15204678362573099
sq0.14806110458284372
az0.0799492385786802
hu0.0799492385786802
et0.07525510204081631
lt0.07525510204081631
lv0.07525510204081631
reliabletrue
passestrue
4
name"Selvi"
dialogue"Haan. Aur har taraf wahi halki si aawaz… jaise koi pedon ke beech saans le raha ho. Main ghabra gayi hoon. Har mod pe lagta hai koi dekh raha hai."
detectedLang"ro"
heavyLang"tl"
scores
ro0.44585180493983534
it0.35424354243542433
fr0.34652725914861837
yo0.34505988023952094
ms0.32327919566898683
tr0.2886178861788618
et0.28687856560717195
no0.28513071895424835
es0.2732558139534884
cs0.2726517040731505
da0.25468483816013626
en0.24373379429559205
sk0.2110009017132552
fi0.2081447963800905
sl0.20670897552130554
ca0.2052679382379655
sv0.15377176015473887
vi0.15213178294573643
tl0.13708086785009863
sq0.12587412587412586
nl0.10714285714285714
pl0.10714285714285714
hu0.10071942446043164
de0.08184679958027283
lt0.07602956705385427
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Okay, listen. I appreciate you sharing this, but I need specifics. Times? Locations? Anyone you recognized?"
detectedLang"en"
heavyLang"en"
scores
en0.7981993169823036
tl0.6705524581855044
fr0.5754408883082952
da0.5170876671619613
it0.5134730538922155
ro0.47833065810593905
sv0.4741100323624596
ca0.4724025974025974
nl0.44961896697713805
no0.4491525423728813
sq0.43032427695004377
pt0.3930905695611578
de0.3658536585365854
hr0.35451837140019865
es0.3512974051896207
cs0.327817993795243
tr0.30406852248394006
et0.30032292787944026
pl0.2942453854505972
lv0.2605233219567691
fi0.2243436754176611
ms0.20634920634920634
yo0.20245398773006135
hu0.18444165621079048
lt0.18032786885245902
is0.1698595146871009
sk0.1677336747759283
sl0.15584415584415584
eu0.15254237288135594
be0.09722222222222222
az0.08835904628330996
uk0.08835904628330996
vi0.08835904628330996
reliabletrue
passestrue
6
name"Selvi"
dialogue"Seb ke bagiche ke end par. Kal shaam tak sab theek tha. Phir achanak… khatam. Meri tasveeron mein bhi woh dikhai dene laga hai."
detectedLang"ms"
heavyLang"la"
scores
ms0.3719611021069692
fr0.34543918918918914
de0.24390243902439027
cs0.23115079365079366
it0.21875
nl0.2131979695431472
da0.21239837398373984
et0.20756646216768918
sq0.2002063983488132
tl0.18592436974789917
vi0.16845493562231761
lv0.16666666666666666
sk0.14174972314507198
es0.1407982261640798
pl0.13600891861761427
is0.1262683201803833
no0.1262683201803833
pt0.11428571428571428
eu0.11327231121281463
hu0.11327231121281463
en0.11225658648339061
sv0.10714285714285714
yo0.10196987253765932
hr0.09778812572759021
fi0.0903755868544601
tr0.08823529411764706
reliablefalse
passesfalse
7
name"Hunter"
dialogue"So, after the orchards, you started seeing anomalies in your photos? That aligns with the last two missing persons reports. Both were near the tree lines."
detectedLang"en"
heavyLang"en"
scores
en0.7968818620992534
tl0.6239837398373984
fr0.5261270491803279
de0.49203734211971445
sv0.4674726540011514
nl0.46220930232558144
no0.4233167082294264
ca0.42295695570804737
da0.41933458882611424
ms0.354050279329609
it0.32580174927113703
lt0.30866965620328846
es0.30241327300150833
sl0.29281345565749234
lv0.28846153846153844
cs0.28405572755417957
ro0.28294573643410853
et0.26703645007923926
yo0.25762439807383625
is0.24612876935615322
pt0.23490488006617036
sk0.20736932305055697
pl0.19284467713787085
az0.18358340688437777
sq0.14351851851851852
hr0.12653446647780925
vi0.0966796875
fi0.0777666999002991
hi0.07684630738522955
tr0.06754032258064516
hu0.06376518218623482
reliabletrue
passestrue
8
name"Selvi"
dialogue"Main bas sach batana chahti hoon. Please, dhyan dein. Yeh sheher ab safe nahi lagta. Log raaton ko udhar-chhaph ho jaate hain."
detectedLang"eu"
heavyLang"tlh"
scores
eu0.3773584905660377
en0.35647425897035884
de0.3248772504091653
ms0.2966751918158568
tl0.29062768701633707
fi0.25742574257425743
fr0.2479489516864175
ca0.2417279411764706
et0.2172675521821632
sl0.19275929549902154
it0.17664670658682635
ro0.17251755265797392
es0.14772727272727273
pt0.14772727272727273
yo0.13702928870292888
lv0.12974683544303797
no0.1185897435897436
sk0.1185897435897436
cs0.11385606874328678
lt0.10326086956521739
hu0.10228509249183897
az0.08839779005524862
sq0.08637873754152825
sv0.08637873754152825
tr0.08637873754152825
hr0.07924107142857142
reliablefalse
passesfalse
9
name"Hunter"
dialogue"People go quiet when they’re scared. I get it. But staring at screens won’t solve this. We need witnesses on the ground. Have you told anyone else at your university?"
detectedLang"en"
heavyLang"en"
scores
en0.8122546509643284
tl0.6520088579563429
da0.4376278118609407
no0.4234800838574424
fr0.4037940379403794
nl0.3710691823899371
yo0.36599423631123923
sv0.3251533742331288
pl0.31207004377736086
it0.29532351057014733
ca0.29214929214929214
sq0.28664072632944226
et0.2739273927392739
cs0.2671552298467688
ms0.260752688172043
ro0.2537313432835821
de0.24657534246575344
lv0.24085576259489305
pt0.23717059639389734
is0.21930447125621005
hr0.21540656205420827
es0.2137240886347391
sk0.20462762111352134
lt0.19177075679647318
fi0.17726252804786838
az0.1466252909231963
sl0.11361804995970992
hi0.07094594594594594
be0.05982905982905983
tr0.05982905982905983
hu0.05741216795201371
uk0.05417024935511608
vi0.05417024935511608
reliabletrue
passestrue
10
name"Selvi"
dialogue"Unhein kaise bataun? English nahi aati mujhe, aur ve bhi dare hue hain. Main akeli hoon yahan. Bas yeh camera mere saath hai. Par ab woh bhi shayad kisi ne hataya ho."
detectedLang"fr"
heavyLang"tl"
scores
fr0.4061085972850679
tr0.37722419928825623
it0.3514515132798023
ro0.3264913406029506
tl0.3234536082474227
en0.3073878627968338
ms0.3018617021276596
de0.29340511440107675
eu0.27335640138408307
fi0.270326615705351
ca0.2584745762711864
cs0.2369186046511628
sv0.23636363636363636
da0.23525127458120904
az0.2003046458492003
lv0.19724770642201836
hu0.16134185303514376
no0.15526950925181013
hr0.14979757085020243
et0.1484184914841849
es0.14004914004914004
vi0.1300745650372825
sl0.10865874363327674
sq0.0979381443298969
lt0.09560723514211886
sk0.09560723514211886
nl0.0674955595026643
pt0.0641711229946524
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Keep it close. And stay in populated areas. If you see that jacket again, don’t touch it. Call dispatch instead."
detectedLang"en"
heavyLang"en"
scores
en0.8202301054650047
tl0.6019108280254777
sv0.45255474452554745
fr0.4126859827721222
nl0.39123376623376627
ro0.37810945273631835
de0.375
it0.3345164152617569
et0.32795698924731176
pt0.3119266055045872
es0.30037313432835816
sq0.2984097287184284
no0.28977272727272724
ms0.2732558139534884
cs0.2668621700879765
sl0.2661448140900196
yo0.2596248766041461
ca0.2378048780487805
pl0.22440537745604963
lv0.22360248447204967
lt0.21548117154811713
zh0.17035398230088497
az0.1601343784994401
hr0.156355455568054
da0.14772727272727273
sk0.14578587699316628
hi0.12075029308323564
eu0.08200734394124846
reliabletrue
passestrue
12
name"Selvi"
dialogue"Ji. Dhanyavaad. Aap accha kaam kar rahe hain. Unhein dhoondne ke liye."
detectedLang"sl"
heavyLang"af"
scores
sl0.3617021276595745
cs0.31402439024390244
ms0.23728813559322032
eu0.23469387755102045
lt0.20071047957371224
de0.1891891891891892
sq0.1891891891891892
tr0.1818181818181818
yo0.16356877323420074
reliablefalse
passesfalse
13
name"Hunter"
dialogue"We’re doing our best. Look, I——hold on."
detectedLang"en"
heavyLang"en"
scores
en0.8287671232876712
da0.500998003992016
tl0.494949494949495
ca0.48665297741273095
hr0.47589098532494756
no0.4692144373673036
et0.4646680942184154
pl0.45652173913043476
cs0.4186046511627907
yo0.39320388349514557
fi0.375
is0.3734335839598998
sk0.37027707808564225
sv0.3556701030927836
sq0.34895833333333337
it0.3150684931506849
fr0.30362116991643456
ro0.2647058823529412
nl0.25595238095238093
hi0.251497005988024
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
lt0.20127795527156547
lv0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
14
name"Selvi"
dialogue"Kya hua? Koi aur mil gaya?"
detectedLang"ro"
heavyLang"fi"
scores
ro0.5440729483282675
tl0.42748091603053434
pt0.40711462450592883
ms0.39999999999999997
es0.38524590163934425
sk0.3723849372384937
ca0.33035714285714285
et0.33035714285714285
sv0.33035714285714285
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Negative. New tip. Festival grounds. North quadrant. Gotta roll."
detectedLang"en"
heavyLang"en"
scores
en0.6957403651115619
tl0.6451104100946372
it0.6314496314496314
sv0.5833333333333334
fr0.5706106870229007
ro0.5553359683794467
no0.5454545454545454
da0.5375128468653648
ca0.5356037151702787
pt0.533195020746888
hr0.5044052863436124
sl0.4938132733408324
de0.4742990654205608
es0.47058823529411764
nl0.4636471990464839
cs0.45255474452554745
sq0.4367959949937422
ms0.43037974683544306
sk0.3440233236151603
lt0.3119266055045872
et0.2868462757527734
fi0.27999999999999997
hu0.27999999999999997
lv0.22413793103448276
pl0.21875
az0.2077464788732394
tr0.1818181818181818
yo0.12280701754385964
reliabletrue
passestrue
16
name"Selvi"
dialogue"Wapas aana. Apna khayal rakhna. Jaldi safai se lautna."
detectedLang"es"
heavyLang"is"
scores
es0.38016528925619836
pt0.3686868686868687
fi0.35008665511265163
ca0.34895833333333337
cs0.2661448140900196
hr0.2618110236220473
sl0.26035502958579887
ro0.24242424242424243
sq0.2299794661190965
fr0.22520661157024793
yo0.2219917012448133
eu0.2203742203742204
de0.21052631578947367
it0.20550847457627117
is0.20042643923240938
da0.19700214132762314
sv0.18655097613882862
et0.17218543046357618
no0.16666666666666666
reliablefalse
passesfalse
17
name"Hunter"
dialogue"I will. Stay clear of the woods. And… thanks for trying to communicate. I know it wasn’t easy."
detectedLang"en"
heavyLang"en"
scores
en0.8354846874209062
tl0.686141960405601
no0.5105421686746987
yo0.48778565799842394
nl0.46236559139784944
da0.45788156797331114
it0.38679245283018865
fr0.375
sq0.3143459915611814
ro0.3055555555555556
sv0.3048128342245989
sk0.29577464788732394
lv0.2942453854505972
de0.2903930131004367
pl0.2864983534577387
hr0.281767955801105
cs0.26636568848758463
ca0.24330616996507565
vi0.24242424242424243
es0.20828258221680876
tr0.2073170731707317
lt0.20440636474908203
pt0.19454770755885997
is0.18952618453865336
az0.16879795396419436
et0.16879795396419436
sl0.15693904020752272
ms0.10714285714285714
be0.09722222222222222
hu0.09344490934449094
uk0.08835904628330996
reliabletrue
passestrue
18
name"Selvi"
dialogue"Theek hai. Jaldi aana."
detectedLang"vi"
heavyLang"is"
scores
vi0.511400651465798
eu0.4140625
nl0.4117647058823529
it0.39999999999999997
is0.38524590163934425
et0.34210526315789475
reliablefalse
passesfalse
19
name"Hunter"
dialogue"On my way."
detectedLang"en"
heavyLang"en"
scores
en0.8366013071895425
pl0.701195219123506
cs0.6822033898305085
sk0.6822033898305085
tl0.6808510638297872
et0.6724890829694322
fi0.6666666666666666
fr0.592391304347826
ca0.5689655172413793
hr0.5398773006134969
hi0.5283018867924528
yo0.5
reliabletrue
passestrue