Run: 2026-09-02-01M1HBGXQF9Z679DR319SWBX16

Run Details

Model:
Qwen 3.8 Max (Reasoning, XHigh)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
5m 49s
Cost:
$0.081622
Provider:
Alibaba

Evaluation summary

Score Evaluator
Details Link
54.55% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Mujhe angrezi nahin aati." [I don't know English.] Hunter: "I'm sorry?" Selvi: "Main Hindi bolti hoon. Mujhe samajh nahin aa raha." [I speak Hindi. I don't understand.] Hunter: "Detective Hunter, Alborn police. I need to ask about the apple festival last night. A woman disappeared." Selvi: "Seb ka mela? Kal raat?" [Apple festival? Last night?] Hunter: "Yes. The festival. Missing woman." Selvi: "Woh... maine use dekha tha. Woh seb ki tokriyon ke paas khadi thi. Bahut dari hui thi." [I... I saw her. She was standing near the apple baskets. She was very frightened.] Hunter: "I don't—" Selvi: "Woh baar-baar peeche mud rahi thi, jaise koi uska peechha kar raha ho." [She kept looking back, as if someone was following her.] Hunter: "Hindi? I don't speak Hindi. Okay. Camera. Your camera. Did you take pictures?" Selvi: "Mera camera? Tasveeren?" [My camera? Pictures?] Hunter: "Pictures. Yes. Can I see them?" Selvi: "Mere paas kuch tasveeren hain. Lekin main aapko kyun dikhaun? Pehle bataiye, woh aurat kahan hai." [I have some pictures. But why should I show you? First tell me where that woman is.] Hunter: "Ma'am, if you saw something, I need it." Selvi: "Main yahan padhne aayi hoon. Mujhe musibat mein nahin padna." [I came here to study. I don't want to get into trouble.] Hunter: "No trouble. Help." Selvi: "Madad? Main madad karna chahti hoon. Par aap meri bhasha nahin samajhte." [Help? I want to help. But you don't understand my language.] Hunter: "One second." Hunter: "Hunter. ... Yeah. The cider barn? I'm on my way." Selvi: "Kya hua?" [What happened?] Hunter: "I have to go. Stay here. Don't leave town." Selvi: "Theek hai. Main yahin rahungi." [Okay. I'll stay here.]
created_at"2026-09-02T15:24:11.389Z" 9/2/2026, 3:24:11 PM
model"qwen/qwen3.8-max-20260803"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1210
moderation_latency(null)
generation_time349079
tokens_prompt302
tokens_completion14855
native_tokens_prompt338
native_tokens_completion13491
native_tokens_completion_images(null)
native_tokens_reasoning12944
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.081622
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788362651-l1maIxCmkZyrkt7vtrCd"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788362651-HF1qU7OASJQmQ0lF0Dmq"
upstream_id"chatcmpl-3c595e81-5914-9187-816f-9b89fa4fab39"
provider_responses
0
endpoint_id"6332e9fd-e0c4-4cae-8c17-d25bc774864a"
id"chatcmpl-3c595e81-5914-9187-816f-9b89fa4fab39"
is_byokfalse
latency1210
model_permaslug"qwen/qwen3.8-max-20260803"
provider_name"Alibaba"
status200
total_cost0.081622
cache_discount(null)
upstream_inference_cost0
provider_name"Alibaba"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
54.55% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe angrezi nahin aati."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5689655172413793
eu0.45652173913043476
ro0.375
no0.34944237918215615
da0.3346007604562738
de0.308300395256917
reliablefalse
passesfalse
1
name"Hunter"
dialogue"I'm sorry?"
detectedLang"en"
heavyLang"en"
scores
en0.7321428571428571
it0.5714285714285714
pt0.5714285714285714
tl0.5714285714285714
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main Hindi bolti hoon. Mujhe samajh nahin aa raha."
detectedLang"tl"
heavyLang"tl"
scores
tl0.6461071789686553
is0.5364238410596026
et0.49201741654571846
it0.3934142114384749
no0.38271604938271603
eu0.29577464788732394
fi0.2290748898678414
en0.22048997772828507
lv0.21700223713646533
fr0.2009132420091324
sq0.19908466819221968
da0.19724770642201836
sv0.18604651162790697
de0.1822429906542056
hi0.1822429906542056
ms0.16864608076009502
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Detective Hunter, Alborn police. I need to ask about the apple festival last night. A woman disappeared."
detectedLang"en"
heavyLang"en"
scores
en0.7909360669004586
tl0.6332229058211075
fr0.5908130939809926
it0.5658263305322129
no0.562887760857304
ro0.5411486086441681
da0.5400593471810089
nl0.5364832535885167
cs0.5317220543806647
hr0.530018192844148
ca0.5051085568326947
es0.4816053511705686
sq0.4812583668005355
sv0.4735054347826087
sl0.4695414099931554
pt0.45384073291050037
de0.4424460431654676
sk0.4400289017341041
ms0.41904047976011993
et0.41641566265060237
yo0.40338722093918394
pl0.4001547987616099
lt0.37348423605497166
lv0.34433164128595606
hu0.3201754385964912
az0.296094459582198
eu0.28107606679035246
fi0.27230046948356806
tr0.26400759734093066
is0.15115005476451257
vi0.14647577092511013
be0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
4
name"Selvi"
dialogue"Seb ka mela? Kal raat?"
detectedLang"lv"
heavyLang"af"
scores
lv0.5519713261648745
et0.5335820895522388
sq0.5335820895522388
tl0.4747899159663866
yo0.46120689655172414
pl0.40191387559808617
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Yes. The festival. Missing woman."
detectedLang"en"
heavyLang"en"
scores
en0.7914735866543096
nl0.6963562753036436
tl0.6691176470588235
no0.659606656580938
da0.6422893481717011
ms0.6199324324324325
fr0.5938628158844765
sv0.5647969052224371
sq0.5535714285714286
ca0.5526838966202784
hr0.5472837022132797
pt0.5417515274949084
it0.5389344262295082
cs0.5341614906832298
fi0.4955156950672646
ro0.46808510638297873
et0.4538834951456311
sl0.4538834951456311
az0.4485294117647059
es0.4485294117647059
is0.40318302387267907
de0.3869209809264305
lt0.358974358974359
sk0.3440233236151603
yo0.32228915662650603
hu0.22945205479452058
lv0.21875
pl0.21875
reliabletrue
passestrue
6
name"Selvi"
dialogue"Woh... maine use dekha tha. Woh seb ki tokriyon ke paas khadi thi. Bahut dari hui thi."
detectedLang"tr"
heavyLang"de"
scores
tr0.3794326241134752
fr0.373508353221957
en0.3689903846153846
ms0.3689903846153846
sl0.3462017434620174
sq0.29718875502008035
yo0.2768595041322314
tl0.25742574257425743
et0.2369186046511628
fi0.2369186046511628
az0.2290748898678414
vi0.22794117647058826
de0.21875
ro0.21875
hu0.1873065015479876
cs0.1640127388535032
lv0.1435562805872757
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I don't—"
detectedLang"en"
heavyLang"en"
scores
en0.8170731707317073
no0.6590909090909091
da0.6495327102803737
hr0.6495327102803737
ca0.647887323943662
sv0.647887323943662
sq0.6411483253588517
pl0.6268656716417911
it0.6052631578947368
cs0.5833333333333334
ro0.5454545454545454
yo0.5370370370370371
tl0.5
sk0.4897959183673469
be0.4827586206896552
tr0.4827586206896552
hu0.471830985915493
az0.45652173913043476
et0.45652173913043476
is0.45652173913043476
lt0.45652173913043476
lv0.45652173913043476
uk0.45652173913043476
vi0.45652173913043476
reliabletrue
passestrue
8
name"Selvi"
dialogue"Woh baar-baar peeche mud rahi thi, jaise koi uska peechha kar raha ho."
detectedLang"et"
heavyLang"de"
scores
et0.3686868686868687
sl0.2937853107344633
vi0.29245283018867924
ca0.24242424242424243
no0.22839506172839508
sk0.22839506172839508
fr0.22520661157024793
cs0.2203742203742204
it0.2203742203742204
ro0.21875
tr0.21052631578947367
en0.17218543046357618
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Hindi? I don't speak Hindi. Okay. Camera. Your camera. Did you take pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7667398463227223
tl0.7116689280868386
ca0.49101796407185627
ro0.48484848484848486
it0.46874999999999994
sv0.4072524407252441
fr0.38672438672438675
et0.375
sq0.34210526315789475
no0.33800623052959505
da0.33176100628930816
cs0.30098684210526316
is0.2747440273037543
ms0.2608695652173913
nl0.2582897033158813
lv0.25569176882662
de0.2530755711775044
hr0.24645390070921988
pl0.22867513611615245
es0.18893129770992365
yo0.169921875
hi0.1550695825049702
sl0.1550695825049702
sk0.1448692152917505
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
lt0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
10
name"Selvi"
dialogue"Mera camera? Tasveeren?"
detectedLang"ro"
heavyLang"nl"
scores
ro0.6134020618556701
nl0.5833333333333334
de0.5726495726495726
sv0.5548961424332344
ca0.5481927710843374
es0.5440729483282675
it0.512987012987013
no0.4360902255639098
da0.42528735632183906
eu0.4140625
tr0.3775933609958506
en0.336283185840708
fr0.336283185840708
ms0.32432432432432434
tl0.32432432432432434
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Pictures. Yes. Can I see them?"
detectedLang"en"
heavyLang"en"
scores
en0.8166819431714024
ca0.6581196581196581
et0.623352165725047
ro0.5475113122171946
tl0.531615925058548
no0.5203836930455635
da0.51338199513382
sv0.5121951219512195
fr0.4897959183673469
tr0.42363112391930835
lv0.42196531791907516
az0.4117647058823529
hr0.41002949852507375
sq0.40119760479041916
pl0.38650306748466257
it0.36507936507936506
cs0.3442622950819672
yo0.30313588850174217
de0.2647058823529412
nl0.2647058823529412
sk0.2647058823529412
be0.25925925925925924
hu0.250936329588015
is0.23954372623574144
lt0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
12
name"Selvi"
dialogue"Mere paas kuch tasveeren hain. Lekin main aapko kyun dikhaun? Pehle bataiye, woh aurat kahan hai."
detectedLang"eu"
heavyLang"de"
scores
eu0.4359205776173285
tl0.378727634194831
ms0.31991294885745375
fr0.3131868131868132
da0.30089485458612975
ro0.28325688073394495
ca0.2799539170506913
de0.2487980769230769
no0.23406862745098037
fi0.2255266418835192
tr0.20986093552465232
vi0.20076726342711
es0.19562419562419564
nl0.17654808959156787
it0.13793103448275862
en0.1367403314917127
is0.12342215988779803
sq0.11847672778561354
pt0.10329985652797705
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Ma'am, if you saw something, I need it."
detectedLang"en"
heavyLang"en"
scores
en0.8014440433212996
tl0.5401337792642141
sv0.46393762183235865
sq0.4444444444444444
et0.4234800838574424
cs0.39956331877729256
ms0.39293598233995586
yo0.3721461187214612
lv0.3514150943396226
no0.34523809523809523
da0.3357487922705314
hr0.3357487922705314
ca0.3341404358353511
pl0.314214463840399
it0.2948717948717949
ro0.24657534246575344
es0.22096317280453256
pt0.22096317280453256
sk0.207492795389049
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
is0.1863905325443787
lt0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
14
name"Selvi"
dialogue"Main yahan padhne aayi hoon. Mujhe musibat mein nahin padna."
detectedLang"tl"
heavyLang"tl"
scores
tl0.51278928136419
ms0.45799457994579945
de0.3993993993993994
eu0.35379644588045234
ca0.30915371329879104
en0.29701230228471004
fi0.27404718693284935
fr0.27404718693284935
sk0.26605504587155965
hr0.16317991631799164
sl0.16317991631799164
no0.15254237288135594
da0.14893617021276595
pl0.14893617021276595
it0.14346895074946467
sv0.14346895074946467
az0.13606911447084233
es0.12854030501089325
nl0.12854030501089325
pt0.12854030501089325
reliablefalse
passesfalse
15
name"Hunter"
dialogue"No trouble. Help."
detectedLang"en"
heavyLang"en"
scores
en0.7963340122199593
fr0.6655518394648829
tl0.6124031007751938
pt0.5798319327731093
es0.5780590717299579
ca0.574468085106383
lv0.5670995670995671
hr0.5024875621890548
no0.49238578680203043
sk0.47643979057591623
tr0.46808510638297873
it0.4444444444444444
nl0.43820224719101125
pl0.42857142857142855
reliabletrue
passestrue
16
name"Selvi"
dialogue"Madad? Main madad karna chahti hoon. Par aap meri bhasha nahin samajhte."
detectedLang"tl"
heavyLang"tl"
scores
tl0.5422177009155645
et0.49037372593431483
sv0.47613504074505236
lv0.358974358974359
fr0.3401759530791789
fi0.32432432432432434
is0.3087557603686636
da0.28457869634340227
no0.27652733118971057
ms0.2537313432835821
eu0.24623115577889448
pl0.20634920634920634
sq0.1891891891891892
en0.18032786885245902
nl0.16356877323420074
de0.14772727272727273
ro0.13793103448275862
sl0.13793103448275862
reliablefalse
passesfalse
17
name"Hunter"
dialogue"One second."
detectedLang"en"
heavyLang"en"
scores
en0.8157248157248157
tl0.7754491017964071
fr0.6926229508196721
it0.6052631578947368
hr0.5370370370370371
pl0.5370370370370371
nl0.5
ro0.5
reliabletrue
passestrue
18
name"Hunter"
dialogue"Hunter. ... Yeah. The cider barn? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7712146422628952
tl0.5925925925925926
no0.5585874799357945
fr0.5499181669394435
da0.544701986754967
sv0.5431893687707641
nl0.44889779559118237
yo0.3982494529540482
pl0.3902439024390244
de0.3820224719101124
cs0.3692660550458715
sk0.3692660550458715
ca0.3648960739030023
et0.358974358974359
fi0.3529411764705882
ms0.3325242718446602
sq0.3325242718446602
ro0.3176178660049628
tr0.3176178660049628
hr0.24242424242424243
hi0.233983286908078
is0.21875
az0.2005813953488372
it0.1863905325443787
pt0.1863905325443787
sl0.17664670658682635
reliabletrue
passestrue
19
name"Selvi"
dialogue"Kya hua?"
detectedLang""
heavyLang"tl"
scores
reliablefalse
passestrue
20
name"Hunter"
dialogue"I have to go. Stay here. Don't leave town."
detectedLang"en"
heavyLang"en"
scores
en0.829086389061529
da0.5864661654135338
pl0.5729813664596274
yo0.5225694444444445
hr0.4811320754716981
no0.48015122873345933
tl0.46601941747572817
cs0.461839530332681
sq0.45972495088408644
sk0.4258872651356994
lv0.40217391304347827
lt0.3778280542986425
ca0.3341404358353511
sv0.3341404358353511
sl0.3055555555555556
it0.2948717948717949
ro0.24657534246575344
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
21
name"Selvi"
dialogue"Theek hai. Main yahin rahungi."
detectedLang"vi"
heavyLang"et"
scores
vi0.43977591036414565
et0.40298507462686567
ms0.3957703927492447
tl0.3957703927492447
nl0.3442622950819672
it0.3333333333333333
en0.3311036789297659
fr0.3055555555555556
de0.2805755395683453
reliablefalse
passesfalse