Run: 2026-03-09-01KKACAZYB51S0RWES1NNGGZ36

Run Details

Model:
GPT-5.4 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
13.5s
Cost:
$0.011105
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Ma'am? Excuse me. I'm Detective Hunter. I need to ask you about what happened near the old orchard last night." Selvi: "Maine... maine kuch dekha tha. Bahut ajeeb tha. Mujhe samajh nahi aa raha..." Hunter: "I'm sorry, I don't understand. Did you see someone?" Selvi: "Haan, koi tha wahan. Andhera tha, lekin maine awaaz suni. Phir ek aadmi... gayab ho gaya. Jaise bas hawa mein." Hunter: "Slow down. I don't speak... that language. Can you point? Show me? Someone was there?" Selvi: "Haan, haan, wahan. Pedon ke paas. Main tasveerein le rahi thi, phir mujhe bahut dar laga." Hunter: "You were taking pictures? With that camera? Did you photograph the person?" Selvi: "Shayad. Mujhe nahi pata. Maine dekha, phir main ghabra gayi. Sab kuch bahut jaldi hua." Hunter: "You have photos? Pictures? Can I see?" Selvi: "Yeh camera... ismein ho sakta hai. Lekin main..." Hunter: "Okay. Camera. Photos. Good. Can you show me the orchard? On a map, maybe?" Selvi: "Naksha? Nahi... lekin main jagah pehchan sakti hoon. Wahan ek purana lakdi ka board tha... aur seb ke ped." Hunter: "Right. Orchard. Apple trees. That's something." Selvi: "Wahan kuch theek nahi tha. Kisi ne madad ke liye chillaya tha. Maine suna." Hunter: "Someone shouted for help?" Selvi: "Haan! Haan, bilkul. 'Bachao' jaisa... phir sab chup." Hunter: "I wish I knew what you were saying." Selvi: "Mujhe angrezi nahi aati... maaf kijiye. Main samjha nahi paa rahi." Hunter: "It's alright. You're trying. Stay calm." Selvi: "Main shaant hoon... nahi, nahi hoon. Bahut bura tha." Hunter: "Did you come here alone?" Selvi: "Haan, akeli." Hunter: "Alright. Don't go anywhere for now. I may need that camera." Hunter: "Damn. Hunter speaking... Yeah? Right now?... I'm on my way." Hunter: "I have to go. Stay here. Don't leave with anyone, alright?" Selvi: "Kya? Aap ja rahe hain? Lekin—" Hunter: "I'll come back. Camera. Stay here." Selvi: "Theek hai... main yahin rahoongi."
created_at"2026-03-09T22:43:59.062Z" 3/9/2026, 10:43:59 PM
model"openai/gpt-5.4-20260305"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2274
moderation_latency(null)
generation_time13323
tokens_prompt315
tokens_completion533
native_tokens_prompt272
native_tokens_completion695
native_tokens_completion_images0
native_tokens_reasoning99
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.011105
router(null)
provider_responses
0
endpoint_id"9ff5625c-403f-4d7f-b895-58ac7295062c"
id"resp_01b84a7bf5292d4a0169af4d2f2cfc8190932cf1f0c2a01070"
is_byokfalse
latency208
model_permaslug"openai/gpt-5.4-20260305"
provider_name"OpenAI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773096239-zr8f6qASGOoZlJ6Z1oki"
upstream_id"resp_01b84a7bf5292d4a0169af4d2f2cfc8190932cf1f0c2a01070"
total_cost0.011105
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Ma'am? Excuse me. I'm Detective Hunter. I need to ask you about what happened near the old orchard last night."
detectedLang"en"
heavyLang"en"
scores
en0.7989815062985794
tl0.6198682209832742
no0.49899799599198397
fr0.4373593398349587
da0.4279176201372997
sq0.40570522979397783
nl0.38271604938271603
it0.36494496189669773
yo0.35064935064935066
ro0.3483927019982624
cs0.3397887323943662
ca0.3345164152617569
et0.33274021352313166
sv0.32003626473254765
sl0.3087557603686636
hr0.30037313432835816
de0.299719887955182
pt0.299719887955182
es0.27184466019417475
pl0.258160237388724
ms0.22760041194644695
sk0.21383647798742136
lv0.19786096256684493
lt0.18211559432933477
tr0.14675767918088736
fi0.09090909090909091
be0.08536585365853659
hu0.08200734394124846
az0.07749077490774908
is0.07749077490774908
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
1
name"Selvi"
dialogue"Maine... maine kuch dekha tha. Bahut ajeeb tha. Mujhe samajh nahi aa raha..."
detectedLang"et"
heavyLang"tl"
scores
et0.4897959183673469
fi0.38583815028901736
sq0.3431221020092735
no0.33800623052959505
fr0.3285939968404423
lv0.30327868852459017
tl0.2963576158940397
eu0.2796610169491525
en0.2772108843537415
de0.256993006993007
ro0.256993006993007
is0.1935483870967742
da0.16829745596868884
sv0.15841584158415842
ms0.1431451612903226
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I'm sorry, I don't understand. Did you see someone?"
detectedLang"en"
heavyLang"en"
scores
en0.8042505592841164
no0.5580808080808082
da0.5569620253164557
sv0.4992846924177396
tl0.47994056463595847
cs0.43273905996758516
et0.3996569468267582
it0.3805309734513274
pl0.36823104693140796
de0.3554327808471455
nl0.3371212121212121
pt0.3371212121212121
ro0.31906614785992216
sk0.3150684931506849
hr0.2842535787321063
ca0.2827868852459016
is0.2813141683778234
sq0.2768595041322314
yo0.19908466819221968
es0.1822429906542056
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
3
name"Selvi"
dialogue"Haan, koi tha wahan. Andhera tha, lekin maine awaaz suni. Phir ek aadmi... gayab ho gaya. Jaise bas hawa mein."
detectedLang"ms"
heavyLang"vi"
scores
ms0.39624329159212884
fr0.3885869565217392
fi0.3382352941176471
tl0.32499999999999996
de0.28722280887011614
eu0.28722280887011614
en0.26310043668122274
et0.26310043668122274
ro0.17883211678832117
ca0.15094339622641512
sq0.14772727272727273
tr0.1423125794155019
no0.1412213740458015
sk0.1412213740458015
cs0.1357234314980794
it0.1357234314980794
nl0.12903225806451613
is0.11533420707732633
lv0.11533420707732633
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Slow down. I don't speak... that language. Can you point? Show me? Someone was there?"
detectedLang"en"
heavyLang"en"
scores
en0.8187808896210874
tl0.5617529880478088
de0.41113490364025695
nl0.40987124463519314
da0.40796555435952636
fr0.39890710382513656
sq0.39560439560439564
no0.3735763097949886
ro0.3349455864570738
pt0.3064312736443884
yo0.301143583227446
et0.3002544529262086
pl0.2838541666666667
ca0.28104575163398693
it0.26174496644295303
cs0.24965893587994542
es0.24657534246575344
ms0.23717059639389734
is0.2109038737446198
tr0.2109038737446198
az0.20289855072463767
hr0.20174165457184323
sv0.2005813953488372
lt0.1863905325443787
sl0.13793103448275862
eu0.12420382165605094
fi0.12
sk0.11575562700964631
be0.11290322580645161
hu0.1085899513776337
lv0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
5
name"Selvi"
dialogue"Haan, haan, wahan. Pedon ke paas. Main tasveerein le rahi thi, phir mujhe bahut dar laga."
detectedLang"ms"
heavyLang"vi"
scores
ms0.421806167400881
fr0.32778489116517284
ro0.3155149934810952
es0.28765264586160105
yo0.2857142857142857
is0.2818057455540356
fi0.26880222841225626
de0.2290748898678414
vi0.22794117647058826
it0.2164179104477612
tl0.19969512195121952
lt0.1935483870967742
sl0.1822429906542056
no0.1758241758241758
sq0.16666666666666666
cs0.1640127388535032
en0.15865384615384615
hu0.15730337078651685
pt0.15048543689320387
nl0.1435562805872757
reliablefalse
passesfalse
6
name"Hunter"
dialogue"You were taking pictures? With that camera? Did you photograph the person?"
detectedLang"en"
heavyLang"en"
scores
en0.8137417218543046
tl0.6855345911949685
fr0.6097137901127494
sv0.5108695652173912
no0.47735191637630664
nl0.47613504074505236
ro0.4668246445497631
de0.45121951219512196
ca0.44581280788177335
ms0.412532637075718
da0.39839572192513373
sq0.39759036144578314
it0.35344827586206895
et0.336283185840708
pt0.3171471927162367
is0.31297709923664124
es0.293563579277865
pl0.2682926829268293
lv0.2598684210526316
tr0.2537313432835821
cs0.23339011925042585
sk0.22413793103448276
yo0.19210053859964096
fi0.15094339622641512
hi0.14611005692599618
lt0.13793103448275862
sl0.1362763915547025
hu0.12280701754385964
az0.11591355599214145
hr0.11591355599214145
reliabletrue
passestrue
7
name"Selvi"
dialogue"Shayad. Mujhe nahi pata. Maine dekha, phir main ghabra gayi. Sab kuch bahut jaldi hua."
detectedLang"fr"
heavyLang"is"
scores
fr0.34988179669030733
eu0.33008526187576126
en0.3226600985221675
et0.30467762326169406
de0.29032258064516125
tl0.26568758344459276
fi0.2286115007012623
ro0.2109038737446198
es0.16030534351145037
sq0.16030534351145037
is0.14596273291925466
lv0.13793103448275862
reliablefalse
passesfalse
8
name"Hunter"
dialogue"You have photos? Pictures? Can I see?"
detectedLang"en"
heavyLang"en"
scores
en0.8153618906942393
ca0.6458923512747876
tl0.6044303797468354
fr0.5993589743589743
da0.5888157894736842
et0.5697074010327022
ro0.49186991869918695
lv0.4646680942184154
no0.4646680942184154
sv0.45652173913043476
cs0.42263279445727486
tr0.37027707808564225
de0.36386768447837153
lt0.36386768447837153
nl0.36386768447837153
az0.358974358974359
hr0.3573264781491003
sq0.34895833333333337
pl0.33510638297872336
it0.3150684931506849
yo0.258160237388724
es0.24242424242424243
pt0.24242424242424243
hi0.23547400611620795
sk0.22360248447204967
be0.21875
hu0.21135646687697163
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
9
name"Selvi"
dialogue"Yeh camera... ismein ho sakta hai. Lekin main..."
detectedLang"it"
heavyLang"ber"
scores
it0.5481927710843374
ca0.42528735632183906
no0.3839835728952772
sq0.37629937629937626
en0.3684210526315789
fr0.35344827586206895
is0.35344827586206895
ro0.34497816593886466
sv0.34497816593886466
vi0.3435448577680525
de0.3333333333333333
eu0.3288590604026846
hu0.3150684931506849
sk0.27007299270072993
cs0.26108374384236455
es0.24812030075187969
tr0.24433249370277077
fi0.23857868020304565
nl0.20212765957446807
ms0.1935483870967742
tl0.1935483870967742
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Okay. Camera. Photos. Good. Can you show me the orchard? On a map, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.7869318181818181
tl0.6639283047050037
fr0.6179966044142614
nl0.5440729483282675
ca0.5187165775401069
es0.47856315179606024
pt0.46107784431137727
it0.44649446494464945
no0.4238156209987196
et0.4094488188976378
yo0.4007989347536618
sq0.39839572192513373
ms0.39759036144578314
ro0.39759036144578314
fi0.3902439024390244
cs0.3877551020408163
de0.3877551020408163
sv0.33135215453194655
sk0.31297709923664124
hr0.30769230769230765
pl0.29577464788732394
sl0.2834394904458599
lt0.2647058823529412
hi0.26350245499181674
hu0.25742574257425743
tr0.2549668874172185
da0.25
az0.24623115577889448
lv0.23857868020304565
is0.14285714285714285
eu0.1346153846153846
vi0.1346153846153846
reliabletrue
passestrue
11
name"Selvi"
dialogue"Naksha? Nahi... lekin main jagah pehchan sakti hoon. Wahan ek purana lakdi ka board tha... aur seb ke ped."
detectedLang"ms"
heavyLang"id"
scores
ms0.46236559139784944
sq0.4341147938561034
tl0.38811188811188807
en0.32627526467757456
eu0.308300395256917
et0.2670157068062827
yo0.21787709497206703
fi0.20634920634920634
tr0.20364050056882824
ro0.19724770642201836
cs0.19540229885057472
lv0.18032786885245902
nl0.125
sv0.125
hr0.11504424778761062
fr0.1116751269035533
is0.1116751269035533
pl0.10714285714285714
de0.10025706940874037
sk0.0967741935483871
sl0.0967741935483871
az0.08735332464146023
ca0.08735332464146023
es0.08735332464146023
it0.08735332464146023
reliablefalse
passesfalse
12
name"Hunter"
dialogue"Right. Orchard. Apple trees. That's something."
detectedLang"en"
heavyLang"en"
scores
en0.791933418693982
tl0.5454545454545454
fr0.49297971918876754
de0.48083067092651754
es0.41441441441441446
nl0.3143459915611814
no0.3143459915611814
ca0.23529411764705882
et0.23529411764705882
sq0.23529411764705882
it0.2034313725490196
ms0.1935483870967742
pt0.1935483870967742
da0.18546365914786966
sv0.18546365914786966
yo0.18546365914786966
reliabletrue
passestrue
13
name"Selvi"
dialogue"Wahan kuch theek nahi tha. Kisi ne madad ke liye chillaya tha. Maine suna."
detectedLang"tl"
heavyLang"vi"
scores
tl0.5235707121364093
fi0.4662921348314607
ms0.44638694638694637
fr0.40624999999999994
et0.36666666666666664
en0.35983827493261455
ro0.34392265193370164
sq0.3271954674220963
lv0.28678678678678676
cs0.2803030303030303
eu0.2578125
it0.2566510172143975
de0.23633440514469453
sl0.2122719734660033
hr0.19217687074829934
lt0.18941979522184302
nl0.1810344827586207
sv0.1810344827586207
az0.1739130434782609
tr0.16520210896309317
yo0.15630550621669628
es0.1532976827094474
hu0.14721723518850988
ca0.1316270566727605
reliablefalse
passesfalse
14
name"Hunter"
dialogue"Someone shouted for help?"
detectedLang"en"
heavyLang"en"
scores
en0.834983498349835
pt0.5222929936305732
da0.5145631067961165
no0.512987012987013
tl0.39271255060728744
es0.34210526315789475
reliabletrue
passestrue
15
name"Selvi"
dialogue"Haan! Haan, bilkul. 'Bachao' jaisa... phir sab chup."
detectedLang"lv"
heavyLang"tlh"
scores
lv0.2857142857142857
tl0.2857142857142857
reliablefalse
passesfalse
16
name"Hunter"
dialogue"I wish I knew what you were saying."
detectedLang"en"
heavyLang"en"
scores
en0.8341625207296849
tl0.5584988962472406
cs0.47780678851174935
tr0.4594594594594595
no0.42028985507246375
da0.41002949852507375
hr0.41002949852507375
ca0.40828402366863903
sv0.40828402366863903
sq0.40119760479041916
pl0.38650306748466257
it0.36507936507936506
ro0.3103448275862069
yo0.30313588850174217
sk0.2647058823529412
be0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
17
name"Selvi"
dialogue"Mujhe angrezi nahi aati... maaf kijiye. Main samjha nahi paa rahi."
detectedLang"no"
heavyLang"tl"
scores
no0.37050359712230213
eu0.32038834951456313
de0.308300395256917
ro0.23076923076923078
tl0.2222222222222222
en0.22048997772828507
da0.2009132420091324
fr0.2009132420091324
reliablefalse
passesfalse
18
name"Hunter"
dialogue"It's alright. You're trying. Stay calm."
detectedLang"en"
heavyLang"en"
scores
en0.7842761265580057
tl0.471830985915493
da0.2474916387959866
de0.2474916387959866
fr0.2474916387959866
no0.2474916387959866
yo0.2474916387959866
reliabletrue
passestrue
19
name"Selvi"
dialogue"Main shaant hoon... nahi, nahi hoon. Bahut bura tha."
detectedLang"sq"
heavyLang"vi"
scores
sq0.49664429530201337
eu0.4230769230769231
az0.3181818181818182
en0.3055555555555556
fr0.281150159744409
de0.25742574257425743
reliablefalse
passesfalse
20
name"Hunter"
dialogue"Did you come here alone?"
detectedLang"en"
heavyLang"en"
scores
en0.8293515358361775
it0.6240601503759399
sq0.39999999999999997
cs0.34210526315789475
tl0.34210526315789475
fr0.33920704845814975
pl0.33920704845814975
reliabletrue
passestrue
21
name"Selvi"
dialogue"Haan, akeli."
detectedLang""
heavyLang"fi"
scores
reliablefalse
passestrue
22
name"Hunter"
dialogue"Alright. Don't go anywhere for now. I may need that camera."
detectedLang"en"
heavyLang"en"
scores
en0.7997997997997998
tl0.6563573883161512
no0.4851994851994852
da0.48186528497409326
yo0.45652173913043476
it0.40564635958395245
ro0.38271604938271603
ca0.375
pl0.36908517350157727
de0.358974358974359
sv0.3548387096774194
sq0.3464052287581699
et0.33554817275747506
vi0.2805755395683453
fr0.2727272727272727
hr0.25788497217068646
cs0.2079207920792079
es0.19839679358717435
pt0.17695473251028807
nl0.15966386554621848
ms0.15254237288135594
sk0.15254237288135594
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
is0.13606911447084233
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
reliabletrue
passestrue
23
name"Hunter"
dialogue"Damn. Hunter speaking... Yeah? Right now?... I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7974537037037037
tl0.6800731261425961
fr0.48224852071005914
de0.40878378378378377
no0.40476190476190477
pl0.3346007604562738
nl0.32038834951456313
cs0.3150684931506849
sk0.3150684931506849
ca0.3110236220472441
da0.308300395256917
et0.3055555555555556
fi0.3
yo0.2985971943887776
ms0.29435483870967744
sv0.28716904276985744
pt0.2768595041322314
hr0.2009132420091324
lt0.19908466819221968
hi0.1935483870967742
is0.16864608076009502
it0.15254237288135594
ro0.14425427872860636
sl0.14425427872860636
sq0.14425427872860636
tr0.14425427872860636
reliabletrue
passestrue
24
name"Hunter"
dialogue"I have to go. Stay here. Don't leave with anyone, alright?"
detectedLang"en"
heavyLang"en"
scores
en0.8198847262247838
tl0.5897155361050328
da0.5530393325387366
yo0.5
pl0.4959677419354839
no0.4665718349928876
hr0.40476190476190477
cs0.3862520458265139
sq0.3842364532019704
sk0.35233160621761656
lv0.33035714285714285
lt0.3081180811808118
ca0.2690058479532163
sv0.2690058479532163
sl0.24395161290322584
it0.23469387755102045
ro0.1935483870967742
ms0.17218543046357618
de0.1648106904231626
fr0.1648106904231626
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
is0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
25
name"Selvi"
dialogue"Kya? Aap ja rahe hain? Lekin—"
detectedLang"eu"
heavyLang"et"
scores
eu0.6195652173913043
fi0.5853080568720379
et0.46808510638297873
lv0.396551724137931
ca0.38380281690140844
de0.3346007604562738
is0.3346007604562738
sk0.32432432432432434
da0.3137254901960784
pl0.3137254901960784
sl0.3137254901960784
sq0.3
sv0.3
yo0.3
reliabletrue
passesfalse
26
name"Hunter"
dialogue"I'll come back. Camera. Stay here."
detectedLang"en"
heavyLang"en"
scores
en0.7622282608695652
it0.6464646464646464
tl0.49567723342939485
ro0.47447447447447455
ca0.36823104693140796
sq0.36363636363636365
es0.3613138686131387
sv0.31906614785992216
fr0.3027888446215139
nl0.3027888446215139
de0.29149797570850206
ms0.29149797570850206
reliabletrue
passestrue
27
name"Selvi"
dialogue"Theek hai... main yahin rahoongi."
detectedLang"vi"
heavyLang"fi"
scores
vi0.4109947643979057
tl0.3679775280898876
fi0.3571428571428572
nl0.3181818181818182
it0.30769230769230765
en0.3055555555555556
fr0.281150159744409
de0.25742574257425743
reliablefalse
passesfalse