Run: 2026-03-09-01KK9PZS3PHH3FF68SJEZVZDCN

Run Details

Model:
GPT-5.4 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
22.4s
Cost:
$0.015695
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
57.14% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Ma'am? Detective Hunter. Can I ask you a few questions about what happened near Miller's Orchard last night?" Selvi: "Kal raat... maine wahan kuch dekha tha. Bahut bura tha. Mujhe abhi bhi darr lag raha hai." Hunter: "I'm sorry—slow down. Did you see someone? At the orchard?" Selvi: "Haan, haan... ek aadmi tha. Phir woh gayab ho gaya. Jaise andhere ne usse nigal liya." Hunter: "I don't understand. Do you speak English?" Selvi: "Mujhe English nahi aati. Main samjha nahi paa rahi. Mere camera mein... shayad kuch hai." Hunter: "Your camera? You took pictures?" Selvi: "Tasveerein hain. Lekin jab maine dekha... sab kuch theek nahi tha. Kuch ajeeb tha. Bahut ajeeb." Hunter: "Pictures, okay. That's something. Can you show me which ones?" Selvi: "Yeh wali... aur yeh. Dekhiye—pedon ke beech. Koi tha wahan. Main jhooth nahi bol rahi." Hunter: "I wish I knew what you were saying. You're upset, I get that. Did these photos catch the person who disappeared?" Selvi: "Maine cheekh bhi suni thi. Phir sab chup ho gaya. Bilkul chup. Jaise kuch hua hi nahi." Hunter: "A scream? Was that a scream? Is that what you mean?" Selvi: "Haan. Aur phir ek gaadi ki awaaz. Tez. Bahut tez." Hunter: "A car? You heard a car?" Selvi: "Ji. Lekin number nahi dekha. Main dar gayi thi." Hunter: "All right. I think you're trying to help. Stay here a second—" Hunter: "Hunter speaking... What? When?... I'm on my way." Hunter: "I have to go. I'm sorry. Don't leave town, okay? I'll come back with someone who can translate." Selvi: "Theek hai... lekin jaldi aaiyega. Mujhe bahut darr lag raha hai." Hunter: "I know. I'll be back."
created_at"2026-03-09T16:30:51.52Z" 3/9/2026, 4:30:51 PM
model"openai/gpt-5.4-20260305"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency14160
moderation_latency(null)
generation_time22321
tokens_prompt315
tokens_completion870
native_tokens_prompt272
native_tokens_completion1001
native_tokens_completion_images0
native_tokens_reasoning516
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.015695
router(null)
provider_responses
0
endpoint_id"9ff5625c-403f-4d7f-b895-58ac7295062c"
id"resp_0bc3f5df86959d9f0169aef5bb9fb88195b3acac3c26187f42"
is_byokfalse
latency215
model_permaslug"openai/gpt-5.4-20260305"
provider_name"OpenAI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773073851-b6iIpkjjbnLiJ63cwMQ5"
upstream_id"resp_0bc3f5df86959d9f0169aef5bb9fb88195b3acac3c26187f42"
total_cost0.015695
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"

Evaluation details

Result Evaluator Details Meta Data
57.14% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Ma'am? Detective Hunter. Can I ask you a few questions about what happened near Miller's Orchard last night?"
detectedLang"en"
heavyLang"en"
scores
en0.7999483737738772
tl0.6013374485596708
fr0.5551090700344432
ca0.515625
it0.49707981829980535
no0.4379985496736766
pt0.413767019667171
ro0.4106463878326996
da0.4056748466257669
es0.3785084202085004
de0.37751004016064255
nl0.37600644122383253
cs0.33304647160068845
tr0.3201754385964912
sq0.3159752868490733
sv0.30368373764600176
hr0.2909423604757548
hu0.28702851885924563
et0.27973977695167285
az0.2783985102420857
yo0.26540284360189575
pl0.22962226640159045
is0.22577422577422576
sl0.21796165489404642
sk0.20675537359263052
lt0.15760869565217392
fi0.15115005476451257
lv0.14647577092511013
vi0.14647577092511013
ms0.13600891861761427
ja0.11428571428571428
be0.08284023668639054
eu0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
1
name"Selvi"
dialogue"Kal raat... maine wahan kuch dekha tha. Bahut bura tha. Mujhe abhi bhi darr lag raha hai."
detectedLang"et"
heavyLang"vi"
scores
et0.3667068757539204
fi0.3234536082474227
ms0.31640625
de0.29906542056074764
sq0.29718875502008035
tl0.2886178861788618
fr0.2837653478854025
en0.2369186046511628
vi0.23020527859237538
ro0.21875
az0.16666666666666666
it0.16
no0.15730337078651685
sv0.15048543689320387
lv0.1435562805872757
nl0.12790697674418602
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I'm sorry—slow down. Did you see someone? At the orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7943595769682726
tl0.6098104793756968
no0.4807121661721069
da0.4195688225538972
pt0.3371212121212121
et0.3269230769230769
nl0.31237721021611
fr0.30417495029821073
yo0.23413566739606126
it0.2222222222222222
cs0.1822429906542056
es0.1822429906542056
ms0.1822429906542056
sq0.1822429906542056
sv0.1822429906542056
de0.1764705882352941
reliabletrue
passestrue
3
name"Selvi"
dialogue"Haan, haan... ek aadmi tha. Phir woh gayab ho gaya. Jaise andhere ne usse nigal liya."
detectedLang"sq"
heavyLang"da"
scores
sq0.38195302843016066
fr0.3112947658402204
tl0.302649930264993
en0.29676511954992973
tr0.2917847025495751
it0.2795389048991354
ca0.2774566473988439
cs0.2732558139534884
sl0.20382165605095542
hr0.1843393148450245
lt0.18166939443535188
no0.18166939443535188
sk0.18166939443535188
lv0.17081260364842457
ro0.16943521594684383
ms0.16666666666666666
nl0.16666666666666666
fi0.14965986394557826
hu0.14089347079037798
de0.13494809688581316
et0.13494809688581316
reliablefalse
passesfalse
4
name"Hunter"
dialogue"I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8113207547169812
no0.6359223300970874
da0.6305418719211823
sv0.5839112343966713
cs0.5714285714285714
pl0.5363214837712519
hr0.5245641838351823
tl0.5184590690208668
sk0.49409780775716694
de0.4690265486725664
sq0.455535390199637
ro0.44029850746268656
nl0.3723849372384937
vi0.3670886075949367
yo0.3548387096774194
pt0.34210526315789475
ca0.3150684931506849
is0.3135011441647597
sl0.2857142857142857
it0.27710843373493976
ms0.1935483870967742
be0.1891891891891892
tr0.1891891891891892
hu0.18256130790190736
az0.17355371900826447
et0.17355371900826447
lt0.17355371900826447
lv0.17355371900826447
uk0.17355371900826447
reliabletrue
passestrue
5
name"Selvi"
dialogue"Mujhe English nahi aati. Main samjha nahi paa rahi. Mere camera mein... shayad kuch hai."
detectedLang"en"
heavyLang"tl"
scores
en0.44959443800695253
de0.4221411192214112
tl0.3782722513089006
it0.35197817189631647
da0.326241134751773
ro0.326241134751773
no0.2899850523168909
eu0.2578125
fr0.2566510172143975
vi0.24841772151898736
sv0.2448330683624801
ms0.23263327948303714
ca0.17677642980935876
es0.17247386759581881
nl0.13793103448275862
hr0.1316270566727605
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Your camera? You took pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7847147470398278
tl0.6551724137931034
ro0.6078431372549019
ca0.576271186440678
fr0.5726495726495726
it0.441340782122905
sv0.4350282485875706
ms0.42857142857142855
nl0.42528735632183906
de0.4186046511627907
es0.3311036789297659
et0.3288590604026846
lv0.29328621908127206
cs0.2805755395683453
da0.2647058823529412
no0.2647058823529412
reliabletrue
passestrue
7
name"Selvi"
dialogue"Tasveerein hain. Lekin jab maine dekha... sab kuch theek nahi tha. Kuch ajeeb tha. Bahut ajeeb."
detectedLang"eu"
heavyLang"et"
scores
eu0.4615384615384615
fi0.3286445012787723
de0.3
sq0.29718875502008035
fr0.2837653478854025
nl0.26880222841225626
is0.25742574257425743
en0.2369186046511628
et0.2369186046511628
ro0.21875
lv0.1435562805872757
tl0.13509060955518945
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Pictures, okay. That's something. Can you show me which ones?"
detectedLang"en"
heavyLang"en"
scores
en0.8142127264282397
tl0.5703544575725027
fr0.4143484626647145
sq0.38271604938271603
ca0.38176197836166925
pt0.37791601866251945
nl0.36808846761453395
et0.3254637436762226
es0.3103448275862069
no0.2895204262877442
ms0.28825622775800713
ro0.2753623188405797
sl0.18032786885245902
lv0.17184265010351968
it0.16666666666666666
cs0.16317991631799164
az0.16142557651991615
tr0.16142557651991615
fi0.15789473684210525
da0.15254237288135594
de0.15254237288135594
sv0.15254237288135594
reliabletrue
passestrue
9
name"Selvi"
dialogue"Yeh wali... aur yeh. Dekhiye—pedon ke beech. Koi tha wahan. Main jhooth nahi bol rahi."
detectedLang"ms"
heavyLang"en"
scores
ms0.4337485843714609
en0.28977272727272724
fi0.2784992784992785
eu0.24812030075187969
sk0.22839506172839508
tl0.20760697305863707
sq0.18962722852512154
ro0.17355371900826447
cs0.17081260364842457
fr0.14965986394557826
yo0.14965986394557826
de0.13494809688581316
reliablefalse
passesfalse
10
name"Hunter"
dialogue"I wish I knew what you were saying. You're upset, I get that. Did these photos catch the person who disappeared?"
detectedLang"en"
heavyLang"en"
scores
en0.8132886943085244
tl0.5074728260869564
fr0.41390460792239286
sv0.39532944120100083
it0.3907563025210084
sq0.38818565400843885
no0.3544078361531611
da0.3348623853211009
nl0.3160377358490566
ca0.2919921875
is0.29060665362035226
de0.28711897738446407
ms0.26693629929221435
cs0.250258531540848
tr0.2463617463617464
pt0.23117709437963943
lt0.22872340425531915
lv0.22376873661670238
hr0.21451787648970747
yo0.21109902067464634
pl0.2032967032967033
ro0.1935483870967742
es0.1881298992161254
eu0.16087962962962962
sk0.1530373831775701
hu0.15204678362573099
az0.14403778040141677
et0.14403778040141677
fi0.12650602409638553
hi0.09600997506234414
be0.0880503144654088
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
11
name"Selvi"
dialogue"Maine cheekh bhi suni thi. Phir sab chup ho gaya. Bilkul chup. Jaise kuch hua hi nahi."
detectedLang"en"
heavyLang"la"
scores
en0.40898345153664306
fr0.38800489596083226
tl0.37027707808564225
ca0.3630573248407643
et0.32523616734143057
eu0.24812030075187969
fi0.24585218702865763
vi0.2366412213740458
de0.22720247295208654
ro0.22720247295208654
no0.18166939443535188
sk0.18166939443535188
cs0.1749174917491749
it0.1749174917491749
ms0.16666666666666666
lv0.14965986394557826
reliablefalse
passesfalse
12
name"Hunter"
dialogue"A scream? Was that a scream? Is that what you mean?"
detectedLang"en"
heavyLang"en"
scores
en0.844934527911785
nl0.6173469387755102
tl0.608695652173913
yo0.5916515426497277
hu0.5794392523364486
cs0.4827586206896552
de0.45255474452554745
is0.4260204081632653
pt0.3835616438356164
ro0.3818681318681319
ca0.3767313019390581
es0.3697478991596639
sk0.36619718309859156
it0.3571428571428572
fr0.34210526315789475
hr0.33234421364985167
pl0.3181818181818182
sl0.2857142857142857
lt0.267100977198697
tr0.2549668874172185
da0.24242424242424243
sq0.24242424242424243
az0.23728813559322032
eu0.23728813559322032
lv0.23728813559322032
no0.23728813559322032
vi0.23728813559322032
et0.21875
fi0.21875
ms0.21875
sv0.21875
reliabletrue
passestrue
13
name"Selvi"
dialogue"Haan. Aur phir ek gaadi ki awaaz. Tez. Bahut tez."
detectedLang"tr"
heavyLang"af"
scores
tr0.512987012987013
az0.471830985915493
sl0.33774834437086093
hu0.28741092636579574
et0.2805755395683453
yo0.2736077481840194
ro0.25925925925925924
sq0.25925925925925924
nl0.25
reliablefalse
passesfalse
14
name"Hunter"
dialogue"A car? You heard a car?"
detectedLang"en"
heavyLang"en"
scores
en0.8292349726775956
tl0.6770025839793281
fr0.659400544959128
cs0.6268656716417911
hu0.5551601423487544
pt0.5283018867924528
ro0.5265151515151516
ca0.5210727969348659
es0.5136186770428015
sk0.5098039215686274
it0.5
yo0.4877049180327869
hr0.47257383966244726
pl0.45652173913043476
sl0.4186046511627907
lt0.3961352657004831
tr0.3811881188118812
is0.375
da0.3654822335025381
sq0.3654822335025381
az0.358974358974359
eu0.358974358974359
lv0.358974358974359
nl0.358974358974359
no0.358974358974359
vi0.358974358974359
de0.34895833333333337
et0.33510638297872336
fi0.33510638297872336
ms0.33510638297872336
sv0.33510638297872336
reliabletrue
passestrue
15
name"Selvi"
dialogue"Ji. Lekin number nahi dekha. Main dar gayi thi."
detectedLang"eu"
heavyLang"tl"
scores
eu0.5098039215686274
en0.506578947368421
lt0.4434137291280148
is0.3617021276595745
sl0.35064935064935066
de0.34210526315789475
et0.34210526315789475
vi0.34065934065934067
tl0.33774834437086093
ro0.29906542056074764
cs0.2555831265508685
yo0.24050632911392408
fi0.23857868020304565
nl0.23857868020304565
es0.2366412213740458
pt0.2366412213740458
ms0.23273657289002556
hu0.22879177377892032
fr0.22680412371134018
no0.2248062015503876
da0.21465968586387435
sv0.20634920634920634
sk0.17355371900826447
reliablefalse
passesfalse
16
name"Hunter"
dialogue"All right. I think you're trying to help. Stay here a second—"
detectedLang"en"
heavyLang"en"
scores
en0.8301358912869703
tl0.6502057613168725
no0.5303867403314917
it0.5011737089201878
yo0.495249406175772
da0.47788697788697787
sq0.47073474470734744
cs0.46406052963430017
hr0.46338383838383834
pl0.4627054361567636
fr0.4585987261146497
sk0.44005270092226617
ro0.4170096021947874
ca0.39198855507868385
sv0.3911174785100286
lv0.375
lt0.3694362017804154
nl0.3656716417910448
hu0.3441358024691358
et0.3348982785602504
de0.3338557993730407
sl0.33176100628930816
tr0.256993006993007
pt0.247787610619469
is0.24511545293072823
az0.23835125448028674
vi0.23835125448028674
es0.236983842010772
be0.1414141414141414
eu0.1414141414141414
fi0.1290983606557377
ms0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
17
name"Hunter"
dialogue"Hunter speaking... What? When?... I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8231511254019291
tl0.6638141809290953
fr0.47817836812144215
pl0.3902439024390244
de0.3792325056433409
nl0.375
no0.3735763097949886
cs0.3692660550458715
sk0.3692660550458715
ca0.3648960739030023
et0.358974358974359
fi0.3529411764705882
ms0.34679334916864607
sv0.33894230769230765
pt0.3276283618581907
hr0.24242424242424243
lt0.2403314917127072
hi0.233983286908078
da0.22969187675070027
yo0.21428571428571427
is0.20520231213872833
it0.1863905325443787
ro0.17664670658682635
sl0.17664670658682635
sq0.17664670658682635
tr0.17664670658682635
reliabletrue
passestrue
18
name"Hunter"
dialogue"I have to go. I'm sorry. Don't leave town, okay? I'll come back with someone who can translate."
detectedLang"en"
heavyLang"en"
scores
en0.8046239010094431
tl0.559147685525349
it0.4618834080717489
da0.4301994301994302
pl0.4225216554379211
hr0.3957703927492447
no0.3951612903225807
yo0.3340732519422864
cs0.329608938547486
ca0.3258426966292135
sk0.3079584775086505
pt0.3006993006993007
ro0.2998833138856476
lv0.29577464788732394
lt0.2805755395683453
tr0.25925925925925924
sq0.2555831265508685
az0.2490613266583229
sv0.24717691342534504
sl0.23076923076923078
es0.2052980132450331
vi0.2010652463382157
ms0.18588873812754408
et0.16897506925207756
fr0.11764705882352942
be0.1044776119402985
de0.10044977511244377
eu0.10044977511244377
hu0.10044977511244377
is0.09502262443438914
nl0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
19
name"Selvi"
dialogue"Theek hai... lekin jaldi aaiyega. Mujhe bahut darr lag raha hai."
detectedLang"eu"
heavyLang"is"
scores
eu0.3874425727411945
et0.35379644588045234
is0.3127147766323024
nl0.3127147766323024
vi0.28186714542190305
sq0.2079207920792079
it0.2
no0.19678714859437751
fi0.1902834008097166
sv0.18864097363083165
de0.16142557651991615
reliablefalse
passesfalse
20
name"Hunter"
dialogue"I know. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8034591194968553
yo0.6118012422360247
hu0.5954692556634305
lt0.5833333333333334
tl0.5833333333333334
no0.5370370370370371
da0.5265151515151516
hr0.5265151515151516
ca0.5247148288973384
sv0.5247148288973384
sq0.5173745173745175
pl0.50199203187251
it0.4791666666666667
cs0.45652173913043476
ro0.4186046511627907
sk0.3654822335025381
be0.358974358974359
tr0.358974358974359
az0.33510638297872336
et0.33510638297872336
is0.33510638297872336
lv0.33510638297872336
uk0.33510638297872336
vi0.33510638297872336
reliabletrue
passestrue