Run: 2026-02-16-01KHKB2G21W7SRXBXPYQG6JFQE

Run Details

Model:
GPT-5 Nano
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 2s
Cost:
$0.002799
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "हाँ, मैं परेशान और डरी हुई हूँ।" Hunter: "I don't understand Hindi." Selvi: "शहर में हाल की घटना ने हर किसी को डर में डाल दिया है—Apple festival के पास से कुछ लोग गायब हो गए थे।" Hunter: "Describe what you saw, in simple terms." Selvi: "मेरे कैमरे के फ्रेम में एक अजीब-सी जीवंत छाया दिखी थी, जो भीड़ के बीच से गुजर गई और फिर गायब हो गई।" Hunter: "That helps. I have to take this call."
created_at"2026-02-16T13:44:41.393421+00:00" 2/16/2026, 1:44:41 PM
model"openai/gpt-5-nano-2025-08-07"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency61594
moderation_latency(null)
generation_time62365
tokens_prompt315
tokens_completion226
native_tokens_prompt272
native_tokens_completion6964
native_tokens_completion_images0
native_tokens_reasoning6784
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.0027992
router(null)
provider_responses
0
id"resp_08a237e71c204f600169931f0a67048194b4b7efd9c0511f34"
status200
is_byokfalse
latency118
endpoint_id"50329d77-04e1-4979-a184-c33030289476"
provider_name"OpenAI"
model_permaslug"openai/gpt-5-nano-2025-08-07"
api_type"completions"
id"gen-1771249418-LOnSD3UgRPQTdux7o5Ov"
upstream_id"resp_08a237e71c204f600169931f0a67048194b4b7efd9c0511f34"
total_cost0.0027992
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"हाँ, मैं परेशान और डरी हुई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8846476510067114
mr0.8717948717948718
reliabletrue
passestrue
1
name"Hunter"
dialogue"I don't understand Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.7555012224938875
tl0.6951219512195121
no0.6884735202492211
da0.6875
sv0.6357012750455373
is0.5402298850574713
sq0.5249406175771971
it0.5203836930455635
pl0.504950495049505
de0.4910941475826972
cs0.48586118251928023
nl0.4708994708994709
ro0.45054945054945056
sk0.44598337950138506
et0.43977591036414565
hr0.41002949852507375
ca0.40828402366863903
yo0.30313588850174217
hi0.2805755395683453
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
2
name"Selvi"
dialogue"शहर में हाल की घटना ने हर किसी को डर में डाल दिया है—Apple festival के पास से कुछ लोग गायब हो गए थे।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8623934659090909
mr0.8558675841547331
fr0.3086529884032114
es0.30180180180180183
en0.27093132643461904
it0.26609848484848486
nl0.2504835589941973
de0.2226680040120361
ca0.20998980632008157
hr0.20594262295081966
pt0.20594262295081966
sv0.19855222337125128
cs0.1943866943866944
da0.1943866943866944
no0.1943866943866944
sl0.1943866943866944
ms0.1876310272536688
tl0.1876310272536688
sq0.143646408839779
lt0.13984461709211987
et0.13600891861761427
az0.13213885778275478
ro0.13213885778275478
sk0.13213885778275478
hu0.07957244655581948
fi0.07517899761336516
lv0.07517899761336516
pl0.07517899761336516
reliabletrue
passestrue
3
name"Hunter"
dialogue"Describe what you saw, in simple terms."
detectedLang"en"
heavyLang"en"
scores
en0.8141891891891891
es0.6527777777777778
ro0.6278755074424898
tl0.5736434108527132
ca0.5431893687707641
ms0.5431893687707641
fr0.535472972972973
it0.5141342756183745
nl0.5045045045045045
sl0.5027124773960217
pt0.47115384615384615
de0.42827442827442824
pl0.3544600938967136
cs0.3325242718446602
sq0.3176178660049628
hr0.31077694235588976
sv0.2801047120418848
yo0.24242424242424243
az0.233983286908078
hu0.21875
da0.19117647058823528
lv0.1863905325443787
lt0.17664670658682635
sk0.17664670658682635
tr0.17664670658682635
reliabletrue
passestrue
4
name"Selvi"
dialogue"मेरे कैमरे के फ्रेम में एक अजीब-सी जीवंत छाया दिखी थी, जो भीड़ के बीच से गुजर गई और फिर गायब हो गई।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8848247940806925
mr0.8777415530527564
reliabletrue
passestrue
5
name"Hunter"
dialogue"That helps. I have to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.8435326842837274
tl0.6621621621621622
da0.6341463414634145
pl0.5370370370370371
hr0.53125
no0.5302713987473904
cs0.5119305856832972
yo0.49888641425389757
sk0.4755244755244755
sl0.4693396226415094
lv0.45121951219512196
lt0.4260204081632653
ca0.38016528925619836
sv0.38016528925619836
sq0.3732590529247911
it0.3382352941176471
fi0.3055555555555556
ro0.2857142857142857
nl0.281150159744409
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
et0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue