Run: 2026-02-16-01KHKA2WRF5CY4M3G01X70JVS0

Run Details

Model:
GPT-5 Nano
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 17s
Cost:
$0.002568
Provider:
OpenAI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "यह सब मुझे बहुत डरा रहा है. कल रात से शहर में कुछ अजीब हो रहा है—लोग गायब हो रहे हैं. मैंने जो देखा, उसे शब्दों में बयां नहीं कर पाऊँगी." Hunter: "I don’t speak Hindi. Please tell me in English what you saw." Selvi: "कैमरे में apple festival के दौरान एक अजीब-सी हरकत दिखी—कुछ लोग धुंध में भागते दिखे, फिर सब गायब हो गए." Hunter: "Describe them: what were they wearing, any distinguishing marks, anything you remember." Selvi: "एक आदमी काला टोपी पहने था, धारीदार जैकेट और चेहरा धुंध में था—मैं चेहरा पहचान नहीं पाई." Hunter: "That helps. Thanks for sharing what you can. I’ve just got a call I need to take. I’ll step outside to take it." Hunter: "I’ll be back as soon as I can."
created_at"2026-02-16T13:27:40.292632+00:00" 2/16/2026, 1:27:40 PM
model"openai/gpt-5-nano-2025-08-07"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency7057
moderation_latency(null)
generation_time76849
tokens_prompt315
tokens_completion3145
native_tokens_prompt272
native_tokens_completion6386
native_tokens_completion_images0
native_tokens_reasoning6144
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
usage0.002568
router(null)
provider_responses
0
id"resp_048ffbeb2a2ec2420169931afed42c8196b6ba7a87c8c0413e"
status200
is_byokfalse
latency132
endpoint_id"50329d77-04e1-4979-a184-c33030289476"
provider_name"OpenAI"
model_permaslug"openai/gpt-5-nano-2025-08-07"
api_type"completions"
id"gen-1771248382-Eedc1P5jlgSjhvjbN4f3"
upstream_id"resp_048ffbeb2a2ec2420169931afed42c8196b6ba7a87c8c0413e"
total_cost0.002568
cache_discount(null)
upstream_inference_cost0
provider_name"OpenAI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"यह सब मुझे बहुत डरा रहा है. कल रात से शहर में कुछ अजीब हो रहा है—लोग गायब हो रहे हैं. मैंने जो देखा, उसे शब्दों में बयां नहीं कर पाऊँगी."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8784581548790369
mr0.8718105237455744
reliabletrue
passestrue
1
name"Hunter"
dialogue"I don’t speak Hindi. Please tell me in English what you saw."
detectedLang"en"
heavyLang"en"
scores
en0.8077792853912257
tl0.6811702925731433
it0.5109321058688148
ro0.4873341375150784
sq0.46473551637279603
ms0.4378306878306878
no0.4279946164199193
sv0.4272237196765499
et0.3722304283604136
sl0.36281859070464767
nl0.3609022556390977
de0.34006211180124224
da0.33176100628930816
hr0.33176100628930816
pl0.33070866141732286
cs0.30098684210526316
yo0.2916666666666667
is0.2747440273037543
az0.256993006993007
ca0.24511545293072823
es0.1935483870967742
fr0.17635658914728683
pt0.17153996101364524
hi0.1550695825049702
fi0.15
sk0.1448692152917505
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
2
name"Selvi"
dialogue"कैमरे में apple festival के दौरान एक अजीब-सी हरकत दिखी—कुछ लोग धुंध में भागते दिखे, फिर सब गायब हो गए."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8661360347322721
mr0.8601028433151845
fr0.2722265932336742
es0.26587301587301587
en0.23742786479802147
it0.2330016583747927
nl0.21875
de0.1935483870967742
ca0.18213969938107868
hr0.17850799289520428
pt0.17850799289520428
sv0.1718889883616831
cs0.1681654676258993
da0.1681654676258993
no0.1681654676258993
sl0.1681654676258993
ms0.1621376811594203
tl0.1621376811594203
sq0.12322274881516589
lt0.11988582302568983
et0.11652340019102196
az0.1131351869606903
ro0.1131351869606903
sk0.1131351869606903
hu0.06754032258064516
fi0.06376518218623482
lv0.06376518218623482
pl0.06376518218623482
reliabletrue
passestrue
3
name"Hunter"
dialogue"Describe them: what were they wearing, any distinguishing marks, anything you remember."
detectedLang"en"
heavyLang"en"
scores
en0.8149340199549404
tl0.49383802816901406
no0.47296058661778184
da0.4460500963391137
nl0.4334975369458128
ms0.4221105527638191
sv0.4138634046890927
ca0.40476190476190477
es0.40476190476190477
fr0.3596881959910913
pt0.3568232662192394
is0.3561030235162374
de0.3502824858757062
sq0.28214731585518105
et0.26376440460947503
yo0.24738219895287958
ro0.24540682414698162
sk0.24540682414698162
sl0.24540682414698162
hu0.2353723404255319
it0.21981004070556312
cs0.19692737430167598
hr0.18899858956276447
lt0.13922155688622756
fi0.10852713178294573
lv0.10714285714285714
eu0.1043613707165109
pl0.0987460815047022
tr0.0987460815047022
az0.09305993690851734
reliabletrue
passestrue
4
name"Selvi"
dialogue"एक आदमी काला टोपी पहने था, धारीदार जैकेट और चेहरा धुंध में था—मैं चेहरा पहचान नहीं पाई."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8837016115633827
mr0.87468671679198
reliabletrue
passestrue
5
name"Hunter"
dialogue"That helps. Thanks for sharing what you can. I’ve just got a call I need to take. I’ll step outside to take it."
detectedLang"en"
heavyLang"en"
scores
en0.8313002854918247
tl0.5955196017423771
no0.5109104589917232
da0.5083207261724659
et0.411231884057971
cs0.40693430656934304
ca0.3970315398886827
yo0.391955098222638
sv0.3908153701968135
nl0.3737957610789981
sq0.36211972522080466
hr0.3608652900688299
pl0.3602362204724409
lv0.3440968718466196
sk0.3394308943089431
sl0.3077742279020234
vi0.2995689655172413
lt0.27697441601779754
it0.2696629213483146
ms0.2630385487528345
ro0.2605233219567691
pt0.25799086757990863
tr0.2562929061784897
hu0.2554410080183276
az0.24418604651162787
fi0.19950738916256158
de0.18648310387984982
is0.1751269035532995
es0.16879795396419436
fr0.15254237288135594
be0.09722222222222222
eu0.09722222222222222
uk0.08835904628330996
reliabletrue
passestrue
6
name"Hunter"
dialogue"I’ll be back as soon as I can."
detectedLang"en"
heavyLang"en"
scores
en0.8294970161977835
tl0.6415770609318996
yo0.588477366255144
hu0.5717344753747323
sq0.5271867612293144
ca0.5180722891566265
lt0.4666666666666667
tr0.42363112391930835
no0.42028985507246375
pt0.41348973607038125
az0.4117647058823529
da0.41002949852507375
hr0.41002949852507375
sv0.40828402366863903
pl0.38650306748466257
it0.36507936507936506
cs0.3442622950819672
ja0.3333333333333333
ms0.3197278911564626
ro0.3103448275862069
sk0.2647058823529412
be0.25925925925925924
et0.23954372623574144
is0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue