Run: 2026-03-11-01KKFCYWMHKT72AZFFJK3BNSX4

Run Details

Model:
Nemotron 3 Nano
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
11.4s
Cost:
$0.000183
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "यह घटना... मैं घबरा गई हूँ, बहुत डरी हुई हूँ।" Hunter: "I’m sorry, I didn’t catch that." Selvi: "रात में लोग गायब हो रहे हैं, मेरे फोटो में कुछ नहीं दिख रहा।" Hunter: "Disappearing people? Like...?" Selvi: "हां, वे गायब हो रहे हैं, और कोई सुराग नहीं मिल रहा।" Hunter: "I need to look into that. Just a moment." Hunter: "Excuse me, I have to take this call." Hunter: "Sorry, I have to leave now."
created_at"2026-03-11T21:31:03.199Z" 3/11/2026, 9:31:03 PM
model"nvidia/nemotron-3-nano-30b-a3b"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency467
moderation_latency(null)
generation_time11196
tokens_prompt315
tokens_completion1161
native_tokens_prompt285
native_tokens_completion842
native_tokens_completion_images(null)
native_tokens_reasoning966
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason(null)
native_finish_reason(null)
usage0.00018265
router(null)
provider_responses
0
endpoint_id"2bd3912d-8b35-4818-b873-24ccfefa6cf9"
id"chatcmpl-RL3sbMIvADyaqu3yJsHrJtTf"
is_byokfalse
latency61
model_permaslug"nvidia/nemotron-3-nano-30b-a3b"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773264663-NwL3YrIoGQI0eLkfTdth"
upstream_id"chatcmpl-RL3sbMIvADyaqu3yJsHrJtTf"
total_cost0.00018265
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"यह घटना... मैं घबरा गई हूँ, बहुत डरी हुई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8733233979135618
mr0.8602892833662065
reliabletrue
passestrue
1
name"Hunter"
dialogue"I’m sorry, I didn’t catch that."
detectedLang"en"
heavyLang"en"
scores
en0.8125426039536469
tl0.7182377049180328
it0.5132743362831859
sv0.45436507936507936
tr0.3820224719101124
no0.34523809523809523
da0.3357487922705314
hr0.3357487922705314
ca0.3341404358353511
sq0.3276283618581907
pl0.314214463840399
cs0.2763157894736842
pt0.26666666666666666
fr0.2486338797814208
ro0.24657534246575344
yo0.2403314917127072
de0.21428571428571427
sk0.207492795389049
be0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
lt0.1863905325443787
lv0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue
2
name"Selvi"
dialogue"रात में लोग गायब हो रहे हैं, मेरे फोटो में कुछ नहीं दिख रहा।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.888779041028176
mr0.8832381940840685
reliabletrue
passestrue
3
name"Hunter"
dialogue"Disappearing people? Like...?"
detectedLang"en"
heavyLang"en"
scores
en0.7909199522102748
no0.5833333333333334
nl0.5603015075376884
tl0.5406824146981627
ms0.5205479452054795
da0.40878378378378377
sv0.3944636678200692
it0.3320610687022901
de0.31906614785992216
fr0.3055555555555556
reliabletrue
passestrue
4
name"Selvi"
dialogue"हां, वे गायब हो रहे हैं, और कोई सुराग नहीं मिल रहा।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8889179299529535
mr0.87884834663626
reliabletrue
passestrue
5
name"Hunter"
dialogue"I need to look into that. Just a moment."
detectedLang"en"
heavyLang"en"
scores
en0.835742444152431
ca0.6909765142150803
pl0.6688741721854304
cs0.6648793565683647
sk0.6522948539638386
hr0.6323529411764706
tl0.6279761904761905
yo0.6189024390243903
ro0.6147919876733435
no0.6099843993759752
da0.6044303797468354
et0.5948136142625607
sv0.5941558441558442
sq0.5798319327731093
it0.5652173913043478
fr0.5621716287215411
hu0.5335820895522388
lv0.504950495049505
lt0.49899799599198397
nl0.4813278008298755
pt0.47368421052631576
es0.46808510638297873
sl0.4577006507592191
de0.4529540481400437
az0.43946188340807174
tr0.37027707808564225
is0.3556701030927836
vi0.34725848563968675
be0.21875
eu0.21875
fi0.20127795527156547
ms0.20127795527156547
uk0.20127795527156547
reliabletrue
passestrue
6
name"Hunter"
dialogue"Excuse me, I have to take this call."
detectedLang"en"
heavyLang"en"
scores
en0.804006968641115
da0.6341463414634145
no0.6052631578947368
tl0.6024734982332155
sl0.560546875
sq0.5562130177514794
pl0.5370370370370371
hr0.53125
cs0.5119305856832972
yo0.49888641425389757
sk0.4755244755244755
it0.46428571428571425
lv0.45121951219512196
lt0.4260204081632653
et0.412532637075718
ca0.38016528925619836
sv0.38016528925619836
es0.3119266055045872
fr0.2879746835443038
ro0.2857142857142857
pt0.281150159744409
ms0.27184466019417475
nl0.27184466019417475
fi0.25
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
7
name"Hunter"
dialogue"Sorry, I have to leave now."
detectedLang"en"
heavyLang"en"
scores
en0.8175182481751825
da0.6610169491525424
tl0.5680345572354212
pl0.5661605206073753
hr0.5604395604395604
no0.5594713656387665
cs0.5412844036697247
yo0.5283018867924528
it0.5180722891566265
sk0.504950495049505
lv0.4805194805194805
lt0.4550408719346049
ca0.40828402366863903
sv0.40828402366863903
sq0.40119760479041916
sl0.37694704049844235
pt0.3333333333333333
ro0.3103448275862069
be0.25925925925925924
tr0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue