Run: 2026-03-11-01KKFGN2A979RKBAFN8F05269V

Run Details

Model:
Nemotron 3 Super
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
6.1s
Cost:
$0.000000
Provider:
Nvidia

Evaluation summary

Score Evaluator
Details Link
90.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, are you Selvi? I'm Detective Hunter with the Alborn police. I wanted to ask you about the recent disappearance near the lake." Selvi: "मैं डर गई हूँ... मैंने कैमरे में कुछ अजीब देखा है, लेकिन मैं समझ नहीं पा रही हूँ।" Hunter: "I'm sorry, I don't speak Hindi. Could you repeat that in English?" Selvi: "मुझे अंग्रेज़ी नहीं आती, मैं बस अपना कैमरा देख रही थी।" Hunter: "Alright, let's try again. Did you notice anything unusual around the town square yesterday?" Selvi: "हाँ, मैं कैमरे में एक सिल्हूट देखी—जैसे कोई जंगल में भाग रहा हो, लेकिन फिर वो गायब हो गया।" Hunter: (looking confused) "I still don’t follow. Is there someone who can translate for you?" Selvi: "नहीं, मैं अकेली हूँ। मैं बस अपने फोटोग्राफी के शौक में व्यस्त हूँ।" Hunter: (phone rings, answers) "Yeah, I’m on my way... Okay, I’ll be there." Hunter: "I have to go, sorry. Stay safe, okay?" Selvi: "धन्यवाद, कृपया सावधान रहें।"
created_at"2026-03-11T22:35:35.637Z" 3/11/2026, 10:35:35 PM
model"nvidia/nemotron-3-super-120b-a12b-20230311:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency708
moderation_latency(null)
generation_time5983
tokens_prompt332
tokens_completion1339
native_tokens_prompt285
native_tokens_completion1002
native_tokens_completion_images(null)
native_tokens_reasoning910
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
endpoint_id"970aecad-f13b-4ec3-9362-e1758aea3e56"
id"chatcmpl-b08826e87229918b"
is_byokfalse
latency708
model_permaslug"nvidia/nemotron-3-super-120b-a12b-20230311"
provider_name"Nvidia"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773268535-utgNJg9NyKGmd9FViAqq"
upstream_id"chatcmpl-b08826e87229918b"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Nvidia"

Evaluation details

Result Evaluator Details Meta Data
90.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"मैं डर गई हूँ... मैंने कैमरे में कुछ अजीब देखा है, लेकिन मैं समझ नहीं पा रही हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8820532175882242
mr0.8707342295760083
reliabletrue
passesfalse
1
name"Hunter"
dialogue"I'm sorry, I don't speak Hindi. Could you repeat that in English?"
detectedLang"en"
heavyLang"en"
scores
en0.7940156114483955
tl0.6433933933933934
it0.49414270500532487
ro0.4508670520231214
sv0.40025252525252525
no0.3233618233618234
ca0.32045779685264664
sq0.31752873563218387
de0.3155619596541787
da0.30758017492711365
hr0.30758017492711365
pl0.3065693430656934
cs0.27811550151975684
pt0.27035330261136714
yo0.2692307692307693
is0.2531446540880503
et0.24841772151898736
nl0.24722662440570525
sl0.2448330683624801
az0.23633440514469453
ms0.23633440514469453
fr0.1908006814310051
hi0.1410488245931284
es0.13793103448275862
sk0.1316270566727605
be0.12844036697247707
tr0.12844036697247707
hu0.12361623616236161
lt0.1171003717472119
lv0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
2
name"Selvi"
dialogue"मुझे अंग्रेज़ी नहीं आती, मैं बस अपना कैमरा देख रही थी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8828443357783211
mr0.8790492217080353
reliabletrue
passestrue
3
name"Hunter"
dialogue"Alright, let's try again. Did you notice anything unusual around the town square yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.7863247863247863
tl0.5151280062063615
nl0.4555749128919861
fr0.3315508021390375
it0.31167400881057267
ms0.2715617715617716
ro0.23594132029339854
yo0.22456575682382132
sq0.22166874221668745
no0.2128463476070529
es0.20986093552465232
cs0.20584498094027956
da0.19562419562419564
pt0.19458762886597938
lv0.15994623655913978
et0.14383561643835618
hr0.11847672778561354
sv0.11095305832147938
de0.10586552217453504
sk0.10586552217453504
reliabletrue
passestrue
4
name"Selvi"
dialogue"हाँ, मैं कैमरे में एक सिल्हूट देखी—जैसे कोई जंगल में भाग रहा हो, लेकिन फिर वो गायब हो गया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8867829587386783
mr0.8796362339514978
reliabletrue
passestrue
5
name"Hunter"
dialogue"I still don’t follow. Is there someone who can translate for you?"
detectedLang"en"
heavyLang"en"
scores
en0.8287053732419762
tl0.6015100671140939
no0.5268924302788844
da0.4859307359307359
it0.4558991981672394
sq0.43045563549160676
hr0.42002442002442
sv0.4186046511627907
de0.3964421855146125
is0.3870967741935484
ca0.3790849673202614
nl0.3782722513089006
ro0.3510928961748634
pt0.33936022253129344
cs0.33751743375174337
hu0.31752873563218387
tr0.3065693430656934
yo0.3035190615835778
az0.2952522255192878
lt0.2931547619047619
lv0.2931547619047619
pl0.29210134128166915
es0.24603174603174602
vi0.24121405750798725
sk0.22131147540983606
et0.20435510887772196
fr0.14414414414414414
be0.12844036697247707
eu0.12361623616236161
uk0.1171003717472119
ms0.11048689138576778
sl0.11048689138576778
reliabletrue
passestrue
6
name"Selvi"
dialogue"नहीं, मैं अकेली हूँ। मैं बस अपने फोटोग्राफी के शौक में व्यस्त हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8853211009174312
mr0.8819163292847504
reliabletrue
passestrue
7
name"Hunter"
dialogue"Yeah, I’m on my way... Okay, I’ll be there."
detectedLang"en"
heavyLang"en"
scores
en0.8080949057920448
tl0.6283783783783783
yo0.40217391304347827
de0.39293598233995586
pl0.3902439024390244
cs0.3692660550458715
sk0.3692660550458715
et0.358974358974359
fi0.3529411764705882
hu0.298469387755102
lt0.289405684754522
fr0.2838541666666667
ca0.2647058823529412
hr0.24242424242424243
hi0.233983286908078
sq0.22096317280453256
reliabletrue
passestrue
8
name"Hunter"
dialogue"I have to go, sorry. Stay safe, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.7879359095193214
tl0.664179104477612
da0.6341463414634145
pl0.6212121212121212
yo0.5722433460076045
hr0.53125
no0.5302713987473904
cs0.5119305856832972
it0.4886363636363637
sk0.4755244755244755
lv0.45121951219512196
lt0.4260204081632653
ca0.38016528925619836
sv0.38016528925619836
sq0.3732590529247911
sl0.34971098265895956
pt0.30769230769230765
ro0.2857142857142857
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
et0.21875
is0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
9
name"Selvi"
dialogue"धन्यवाद, कृपया सावधान रहें।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8791436464088398
mr0.8771929824561404
reliabletrue
passestrue