Run: 2026-03-11-01KKFCMDRVX2NYPB3RTQ666FDT

Run Details

Model:
Nemotron 3 Super
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 52s
Cost:
$0.000000
Provider:
Nvidia

Evaluation summary

Score Evaluator
Details Link
87.50% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "कल शाम को झील के पास मैं ने एक काला साया देखा… वो लग रहा था जैसे कोई इंसान नहीं, बस एक धुंधला साया।" Hunter: "I’m sorry, I don’t speak Hindi. Can you tell me what you saw in English, or maybe show me?" Selvi: "मेरे कैमरे में वो साया फँस गया है… मैं बहुत डर गई हूँ… मैं नहीं जानती कि वो क्या था।" Hunter: "Let me look at your pictures. Maybe I can understand." Selvi: "ये तस्वीर देखो… वहां पर अजीब सी रोशनी थी और साया थोड़ा हिल रहा था…" Hunter: "That does look strange… I’ll need to run this by the lab." Hunter: *(answers phone)* "Yeah… I’m on my way. Sorry, I’ve got to go. Thanks for talking." Selvi: "कृपया… सावधान रहें… अगर आप कुछ भी देखें तो तुरंत बताना।" Hunter: "Will do. Stay safe."
created_at"2026-03-11T21:25:20.294Z" 3/11/2026, 9:25:20 PM
model"nvidia/nemotron-3-super-120b-a12b-20230311:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency25791
moderation_latency(null)
generation_time112272
tokens_prompt332
tokens_completion1577
native_tokens_prompt285
native_tokens_completion1163
native_tokens_completion_images(null)
native_tokens_reasoning1210
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
endpoint_id"970aecad-f13b-4ec3-9362-e1758aea3e56"
id"chatcmpl-89bcb36501edcb51"
is_byokfalse
latency854
model_permaslug"nvidia/nemotron-3-super-120b-a12b-20230311"
provider_name"Nvidia"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773264320-kfIkwgz1DN4XUcSxn9f9"
upstream_id"chatcmpl-89bcb36501edcb51"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Nvidia"

Evaluation details

Result Evaluator Details Meta Data
87.50% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"कल शाम को झील के पास मैं ने एक काला साया देखा… वो लग रहा था जैसे कोई इंसान नहीं, बस एक धुंधला साया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.881769641495042
mr0.8798822070675759
reliabletrue
passestrue
1
name"Hunter"
dialogue"I’m sorry, I don’t speak Hindi. Can you tell me what you saw in English, or maybe show me?"
detectedLang"en"
heavyLang"en"
scores
en0.8021760633036598
tl0.6838777660695469
it0.4755244755244755
sq0.38080495356037153
ms0.35553168635875404
no0.3464052287581699
nl0.3456924754634678
sv0.3456924754634678
ro0.336283185840708
pt0.3063583815028902
et0.29577464788732394
sl0.28741092636579574
az0.27184466019417475
de0.2673992673992674
ca0.26380368098159507
da0.2601726263871763
hr0.2601726263871763
pl0.25925925925925924
cs0.23371647509578544
yo0.22580645161290325
fr0.2197659297789337
is0.21156373193166886
tr0.19678714859437751
es0.1452991452991453
hi0.11504424778761062
fi0.1111111111111111
sk0.10714285714285714
be0.1044776119402985
hu0.10044977511244377
lt0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
2
name"Selvi"
dialogue"मेरे कैमरे में वो साया फँस गया है… मैं बहुत डर गई हूँ… मैं नहीं जानती कि वो क्या था।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8841426556518235
mr0.8717376756636182
reliabletrue
passestrue
3
name"Hunter"
dialogue"ये तस्वीर देखो… वहां पर अजीब सी रोशनी थी और साया थोड़ा हिल रहा था…"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8844945481426724
mr0.8796224961479199
reliabletrue
passesfalse
4
name"Hunter"
dialogue"That does look strange… I’ll need to run this by the lab."
detectedLang"en"
heavyLang"en"
scores
en0.8319731156985118
tl0.6676163342830009
da0.5700245700245701
no0.5295698924731184
sk0.5042492917847025
cs0.49640287769784175
yo0.494949494949495
pl0.48604992657856094
nl0.41666666666666663
fr0.3944636678200692
sl0.3738819320214669
hr0.36936936936936937
et0.3613138686131387
lv0.35424354243542433
de0.328214971209213
lt0.328214971209213
sv0.3
ms0.28716904276985744
sq0.2813141683778234
it0.19168591224018475
ro0.1764705882352941
is0.1606714628297362
az0.14425427872860636
tr0.14425427872860636
reliabletrue
passestrue
5
name"Hunter"
dialogue"Yeah… I’m on my way. Sorry, I’ve got to go. Thanks for talking."
detectedLang"en"
heavyLang"en"
scores
en0.8116134751773051
tl0.6621621621621622
pl0.49644549763033174
no0.4537275064267352
sk0.40807799442896936
cs0.4072524407252441
yo0.40476190476190477
da0.38226744186046513
pt0.37683284457478006
nl0.3348982785602504
hr0.32432432432432434
fr0.2975206611570248
et0.2659758203799654
fi0.2608695652173913
vi0.25438596491228066
lv0.22303473491773307
sl0.2216117216117216
lt0.19659735349716445
it0.1904761904761905
ca0.18893129770992365
hi0.1650294695481336
de0.15841584158415842
is0.1431451612903226
sv0.1431451612903226
reliabletrue
passestrue
6
name"Selvi"
dialogue"कृपया… सावधान रहें… अगर आप कुछ भी देखें तो तुरंत बताना।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8833510074231177
mr0.8795180722891566
reliabletrue
passestrue
7
name"Hunter"
dialogue"Will do. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8191681735985533
pt0.609375
pl0.588477366255144
cs0.5708154506437768
sk0.5689655172413793
hr0.5454545454545454
sl0.5454545454545454
sq0.5391705069124424
vi0.5260663507109005
de0.5145631067961165
tl0.43820224719101125
yo0.43820224719101125
reliabletrue
passestrue