Run: 2026-03-11-01KKFJMK6A0JXRYW72Z2156B2G

Run Details

Model:
Nemotron 3 Super
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
7.9s
Cost:
$0.000000
Provider:
Nvidia

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: Hey there, mind if I ask you a few questions? Marie: Je suis désolée, je ne parle pas anglais. Hunter: Oh… do you understand any English at all? Marie: Non, je ne comprends rien. Hunter: Okay… I'm Detective Hunter. I'm looking into some disappearances in Alborn. Have you noticed anything strange lately? Marie: Oui… hier soir, près du vieux moulin, j'ai vu des lumières étranges et entendu des cris. Hunter: I'm sorry, I didn't catch that. Could you repeat? Marie: J'ai vu quelqu'un traîner près de l'eau, puis il a disparu. Hunter: Did you see a person? Could you describe them? Marie: Il portait un manteau sombre, et ses yeux… ils brillaient comme… Hunter: *(phone rings, he checks it)* Sorry, I gotta take this. Thanks for your time. Marie: Fais attention…
created_at"2026-03-11T23:10:17.304Z" 3/11/2026, 11:10:17 PM
model"nvidia/nemotron-3-super-120b-a12b-20230311:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency344
moderation_latency(null)
generation_time7676
tokens_prompt333
tokens_completion865
native_tokens_prompt280
native_tokens_completion779
native_tokens_completion_images(null)
native_tokens_reasoning650
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
endpoint_id"970aecad-f13b-4ec3-9362-e1758aea3e56"
id"chatcmpl-a0d7c2fe36f3b8e4"
is_byokfalse
latency208
model_permaslug"nvidia/nemotron-3-super-120b-a12b-20230311"
provider_name"Nvidia"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773270617-sj6BM8Wi8nDB89LPgI6a"
upstream_id"chatcmpl-a0d7c2fe36f3b8e4"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Nvidia"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Hey there, mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.8171074845244796
it0.5906801007556676
fr0.5886075949367089
ca0.5614035087719298
tl0.5038167938931297
cs0.4921875
pt0.49139280125195617
hu0.48899371069182396
sv0.48083067092651754
sq0.4663382594417077
hr0.4357638888888889
de0.4298245614035088
pl0.41546762589928055
ro0.4133574007220217
no0.3981481481481482
et0.3970315398886827
da0.39365671641791045
es0.3902439024390244
yo0.3879472693032015
sk0.38330170777988615
nl0.34343434343434337
tr0.3114406779661017
lt0.30851063829787234
is0.29805615550755943
az0.2903930131004367
lv0.2903930131004367
vi0.2903930131004367
sl0.21686746987951808
be0.17721518987341772
eu0.17721518987341772
fi0.16237113402061853
ms0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
1
name"Marie"
dialogue"Je suis désolée, je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8010130246020261
sl0.6545226130653266
lt0.6060171919770774
sq0.5820668693009119
cs0.5749613601236476
hr0.5578778135048231
ca0.533106960950764
sk0.5098039215686274
nl0.5045045045045045
lv0.4821092278719397
it0.46911196911196906
ro0.46911196911196906
yo0.3721461187214612
pl0.3648960739030023
tr0.3574766355140187
hu0.3514150943396226
ms0.3483412322274882
es0.34679334916864607
de0.34210526315789475
en0.3276283618581907
fi0.24242424242424243
az0.20289855072463767
et0.1863905325443787
pt0.1863905325443787
da0.17664670658682635
no0.17664670658682635
sv0.17664670658682635
reliabletrue
passestrue
2
name"Hunter"
dialogue"Oh… do you understand any English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.806064880112835
no0.6910112359550562
da0.6658566221142164
tl0.5925925925925926
sv0.5634920634920635
de0.5506535947712418
nl0.5242214532871973
cs0.5175438596491229
pl0.4455645161290322
sk0.4455645161290322
hr0.41113490364025695
sq0.4073275862068965
pt0.36194895591647336
ro0.34679334916864607
ca0.32598039215686275
sl0.3037974683544304
vi0.28756476683937826
et0.24242424242424243
yo0.22096317280453256
is0.21203438395415475
it0.207492795389049
ms0.207492795389049
reliabletrue
passestrue
3
name"Marie"
dialogue"Non, je ne comprends rien."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8122317596566524
it0.717741935483871
en0.6399176954732511
sl0.6323529411764706
hr0.6187363834422658
ca0.6102449888641426
cs0.5668316831683169
nl0.5535714285714286
ro0.5501285347043702
es0.5418848167539267
lt0.5295698924731184
tl0.4897959183673469
yo0.48224852071005914
de0.4728915662650602
sk0.453125
pt0.41077441077441074
sq0.3944636678200692
lv0.37050359712230213
tr0.34944237918215615
pl0.34210526315789475
fi0.3346007604562738
eu0.3320610687022901
hu0.31906614785992216
reliabletrue
passestrue
4
name"Hunter"
dialogue"Okay… I'm Detective Hunter. I'm looking into some disappearances in Alborn. Have you noticed anything strange lately?"
detectedLang"en"
heavyLang"en"
scores
en0.7942386831275721
tl0.5672244662435083
fr0.5378927911275416
nl0.5107632093933464
de0.4627507163323783
it0.46120689655172414
pt0.41815360744763375
ro0.4131455399061033
da0.4042891183478951
no0.36655405405405406
ca0.34210526315789475
sv0.3403693931398417
ms0.3321460373998219
sl0.32915921288014316
es0.3218806509945751
sq0.293119698397738
lv0.2596248766041461
sk0.24242424242424243
pl0.24089068825910928
cs0.237029501525941
hr0.17218543046357618
az0.1601343784994401
is0.15540540540540537
tr0.1359447004608295
yo0.10501193317422433
fi0.09420289855072464
hi0.09200968523002422
lt0.08200734394124846
et0.07292954264524104
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui… hier soir, près du vieux moulin, j'ai vu des lumières étranges et entendu des cris."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8130689206762027
ca0.5030250648228177
da0.4221105527638191
de0.3869936034115139
no0.3495475113122172
tl0.31220095693779903
eu0.30303030303030304
et0.28924598269468477
sv0.25032594524119944
en0.2404227212681638
pt0.21875
cs0.203601108033241
sk0.1581259150805271
nl0.15191740412979352
vi0.14688427299703263
lt0.14307004470938897
ro0.13010590015128592
sq0.13010590015128592
es0.11944869831546708
fi0.11674347158218126
tr0.10852713178294573
reliabletrue
passestrue
6
name"Hunter"
dialogue"I'm sorry, I didn't catch that. Could you repeat?"
detectedLang"en"
heavyLang"en"
scores
en0.8033707865168539
tl0.5501285347043702
it0.453125
sv0.3955094991364421
ca0.3902439024390244
fr0.3670886075949367
cs0.3433395872420263
pt0.3346007604562738
ro0.3346007604562738
no0.29292929292929293
da0.2842535787321063
hr0.2842535787321063
sq0.2768595041322314
pl0.2647058823529412
yo0.19908466819221968
es0.1784037558685446
de0.1764705882352941
sk0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
7
name"Marie"
dialogue"J'ai vu quelqu'un traîner près de l'eau, puis il a disparu. Hunter: Did you see a person? Could you describe them?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7141276281814829
en0.6970289288506646
ca0.5438493231312537
it0.5101137800252844
pt0.5073108709472346
es0.4993540051679586
ro0.481951871657754
de0.39922480620155043
tl0.3568464730290456
da0.3520066889632107
no0.3487394957983193
sv0.3481917577796467
sq0.3465430016863406
tr0.3318965517241379
nl0.31778169014084506
cs0.30368373764600176
hu0.2896425297891842
az0.2837338262476894
et0.2736644798500469
ms0.2604961832061069
sk0.24975798644724106
yo0.21558704453441296
is0.21239837398373984
hr0.18076109936575055
pl0.17465388711395102
lt0.16576964477933262
sl0.16125541125541126
lv0.15760869565217392
eu0.15300546448087432
vi0.08284023668639054
fi0.07517899761336516
reliabletrue
passestrue
8
name"Marie"
dialogue"Il portait un manteau sombre, et ses yeux… ils brillaient comme…"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8080397470641372
ca0.6262093227792437
it0.6252204585537918
ro0.5298672566371682
es0.5069605568445477
da0.48296836982968366
lv0.42489851150202973
tr0.4097222222222222
et0.40807799442896936
en0.4072524407252441
pt0.4064245810055866
no0.40308988764044945
nl0.36472346786248133
tl0.3178170144462279
az0.2904841402337229
yo0.28451178451178455
de0.24511545293072823
sv0.24242424242424243
fi0.2085661080074488
sl0.1448692152917505
sq0.1414141414141414
pl0.1361788617886179
hr0.1290983606557377
hu0.1290983606557377
sk0.1290983606557377
cs0.121900826446281
lt0.121900826446281
ms0.121900826446281
reliabletrue
passestrue
9
name"Hunter"
dialogue"Sorry, I gotta take this. Thanks for your time."
detectedLang"en"
heavyLang"en"
scores
en0.7855611150822016
tl0.6735582154515778
it0.5792426367461431
no0.5575221238938053
da0.5542347696879644
pt0.47368421052631576
hr0.4263862332695985
sv0.4174757281553398
vi0.4094488188976378
hu0.3684210526315789
ca0.3150684931506849
sq0.3087557603686636
pl0.29577464788732394
fi0.27184466019417475
nl0.27184466019417475
cs0.25925925925925924
ro0.23076923076923078
yo0.2248062015503876
ms0.20634920634920634
sl0.20634920634920634
sk0.1935483870967742
be0.1891891891891892
tr0.1891891891891892
az0.17355371900826447
et0.17355371900826447
is0.17355371900826447
lt0.17355371900826447
lv0.17355371900826447
uk0.17355371900826447
reliabletrue
passestrue
10
name"Marie"
dialogue"Fais attention…"
detectedLang"en"
heavyLang"fr"
scores
en0.7685185185185185
fr0.7685185185185185
no0.6794871794871795
tl0.6563573883161512
de0.6428571428571429
it0.6376811594202898
da0.635036496350365
sv0.6282527881040892
yo0.6153846153846154
nl0.5983935742971888
fi0.5918367346938775
lv0.574468085106383
zh0.4350282485875706
es0.42857142857142855
ro0.4117647058823529
az0.40119760479041916
hr0.40119760479041916
ms0.40119760479041916
sl0.40119760479041916
sq0.40119760479041916
lt0.38650306748466257
pt0.38650306748466257
ca0.3710691823899371
et0.3710691823899371
reliabletrue
passestrue