Run: 2026-03-11-01KKFDAVFKT1BERZ6PGNN818BS

Run Details

Model:
Nemotron 3 Super
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
1m 21s
Cost:
$0.000000
Provider:
Nvidia

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Hey, I’m Detective Hunter. I’m looking into the recent disappearance near the old mill. Did you notice anything unusual?" Marie: "Je… je n’ai rien vu de net, mais j’ai entendu des bruits étranges derrière moi." Hunter: "Sorry, I don’t understand French. Could you say that again in English?" Marie: "Je ne parle pas anglais. J’ai vu une silhouette près du lac, vêtue d’un manteau sombre." Hunter: "Okay, thanks. Do you know what time this happened?" Marie: "Vers minuit, juste après le feu d’artifice du festival des pommes." Hunter: "Got it. I’ve got to take this call—excuse me."
created_at"2026-03-11T21:37:35.233Z" 3/11/2026, 9:37:35 PM
model"nvidia/nemotron-3-super-120b-a12b-20230311:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency37622
moderation_latency(null)
generation_time80715
tokens_prompt333
tokens_completion1269
native_tokens_prompt280
native_tokens_completion1123
native_tokens_completion_images(null)
native_tokens_reasoning1105
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
endpoint_id"970aecad-f13b-4ec3-9362-e1758aea3e56"
id"chatcmpl-a38d6d011b37ac0f"
is_byokfalse
latency237
model_permaslug"nvidia/nemotron-3-super-120b-a12b-20230311"
provider_name"Nvidia"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773265055-XJDQDO3EMH1dUDVZVyan"
upstream_id"chatcmpl-a38d6d011b37ac0f"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Nvidia"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Hey, I’m Detective Hunter. I’m looking into the recent disappearance near the old mill. Did you notice anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7925311203319502
tl0.6163682864450128
fr0.5440729483282675
nl0.46846208362863223
pt0.44812362030905084
ro0.42263279445727486
it0.41905499612703334
es0.38524590163934425
sv0.37707641196013286
cs0.37290969899665555
no0.3466898954703833
da0.3444055944055944
ms0.34210526315789475
sq0.3415276558384548
ca0.33510638297872336
de0.29577464788732394
sk0.27395934172313646
hr0.2668621700879765
sl0.251497005988024
yo0.1812227074235808
lv0.13693901035673187
et0.12280701754385964
is0.08647990255785627
pl0.08424908424908424
lt0.07749077490774908
tr0.07292954264524104
reliabletrue
passestrue
1
name"Marie"
dialogue"Je… je n’ai rien vu de net, mais j’ai entendu des bruits étranges derrière moi."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8111510791366906
nl0.5650372825186413
ca0.563953488372093
pt0.515235457063712
en0.43058568329718006
es0.37796208530805686
cs0.358974358974359
de0.35344827586206895
da0.336283185840708
yo0.3286445012787723
sk0.3251928020565552
tr0.3155149934810952
tl0.3073878627968338
ro0.2981283422459893
sv0.26675977653631283
no0.25426136363636365
eu0.2532005689900427
sl0.24785100286532946
hr0.2456896551724138
lt0.17061611374407584
hu0.15594855305466235
pl0.14772727272727273
et0.12790697674418602
zh0.12353923205342236
it0.11317567567567569
az0.10714285714285714
ms0.10714285714285714
sq0.10714285714285714
reliabletrue
passestrue
2
name"Hunter"
dialogue"Sorry, I don’t understand French. Could you say that again in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8228834573149132
tl0.634235552304316
nl0.5164410058027079
sv0.5136186770428015
no0.51171875
da0.5059288537549407
it0.4675186368477103
de0.4517543859649123
ro0.43052391799544415
pl0.3654822335025381
cs0.34810951760104303
hr0.29676511954992973
pt0.2784992784992785
yo0.25925925925925924
sk0.24357034795764
sl0.23547400611620795
az0.22720247295208654
ms0.22720247295208654
ca0.2163009404388715
is0.21507064364207218
sq0.21135646687697163
fr0.1830065359477124
es0.1638795986622074
be0.12280701754385964
tr0.12280701754385964
hu0.11816578483245149
et0.11190053285968028
lt0.11190053285968028
lv0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
3
name"Marie"
dialogue"Je ne parle pas anglais. J’ai vu une silhouette près du lac, vêtue d’un manteau sombre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7753973738769868
ca0.6029321930360415
it0.49768160741885625
sl0.44491887275832626
lt0.44396920444824634
tr0.3737957610789981
sq0.37076476282671833
cs0.36399217221135033
es0.35834155972359333
nl0.35770750988142297
hr0.34804413239719156
ro0.34541792547834843
lv0.34343434343434337
de0.34277047522750254
da0.3107104984093319
no0.30851063829787234
sk0.3055555555555556
hu0.2919389978213508
sv0.2111650485436893
yo0.2004920049200492
pl0.19554455445544552
pt0.19554455445544552
ms0.18444165621079048
eu0.1792929292929293
en0.1709183673469388
vi0.1321762349799733
tl0.12398921832884095
fi0.11924119241192413
az0.09722222222222222
et0.08835904628330996
reliabletrue
passestrue
4
name"Hunter"
dialogue"Okay, thanks. Do you know what time this happened?"
detectedLang"en"
heavyLang"en"
scores
en0.8236331569664903
tl0.6124031007751938
vi0.460431654676259
pt0.4444444444444444
cs0.4129158512720157
hr0.40476190476190477
pl0.3227990970654628
sk0.3055555555555556
sl0.2857142857142857
sq0.2805755395683453
nl0.27184466019417475
yo0.20634920634920634
da0.2
no0.2
reliabletrue
passestrue
5
name"Marie"
dialogue"Vers minuit, juste après le feu d’artifice du festival des pommes."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7907949790794979
ca0.6400287976961844
it0.570446735395189
ro0.5507637017070979
en0.5224450811843362
da0.5093228655544652
de0.506416584402764
es0.5054401582591495
pt0.49748743718592964
et0.491353001017294
tl0.4807892004153686
nl0.45711183496199786
no0.45593035908596297
sl0.4292237442922375
sv0.4212962962962963
hr0.40119760479041916
ms0.37888198757763975
lt0.3630573248407643
sk0.3597951344430218
cs0.3438320209973753
sq0.34210526315789475
eu0.29873772791023845
hu0.24812030075187969
fi0.2125984251968504
pl0.20127795527156547
yo0.19614147909967844
az0.19093851132686085
vi0.1652754590984975
is0.14965986394557826
tr0.11816578483245149
lv0.11190053285968028
reliabletrue
passestrue
6
name"Hunter"
dialogue"Got it. I’ve got to take this call—excuse me."
detectedLang"en"
heavyLang"en"
scores
en0.8087621696801112
tl0.6164574616457461
sl0.5106761565836299
sq0.45972495088408644
yo0.4364754098360656
lv0.43064182194616984
no0.42105263157894735
pl0.32926829268292684
sk0.32432432432432434
cs0.3226600985221675
hr0.2966751918158568
da0.2744063324538259
lt0.2744063324538259
es0.27055702917771884
et0.25675675675675674
fr0.2486338797814208
pt0.24242424242424243
ms0.233983286908078
nl0.233983286908078
it0.22535211267605632
fi0.21428571428571427
reliabletrue
passestrue