Run: 2026-03-11-01KKFCF16BVVFR8R804ZZNWHT4

Run Details

Model:
Nemotron 3 Super
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
32.4s
Cost:
$0.000000
Provider:
Nvidia

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Hey, excuse me. I'm Detective Hunter. Have you noticed anything odd around the town lately?" Marie: "Je... je n'ose pas vraiment parler, mais j'ai entendu des pas dans la ruelle derrière le café hier soir." Hunter: "I'm sorry, I don't speak French. Can you repeat that in English?" Marie: "Non, je ne parle pas anglais... J'ai vu une lumière étrange près de l'ancien entrepôt." Hunter: "A strange light near the old warehouse? Did you see anyone?" Marie: "Oui, une silhouette vêtue de noir, puis elle a disparu dans la brume." Hunter: "Sorry, I've got to take this. Thanks for your help." Marie: "Faites attention, s'il vous plaît."
created_at"2026-03-11T21:22:23.575Z" 3/11/2026, 9:22:23 PM
model"nvidia/nemotron-3-super-120b-a12b-20230311:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency6599
moderation_latency(null)
generation_time32335
tokens_prompt333
tokens_completion1277
native_tokens_prompt280
native_tokens_completion1183
native_tokens_completion_images(null)
native_tokens_reasoning1105
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
endpoint_id"970aecad-f13b-4ec3-9362-e1758aea3e56"
id"chatcmpl-ae437ad60826b746"
is_byokfalse
latency252
model_permaslug"nvidia/nemotron-3-super-120b-a12b-20230311"
provider_name"Nvidia"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773264143-6nozW2FMNOkeu9g3wOY3"
upstream_id"chatcmpl-ae437ad60826b746"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Nvidia"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Hey, excuse me. I'm Detective Hunter. Have you noticed anything odd around the town lately?"
detectedLang"en"
heavyLang"en"
scores
en0.7930320800275957
tl0.5370370370370371
fr0.45848375451263534
sq0.4434137291280148
no0.4280266920877026
nl0.4129158512720157
it0.40298507462686567
pt0.3969849246231156
da0.39455095862764883
es0.38080495356037153
ro0.3413830954994512
ms0.3325917686318131
de0.29245283018867924
ca0.28486293206197855
sv0.26380368098159507
sl0.2628992628992629
fi0.20318725099601595
sk0.20212765957446807
cs0.2
lv0.16550764951321278
yo0.15134370579915135
et0.1366906474820144
hi0.11242603550295857
pl0.11242603550295857
hr0.10044977511244377
tr0.08952959028831564
reliabletrue
passestrue
1
name"Marie"
dialogue"Je... je n'ose pas vraiment parler, mais j'ai entendu des pas dans la ruelle derrière le café hier soir."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7989483451902258
nl0.5703899537343027
ca0.5634654130288784
pt0.5213549337260678
it0.4857594936708861
de0.47197400487408614
es0.4425385934819897
ro0.4328097731239092
no0.4106980961015413
yo0.4036697247706422
cs0.3925233644859813
sq0.3803622497616778
da0.37977099236641226
sk0.3725868725868726
sl0.35194416749750745
tl0.33605720122574056
hr0.31362196409714893
en0.28017718715393136
tr0.27697441601779754
hu0.25968109339407747
lt0.2571428571428571
pl0.2571428571428571
az0.2450638792102207
eu0.23439340400471145
et0.22062350119904073
ms0.18444165621079048
sv0.15803108808290156
fi0.15474642392717813
vi0.11444141689373298
lv0.08321579689703808
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry, I don't speak French. Can you repeat that in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8043478260869565
tl0.5894160583941606
it0.4938132733408324
ro0.46428571428571425
sv0.41329856584093866
ca0.4007989347536618
pt0.37413073713490963
no0.3353028064992614
az0.33234421364985167
de0.3273542600896861
da0.31921331316187596
hr0.31921331316187596
pl0.3181818181818182
cs0.2890995260663507
yo0.27999999999999997
es0.27884615384615385
nl0.25742574257425743
sl0.2549668874172185
ms0.24623115577889448
tr0.24623115577889448
sq0.22945205479452058
sk0.13793103448275862
be0.1346153846153846
hu0.12959381044487428
et0.12280701754385964
is0.12280701754385964
lt0.12280701754385964
lv0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
3
name"Marie"
dialogue"Non, je ne parle pas anglais... J'ai vu une lumière étrange près de l'ancien entrepôt."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8157074000567054
ca0.6205487448920024
it0.5019157088122606
nl0.48899371069182396
en0.4619205298013245
sq0.4500846023688663
sl0.44491887275832626
ro0.4237588652482269
es0.3964716805942433
lt0.39422180801491147
pt0.38967136150234744
cs0.36399217221135033
hr0.34804413239719156
da0.3186582809224318
de0.3186582809224318
no0.3055555555555556
sk0.3055555555555556
yo0.28335170893054024
lv0.282560706401766
tr0.2785793562708102
sv0.2777777777777778
hu0.27455357142857145
tl0.2655367231638418
ms0.24418604651162787
et0.20537897310513448
fi0.20147420147420148
pl0.19554455445544552
eu0.19454770755885997
az0.1698595146871009
reliabletrue
passestrue
4
name"Hunter"
dialogue"A strange light near the old warehouse? Did you see anyone?"
detectedLang"en"
heavyLang"en"
scores
en0.8095238095238095
tl0.6927803379416283
fr0.5589856670341786
nl0.5327102803738317
de0.5266272189349113
no0.517490952955368
da0.5121951219512195
yo0.42857142857142855
cs0.4227994227994228
et0.42196531791907516
sk0.35275080906148865
ro0.3485342019543974
sv0.3474714518760196
sq0.34318555008210183
it0.34210526315789475
ms0.33774834437086093
hr0.33444259567387685
pl0.313893653516295
sl0.3079584775086505
hu0.2805755395683453
lt0.27140255009107467
is0.26199261992619927
lv0.25925925925925924
pt0.25925925925925924
ca0.2537313432835821
tr0.2537313432835821
es0.24812030075187969
az0.2438563327032136
eu0.14893617021276595
vi0.14893617021276595
fi0.13606911447084233
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui, une silhouette vêtue de noir, puis elle a disparu dans la brume."
detectedLang"fr"
heavyLang"fr"
scores
fr0.773071104387292
es0.5522388059701493
ca0.55
it0.5477386934673367
ro0.5468277945619335
da0.469964664310954
no0.46428571428571425
pt0.4636471990464839
hu0.45255474452554745
nl0.4039735099337748
yo0.4039735099337748
de0.39271255060728744
sq0.38524590163934425
en0.38271604938271603
tr0.3635077793493635
tl0.33920704845814975
cs0.3087557603686636
sk0.3066255778120185
sv0.2822966507177033
vi0.2549668874172185
eu0.23728813559322032
az0.22813036020583194
ms0.21875
hr0.199288256227758
pl0.1891891891891892
sl0.16666666666666666
lt0.15413533834586465
is0.14285714285714285
lv0.1346153846153846
et0.12280701754385964
fi0.12280701754385964
reliabletrue
passestrue
6
name"Hunter"
dialogue"Sorry, I've got to take this. Thanks for your help."
detectedLang"en"
heavyLang"en"
scores
en0.8236331569664903
tl0.6432818073721759
no0.4708994708994709
da0.46714031971580816
sl0.39879759519038077
pt0.38271604938271603
vi0.3258426966292135
yo0.3135011441647597
pl0.3103448275862069
sk0.3055555555555556
cs0.30394431554524365
lv0.2890995260663507
hr0.27884615384615385
nl0.27184466019417475
lt0.25742574257425743
it0.25
ms0.20634920634920634
reliabletrue
passestrue
7
name"Marie"
dialogue"Faites attention, s'il vous plaît."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8062015503875969
en0.6955345060893099
ca0.5417515274949084
de0.5283018867924528
no0.4851258581235698
tl0.45913461538461536
it0.43890274314214467
da0.4360902255639098
sv0.4289340101522843
yo0.4155844155844156
nl0.39839572192513373
es0.3951612903225807
fi0.39189189189189183
lt0.375
lv0.375
pt0.375
et0.3679775280898876
zh0.2549668874172185
ro0.23728813559322032
az0.22945205479452058
hr0.22945205479452058
ms0.22945205479452058
sl0.22945205479452058
sq0.22945205479452058
reliabletrue
passestrue