Run: 2026-03-11-01KKFFNQKRS556FE7VGXS9KNZR

Run Details

Model:
Nemotron 3 Nano
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
9.6s
Cost:
$0.000298
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "यह घटना... मैं घबर गई हूँ।" Hunter: "Excuse me, could you tell me what you mean?" Selvi: "अरे, वो लोग गायब हो रहे हैं, मैं डर रही हूँ।" Hunter: "I'm not sure I follow. Can you explain in English?" Selvi: "मैं अभी तक कुछ नहीं देखी हूँ, लेकिन मैं बहुत परेशान हूँ।" Hunter: "I see, that must be unsettling. I'll look into it." Hunter: "Sorry, I have a call coming in. I need to step out."
created_at"2026-03-11T22:18:28.87Z" 3/11/2026, 10:18:28 PM
model"nvidia/nemotron-3-nano-30b-a3b"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency165
moderation_latency(null)
generation_time9365
tokens_prompt315
tokens_completion1843
native_tokens_prompt285
native_tokens_completion1418
native_tokens_completion_images(null)
native_tokens_reasoning1666
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason(null)
native_finish_reason(null)
usage0.00029785
router(null)
provider_responses
0
endpoint_id"2bd3912d-8b35-4818-b873-24ccfefa6cf9"
id"chatcmpl-RxCSM5BByhqKfEdaiiW8UsMH"
is_byokfalse
latency85
model_permaslug"nvidia/nemotron-3-nano-30b-a3b"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773267508-dcTkr5QCoadlOeWgYBmN"
upstream_id"chatcmpl-RxCSM5BByhqKfEdaiiW8UsMH"
total_cost0.00029785
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"यह घटना... मैं घबर गई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8743718592964824
mr0.8580278781621063
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, could you tell me what you mean?"
detectedLang"en"
heavyLang"en"
scores
en0.7991071428571429
fr0.4742990654205608
sq0.3967828418230563
es0.3119266055045872
et0.296875
no0.2879746835443038
pt0.281150159744409
sl0.281150159744409
ms0.27184466019417475
nl0.27184466019417475
it0.26229508196721313
cs0.25742574257425743
tl0.25742574257425743
fi0.25
reliabletrue
passestrue
2
name"Selvi"
dialogue"अरे, वो लोग गायब हो रहे हैं, मैं डर रही हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8805586181550901
mr0.8783682634730539
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm not sure I follow. Can you explain in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8195446973903386
tl0.6759720837487537
ro0.548611111111111
sv0.544179523141655
it0.5112781954887218
ca0.4969040247678019
de0.4715447154471545
ms0.4444444444444444
nl0.411231884057971
no0.411231884057971
tr0.40909090909090906
az0.4080145719489982
da0.39365671641791045
hr0.39365671641791045
pl0.3925233644859813
cs0.3602362204724409
yo0.35000000000000003
fr0.34343434343434337
sl0.32150313152400833
sq0.2919389978213508
es0.23529411764705882
pt0.2243436754176611
fi0.18952618453865336
sk0.181360201511335
be0.17721518987341772
hu0.1709183673469388
et0.16237113402061853
is0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
4
name"Selvi"
dialogue"मैं अभी तक कुछ नहीं देखी हूँ, लेकिन मैं बहुत परेशान हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8872858431018936
mr0.8828491096532334
reliabletrue
passestrue
5
name"Hunter"
dialogue"I see, that must be unsettling. I'll look into it."
detectedLang"en"
heavyLang"en"
scores
en0.8046875
tl0.5568685376661743
yo0.47643979057591623
no0.4594594594594595
da0.4545454545454546
sv0.441340782122905
et0.4371482176360225
de0.4360902255639098
sq0.4230769230769231
hu0.38016528925619836
lt0.3684210526315789
lv0.33184855233853006
hr0.31662870159453305
ca0.3150684931506849
pl0.29577464788732394
nl0.2805755395683453
it0.27710843373493976
cs0.25925925925925924
ms0.24812030075187969
ro0.23076923076923078
sk0.1935483870967742
be0.1891891891891892
tr0.1891891891891892
az0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
6
name"Hunter"
dialogue"Sorry, I have a call coming in. I need to step out."
detectedLang"en"
heavyLang"en"
scores
en0.823177366702938
tl0.6649484536082474
it0.6412803532008831
da0.6264367816091954
ro0.5906801007556676
pl0.5806451612903226
yo0.5701058201058201
no0.5504840940525588
ca0.5310245310245311
cs0.5310245310245311
hr0.5303468208092486
sl0.5289855072463767
pt0.5068285280728376
sk0.5068285280728376
nl0.496124031007752
sv0.48657187993680884
de0.4698205546492659
fr0.46546052631578944
et0.4491525423728813
lv0.43965517241379315
lt0.4337979094076655
es0.417562724014337
hu0.40693430656934304
az0.4003690036900369
sq0.3879472693032015
tr0.3114406779661017
is0.29805615550755943
ms0.29805615550755943
vi0.2903930131004367
be0.17721518987341772
eu0.17721518987341772
fi0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue