Run: 2026-03-11-01KKFCXAE93FH067EJRVW12192

Run Details

Model:
Nemotron 3 Nano
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
12.2s
Cost:
$0.000194
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "वह मिली नहीं रही है,Hunter ने कहा है…" Hunter: "I'm sorry, I didn't catch that." Selvi: "मैं बहुत डरी हुई हूँ… कुछ अजीब हुआ है।" Hunter: "I don't understand. Could you repeat that in English?" Selvi: "मैं नहीं कर सकती, मेरे पास सिर्फ हिंदी में बात करने का शब्द है।" Hunter: "Okay, I have to take this call now. Excuse me."
created_at"2026-03-11T21:30:11.797Z" 3/11/2026, 9:30:11 PM
model"nvidia/nemotron-3-nano-30b-a3b"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency492
moderation_latency(null)
generation_time12022
tokens_prompt315
tokens_completion1178
native_tokens_prompt285
native_tokens_completion900
native_tokens_completion_images(null)
native_tokens_reasoning1015
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason(null)
native_finish_reason(null)
usage0.00019425
router(null)
provider_responses
0
endpoint_id"2bd3912d-8b35-4818-b873-24ccfefa6cf9"
id"chatcmpl-RlIXMeNGFcS53VJrJDHyVhqW"
is_byokfalse
latency60
model_permaslug"nvidia/nemotron-3-nano-30b-a3b"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773264611-9pXQNtf5VPjdjPAgDXwz"
upstream_id"chatcmpl-RlIXMeNGFcS53VJrJDHyVhqW"
total_cost0.00019425
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"वह मिली नहीं रही है,Hunter ने कहा है…"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8720292504570384
mr0.8610559745930925
en0.33586337760910817
de0.2009132420091324
da0.1898148148148148
no0.1822429906542056
fr0.17061611374407584
sv0.16666666666666666
tl0.1606714628297362
it0.15254237288135594
nl0.15254237288135594
pt0.15254237288135594
ca0.14425427872860636
ms0.14425427872860636
ro0.14425427872860636
sl0.14425427872860636
sq0.14425427872860636
tr0.14425427872860636
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm sorry, I didn't catch that."
detectedLang"en"
heavyLang"en"
scores
en0.8015873015873016
tl0.608695652173913
it0.5631067961165048
sv0.5044052863436124
no0.39189189189189183
da0.3818681318681319
hr0.3818681318681319
ca0.38016528925619836
sq0.3732590529247911
pl0.358974358974359
cs0.3181818181818182
pt0.30769230769230765
fr0.2879746835443038
ro0.2857142857142857
yo0.27884615384615385
de0.25
sk0.24242424242424243
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
et0.21875
is0.21875
lt0.21875
lv0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue
2
name"Selvi"
dialogue"मैं बहुत डरी हुई हूँ… कुछ अजीब हुआ है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8793103448275862
mr0.87286596440247
reliabletrue
passestrue
3
name"Hunter"
dialogue"I don't understand. Could you repeat that in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8185776487663279
sv0.584717607973422
no0.5828698553948832
da0.5772266065388951
ro0.5530393325387366
tl0.5259165613147914
de0.5235069885641677
nl0.4710860366713681
pl0.43438914027149317
cs0.41588785046728977
it0.4113029827315541
ca0.37395659432387307
hr0.36006825938566556
yo0.3181818181818182
sk0.30037313432835816
sl0.29111531190926276
az0.2816091954022989
ms0.2816091954022989
is0.267578125
sq0.2632612966601179
fr0.2299794661190965
es0.16851441241685144
pt0.16851441241685144
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
4
name"Selvi"
dialogue"मैं नहीं कर सकती, मेरे पास सिर्फ हिंदी में बात करने का शब्द है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.887940234791889
mr0.8836178230990911
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay, I have to take this call now. Excuse me."
detectedLang"en"
heavyLang"en"
scores
en0.7953869047619048
tl0.6185852981969487
da0.5864661654135338
no0.5564516129032259
sl0.5106761565836299
sq0.5062836624775583
pl0.4869402985074627
hr0.4811320754716981
cs0.461839530332681
yo0.44889779559118237
sk0.4258872651356994
it0.4148936170212766
lv0.40217391304347827
lt0.3778280542986425
et0.3648960739030023
ca0.3341404358353511
sv0.3341404358353511
es0.27055702917771884
fr0.2486338797814208
ro0.24657534246575344
pt0.24242424242424243
ms0.233983286908078
nl0.233983286908078
fi0.21428571428571427
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue