Run: 2026-03-06-01KK1GPC8ZYFJ6NAC803SC726X

Run Details

Model:
Inception Mercury 2
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1.4s
Cost:
$0.000662
Provider:
Inception

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "मैं यहाँ की सड़कों को देख रही थी, और अचानक वह आवाज़ सुनाई दी।" Hunter: "Excuse me, I’m Detective Hunter. Have you seen anything unusual today?" Selvi: "मैं… मैं बहुत परेशान हूँ। मैं नहीं समझती कि क्या हुआ।" Hunter: "I’m sorry, I don’t understand. Could you try to tell me in English?" Selvi: "मैं अंग्रेज़ी नहीं बोलती। मैं सिर्फ़ फ़ोटो ले रही थी।" Hunter: "Okay, just point to anything that seemed odd." Selvi: "यहाँ, वह पेड़ के पास… कुछ लोग जल्दी से चले गए।" Hunter: "Got it. I’ll note that. Thanks." Hunter (checking his phone): "Hold on, I’m getting a call." Hunter: "Sorry, I have to go. I’ll be back later." Selvi: "धन्यवाद। कृपया जल्द वापस आएँ।"
created_at"2026-03-06T12:06:56.55Z" 3/6/2026, 12:06:56 PM
model"inception/mercury-2-20260304"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1327
moderation_latency(null)
generation_time1389
tokens_prompt315
tokens_completion500
native_tokens_prompt267
native_tokens_completion796
native_tokens_completion_images(null)
native_tokens_reasoning585
native_tokens_cached6
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0006624
router(null)
provider_responses
0
endpoint_id"c2a24e34-c306-4b4d-9e2f-b162c2d8bf0e"
id"chatcmpl-39a81a51-5e7d-46a5-b798-6499c2d54460"
is_byokfalse
latency99
model_permaslug"inception/mercury-2-20260304"
provider_name"Inception"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1772798816-k6XxqzDeBuLmhdjhGlbP"
upstream_id"chatcmpl-39a81a51-5e7d-46a5-b798-6499c2d54460"
total_cost0.0006624
cache_discount0.00000135
upstream_inference_cost0
provider_name"Inception"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"मैं यहाँ की सड़कों को देख रही थी, और अचानक वह आवाज़ सुनाई दी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8831557300429987
mr0.8695470674180755
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, I’m Detective Hunter. Have you seen anything unusual today?"
detectedLang"en"
heavyLang"en"
scores
en0.7878659312685617
tl0.5715509854327335
pt0.5
es0.4802494802494803
sq0.4444444444444444
fr0.41588785046728977
it0.3872549019607844
da0.3849938499384994
ro0.3834771886559803
ms0.3734335839598998
no0.33244325767690247
ca0.3234100135317997
nl0.31412894375857336
sl0.299719887955182
et0.2857142857142857
de0.25595238095238093
cs0.23076923076923078
sv0.21507064364207218
yo0.1482112436115843
fi0.13043478260869565
hr0.11816578483245149
tr0.10554561717352416
reliabletrue
passestrue
2
name"Selvi"
dialogue"मैं… मैं बहुत परेशान हूँ। मैं नहीं समझती कि क्या हुआ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8801597869507324
mr0.8754842280022136
reliabletrue
passestrue
3
name"Hunter"
dialogue"I’m sorry, I don’t understand. Could you try to tell me in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8179832544594102
tl0.6309963099630996
no0.5915032679738562
da0.5519713261648745
sv0.5136186770428015
nl0.5088408644400786
it0.4692144373673036
pl0.4582881906825569
de0.4517543859649123
cs0.44320712694877507
ro0.43052391799544415
sl0.4206257242178447
hr0.3954050785973398
yo0.3842364532019704
sk0.36948297604035313
sq0.36061381074168797
ms0.3160054719562244
fr0.28876244665718354
pt0.2732558139534884
lv0.27007299270072993
lt0.25037481259370314
et0.2401215805471125
az0.22720247295208654
ca0.2163009404388715
is0.21507064364207218
es0.16943521594684383
fi0.13043478260869565
be0.12280701754385964
tr0.12280701754385964
hu0.11816578483245149
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
4
name"Selvi"
dialogue"मैं अंग्रेज़ी नहीं बोलती। मैं सिर्फ़ फ़ोटो ले रही थी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8877443211833069
mr0.8820754716981132
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay, just point to anything that seemed odd."
detectedLang"en"
heavyLang"en"
scores
en0.8031496062992126
tl0.6567505720823799
da0.4614003590664273
pl0.4307400379506641
no0.4163424124513619
fr0.40476190476190477
yo0.3135011441647597
sk0.3055555555555556
cs0.30394431554524365
lv0.2890995260663507
sl0.28741092636579574
hr0.27884615384615385
lt0.25742574257425743
et0.2537313432835821
sv0.2537313432835821
sq0.25
ms0.20634920634920634
ca0.20424403183023873
reliabletrue
passestrue
6
name"Selvi"
dialogue"यहाँ, वह पेड़ के पास… कुछ लोग जल्दी से चले गए।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8829953198127926
mr0.8703917050691244
reliabletrue
passestrue
7
name"Hunter"
dialogue"Got it. I’ll note that. Thanks."
detectedLang"en"
heavyLang"en"
scores
en0.8341625207296849
tl0.5798319327731093
vi0.42028985507246375
nl0.358974358974359
fr0.3333333333333333
lv0.3006993006993007
sq0.3006993006993007
yo0.2753623188405797
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hold on, I’m getting a call."
detectedLang"en"
heavyLang"en"
scores
en0.828030954428203
tl0.7054491899852725
it0.5934959349593496
hr0.5717344753747323
ca0.5402298850574713
fr0.5305164319248826
et0.5203836930455635
fi0.5157384987893463
cs0.5085995085995086
pt0.5085995085995086
ro0.5073891625615764
sk0.5061728395061729
yo0.49238578680203043
pl0.48586118251928023
da0.4791666666666667
nl0.46236559139784944
hu0.43820224719101125
ms0.4350282485875706
no0.4350282485875706
is0.42857142857142855
de0.42363112391930835
sv0.41690962099125367
es0.39759036144578314
sl0.3103448275862069
hi0.29577464788732394
lt0.2907801418439716
tr0.2779783393501805
sq0.2647058823529412
az0.25925925925925924
eu0.25925925925925924
lv0.25925925925925924
vi0.25925925925925924
reliabletrue
passestrue
9
name"Hunter"
dialogue"Sorry, I have to go. I’ll be back later."
detectedLang"en"
heavyLang"en"
scores
en0.8161764705882353
tl0.6706915477497256
da0.6173469387755102
pl0.5973154362416108
yo0.5780590717299579
no0.5348837209302325
lt0.48186528497409326
hr0.4594594594594595
cs0.44029850746268656
sv0.42748091603053434
it0.4174757281553398
nl0.4106090373280943
sk0.40476190476190477
lv0.3814432989690722
hu0.38016528925619836
pt0.3630573248407643
de0.34210526315789475
ca0.3150684931506849
sq0.3087557603686636
sl0.28741092636579574
ro0.23076923076923078
hi0.20212765957446807
fr0.19137466307277629
be0.1891891891891892
tr0.1891891891891892
az0.17355371900826447
et0.17355371900826447
is0.17355371900826447
uk0.17355371900826447
vi0.17355371900826447
reliabletrue
passestrue
10
name"Selvi"
dialogue"धन्यवाद। कृपया जल्द वापस आएँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8727735368956743
mr0.8662079510703364
reliabletrue
passestrue