Run: 2026-03-06-01KK1GMARRAH6MB0Z13ZK2XNA0

Run Details

Model:
Inception Mercury
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1.4s
Cost:
$0.000218
Provider:
Inception

Evaluation summary

Score Evaluator
Details Link
54.55% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Mujhe lagta hai ki kuch ajeeb ho raha hai..." Hunter: "What... what are you saying?" Selvi: "Log missing ho rahe hain, aur har koi darr mein hai..." Hunter: "I don't understand, but I can sense something's wrong." Selvi: "Kya aap samajh pa rahe hain?" Hunter: "No, I don't know Hindi, but I can see the worry in your eyes." Selvi: "Yeh town Alborn mein behtar log missing ho rahe hain, aur main sochti hoon ki koi chhupa hua sach hai..." Hunter: "Can you tell me more about the disappearances?" Selvi: "Maine pehle hi ek photograph li thi, aur main dekh rahi thi ki log apne gharon se nikal rahe the..." Hunter: "Okay, note that down. Thanks for sharing." Hunter: "Sorry, I have to go. My phone just rang."
created_at"2026-03-06T12:05:49.471Z" 3/6/2026, 12:05:49 PM
model"inception/mercury"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1084
moderation_latency(null)
generation_time1371
tokens_prompt315
tokens_completion191
native_tokens_prompt269
native_tokens_completion211
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached32
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0002183
router(null)
provider_responses
0
endpoint_id"da1082ea-721e-460e-b330-034ae7aefc7f"
id"chatcmpl-f541b04b-0ffd-468f-89a9-a093814ea749"
is_byokfalse
latency57
model_permaslug"inception/mercury"
provider_name"Inception"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1772798749-aTlsvSip4yPRH14Yhoiq"
upstream_id"chatcmpl-f541b04b-0ffd-468f-89a9-a093814ea749"
total_cost0.0002183
cache_discount0.0000072
upstream_inference_cost0
provider_name"Inception"

Evaluation details

Result Evaluator Details Meta Data
54.55% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mujhe lagta hai ki kuch ajeeb ho raha hai..."
detectedLang"it"
heavyLang"et"
scores
it0.42827442827442824
vi0.36342592592592593
az0.36194895591647336
sl0.3574766355140187
et0.33894230769230765
hu0.3055555555555556
ca0.3037974683544304
yo0.2912371134020619
no0.28756476683937826
sk0.28756476683937826
cs0.27821522309711283
tr0.2744063324538259
reliablefalse
passesfalse
1
name"Hunter"
dialogue"What... what are you saying?"
detectedLang"en"
heavyLang"en"
scores
en0.8497596153846154
tl0.5874587458745875
ro0.5421245421245421
tr0.4444444444444444
cs0.3842364532019704
reliabletrue
passestrue
2
name"Selvi"
dialogue"Log missing ho rahe hain, aur har koi darr mein hai..."
detectedLang"no"
heavyLang"it"
scores
no0.5384615384615384
da0.49748743718592964
it0.4746059544658494
sv0.4594594594594595
ms0.4174757281553398
de0.3963782696177062
en0.3939393939393939
ca0.3902439024390244
nl0.3697478991596639
vi0.3435448577680525
is0.336283185840708
eu0.3150684931506849
sk0.27007299270072993
cs0.26108374384236455
ro0.25925925925925924
tl0.2518703241895262
fi0.20634920634920634
fr0.1935483870967742
az0.1780821917808219
et0.1780821917808219
pt0.1780821917808219
reliablefalse
passesfalse
3
name"Hunter"
dialogue"I don't understand, but I can sense something's wrong."
detectedLang"en"
heavyLang"en"
scores
en0.7865528281750267
no0.5614035087719298
da0.5604395604395604
ca0.51278928136419
tl0.4910941475826972
sv0.465954606141522
pl0.4065281899109792
it0.4020926756352765
de0.39668174962292607
nl0.3902439024390244
fr0.3893129770992366
pt0.375
ro0.36908517350157727
es0.3670886075949367
vi0.35170178282009723
cs0.32088285229202035
sk0.28698752228163993
ms0.28186714542190305
tr0.2687385740402194
az0.25925925925925924
hr0.25788497217068646
is0.25512104283054005
sq0.250936329588015
yo0.17864476386036962
be0.14893617021276595
hu0.14346895074946467
et0.13606911447084233
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
reliabletrue
passestrue
4
name"Selvi"
dialogue"Kya aap samajh pa rahe hain?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.580335731414868
lv0.5370370370370371
sl0.4615384615384615
eu0.44089456869009586
hr0.38162544169611307
sq0.37722419928825623
et0.37275985663082434
fi0.37275985663082434
yo0.37050359712230213
is0.36823104693140796
no0.36363636363636365
da0.32950191570881227
lt0.3217054263565891
sv0.3137254901960784
ms0.2886178861788618
reliablefalse
passesfalse
5
name"Hunter"
dialogue"No, I don't know Hindi, but I can see the worry in your eyes."
detectedLang"en"
heavyLang"en"
scores
en0.812821712681329
tl0.6967399545109931
it0.5260663507109005
ca0.4666666666666667
no0.45725915875169604
et0.4497936726272352
sv0.4467496542185339
sq0.42775393419170243
pl0.41605839416058393
yo0.41348973607038125
hr0.375
nl0.375
tr0.3700787401574803
ro0.3670886075949367
ms0.36608557844690964
az0.358974358974359
da0.35170178282009723
lv0.3265993265993266
fr0.29328621908127206
sk0.2895204262877442
is0.28698752228163993
sl0.2779783393501805
de0.2687385740402194
pt0.25650557620817843
es0.25512104283054005
cs0.2079207920792079
hi0.16317991631799164
be0.14893617021276595
hu0.14346895074946467
lt0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
6
name"Selvi"
dialogue"Yeh town Alborn mein behtar log missing ho rahe hain, aur main sochti hoon ki koi chhupa hua sach hai..."
detectedLang"en"
heavyLang"ber"
scores
en0.39671814671814676
de0.3055555555555556
it0.3024553571428571
az0.26122931442080377
ms0.25595238095238093
tr0.2460796139927624
no0.2368742368742369
ca0.2350061199510404
nl0.21972534332084895
fr0.20382165605095542
vi0.20076726342711
sl0.19665809768637532
is0.19562419562419564
da0.1819371727748691
eu0.18086500655307994
hu0.16219839142091153
yo0.15311653116531165
sk0.15081521739130435
cs0.14500683994528044
ro0.14383561643835618
tl0.1391184573002755
sq0.13793103448275862
sv0.13314840499306518
fi0.11095305832147938
et0.09420289855072464
pt0.09420289855072464
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Can you tell me more about the disappearances?"
detectedLang"en"
heavyLang"en"
scores
en0.8195446973903386
fr0.59727385377943
nl0.45652173913043476
ms0.4444444444444444
tl0.4406196213425129
pt0.4337979094076655
ca0.4122965641952984
sq0.41016333938294003
es0.3701550387596899
no0.36399217221135033
sl0.3512974051896207
it0.3394308943089431
yo0.2476851851851852
et0.2261904761904762
cs0.1935483870967742
da0.1935483870967742
hr0.1935483870967742
sv0.1935483870967742
az0.19154228855721395
tr0.19154228855721395
fi0.1875
lv0.18546365914786966
reliabletrue
passestrue
8
name"Selvi"
dialogue"Maine pehle hi ek photograph li thi, aur main dekh rahi thi ki log apne gharon se nikal rahe the..."
detectedLang"en"
heavyLang"vi"
scores
en0.5434623813002191
fr0.5229007633587787
tl0.45367132867132864
ro0.4164332399626517
yo0.39320388349514557
ca0.37311935807422264
sl0.36740890688259115
hr0.3441762854144806
tr0.31991294885745375
ms0.31394072447859495
sq0.30011198208286677
fi0.29775280898876405
es0.29537767756482525
de0.2647058823529412
cs0.259478672985782
nl0.22744128553770088
it0.22360248447204967
da0.21383647798742136
no0.21383647798742136
sv0.20785804816223066
et0.20685279187817257
az0.1997439180537772
vi0.19871794871794873
hu0.16219839142091153
pt0.15994623655913978
lv0.12342215988779803
hi0.10968660968660969
lt0.10586552217453504
pl0.10586552217453504
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Okay, note that down. Thanks for sharing."
detectedLang"en"
heavyLang"en"
scores
en0.819277108433735
tl0.6875
da0.5544554455445544
no0.5526838966202784
nl0.5054945054945055
ms0.4289340101522843
vi0.39189189189189183
sv0.336283185840708
fr0.30769230769230765
pt0.27652733118971057
de0.267100977198697
sq0.2549668874172185
reliabletrue
passestrue
10
name"Hunter"
dialogue"Sorry, I have to go. My phone just rang."
detectedLang"en"
heavyLang"en"
scores
en0.7897553516819572
tl0.6409921671018277
da0.6283783783783783
pl0.626358695652174
cs0.5393634840871022
yo0.5225694444444445
sk0.5132743362831859
hr0.4811320754716981
no0.48015122873345933
sv0.46601941747572817
ca0.4387755102040817
it0.4387755102040817
vi0.416135881104034
fr0.4073275862068965
lv0.40217391304347827
lt0.3778280542986425
et0.375
sq0.3276283618581907
sl0.3055555555555556
pt0.26666666666666666
ro0.24657534246575344
de0.21428571428571427
nl0.21428571428571427
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
reliabletrue
passestrue