Run: 2026-03-06-01KK1HXKDN08FY29ZZSANPPE62

Run Details

Model:
Inception Mercury 2
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1.3s
Cost:
$0.000530
Provider:
Inception

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: “मैं यहाँ बैठी हूँ, कैमरे में देख रही हूँ… यह सब बहुत अजीब लग रहा है।” Hunter: “Excuse me, are you Selvi? I’m Detective Hunter. Have you heard anything about the recent disappearance?” Selvi: “वह आदमी… वह रात में गया था, और फिर… फिर वह नहीं आया। मैं बहुत परेशान हूँ।” Hunter: “I’m sorry, I don’t understand… could you…?” Selvi: “मैं… मैं बस यहाँ हूँ, और मैं नहीं जानती कि क्या हुआ। यह सब बहुत डरावना है।” Hunter: “Okay, I’ll… I’ll keep looking. If you remember anything, please let me know.” Selvi: “धन्यवाद… मैं कोशिश करूँगी याद रखने की।” Hunter: “Hold on, I’m getting a call. I have to go now.” Selvi: “ठीक है, कृपया सुरक्षित रहें।”
created_at"2026-03-06T12:28:21.82Z" 3/6/2026, 12:28:21 PM
model"inception/mercury-2-20260304"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1199
moderation_latency(null)
generation_time1267
tokens_prompt315
tokens_completion613
native_tokens_prompt265
native_tokens_completion620
native_tokens_completion_images(null)
native_tokens_reasoning419
native_tokens_cached6
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0005299
router(null)
provider_responses
0
endpoint_id"c2a24e34-c306-4b4d-9e2f-b162c2d8bf0e"
id"chatcmpl-bed0c173-c80f-427b-be82-a6be0f91192a"
is_byokfalse
latency52
model_permaslug"inception/mercury-2-20260304"
provider_name"Inception"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1772800101-vbyJDCfAKFWuCW0vIQXj"
upstream_id"chatcmpl-bed0c173-c80f-427b-be82-a6be0f91192a"
total_cost0.0005299
cache_discount0.00000135
upstream_inference_cost0
provider_name"Inception"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"“मैं यहाँ बैठी हूँ, कैमरे में देख रही हूँ… यह सब बहुत अजीब लग रहा है।”"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8814655172413793
mr0.876376713868285
reliabletrue
passestrue
1
name"Hunter"
dialogue"“Excuse me, are you Selvi? I’m Detective Hunter. Have you heard anything about the recent disappearance?”"
detectedLang"en"
heavyLang"en"
scores
en0.7953711543889359
tl0.5850028620492272
fr0.5107962213225371
da0.4738751814223512
nl0.4700292397660819
ro0.4520030234315949
sq0.42551505546751184
it0.4232299124900557
no0.40622440622440625
pt0.39583333333333337
ca0.3855932203389831
es0.358974358974359
ms0.3538324420677362
sv0.34566787003610105
cs0.3330266789328427
sl0.3192488262910798
de0.24479166666666666
sk0.22376873661670238
hr0.20678336980306347
fi0.2032967032967033
yo0.186307519640853
et0.11585365853658537
pl0.08690176322418136
lt0.0799492385786802
tr0.07525510204081631
reliabletrue
passestrue
2
name"Selvi"
dialogue"“वह आदमी… वह रात में गया था, और फिर… फिर वह नहीं आया। मैं बहुत परेशान हूँ।”"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8830409356725146
mr0.8707453683757002
reliabletrue
passestrue
3
name"Hunter"
dialogue"“I’m sorry, I don’t understand… could you…?”"
detectedLang"en"
heavyLang"en"
scores
en0.8144977168949772
tl0.6746746746746748
no0.576271186440678
da0.5751633986928104
sv0.5178041543026707
cs0.45101351351351354
it0.3981481481481482
pl0.385633270321361
de0.3725868725868726
nl0.3538767395626242
ro0.33537832310838445
sk0.33127572016460904
hr0.2995689655172413
ca0.29805615550755943
is0.29653679653679654
sq0.2919389978213508
fr0.2562929061784897
pt0.23529411764705882
yo0.2111650485436893
be0.17721518987341772
tr0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
et0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
4
name"Selvi"
dialogue"“मैं… मैं बस यहाँ हूँ, और मैं नहीं जानती कि क्या हुआ। यह सब बहुत डरावना है।”"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8787687117857895
mr0.8674809864023969
reliabletrue
passestrue
5
name"Hunter"
dialogue"“Okay, I’ll… I’ll keep looking. If you remember anything, please let me know.”"
detectedLang"en"
heavyLang"en"
scores
en0.8125493291239149
tl0.6051537822111388
nl0.4391971664698937
no0.4235436893203884
ms0.4135802469135802
sl0.4032663316582915
sv0.4032663316582915
fr0.35549525101763907
sq0.343015214384509
da0.33286516853932585
de0.3319268635724332
is0.32142857142857145
cs0.2857142857142857
yo0.2846385542168675
hu0.2714723926380368
et0.2669753086419753
pt0.250788643533123
sk0.2122719734660033
es0.17677642980935876
ro0.1739130434782609
it0.14414414414414414
fi0.13636363636363635
reliabletrue
passestrue
6
name"Selvi"
dialogue"“धन्यवाद… मैं कोशिश करूँगी याद रखने की।”"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8816287878787878
mr0.8796534017971759
reliabletrue
passestrue
7
name"Hunter"
dialogue"“Hold on, I’m getting a call. I have to go now.”"
detectedLang"en"
heavyLang"en"
scores
en0.8341836734693877
tl0.6886973180076629
da0.6384872080088987
pl0.6319365798414496
hr0.6162927981109798
yo0.6036585365853658
cs0.5768229166666667
sk0.5572207084468664
no0.5566166439290586
it0.5560109289617486
ca0.5343839541547278
ro0.4766505636070853
sv0.46369636963696376
et0.4628099173553719
lv0.43965517241379315
lt0.4337979094076655
fr0.41016333938294003
hu0.40693430656934304
fi0.3959107806691449
is0.3959107806691449
sl0.39365671641791045
pt0.3890977443609023
sq0.3879472693032015
nl0.3460764587525151
ms0.32150313152400833
de0.3114406779661017
tr0.3114406779661017
az0.2903930131004367
vi0.2903930131004367
es0.28884026258205686
hi0.20537897310513448
be0.17721518987341772
eu0.17721518987341772
uk0.16237113402061853
reliabletrue
passestrue
8
name"Selvi"
dialogue"“ठीक है, कृपया सुरक्षित रहें।”"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8871100164203612
mr0.8854643898375677
reliabletrue
passestrue