Run: 2026-10-27-01M5YJ4S2E4SKK7GTJ3H5BZ3DT

Run Details

Model:
Kimi K3.1 Pro (Reasoning, Max)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
5m 10s
Cost:
$0.101995
Provider:
Moonshot AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Detective Hunter, Alborn Police. I'd like to ask about last night's apple festival—and Mara Bell, who disappeared afterward." Selvi: "माफ़ कीजिए? मैं अंग्रेज़ी नहीं समझती... आपने मारा का नाम लिया? उसे क्या हुआ?" Hunter: "You know Mara? When did you last see her?" Selvi: "वह मेरी दोस्त है। कल शाम वह मेरे साथ थी, और तब से उसका फ़ोन बंद है। कृपया बताइए... वह कहाँ है?" Hunter: "I'm sorry—what? I don't understand. Not a word. Do you speak English? Is there someone here who can translate?" Selvi: "मैं समझी नहीं... लेकिन मेरे कैमरे में कल शाम की तस्वीरें हैं। शायद इनसे... देखिए।" Hunter: "Your camera? Yes. May I see the festival photographs?" Selvi: "यह मारा है, सेब के बाग़ की बाड़ के पास। और यह आदमी उसके पीछे... तस्वीर लेते समय मैंने उसे देखा ही नहीं।" Hunter: "That's Mara. Who's the man behind her? Do you recognize him?" Selvi: "मुझे नहीं पता कि आप क्या पूछ रहे हैं। लेकिन उसी काले जैकेट वाले आदमी को मैंने रात में अपने गेस्टहाउस के बाहर देखा था। मुझे... मुझे बहुत डर लग रहा है।" Hunter: "I can see that. I wish I knew what you were saying. We'll get an interpreter from the college. Until then, don't delete any photographs." Selvi: "मारा लापता है, है न? इसीलिए आप यहाँ हैं। हे भगवान... और तस्वीर में वह आदमी सीधा मेरी ओर देख रहा है।" Hunter: "We'll find Mara. Just keep the camera safe, and—sorry, I have to take this. Hunter. ... Where? ... The old cider barn? ... You found her scarf? ... Keep everyone back. I'm on my way." Selvi: "मारा? क्या मारा मिल गई? आप कहाँ जा रहे हैं? रुकिए..." Hunter: "I have to go. Stay inside the café, where there are people. I'll send someone who speaks Hindi. I'll come back."
created_at"2026-10-27T11:32:48.345Z" 10/27/2026, 11:32:48 AM
model"moonshotai/kimi-k3.1-pro-20261023"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2245
moderation_latency(null)
generation_time309630
tokens_prompt302
tokens_completion12002
native_tokens_prompt363
native_tokens_completion10173
native_tokens_completion_images(null)
native_tokens_reasoning9492
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.1019952
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.22.1; linux; x64))"
http_referer(null)
request_id"req-1793100768-Qli5NViRkWHfQylXv221"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1793100768-p0x2nrZSAD2twPpzf6IH"
upstream_id"chatcmpl-6ae08be15c2d450c98507ac3"
provider_responses
0
endpoint_id"a3fafaac-f097-4ef1-86b3-842854dad5c6"
id"chatcmpl-6ae08be15c2d450c98507ac3"
is_byokfalse
latency2245
model_permaslug"moonshotai/kimi-k3.1-pro-20261023"
provider_name"Moonshot AI"
status200
total_cost0.1019952
cache_discount0.0004608
upstream_inference_cost0
provider_name"Moonshot AI"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, Alborn Police. I'd like to ask about last night's apple festival—and Mara Bell, who disappeared afterward."
detectedLang"en"
heavyLang"en"
scores
en0.750575594781274
tl0.5693462897526502
fr0.4911273486430063
no0.4860305745914602
nl0.482484076433121
it0.4657534246575343
es0.41441441441441446
sl0.4122965641952984
da0.3981481481481482
ro0.38291139240506333
ms0.38173747622067217
pt0.377791959157626
cs0.3697478991596639
hr0.36149312377210213
de0.3610747051114024
ca0.346514745308311
sq0.3443174176193679
sv0.30007178750897345
sk0.2945007235890014
et0.2820324005891017
pl0.2713004484304933
lt0.24535603715170282
yo0.24242424242424243
lv0.21937550040032028
eu0.19288079470198677
fi0.18546365914786966
az0.16523972602739725
hu0.1271262309758281
tr0.11844484629294756
reliabletrue
passestrue
1
name"Selvi"
dialogue"माफ़ कीजिए? मैं अंग्रेज़ी नहीं समझती... आपने मारा का नाम लिया? उसे क्या हुआ?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8807157057654076
mr0.8738170347003155
reliabletrue
passestrue
2
name"Hunter"
dialogue"You know Mara? When did you last see her?"
detectedLang"en"
heavyLang"en"
scores
en0.8204667863554758
tl0.5698924731182796
et0.5525727069351231
tr0.38461538461538464
da0.37888198757763975
no0.3630573248407643
ms0.3333333333333333
cs0.2805755395683453
nl0.2779783393501805
reliabletrue
passestrue
3
name"Selvi"
dialogue"वह मेरी दोस्त है। कल शाम वह मेरे साथ थी, और तब से उसका फ़ोन बंद है। कृपया बताइए... वह कहाँ है?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8820383768480654
mr0.8732251521298174
reliabletrue
passestrue
4
name"Hunter"
dialogue"I'm sorry—what? I don't understand. Not a word. Do you speak English? Is there someone here who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8185776487663279
no0.4939271255060729
tl0.48665297741273095
da0.46313528990694347
cs0.44071588366890374
hr0.4365138993238167
de0.4348153730218538
sq0.4331065759637188
pt0.4248466257668711
sv0.419953596287703
ro0.4195046439628483
pl0.410377358490566
sk0.39320388349514557
it0.3892508143322475
nl0.38524590163934425
ca0.36224489795918363
yo0.35008665511265163
hu0.3345164152617569
tr0.3273542600896861
vi0.30683918669131244
is0.28842504743833014
es0.2767598842815815
az0.26398429833169773
sl0.26398429833169773
lt0.2203742203742204
lv0.21052631578947367
fr0.20802534318901794
ms0.20550847457627117
et0.19786096256684493
eu0.1544532130777903
be0.08536585365853659
fi0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
5
name"Selvi"
dialogue"मैं समझी नहीं... लेकिन मेरे कैमरे में कल शाम की तस्वीरें हैं। शायद इनसे... देखिए।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8827514330380406
mr0.8760785753625849
reliabletrue
passestrue
6
name"Hunter"
dialogue"Your camera? Yes. May I see the festival photographs?"
detectedLang"en"
heavyLang"en"
scores
en0.7774480712166172
tl0.6597096188747732
fr0.6287128712871286
it0.5567375886524822
ca0.5432399512789281
no0.5324189526184538
sv0.5259165613147914
ms0.520460358056266
da0.5186136071887034
ro0.4939271255060729
et0.4863013698630137
nl0.4791666666666667
sq0.4769874476987448
hr0.4755244755244755
cs0.4377811094452773
yo0.4377811094452773
es0.4292237442922375
pt0.34895833333333337
sk0.336283185840708
lt0.33510638297872336
pl0.33510638297872336
sl0.33274021352313166
az0.32553956834532377
vi0.2937853107344633
de0.27466150870406186
hu0.2632612966601179
lv0.251497005988024
hi0.17035398230088497
be0.15730337078651685
tr0.15730337078651685
fi0.14383561643835618
is0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
7
name"Selvi"
dialogue"यह मारा है, सेब के बाग़ की बाड़ के पास। और यह आदमी उसके पीछे... तस्वीर लेते समय मैंने उसे देखा ही नहीं।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8849952645108916
mr0.8777506112469438
reliabletrue
passestrue
8
name"Hunter"
dialogue"That's Mara. Who's the man behind her? Do you recognize him?"
detectedLang"en"
heavyLang"en"
scores
en0.7970573313039067
tl0.5375722543352601
da0.4513031550068587
no0.4310099573257468
sq0.4244604316546763
pt0.3902439024390244
nl0.3893129770992366
tr0.3798449612403101
cs0.3453355155482815
sv0.33884297520661155
yo0.3162393162393162
ms0.3079584775086505
fr0.30434782608695654
pl0.26335174953959484
eu0.26062846580406657
sk0.24812030075187969
hr0.23076923076923078
sl0.23076923076923078
de0.2248062015503876
ca0.21875
vi0.2172211350293542
es0.2125984251968504
lv0.2125984251968504
lt0.1902834008097166
ro0.17695473251028807
it0.15074309978768577
reliabletrue
passestrue
9
name"Selvi"
dialogue"मुझे नहीं पता कि आप क्या पूछ रहे हैं। लेकिन उसी काले जैकेट वाले आदमी को मैंने रात में अपने गेस्टहाउस के बाहर देखा था। मुझे... मुझे बहुत डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8810404991011949
mr0.8765093304061471
reliabletrue
passestrue
10
name"Hunter"
dialogue"I can see that. I wish I knew what you were saying. We'll get an interpreter from the college. Until then, don't delete any photographs."
detectedLang"en"
heavyLang"en"
scores
en0.8080719456021056
tl0.4950952106174264
no0.4849911712772219
ca0.4816350710900474
fr0.470659407138536
tr0.4075829383886255
ro0.3957182320441989
de0.37589158345221113
sq0.3603801169590643
nl0.35519528371407516
sv0.34210526315789475
it0.3411144578313253
da0.33962264150943394
es0.33862433862433866
et0.3340943683409437
pt0.3055555555555556
yo0.29149797570850206
hu0.2597292724196278
ms0.2527754056362084
cs0.2290748898678414
vi0.21171171171171171
hr0.2023701002734731
sl0.19798350137488543
sk0.19651056014692378
pl0.19205909510618652
az0.1913123844731978
eu0.17530631479736097
is0.15703275529865127
lv0.1455078125
lt0.13793103448275862
hi0.08088235294117647
be0.07407407407407407
uk0.06716417910447761
reliabletrue
passestrue
11
name"Selvi"
dialogue"मारा लापता है, है न? इसीलिए आप यहाँ हैं। हे भगवान... और तस्वीर में वह आदमी सीधा मेरी ओर देख रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8795351473922902
mr0.867601246105919
reliabletrue
passestrue
12
name"Hunter"
dialogue"We'll find Mara. Just keep the camera safe, and—sorry, I have to take this. Hunter. ... Where? ... The old cider barn? ... You found her scarf? ... Keep everyone back. I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7987927565392354
tl0.6332966629996333
da0.48480164863472436
no0.4172494172494172
sv0.3935718617343845
it0.3438320209973753
yo0.33554817275747506
ca0.3220338983050847
cs0.3220338983050847
ro0.31224209078404397
pl0.3041057759220599
fr0.2917847025495751
sk0.2673992673992674
sq0.2587101556708673
hr0.2553983618763961
tr0.2441421012849584
de0.24242424242424243
et0.2418498862774829
ms0.23605805958747134
nl0.23076923076923078
sl0.20508744038155804
lv0.15611814345991562
lt0.143101970865467
pt0.14015477214101463
fi0.13043478260869565
is0.12280701754385964
az0.1166077738515901
es0.09008189262966333
hi0.07749077490774908
be0.06542056074766354
hu0.06279287722586692
uk0.059266227657572904
vi0.059266227657572904
reliabletrue
passestrue
13
name"Selvi"
dialogue"मारा? क्या मारा मिल गई? आप कहाँ जा रहे हैं? रुकिए..."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8896247240618101
mr0.8754669987546699
reliabletrue
passestrue
14
name"Hunter"
dialogue"I have to go. Stay inside the café, where there are people. I'll send someone who speaks Hindi. I'll come back."
detectedLang"en"
heavyLang"en"
scores
en0.8080750639749787
tl0.6066433566433567
da0.44672131147540983
it0.41048034934497823
no0.3869209809264305
yo0.3767313019390581
et0.3620037807183365
sq0.3583650190114069
pl0.35344827586206895
pt0.3408203125
ro0.31402439024390244
nl0.2961418143899896
hr0.2741935483870968
cs0.25905598243688255
sv0.24242424242424243
ca0.23642533936651583
sk0.23208191126279862
lv0.21511627906976746
de0.20867526377491208
lt0.1983372921615202
is0.19258373205741627
es0.18082524271844658
fr0.18082524271844658
ms0.18082524271844658
sl0.1520100502512563
hi0.10358565737051792
be0.09395973154362416
tr0.09395973154362416
hu0.09029649595687331
az0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue