Run: 2026-07-25-01KYD5HYKFM76DB2KRYFS61HBT

Run Details

Model:
MoonshotAI: Kimi K3 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
20.4s
Cost:
$0.008951
Provider:
Moonshot AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *(looking at her camera, murmuring to herself)* "ये तस्वीर... ये तो उसी रात की है..." Hunter: "Excuse me, miss? Detective Hunter, Alborn Police. Mind if I ask you a few questions about what happened near the orchard last night?" Selvi: *(startled, clutching her camera)* "मैं... मैं कुछ नहीं जानती। कृपया मुझे जाने दीजिए।" Hunter: "I'm sorry, I don't... I don't understand. Do you speak English? Just a few questions about the disappearance." Selvi: *(shaken, voice trembling)* "उस आदमी ने मुझे देखा... वो बाग के पास खड़ा था। मुझे बहुत डर लग रहा है।" Hunter: "Ma'am, I wish I could understand you. You seem upset. Are you okay? Can I get you some water?" Selvi: *(pointing at her camera screen)* "फोटो... मैंने फोटो ली थी। रात में। वहाँ।" Hunter: "Your camera? You took photos? Of what — of someone? Can I see?" Selvi: *(hesitating, then nodding slightly)* "हाँ... देखिए। पर ये आदमी... ये कोई गाँव का नहीं है।" Hunter: "Okay, okay, slow down. Let's find someone who can translate. The librarian speaks a few languages, maybe—" *(Hunter's phone rings. He checks the screen and his expression hardens.)* Hunter: "Hunter here. ...Another one? I'll be right there." Selvi: *(anxious)* "क्या हुआ? क्या कोई और गायब हो गया?" Hunter: "I have to go. But please — don't leave town, and don't show those photos to anyone. I'll come back with a translator. I promise." Selvi: *(calling after him)* "सावधान रहिए... वो आदमी खतरनाक है!" Hunter: *(pausing at the door, not understanding, but hearing the fear in her voice)* "I'll be careful. You too, miss."
created_at"2026-07-25T17:35:50.39Z" 7/25/2026, 5:35:50 PM
model"moonshotai/kimi-k3-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2684
moderation_latency(null)
generation_time20292
tokens_prompt302
tokens_completion610
native_tokens_prompt364
native_tokens_completion570
native_tokens_completion_images(null)
native_tokens_reasoning31
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0089508
router(null)
provider_responses
0
endpoint_id"650c9b12-7b6d-444d-8d92-df8daef84d7a"
id"chatcmpl-6a64f3f770675b5e4d010ccb"
is_byokfalse
latency2684
model_permaslug"moonshotai/kimi-k3-20260715"
provider_name"Moonshot AI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1785000950-FTWRTeF06bQM2HhkdpDf"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1785000950-NWxr9iqet26jTAGXtHSA"
upstream_id"chatcmpl-6a64f3f770675b5e4d010ccb"
total_cost0.0089508
cache_discount0.0006912
upstream_inference_cost0
provider_name"Moonshot AI"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"ये तस्वीर... ये तो उसी रात की है..."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8887900355871886
mr0.888641425389755
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? Detective Hunter, Alborn Police. Mind if I ask you a few questions about what happened near the orchard last night?"
detectedLang"en"
heavyLang"en"
scores
en0.797752808988764
tl0.6215306980656014
fr0.5734597156398105
it0.5137763371150729
no0.46965232763700654
ca0.44683466502765823
nl0.4447871684145589
ro0.44306930693069313
pt0.4392523364485981
sq0.42528735632183906
da0.40750493745885447
sv0.4019933554817276
cs0.3873383253914227
es0.38482570061517435
hr0.35064935064935066
et0.34545454545454546
de0.34210526315789475
sl0.34114202049780384
yo0.3006993006993007
hu0.3001555209953344
ms0.2890995260663507
sk0.28514694201747415
pl0.26168990976210005
tr0.23599320882852293
lt0.2049469964664311
fi0.19786096256684493
lv0.19786096256684493
az0.18772563176895307
eu0.15413533834586465
is0.13294797687861273
vi0.1287512100677638
be0.07216494845360825
uk0.06542056074766354
reliabletrue
passestrue
2
name"Selvi"
dialogue"मैं... मैं कुछ नहीं जानती। कृपया मुझे जाने दीजिए।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8842180263626648
mr0.8748073959938366
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't... I don't understand. Do you speak English? Just a few questions about the disappearance."
detectedLang"en"
heavyLang"en"
scores
en0.8103494987808183
tl0.5251017639077341
no0.5165745856353591
da0.5087719298245614
fr0.5066948555320648
it0.5053003533568905
sv0.4868035190615836
pt0.47328818660647104
cs0.46112394149345654
nl0.45987654320987653
hr0.4176372712146422
ca0.413243922883487
sk0.4077834179357022
sq0.396551724137931
pl0.39236111111111116
yo0.39130434782608703
de0.3607305936073059
ro0.3488372093023256
ms0.3076162215628091
sl0.2805755395683453
es0.2790937178166838
vi0.2584745762711864
et0.2456896551724138
hu0.24160346695557963
is0.2324561403508772
tr0.17355371900826447
lt0.17159763313609466
az0.15966386554621848
lv0.15966386554621848
be0.09090909090909091
eu0.09090909090909091
fi0.08256880733944955
uk0.08256880733944955
reliabletrue
passestrue
4
name"Selvi"
dialogue"उस आदमी ने मुझे देखा... वो बाग के पास खड़ा था। मुझे बहुत डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8819794888490965
mr0.8781512605042017
reliabletrue
passestrue
5
name"Hunter"
dialogue"Ma'am, I wish I could understand you. You seem upset. Are you okay? Can I get you some water?"
detectedLang"en"
heavyLang"en"
scores
en0.7867803837953091
da0.5164410058027079
no0.5159728944820909
tl0.4882292732855681
sv0.46524064171123
nl0.4298745724059293
ro0.3842364532019704
de0.3531694695989651
cs0.34810951760104303
is0.32157394843962006
ca0.3006993006993007
pl0.28977272727272724
fr0.26793557833089315
sk0.24357034795764
tr0.22720247295208654
az0.21875
hr0.21752738654147105
sq0.21135646687697163
it0.18699186991869918
fi0.17355371900826447
yo0.1482112436115843
pt0.1243432574430823
be0.12280701754385964
hu0.11816578483245149
et0.11190053285968028
lt0.11190053285968028
lv0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
6
name"Selvi"
dialogue"फोटो... मैंने फोटो ली थी। रात में। वहाँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8919152615650671
mr0.8892825509300266
reliabletrue
passestrue
7
name"Hunter"
dialogue"Your camera? You took photos? Of what — of someone? Can I see?"
detectedLang"en"
heavyLang"en"
scores
en0.8128342245989305
tl0.5872641509433962
ca0.5257452574525745
it0.43820224719101125
nl0.43820224719101125
fr0.42434210526315785
es0.4233937397034596
ro0.41471571906354515
no0.4057724957555179
et0.3996569468267582
de0.39236111111111116
sv0.38596491228070173
yo0.36363636363636365
cs0.3433395872420263
pt0.3110236220472441
is0.3027888446215139
ms0.3
tr0.29577464788732394
lt0.29006085192697767
az0.2857142857142857
da0.2842535787321063
hr0.2842535787321063
lv0.2768595041322314
sq0.2768595041322314
pl0.2647058823529412
hi0.18032786885245902
sk0.17061611374407584
be0.16666666666666666
hu0.1606714628297362
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
8
name"Selvi"
dialogue"हाँ... देखिए। पर ये आदमी... ये कोई गाँव का नहीं है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8866213151927438
mr0.8795180722891566
reliabletrue
passestrue
9
name"Hunter"
dialogue"Okay, okay, slow down. Let's find someone who can translate. The librarian speaks a few languages, maybe—"
detectedLang"en"
heavyLang"en"
scores
en0.7819523649781952
ro0.5412844036697247
tl0.5350500715307582
da0.46013289036544847
fr0.4500846023688663
nl0.4237588652482269
ms0.37858508604206503
no0.37799043062200954
sq0.37619961612284064
es0.3701550387596899
ca0.35770750988142297
yo0.3564356435643564
it0.34804413239719156
et0.34277047522750254
eu0.3340163934426229
pt0.3143459915611814
de0.31216931216931215
hr0.2777777777777778
tr0.2502883506343714
lt0.2459396751740139
az0.24065420560747666
sv0.23529411764705882
sk0.22894424673784108
cs0.22711058263971462
pl0.21212121212121213
is0.1965389369592089
vi0.19554455445544552
hu0.1935483870967742
sl0.18648310387984982
fi0.18032786885245902
lv0.17407878017789072
reliabletrue
passestrue
10
name"Hunter"
dialogue"Hunter here. ...Another one? I'll be right there."
detectedLang"en"
heavyLang"en"
scores
en0.8235294117647058
tl0.6021220159151194
de0.53125
sq0.441340782122905
da0.43820224719101125
yo0.38016528925619836
no0.336283185840708
fr0.3273542600896861
hu0.2805755395683453
lt0.27184466019417475
es0.25
hr0.2248062015503876
pl0.2248062015503876
sv0.1891891891891892
it0.17355371900826447
nl0.17355371900826447
pt0.17355371900826447
ca0.16434540389972147
ms0.16434540389972147
ro0.16434540389972147
sl0.16434540389972147
tr0.16434540389972147
reliabletrue
passestrue
11
name"Selvi"
dialogue"क्या हुआ? क्या कोई और गायब हो गया?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8825831702544031
mr0.8614958448753463
reliabletrue
passestrue
12
name"Hunter"
dialogue"I have to go. But please — don't leave town, and don't show those photos to anyone. I'll come back with a translator. I promise."
detectedLang"en"
heavyLang"en"
scores
en0.8169838945827232
tl0.6288965858485898
pl0.473314606741573
fr0.4627507163323783
ro0.4592645998558039
da0.438622754491018
cs0.4348153730218538
hr0.4335347432024169
it0.41497659906396256
yo0.40898345153664306
pt0.40617577197149646
sq0.40570522979397783
ca0.3936944219886823
no0.37395659432387307
nl0.35177182368193605
sl0.3483927019982624
sk0.34612031386224934
lt0.34554973821989526
lv0.3438320209973753
et0.336283185840708
es0.3237150586113616
de0.30619796484736356
sv0.299719887955182
ms0.29906542056074764
hu0.2291880781089414
vi0.22760041194644695
tr0.21875
az0.20382165605095542
is0.15540540540540537
eu0.1544532130777903
hi0.09310761789600969
be0.08536585365853659
fi0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
13
name"Selvi"
dialogue"सावधान रहिए... वो आदमी खतरनाक है!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8824668141592921
mr0.8768472906403941
reliabletrue
passestrue
14
name"Hunter"
dialogue"I'll be careful. You too, miss."
detectedLang"en"
heavyLang"en"
scores
en0.8022598870056498
tl0.6013667425968109
ro0.5179063360881543
hu0.4006849315068493
lt0.3902439024390244
yo0.38596491228070173
cs0.308300395256917
es0.3027888446215139
fr0.3027888446215139
reliabletrue
passestrue