Run: 2026-07-25-01KYD69F497EEX5XY8R6HG7E49

Run Details

Model:
MoonshotAI: Kimi K3 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
24.1s
Cost:
$0.010403
Provider:
Moonshot AI

Evaluation summary

Score Evaluator
Details Link
95.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: *(murmuring to herself, scrolling through her camera)* "Cette photo... ce n'est pas possible. Il était là, je l'ai vu..." Hunter: "Excuse me, ma'am. Detective Hunter, Alborn Police. Mind if I ask you a few questions?" Marie: *(startled)* "Oh! Euh... je... je ne parle pas anglais. Désolée." Hunter: "I'm sorry, I didn't catch that. I'm investigating a disappearance near the apple orchard. Were you taking photographs there yesterday afternoon?" Marie: *(visibly shaken, clutching her camera)* "L'orchard... oui, oui! J'y étais! J'ai pris des photos et... et il y avait un homme. Et puis... il a disparu! Comme ça! J'ai couru, j'ai eu tellement peur!" Hunter: *(frowning, leaning in)* "Ma'am, I can see you're upset, but I don't understand. Can you speak slower? Do you know any English at all?" Marie: *(pointing frantically at her camera screen)* "Regardez! Regardez la photo! L'homme, là! Derrière les pommiers!" Hunter: "Okay... okay, you're pointing at the camera. A man. There was a man in your photo?" Marie: "Oui! Un homme! Et après... rien! Personne! C'était horrible!" Hunter: "A man... and then he was gone? Ma'am, nod if I'm right — did you see someone disappear?" Marie: *(nodding rapidly, tears forming)* "Oui, oui! Disparu! Vanished!" Hunter: "Alright. I need you to stay calm. I'm going to find someone who speaks... whatever language that is. French? Spanish?" Marie: "Français! Je suis française!" Hunter: "French. Okay, French. Don't leave town, ma'am. I'll—" *(Hunter's phone rings. He answers, his expression hardening.)* Hunter: "Hunter. ...What? Another one? When? ...I'm on my way." Marie: *(anxiously)* "Qu'est-ce qui se passe? Quelque chose est arrivé?" Hunter: "I have to go. Stay here in town — do you understand? Stay. I'll come back with a translator." Marie: *(calling after him)* "Attendez! Attendez, s'il vous plaît! La photo! Vous devez voir la photo!" Hunter: *(over his shoulder)* "I'll be back, ma'am. I promise. Just don't go anywhere." Marie: *(whispering, alone, staring at her camera)* "Il ne comprend pas... personne ne comprend. Mais la photo ne ment pas."
created_at"2026-07-25T17:48:40.979Z" 7/25/2026, 5:48:40 PM
model"moonshotai/kimi-k3-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency3254
moderation_latency(null)
generation_time23951
tokens_prompt303
tokens_completion570
native_tokens_prompt363
native_tokens_completion667
native_tokens_completion_images(null)
native_tokens_reasoning17
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0104028
router(null)
provider_responses
0
endpoint_id"650c9b12-7b6d-444d-8d92-df8daef84d7a"
id"chatcmpl-6a64f6eb82653a8806f1d978"
is_byokfalse
latency3254
model_permaslug"moonshotai/kimi-k3-20260715"
provider_name"Moonshot AI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1785001721-94acUWVhPdxKjkxQbMAQ"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1785001721-pR2xdnhzi1VN4tcR6Wxp"
upstream_id"chatcmpl-6a64f6eb82653a8806f1d978"
total_cost0.0104028
cache_discount0.0006912
upstream_inference_cost0
provider_name"Moonshot AI"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
95.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Cette photo... ce n'est pas possible. Il était là, je l'ai vu..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8269230769230769
en0.5176848874598071
ca0.5124593716143012
it0.5076586433260394
nl0.39919893190921224
yo0.3580599144079886
cs0.3430656934306569
ro0.3401759530791789
sl0.27768860353130015
hr0.2753623188405797
de0.27184466019417475
tr0.2694805194805195
vi0.25864909390444807
tl0.2537313432835821
sk0.24369747899159663
no0.22010398613518195
sq0.21602787456445993
hu0.20913884007029876
az0.20353982300884957
pt0.20212765957446807
da0.1935483870967742
es0.18772563176895307
lt0.16820702402957485
pl0.16820702402957485
ms0.15730337078651685
hi0.14611005692599618
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, Alborn Police. Mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7601918465227818
fr0.6209728363866076
it0.6131528046421664
tl0.5686556434219986
ca0.5478522984174831
ro0.5440729483282675
pt0.5402298850574713
sq0.494949494949495
cs0.48674080410607357
es0.4840928632846088
no0.4796183868169991
sv0.46761313220940554
hr0.44751381215469616
nl0.4470046082949309
da0.43767572633552015
sl0.4371482176360225
et0.39879759519038077
hu0.39148073022312374
sk0.3743482794577685
de0.34711643090315564
pl0.34711643090315564
ms0.32432432432432434
tr0.31662870159453305
lt0.27884615384615385
fi0.27007299270072993
lv0.27007299270072993
az0.25742574257425743
yo0.2555831265508685
eu0.21465968586387435
is0.18699186991869918
vi0.18144611186903137
be0.1044776119402985
uk0.09502262443438914
reliabletrue
passestrue
2
name"Marie"
dialogue"Oh! Euh... je... je ne parle pas anglais. Désolée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7641509433962265
sl0.6345919610231425
lt0.5850622406639004
nl0.574468085106383
sq0.5607613469985359
cs0.5535714285714286
hr0.5363214837712519
ca0.511400651465798
sk0.48805460750853247
lv0.460431654676259
it0.44751381215469616
ro0.44751381215469616
yo0.35205183585313177
pl0.34497816593886466
tr0.33774834437086093
hu0.33184855233853006
ms0.3288590604026846
es0.3273542600896861
de0.3227990970654628
en0.3087557603686636
fi0.22680412371134018
az0.1891891891891892
et0.17355371900826447
pt0.17355371900826447
da0.16434540389972147
no0.16434540389972147
sv0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I didn't catch that. I'm investigating a disappearance near the apple orchard. Were you taking photographs there yesterday afternoon?"
detectedLang"en"
heavyLang"en"
scores
en0.7858213750267723
tl0.6204933586337761
fr0.563890100305277
nl0.4845360824742268
de0.47257383966244726
it0.4626544868350349
no0.4502473886750962
pt0.4269340974212034
sv0.4175888177053
sq0.37888198757763975
da0.3654822335025381
es0.36386768447837153
sk0.3531694695989651
ro0.3498049414824447
hr0.3394980184940555
cs0.33862433862433866
ca0.2962702322308234
ms0.28212491026561376
yo0.2711370262390671
sl0.25925925925925924
is0.2576095025983668
pl0.25205684367988035
et0.24585218702865763
lt0.21321793863099922
az0.2006394884092726
tr0.18896999188969993
hu0.1823385118560916
lv0.1687448046550291
fi0.16805324459234608
vi0.11738746690203002
hi0.07149489322191271
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
4
name"Marie"
dialogue"L'orchard... oui, oui! J'y étais! J'ai pris des photos et... et il y avait un homme. Et puis... il a disparu! Comme ça! J'ai couru, j'ai eu tellement peur!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8040380047505938
en0.5862587763289869
ca0.5518739815317762
it0.4701348747591522
es0.4611365120836055
ro0.4607843137254902
no0.44029850746268656
de0.4115549215406562
pt0.406901509705248
da0.40604751619870405
nl0.39293598233995586
tl0.3888888888888889
et0.36733128834355827
lv0.3319838056680162
cs0.28879310344827586
sk0.28135888501742157
yo0.25876010781671155
hu0.25742574257425743
lt0.2560865644724977
sv0.25203989120580234
pl0.25136116152450094
tr0.23611111111111113
hr0.23255813953488372
az0.23112767940354148
fi0.20443587270973965
sq0.20135527589545013
vi0.1691842900302115
sl0.16328600405679514
hi0.08536585365853659
is0.08333333333333334
eu0.0782122905027933
ms0.07094594594594594
reliabletrue
passestrue
5
name"Hunter"
dialogue"Ma'am, I can see you're upset, but I don't understand. Can you speak slower? Do you know any English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.7983870967741935
no0.5296167247386759
tl0.5273109243697479
da0.5044052863436124
sv0.4220890410958904
cs0.37209302325581395
ca0.3401759530791789
pl0.3395303326810176
de0.3330039525691699
hr0.3290258449304175
sq0.3236472945891784
et0.32228915662650603
sk0.30268595041322316
ro0.25905598243688255
it0.21693735498839908
nl0.20867526377491208
vi0.2049469964664311
yo0.19642857142857142
pt0.18772563176895307
tr0.17883211678832117
az0.17177914110429449
is0.1687192118226601
sl0.15094339622641512
fi0.1346153846153846
fr0.11533420707732633
ms0.09638554216867469
be0.09395973154362416
hu0.09029649595687331
lt0.08536585365853659
lv0.08536585365853659
uk0.08536585365853659
reliabletrue
passestrue
6
name"Marie"
dialogue"Regardez! Regardez la photo! L'homme, là! Derrière les pommiers!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7991967871485943
ca0.6007984031936128
es0.5215311004784688
nl0.49238578680203043
en0.4609164420485175
ro0.44598337950138506
no0.40298507462686567
vi0.37597503900156004
tl0.3700787401574803
it0.3670886075949367
da0.3150684931506849
et0.3127147766323024
yo0.3103448275862069
cs0.18032786885245902
pl0.17184265010351968
sq0.16317991631799164
hi0.16142557651991615
pt0.16142557651991615
de0.15611814345991562
lv0.15611814345991562
sl0.15611814345991562
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay... okay, you're pointing at the camera. A man. There was a man in your photo?"
detectedLang"en"
heavyLang"en"
scores
en0.8106815464328417
tl0.7107186358099878
de0.6212121212121212
nl0.6031746031746031
ro0.5506149479659413
it0.5467557251908397
fr0.5441458733205374
sv0.5306324110671937
da0.527363184079602
no0.5113168724279835
ms0.490343347639485
yo0.45776255707762553
pl0.3716931216931217
lt0.35549525101763907
sl0.33936022253129344
ca0.3338008415147265
es0.3271954674220963
sq0.32432432432432434
cs0.31654676258992803
pt0.3035190615835778
hr0.27370030581039756
lv0.2725880551301685
hu0.24722662440570525
az0.2448330683624801
is0.24000000000000002
sk0.21487603305785125
hi0.1394927536231884
tr0.1394927536231884
eu0.12844036697247707
vi0.12844036697247707
et0.1171003717472119
fi0.1171003717472119
reliabletrue
passestrue
8
name"Marie"
dialogue"Oui! Un homme! Et après... rien! Personne! C'était horrible!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8178311187312473
ca0.5618556701030928
et0.4766009852216749
es0.448051948051948
it0.44078947368421056
da0.44005270092226617
no0.4186046511627907
lv0.36281859070464767
ro0.3511450381679389
en0.3044189852700491
eu0.29867986798679863
de0.2647058823529412
is0.2621527777777778
sk0.256993006993007
tl0.2517605633802817
yo0.19962335216572505
ms0.17153996101364524
sv0.169921875
fi0.1550695825049702
sq0.1533864541832669
nl0.15
lt0.1448692152917505
pt0.1361788617886179
tr0.1361788617886179
hu0.1290983606557377
az0.121900826446281
cs0.121900826446281
hr0.121900826446281
pl0.121900826446281
reliabletrue
passestrue
9
name"Hunter"
dialogue"A man... and then he was gone? Ma'am, nod if I'm right — did you see someone disappear?"
detectedLang"en"
heavyLang"en"
scores
en0.8037816625044595
tl0.535472972972973
yo0.466537342386033
nl0.4264859228362878
de0.40604751619870405
es0.3483412322274882
sv0.34523809523809523
da0.3333333333333333
fr0.3276283618581907
no0.30203045685279184
et0.29757343550446996
ca0.29214929214929214
pt0.2838541666666667
it0.27821522309711283
cs0.2763157894736842
lv0.2445054945054945
lt0.24242424242424243
ms0.22644163150492264
hu0.22096317280453256
fi0.21875
ro0.20174165457184323
sk0.19117647058823528
hr0.1691842900302115
pl0.16030534351145037
sl0.140625
tr0.12280701754385964
is0.12
sq0.11575562700964631
az0.11290322580645161
eu0.11290322580645161
vi0.11290322580645161
reliabletrue
passestrue
10
name"Marie"
dialogue"Oui, oui! Disparu! Vanished!"
detectedLang"en"
heavyLang"en"
scores
en0.6957403651115619
fr0.5750708215297451
da0.39999999999999997
pt0.39999999999999997
es0.3902439024390244
it0.3902439024390244
ro0.3902439024390244
ca0.375
cs0.3150684931506849
de0.3150684931506849
sk0.3150684931506849
sq0.3150684931506849
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Alright. I need you to stay calm. I'm going to find someone who speaks... whatever language that is. French? Spanish?"
detectedLang"en"
heavyLang"en"
scores
en0.8157092018301982
tl0.5173102529960053
da0.4791666666666667
no0.4478293983244478
yo0.39883913764510776
et0.36625874125874125
nl0.363476733977173
ro0.3299445471349353
cs0.3022136669874879
sv0.2967992240543162
hu0.28711897738446407
pl0.2647058823529412
hr0.2602040816326531
de0.25411522633744854
pt0.25103305785123964
is0.2479253112033195
lt0.24083769633507857
fr0.22954303931987244
sq0.22790202342917998
sk0.21959095801937567
it0.2093784078516903
lv0.2032967032967033
es0.19533851276359598
ca0.15990730011587484
sl0.1430260047281324
ms0.10714285714285714
eu0.09713574097135741
be0.0880503144654088
tr0.0880503144654088
az0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
12
name"Marie"
dialogue"Français! Je suis française!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8245614035087719
hr0.6231155778894472
sl0.6231155778894472
yo0.6183206106870229
cs0.5912806539509536
sk0.5912806539509536
nl0.5726495726495726
ca0.5614035087719298
pl0.5176848874598071
de0.512987012987013
pt0.512987012987013
en0.4915254237288135
eu0.34782608695652173
it0.34782608695652173
et0.34210526315789475
no0.3333333333333333
sq0.3333333333333333
es0.32432432432432434
hu0.3181818181818182
ro0.3181818181818182
da0.3087557603686636
sv0.3087557603686636
tl0.3087557603686636
az0.29577464788732394
tr0.29577464788732394
is0.2822966507177033
lv0.2822966507177033
ms0.2822966507177033
reliabletrue
passestrue
13
name"Hunter"
dialogue"French. Okay, French. Don't leave town, ma'am. I'll—"
detectedLang"en"
heavyLang"en"
scores
en0.7373447946513849
tl0.4270833333333333
es0.26273458445040215
pt0.25271739130434784
it0.21875
reliabletrue
passestrue
14
name"Hunter"
dialogue"Hunter. ...What? Another one? When? ...I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8328267477203647
tl0.6002906976744186
pl0.4888475836431227
fr0.39692982456140347
hr0.3888888888888889
cs0.3692660550458715
sk0.3692660550458715
da0.367816091954023
ca0.3648960739030023
et0.358974358974359
fi0.3529411764705882
es0.26666666666666666
de0.24242424242424243
hi0.233983286908078
no0.22096317280453256
yo0.21428571428571427
sv0.20289855072463767
it0.1863905325443787
nl0.1863905325443787
pt0.1863905325443787
ms0.17664670658682635
ro0.17664670658682635
sl0.17664670658682635
sq0.17664670658682635
tr0.17664670658682635
reliabletrue
passestrue
15
name"Marie"
dialogue"Qu'est-ce qui se passe? Quelque chose est arrivé?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8300970873786407
it0.6644295302013423
ca0.5838287752675386
en0.5302013422818792
ro0.5077355836849508
pt0.4672754946727549
da0.4318181818181818
de0.41373534338358464
sv0.4006849315068493
no0.39759036144578314
cs0.3902439024390244
sq0.38380281690140844
es0.36823104693140796
et0.3137254901960784
nl0.2886178861788618
hr0.2753623188405797
sl0.2738589211618257
yo0.23413566739606126
fi0.22566371681415928
eu0.20273348519362186
sk0.2009132420091324
is0.1566265060240964
ms0.1566265060240964
reliabletrue
passestrue
16
name"Hunter"
dialogue"I have to go. Stay here in town — do you understand? Stay. I'll come back with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8173277661795407
pl0.6356696738376127
da0.628186968838527
tl0.6212121212121212
no0.5866141732283464
cs0.5789895749799518
sv0.5489690721649484
sk0.5406824146981627
it0.5382585751978892
hr0.5378521126760564
ro0.5358090185676392
sl0.5353982300884956
yo0.5274527452745275
sq0.5205479452054795
de0.5075046904315197
nl0.5042492917847025
pt0.45426195426195426
ca0.3993135011441648
ms0.3902439024390244
vi0.38739789964994165
lv0.38016528925619836
lt0.37574316290130794
az0.3445692883895131
et0.31906614785992216
hu0.2981283422459893
is0.28765264586160105
tr0.2857142857142857
es0.284741144414169
fr0.27285318559556787
eu0.20694864048338368
be0.11764705882352942
fi0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue
17
name"Marie"
dialogue"Attendez! Attendez, s'il vous plaît! La photo! Vous devez voir la photo!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8023114355231143
en0.5875634517766497
ca0.5801033591731266
es0.512743628185907
it0.5112781954887218
tl0.4897959183673469
ro0.4328097731239092
no0.40909090909090906
pt0.36647173489278756
yo0.22062350119904073
de0.21686746987951808
cs0.21307506053268765
vi0.20537897310513448
hr0.2034313725490196
sl0.2034313725490196
da0.20147420147420148
nl0.1935483870967742
sq0.1935483870967742
hi0.19154228855721395
lv0.18952618453865336
et0.16666666666666666
sv0.16666666666666666
tr0.16666666666666666
reliabletrue
passestrue
18
name"Hunter"
dialogue"I'll be back, ma'am. I promise. Just don't go anywhere."
detectedLang"en"
heavyLang"en"
scores
en0.7619047619047619
tl0.5253164556962026
et0.44362017804154297
pl0.44196428571428575
ca0.4292237442922375
yo0.4221879815100154
sq0.4195046439628483
cs0.40476190476190477
sv0.3902439024390244
ro0.3872549019607844
hr0.3718592964824121
hu0.32915921288014316
it0.3267504488330341
lt0.3181818181818182
no0.27884615384615385
da0.2704280155642024
de0.267578125
pt0.16666666666666666
sk0.1610738255033557
be0.15730337078651685
es0.15730337078651685
sl0.15730337078651685
tr0.15730337078651685
fr0.1515837104072398
az0.14383561643835618
is0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
ms0.1359447004608295
nl0.1359447004608295
reliabletrue
passestrue
19
name"Marie"
dialogue"Il ne comprend pas... personne ne comprend. Mais la photo ne ment pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8174230568596765
it0.6961805555555556
ca0.6701225259189445
ro0.6102449888641426
es0.5721271393643031
sq0.5289367429340512
en0.5159059474412172
lt0.5070422535211268
pt0.5070422535211268
nl0.49348769898697536
tl0.476831091180867
de0.4186046511627907
hr0.41373534338358464
tr0.4117647058823529
cs0.3955094991364421
lv0.3371212121212121
az0.3320610687022901
ms0.32950191570881227
no0.31640625
hu0.29292929292929293
sk0.2768595041322314
sl0.2677824267782427
yo0.2081447963800905
fi0.2009132420091324
sv0.19908466819221968
vi0.1935483870967742
da0.18032786885245902
hi0.18032786885245902
fa0.1764705882352941
is0.15254237288135594
et0.14425427872860636
pl0.14425427872860636
reliabletrue
passestrue