Run: 2026-07-25-01KYD64V8Q2MWYDDFHF401YAJA

Run Details

Model:
MoonshotAI: Kimi K3 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
24.4s
Cost:
$0.011078
Provider:
Moonshot AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
**Voice Sheet — Scene: The Café in Alborn** --- Marie: "Oh... ces photos sont magnifiques. La lumière du matin sur le verger... incroyable." Hunter: "Excuse me, miss? Mind if I have a word? I'm Detective Hunter. I'm investigating some disappearances around town." Marie: "Je... je suis désolée, je ne comprends pas. Je ne parle pas anglais." Hunter: "Right. Okay. I'm guessing you're not from around here. You were at the apple festival last weekend, weren't you? Taking pictures?" Marie: "Le festival? Oui, oui, j'y étais... mais... quelque chose d'étrange s'est passé. J'ai vu un homme... près de la grange. Il criait. Et puis... plus rien. Il a disparu." Hunter: "I'm sorry, I don't... barn? Did you say something about a barn? Grange... that's barn, right?" Marie: "Oui! La grange! J'ai pris des photos, mais quand je les regarde... il y a une ombre. Quelque chose qui bouge. Ça me fait peur." Hunter: "Photos. You've got photos? Listen, this could be important. Can you show me?" Marie: "Regardez... ici. Vous voyez? Cette forme sombre derrière les arbres. Ce n'était pas un animal. Je le sais. J'étais là. Je tremblais." Hunter: "Okay... okay, I can see you're upset. I wish I understood a word you're saying, but that picture... something's not right there." Marie: "J'ai peur. Depuis ce jour, je ne dors plus. Et maintenant, des gens disparaissent dans cette ville, n'est-ce pas? Je l'ai vu dans les journaux." Hunter: "Three people gone in two months. No trace. And you're telling me — well, I think you're telling me — you saw something at that barn." Marie: "Je ne sais pas ce que j'ai vu. Mais ce n'était pas normal. Personne ne me croit... et je ne peux même pas expliquer correctement." Hunter: "We'll figure this out. I'll find someone who speaks French. Just... don't go anywhere near that barn, alright? Do you understand? Barn. No." Marie: "La grange... non. D'accord. Je comprends ça, au moins." Hunter: "Hold on — sorry, I've got to take this. Detective Hunter... Where? ... I'm on my way. — Miss, I'm sorry, I have to go. Another one's missing. Stay here in town, okay? I'll come back. With a translator." Marie: "Attendez! S'il vous plaît... faites attention. Cette ville cache quelque chose. Je le sens." Hunter: "I don't know what you just said... but I think we're saying the same thing." ---
created_at"2026-07-25T17:46:09.566Z" 7/25/2026, 5:46:09 PM
model"moonshotai/kimi-k3-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2737
moderation_latency(null)
generation_time24165
tokens_prompt303
tokens_completion629
native_tokens_prompt363
native_tokens_completion712
native_tokens_completion_images(null)
native_tokens_reasoning22
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0110778
router(null)
provider_responses
0
endpoint_id"650c9b12-7b6d-444d-8d92-df8daef84d7a"
id"chatcmpl-6a64f66219b53b947a0392b4"
is_byokfalse
latency2737
model_permaslug"moonshotai/kimi-k3-20260715"
provider_name"Moonshot AI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1785001569-D7eUi4vSyBo49yt0Dnzs"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1785001569-Kosx060yxJMujWOKYUQj"
upstream_id"chatcmpl-6a64f66219b53b947a0392b4"
total_cost0.0110778
cache_discount0.0006912
upstream_inference_cost0
provider_name"Moonshot AI"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Oh... ces photos sont magnifiques. La lumière du matin sur le verger... incroyable."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8012443829934324
ca0.6085772634445201
es0.606971975393028
tl0.5479559748427674
en0.5458135860979463
it0.5151770657672851
ro0.46808510638297873
nl0.45652173913043476
sq0.4126659856996936
de0.39727463312368977
no0.37089715536105033
pt0.3604004449388209
da0.32590855803048063
sv0.3162901307966707
yo0.27122940430925224
sl0.25130208333333337
vi0.2414248021108179
lt0.23435419440745675
fi0.20798898071625344
eu0.19804741980474197
hu0.14561664190193166
tr0.13010590015128592
is0.1248097412480974
hi0.11809815950920245
az0.11674347158218126
hr0.11674347158218126
ms0.11538461538461538
lv0.10990712074303406
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? Mind if I have a word? I'm Detective Hunter. I'm investigating some disappearances around town."
detectedLang"en"
heavyLang"en"
scores
en0.7958321599549423
tl0.5978924015529673
fr0.5801968731905037
pt0.5595382746051032
it0.5425867507886435
ro0.5393900889453621
ca0.5279947916666666
no0.4787922358015816
da0.4727272727272728
es0.4727272727272728
sv0.46886446886446886
nl0.46730345334313006
sq0.46256486286137877
hr0.4186046511627907
ms0.38715131022823335
de0.3803418803418803
cs0.377147766323024
et0.3766122098022356
sl0.37229437229437223
sk0.3192488262910798
hu0.30019305019305015
lv0.27644710578842313
is0.2757242757242757
lt0.2720883534136546
az0.257172131147541
pl0.24163179916317992
tr0.22126745435016112
yo0.22126745435016112
fi0.21366594360086769
vi0.15501165501165504
be0.0880503144654088
eu0.0880503144654088
uk0.0799492385786802
reliabletrue
passestrue
2
name"Marie"
dialogue"Je... je suis désolée, je ne comprends pas. Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.799771167048055
sl0.5981630309988519
ca0.5958429561200923
lt0.5925494761350407
it0.5614035087719298
sq0.5225102319236016
cs0.515235457063712
nl0.5145631067961165
ro0.5035460992907801
es0.5021337126600285
en0.5014245014245015
hr0.49784791965566716
sk0.4496855345911949
lv0.42244224422442245
de0.38596491228070173
pt0.34579439252336447
tl0.32432432432432434
yo0.317738791423002
pl0.3110236220472441
tr0.30417495029821073
hu0.2985971943887776
ms0.29577464788732394
fi0.2009132420091324
az0.16666666666666666
et0.15254237288135594
da0.14425427872860636
no0.14425427872860636
sv0.14425427872860636
reliabletrue
passestrue
3
name"Hunter"
dialogue"Right. Okay. I'm guessing you're not from around here. You were at the apple festival last weekend, weren't you? Taking pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.7977941176470589
tl0.7082743988684583
nl0.5727602278612118
da0.4990892531876139
fr0.47982345523329134
no0.47652284263959394
de0.3519245875883739
sv0.3336025848142165
sq0.31478405315614616
ca0.3130724396336387
et0.30846605196982396
ms0.30788590604026844
es0.28879310344827586
it0.25406871609403253
pt0.2479489516864175
ro0.24657534246575344
cs0.24311926605504589
sk0.24311926605504589
sl0.23822714681440443
pl0.22897196261682243
is0.21203438395415475
hr0.19590643274853803
yo0.17992047713717693
tr0.16582406471183014
lv0.15036045314109164
fi0.14772727272727273
lt0.13249211356466878
az0.12513255567338283
hu0.07511210762331838
reliabletrue
passestrue
4
name"Marie"
dialogue"Le festival? Oui, oui, j'y étais... mais... quelque chose d'étrange s'est passé. J'ai vu un homme... près de la grange. Il criait. Et puis... plus rien. Il a disparu."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8102106661605618
ca0.6130030959752323
it0.5862639635912288
pt0.5431703974417542
ro0.5366079703429101
es0.5196926032660903
da0.49469429004547755
en0.4892747701736465
no0.4837377387712959
nl0.3857493857493857
yo0.375
de0.3706733794839521
et0.3662864385297845
tl0.3552546744036106
hu0.3412384716732542
sv0.3408042188529994
sq0.3201903467029232
sl0.31176875430144524
cs0.30891499654457505
lv0.2867332382310985
lt0.2800575953923686
hr0.2753623188405797
sk0.2732558139534884
ms0.27007299270072993
az0.26793557833089315
tr0.2057188244638602
pl0.19224555735056545
fi0.16943521594684383
vi0.1334488734835355
eu0.12280701754385964
is0.12280701754385964
reliabletrue
passestrue
5
name"Hunter"
dialogue"I'm sorry, I don't... barn? Did you say something about a barn? Grange... that's barn, right?"
detectedLang"en"
heavyLang"en"
scores
en0.8145025295109612
tl0.6102055279943304
no0.5058400718778077
da0.5031616982836495
it0.434156378600823
pt0.4216614090431125
cs0.40476190476190477
sv0.40217391304347827
sq0.39890710382513656
fr0.394273127753304
yo0.38684503901895206
ca0.38478747203579416
hr0.3663594470046083
pl0.35370152761457113
de0.3483412322274882
ro0.3436754176610978
es0.33894230769230765
sk0.32182490752157833
hu0.28848641655886154
nl0.2838541666666667
is0.28104575163398693
lt0.27055702917771884
sl0.21316165951359084
tr0.2109038737446198
ms0.2040520984081042
az0.19472913616398244
lv0.19472913616398244
vi0.19472913616398244
et0.1863905325443787
be0.11290322580645161
eu0.11290322580645161
fi0.10277324632952692
uk0.10277324632952692
reliabletrue
passestrue
6
name"Marie"
dialogue"Oui! La grange! J'ai pris des photos, mais quand je les regarde... il y a une ombre. Quelque chose qui bouge. Ça me fait peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8182819383259913
ca0.5927936821322803
it0.5803662258392676
es0.5736434108527132
en0.536777091521617
pt0.4808055380742605
ro0.4254874651810585
no0.4194229415904293
nl0.4181946403385049
de0.41654879773691655
tl0.39560439560439564
sl0.3697478991596639
yo0.3483412322274882
hr0.3394715772618095
pl0.3102006688963211
sq0.30203045685279184
vi0.298469387755102
da0.2978723404255319
cs0.29062768701633707
sk0.2881794650560828
lt0.2112810707456979
sv0.2005813953488372
az0.1831683168316832
tr0.16328600405679514
et0.1607324516785351
hu0.15902140672782875
ms0.15123456790123457
lv0.14596273291925466
fi0.14330218068535827
hi0.08536585365853659
is0.08333333333333334
eu0.0782122905027933
reliabletrue
passestrue
7
name"Hunter"
dialogue"Photos. You've got photos? Listen, this could be important. Can you show me?"
detectedLang"en"
heavyLang"en"
scores
en0.801762114537445
fr0.6243739565943239
tl0.5912806539509536
pt0.5287958115183247
ca0.49776785714285715
es0.4955156950672646
nl0.48216340621403914
no0.47491248541423564
ro0.4289340101522843
it0.4260204081632653
da0.40789473684210525
sq0.3818681318681319
fi0.36886395511921455
lt0.36886395511921455
de0.3635077793493635
sv0.3401759530791789
tr0.33234421364985167
hu0.30448222565687794
lv0.25864909390444807
sl0.24623115577889448
cs0.23857868020304565
eu0.20634920634920634
yo0.19642857142857142
et0.17431192660550457
ms0.15730337078651685
az0.14611005692599618
hi0.14611005692599618
hr0.14285714285714285
is0.1346153846153846
pl0.12959381044487428
sk0.11591355599214145
reliabletrue
passestrue
8
name"Marie"
dialogue"Regardez... ici. Vous voyez? Cette forme sombre derrière les arbres. Ce n'était pas un animal. Je le sais. J'étais là. Je tremblais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8011928429423459
ca0.5517928286852589
es0.5222929936305732
it0.494949494949495
nl0.44717444717444715
ro0.4353826850690088
pt0.3890020366598778
sl0.3675333801827126
yo0.3473531544597534
lv0.3212669683257918
hr0.29411764705882354
lt0.28457869634340227
en0.2598684210526316
de0.25434962717481363
tl0.2474916387959866
no0.24496644295302009
sk0.23857868020304565
hu0.23728813559322032
cs0.1891891891891892
sq0.1891891891891892
da0.1712707182320442
pl0.14933837429111532
vi0.14853358561967833
tr0.1420400381315539
az0.13710450623202303
ms0.13710450623202303
is0.07216494845360825
eu0.06542056074766354
sv0.06542056074766354
reliabletrue
passestrue
9
name"Hunter"
dialogue"Okay... okay, I can see you're upset. I wish I understood a word you're saying, but that picture... something's not right there."
detectedLang"en"
heavyLang"en"
scores
en0.799944812362031
tl0.5885357548240636
no0.4067103109656301
da0.40230832646331405
de0.40082644628099173
sv0.3623570800351803
tr0.35669920141969835
fr0.3503584229390681
sq0.3287037037037037
ca0.3262081784386617
yo0.3262081784386617
hr0.31732580037664787
it0.3101807802093245
cs0.3068833652007648
pl0.2988394584139265
ro0.2974806201550388
et0.2899118511263467
sk0.28641732283464566
hu0.2352320675105485
pt0.23117709437963943
az0.22459893048128343
es0.22459893048128343
sl0.18994413407821228
fi0.1881298992161254
nl0.1751990898748578
lt0.16666666666666666
is0.15990730011587484
lv0.15501165501165504
vi0.15501165501165504
be0.0880503144654088
eu0.0880503144654088
ms0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue
10
name"Marie"
dialogue"J'ai peur. Depuis ce jour, je ne dors plus. Et maintenant, des gens disparaissent dans cette ville, n'est-ce pas? Je l'ai vu dans les journaux."
detectedLang"fr"
heavyLang"fr"
scores
fr0.821014950515898
ca0.5691839837810441
no0.48391013964784463
en0.4798041615667074
da0.45652173913043476
ro0.44115713346482577
de0.40807799442896936
it0.4043447792571829
tl0.34765924788948577
sq0.34565050038491146
nl0.34514637904468415
et0.3156199677938808
fi0.30213464696223313
es0.2951907131011609
sv0.2735042735042735
sl0.26151172893136404
cs0.2595818815331011
lt0.2537313432835821
hr0.2504409171075838
lv0.24911660777385158
pt0.24712134632418067
hu0.236983842010772
sk0.20112781954887218
tr0.17153996101364524
yo0.16090819348469892
pl0.09670563230605739
az0.09188034188034187
ms0.08993576017130622
is0.06900328587075576
reliabletrue
passestrue
11
name"Hunter"
dialogue"Three people gone in two months. No trace. And you're telling me — well, I think you're telling me — you saw something at that barn."
detectedLang"en"
heavyLang"en"
scores
en0.8250116658889406
tl0.6651785714285715
no0.4996664442961974
da0.4322482967448903
it0.43138741470811215
sv0.402390438247012
nl0.3786246893123446
ca0.3723849372384937
ms0.3676222596964587
es0.33862433862433866
pt0.33095450490633366
pl0.32614555256064687
sq0.31255728689275897
fr0.3081180811808118
yo0.30747922437673125
hr0.2850333651096282
de0.28023032629558536
ro0.2795389048991354
cs0.2697176241480039
et0.24698795180722888
sl0.24395161290322584
sk0.22839506172839508
tr0.22440537745604963
lv0.20550847457627117
az0.1638795986622074
is0.15730337078651685
fi0.1515837104072398
be0.08536585365853659
hu0.08200734394124846
lt0.07749077490774908
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
12
name"Marie"
dialogue"Je ne sais pas ce que j'ai vu. Mais ce n'était pas normal. Personne ne me croit... et je ne peux même pas expliquer correctement."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8243427017225748
ca0.5967741935483871
pt0.5703991130820399
es0.5242480049109883
en0.4877726371447455
sq0.4610570236439499
nl0.45917655268667135
it0.45879888268156427
ro0.4511331444759207
de0.3978243978243978
no0.3940578577013292
hr0.375
sl0.36631234668847096
tl0.35416666666666663
da0.353628023352794
cs0.3459915611814346
ms0.3318965517241379
et0.3231441048034934
sv0.3111111111111111
lt0.3030575539568345
sk0.296094459582198
tr0.28040854224698236
pl0.26260704091341575
az0.2475728155339806
lv0.24019607843137253
fi0.22577422577422576
yo0.22577422577422576
hu0.2115971515768057
eu0.07957244655581948
is0.07517899761336516
reliabletrue
passestrue
13
name"Hunter"
dialogue"We'll figure this out. I'll find someone who speaks French. Just... don't go anywhere near that barn, alright? Do you understand? Barn. No."
detectedLang"en"
heavyLang"en"
scores
en0.7901831129196338
tl0.5494265428727472
da0.43337912087912084
no0.43298969072164945
pt0.39293598233995586
sv0.3346774193548387
de0.3341404358353511
pl0.3287225386493084
es0.3164871582435791
sk0.2744063324538259
cs0.26339285714285715
ca0.25942549371633755
sq0.2479489516864175
et0.22607879924953095
yo0.2172675521821632
it0.21503330161750714
fr0.2112810707456979
hr0.2112810707456979
ro0.2112810707456979
nl0.17746759720837485
is0.15471311475409835
lv0.13702928870292888
sl0.12698412698412698
vi0.1185897435897436
tr0.09638554216867469
reliabletrue
passestrue
14
name"Marie"
dialogue"La grange... non. D'accord. Je comprends ça, au moins."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8207456978967496
it0.693126022913257
ca0.6246246246246246
ro0.6145940390544706
en0.6014877789585548
es0.5828698553948832
tl0.5588235294117647
nl0.5381773399014779
yo0.46197991391678617
de0.45255474452554745
no0.4140625
hr0.38825448613376834
sl0.3822075782537067
cs0.35456110154905335
pt0.35344827586206895
sk0.35233160621761656
da0.33035714285714285
pl0.30037313432835816
lt0.27884615384615385
sq0.267578125
eu0.1883116883116883
vi0.1830065359477124
sv0.1515837104072398
reliabletrue
passestrue
15
name"Hunter"
dialogue"Hold on — sorry, I've got to take this. Detective Hunter... Where? ... I'm on my way. — Miss, I'm sorry, I have to go. Another one's missing. Stay here in town, okay? I'll come back. With a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8092296511627908
tl0.6380558428128231
da0.5072735804786485
it0.49103247697527874
pl0.4534096824570536
ro0.445324881141046
ca0.4195688225538972
no0.39620471535365154
sl0.39620471535365154
sq0.3941142527409118
pt0.39271255060728744
nl0.3920092646207296
de0.38953488372093026
sv0.38632378725891287
cs0.38596491228070173
hr0.38089622641509435
fr0.3797991730655641
yo0.3570116350275567
sk0.34701492537313433
ms0.3247588424437299
es0.3168510084580351
et0.3069306930693069
az0.24514737598849745
lv0.23469387755102045
lt0.23133235724743775
fi0.21700223713646533
is0.2164179104477612
tr0.2039423805913571
hu0.17517674783974863
vi0.17387883556254916
eu0.11541701769165964
hi0.07407407407407407
be0.0625
uk0.05660377358490566
reliabletrue
passestrue
16
name"Marie"
dialogue"Attendez! S'il vous plaît... faites attention. Cette ville cache quelque chose. Je le sens."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8134328358208955
en0.6197718631178707
de0.5555555555555556
it0.5334370139968896
no0.4957983193277311
da0.48805460750853247
es0.45701357466063347
ca0.44495837187789083
yo0.4258373205741627
nl0.42028985507246375
tl0.41234084231145934
sv0.4017946161515453
ro0.37629937629937626
et0.3743482794577685
sl0.3730407523510972
fi0.35965848452508004
pt0.34782608695652173
hu0.3181818181818182
hr0.2840095465393795
cs0.19678714859437751
tr0.19678714859437751
sk0.19463087248322147
sq0.18699186991869918
lt0.1836734693877551
lv0.1836734693877551
pl0.13169319826338638
zh0.1137370753323486
az0.10044977511244377
ms0.10044977511244377
is0.09502262443438914
reliabletrue
passestrue
17
name"Hunter"
dialogue"I don't know what you just said... but I think we're saying the same thing."
detectedLang"en"
heavyLang"en"
scores
en0.8361252731245449
tl0.5403472931562819
no0.4260204081632653
sv0.4140625
et0.38101788170563966
da0.3253373313343328
hr0.3253373313343328
ca0.32330827067669177
sq0.3202416918429003
yo0.30124223602484473
nl0.2902208201892744
cs0.2890995260663507
tr0.2741935483870968
fr0.2694805194805195
ms0.25742574257425743
pl0.21875
it0.20353982300884957
ro0.16666666666666666
sk0.13793103448275862
be0.1346153846153846
hu0.12959381044487428
az0.12280701754385964
is0.12280701754385964
lt0.12280701754385964
lv0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue