Run: 2026-07-25-01KYD7M001H5QXXX3XY6G7RJGF

Run Details

Model:
MoonshotAI: Kimi K3 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
17.0s
Cost:
$0.007568
Provider:
Moonshot AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Oh... ces photos... quelque chose ne va pas ici..." Hunter: "Excuse me, ma'am? Detective Hunter. Mind if I ask you a few questions about the missing hiker from the festival last weekend?" Marie: "Pardon? Je... je ne comprends pas. Je ne parle pas anglais." Hunter: "French, huh? Great. Just great. Look—did you see anything unusual near the orchard that night?" Marie: "J'ai vu quelque chose... près du verger. Une silhouette. C'était terrifiant." Hunter: "You're pointing at your camera. Did you... take a picture of something?" Marie: "Oui, oui! Une photo! Regardez—là, entre les arbres. Quelqu'un était là." Hunter: "Whoa, slow down. I can't—okay, okay, show me. Point. Yeah, the photo. Huh. That shadow there... that could be something." Marie: "Je suis désolée, je suis tellement secouée. Depuis ce soir-là, je ne dors plus." Hunter: "I know, I know. Look, I wish I understood a word you're saying, but this photo—this might actually help the case. Can I—may I? Take this to the station?" Marie: "Oui... prenez-la. S'il vous plaît, trouvez cette personne." Hunter: "I'll take that as a yes. Thank you, ma'am. Stay in town, alright? We'll figure out a way to—hold on. Sorry, I've got to take this. ...Detective Hunter. ...Where? ...On my way." Marie: "Qu'est-ce qui se passe? Quelque chose est arrivé?" Hunter: "I don't know how to say this so you'll understand, but—I've got to go. Another disappearance. Stay safe, okay? Merci—I mean—thanks." Marie: "Attendez! Faites attention à vous!"
created_at"2026-07-25T18:11:54.504Z" 7/25/2026, 6:11:54 PM
model"moonshotai/kimi-k3-20260715"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2985
moderation_latency(null)
generation_time16940
tokens_prompt303
tokens_completion414
native_tokens_prompt363
native_tokens_completion478
native_tokens_completion_images(null)
native_tokens_reasoning14
native_tokens_cached256
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0075678
router(null)
provider_responses
0
endpoint_id"650c9b12-7b6d-444d-8d92-df8daef84d7a"
id"chatcmpl-6a64fc6878010525815a5d96"
is_byokfalse
latency2985
model_permaslug"moonshotai/kimi-k3-20260715"
provider_name"Moonshot AI"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1785003114-LnSNLkFRNRi4dtsV9s7M"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1785003114-BdpMOw050uMkJ9CPuh3M"
upstream_id"chatcmpl-6a64fc6878010525815a5d96"
total_cost0.0075678
cache_discount0.0006912
upstream_inference_cost0
provider_name"Moonshot AI"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Oh... ces photos... quelque chose ne va pas ici..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8106060606060606
en0.5732574679943101
ca0.5645863570391872
it0.5081967213114754
nl0.4889267461669506
lt0.4845360824742268
ro0.4434137291280148
sq0.44237918215613387
es0.375
lv0.3670886075949367
de0.33184855233853006
sl0.29906542056074764
hr0.2736077481840194
tr0.23857868020304565
fi0.22680412371134018
ms0.21875
cs0.21465968586387435
hu0.21465968586387435
pt0.21052631578947367
hi0.20424403183023873
tl0.20424403183023873
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, ma'am? Detective Hunter. Mind if I ask you a few questions about the missing hiker from the festival last weekend?"
detectedLang"en"
heavyLang"en"
scores
en0.7823860727086533
tl0.6132848043676069
fr0.575
nl0.568089430894309
it0.5521601685985247
da0.5478723404255319
ca0.5232753785754347
no0.5186862967157418
pt0.5145631067961165
sv0.4934445768772348
sq0.45652173913043476
es0.44115713346482577
ro0.43633952254641906
cs0.40308988764044945
et0.4026704146170063
ms0.4026704146170063
hr0.379108838568298
sl0.366144668158091
de0.3550834597875569
sk0.3178170144462279
hu0.3078175895765472
pl0.30327868852459017
az0.27101200686106347
yo0.2691315563198624
is0.25438596491228066
fi0.24712134632418067
lt0.24174843889384479
tr0.19507575757575757
lv0.18738049713193117
vi0.1353001017293998
be0.07608695652173912
eu0.07608695652173912
uk0.06900328587075576
reliabletrue
passestrue
2
name"Marie"
dialogue"Pardon? Je... je ne comprends pas. Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.768160741885626
lt0.6805111821086262
sl0.6345919610231425
ca0.6323529411764706
cs0.6113989637305699
it0.5989304812834225
sq0.5607613469985359
nl0.5529061102831594
ro0.5419847328244275
es0.5405819295558958
en0.5398773006134969
hr0.5363214837712519
sk0.48805460750853247
tl0.47643979057591623
lv0.460431654676259
de0.4230769230769231
pt0.3814432989690722
yo0.35205183585313177
pl0.34497816593886466
tr0.33774834437086093
hu0.33184855233853006
ms0.3288590604026846
fi0.22680412371134018
az0.1891891891891892
et0.17355371900826447
da0.16434540389972147
no0.16434540389972147
sv0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"French, huh? Great. Just great. Look—did you see anything unusual near the orchard that night?"
detectedLang"en"
heavyLang"en"
scores
en0.8092926490984743
tl0.6145760336370006
et0.4066882416396979
no0.30730478589420657
ms0.29757343550446996
fr0.29214929214929214
yo0.24760601915184677
sv0.24657534246575344
sq0.2445054945054945
es0.2413793103448276
pt0.23611111111111113
nl0.22425952045133993
da0.21652421652421652
de0.21316165951359084
ro0.15384615384615385
cs0.12420382165605094
ca0.12280701754385964
it0.12280701754385964
reliabletrue
passestrue
4
name"Marie"
dialogue"J'ai vu quelque chose... près du verger. Une silhouette. C'était terrifiant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8039581777445856
de0.5056497175141244
en0.5047169811320754
da0.4198895027624309
it0.4186046511627907
no0.4120940649496081
ca0.4114349775784753
nl0.3902439024390244
sv0.32432432432432434
lt0.2698191933240611
hu0.25742574257425743
tr0.24242424242424243
eu0.2128935532233883
az0.20933734939759033
vi0.15865384615384615
ro0.12935323383084577
pt0.12060301507537688
es0.11764705882352942
sq0.11764705882352942
et0.10714285714285714
fi0.10102739726027396
pl0.10102739726027396
reliabletrue
passestrue
5
name"Hunter"
dialogue"You're pointing at your camera. Did you... take a picture of something?"
detectedLang"en"
heavyLang"en"
scores
en0.8145979703356753
tl0.7192671394799054
ro0.5216515609264853
it0.5187436676798379
fr0.463882618510158
no0.4583808437856328
ms0.4457409568261376
nl0.4405182567726737
de0.4398584905660377
da0.40476190476190477
es0.39413265306122447
yo0.38946015424164526
pt0.375
hr0.3581081081081081
sl0.343015214384509
is0.33473389355742295
ca0.3338008415147265
sv0.32142857142857145
cs0.3065693430656934
pl0.2931547619047619
lt0.26127527216174184
hu0.24722662440570525
sq0.2313915857605178
sk0.21487603305785125
tr0.1394927536231884
az0.12844036697247707
eu0.12844036697247707
lv0.12844036697247707
vi0.12844036697247707
et0.1171003717472119
fi0.1171003717472119
reliabletrue
passestrue
6
name"Marie"
dialogue"Oui, oui! Une photo! Regardez—là, entre les arbres. Quelqu'un était là."
detectedLang"fr"
heavyLang"fr"
scores
fr0.803921568627451
ca0.609375
es0.5322245322245323
it0.4724501758499414
en0.4289340101522843
pt0.4140625
ro0.30769230769230765
vi0.25864909390444807
tl0.25124792013311154
nl0.1818181818181818
no0.1712707182320442
cs0.16356877323420074
yo0.16356877323420074
de0.14772727272727273
hi0.14611005692599618
reliabletrue
passestrue
7
name"Hunter"
dialogue"Whoa, slow down. I can't—okay, okay, show me. Point. Yeah, the photo. Huh. That shadow there... that could be something."
detectedLang"en"
heavyLang"en"
scores
en0.7847576530612245
tl0.5843596059113301
fr0.5
sq0.3935309973045822
da0.35406698564593303
no0.3290258449304175
yo0.3105209397344229
nl0.266304347826087
pt0.2647058823529412
ms0.26229508196721313
pl0.24412094064949608
sv0.24242424242424243
it0.22413793103448276
cs0.22235023041474655
hu0.21420256111757857
es0.21052631578947367
de0.20867526377491208
lt0.2058823529411765
et0.18967587034813926
hr0.17076167076167076
ca0.16974169741697415
ro0.11764705882352942
sl0.11533420707732633
hi0.10239361702127658
fi0.09999999999999999
sk0.09638554216867469
be0.09395973154362416
tr0.09395973154362416
az0.08536585365853659
is0.08536585365853659
lv0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue
8
name"Marie"
dialogue"Je suis désolée, je suis tellement secouée. Depuis ce soir-là, je ne dors plus."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8023304203079484
ro0.5774021352313167
en0.4825708061002179
nl0.4318181818181818
it0.4256348246674728
hr0.4221411192214112
yo0.39797211660329534
sl0.38788659793814434
cs0.3807040417209909
ca0.3546195652173913
sq0.3466299862448418
tl0.33751743375174337
sk0.30453879941434847
lv0.2899850523168909
tr0.2835595776772248
pt0.2543171114599686
pl0.24960505529225907
vi0.24841772151898736
de0.24603174603174602
az0.23878205128205127
hu0.23387096774193547
da0.23263327948303714
sv0.22764227642276424
no0.22512234910277326
lt0.18941979522184302
et0.15630550621669628
fi0.15630550621669628
es0.13003663003663005
reliabletrue
passestrue
9
name"Hunter"
dialogue"I know, I know. Look, I wish I understood a word you're saying, but this photo—this might actually help the case. Can I—may I? Take this to the station?"
detectedLang"en"
heavyLang"en"
scores
en0.8278542869835629
tl0.6537086684539768
no0.5254133496631966
da0.5248313917841815
fr0.5224892174984596
yo0.5009658725048294
sv0.4640387275242047
cs0.4375907111756169
pl0.3954758190327613
sk0.3834526650755768
ro0.38099041533546324
ca0.37348423605497166
nl0.3719611021069692
hr0.3568464730290456
de0.35416666666666663
it0.35146443514644354
tr0.33074265975820377
sl0.3123336291038154
sq0.3117229129662522
lt0.29481346678798903
lv0.2909423604757548
az0.2604961832061069
es0.23115079365079366
vi0.22577422577422576
hu0.22344689378757512
pt0.22344689378757512
ms0.2051282051282051
et0.19270833333333331
fi0.15760869565217392
is0.15115005476451257
hi0.0903755868544601
zh0.0903755868544601
be0.08284023668639054
eu0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
10
name"Marie"
dialogue"Oui... prenez-la. S'il vous plaît, trouvez cette personne."
detectedLang"fr"
heavyLang"fr"
scores
fr0.821852731591449
it0.5856353591160222
ca0.5546318289786223
es0.4806094182825485
no0.43524096385542166
ro0.39320388349514557
de0.39123376623376627
nl0.38524590163934425
tr0.3697478991596639
da0.33035714285714285
hu0.3267504488330341
en0.29245283018867924
sq0.29245283018867924
tl0.2870722433460076
eu0.2732558139534884
hr0.2704280155642024
sk0.2704280155642024
pt0.2690058479532163
yo0.19700214132762314
sl0.19527896995708155
ms0.19006479481641467
sv0.1883116883116883
vi0.1830065359477124
lv0.16666666666666666
lt0.1610738255033557
is0.14383561643835618
az0.1359447004608295
cs0.1359447004608295
et0.1359447004608295
pl0.1359447004608295
reliabletrue
passestrue
11
name"Hunter"
dialogue"I'll take that as a yes. Thank you, ma'am. Stay in town, alright? We'll figure out a way to—hold on. Sorry, I've got to take this. ...Detective Hunter. ...Where? ...On my way."
detectedLang"en"
heavyLang"en"
scores
en0.7971818958155422
tl0.603836530442035
ro0.43753700414446417
fr0.42839951865222625
pt0.41824862216778935
it0.41610325752919486
de0.38985228002569045
da0.3859082094376212
yo0.37989556135770236
cs0.3766404199475065
sl0.3745885450954575
ca0.3670886075949367
pl0.3448275862068966
no0.3356643356643356
sq0.3300423131170663
sk0.30808448652585574
hr0.2873218304576144
es0.28517682468021066
nl0.2808478425435276
sv0.24423229912490055
ms0.23448831587429494
hu0.20100925147182505
et0.18594687232219365
vi0.18454935622317598
fi0.1831470335339639
lv0.16812609457092817
lt0.16373239436619716
az0.1394927536231884
tr0.1252302025782689
hi0.08123791102514508
is0.07317073170731707
eu0.06862745098039216
reliabletrue
passestrue
12
name"Marie"
dialogue"Qu'est-ce qui se passe? Quelque chose est arrivé?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8300970873786407
it0.6644295302013423
ca0.5838287752675386
en0.5302013422818792
ro0.5077355836849508
pt0.4672754946727549
da0.4318181818181818
de0.41373534338358464
sv0.4006849315068493
no0.39759036144578314
cs0.3902439024390244
sq0.38380281690140844
es0.36823104693140796
et0.3137254901960784
nl0.2886178861788618
hr0.2753623188405797
sl0.2738589211618257
yo0.23413566739606126
fi0.22566371681415928
eu0.20273348519362186
sk0.2009132420091324
is0.1566265060240964
ms0.1566265060240964
reliabletrue
passestrue
13
name"Hunter"
dialogue"I don't know how to say this so you'll understand, but—I've got to go. Another disappearance. Stay safe, okay? Merci—I mean—thanks."
detectedLang"en"
heavyLang"en"
scores
en0.8000499875031242
tl0.560197910940077
no0.465954606141522
da0.4612794612794613
pl0.4002998500749625
yo0.37791601866251945
cs0.3670886075949367
sk0.3640699523052464
nl0.3620414673046252
de0.35846030473135526
it0.35012185215272135
fr0.3485342019543974
sl0.33554817275747506
sv0.30374238468233244
hr0.28186714542190305
vi0.27732610659439927
es0.23809523809523808
ca0.21568627450980393
sq0.19436052366565962
lv0.18781725888324874
lt0.17269906928645296
ms0.17269906928645296
ro0.17012448132780084
pt0.1543340380549683
tr0.14802981895633652
is0.14621131270010673
be0.08045977011494253
hu0.07727797001153403
az0.07300115874855156
et0.07300115874855156
uk0.07300115874855156
reliabletrue
passestrue
14
name"Marie"
dialogue"Attendez! Faites attention à vous!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.82
en0.725943970767357
pt0.6107266435986158
de0.6031746031746031
es0.5841035120147875
ca0.5656370656370656
yo0.5544554455445544
no0.5517928286852589
tl0.5436105476673428
da0.5322245322245323
it0.5302713987473904
sv0.5098039215686274
nl0.5022123893805309
et0.4655581947743468
fi0.39189189189189183
lt0.375
lv0.375
zh0.2549668874172185
ro0.23728813559322032
az0.22945205479452058
hr0.22945205479452058
ms0.22945205479452058
sl0.22945205479452058
sq0.22945205479452058
tr0.22413793103448276
reliabletrue
passestrue