Run: 2026-04-24-01KQ06F62K1WANXSJJ8NWWC5ST

Run Details

Model:
MoonshotAI: Kimi K2.6
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
4m 5s
Cost:
$0.025720
Provider:
SiliconFlow

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Miss. Detective Hunter, Alborn County. I need to ask you some questions." Marie: "Pardon ? Je... je ne comprends pas. Je ne parle pas anglais. Pas du tout." Hunter: "You don't speak English. Great. Look, did you see anything unusual at the apple festival last night? Another person disappeared." Marie: "Le festival des pommes ? Oui, j'y étais ! J'ai pris des photos du paysage près de la rivière. Mais il y avait quelque chose d'autre... une silhouette derrière les arbres. J'ai entendu un bruit terrible. J'ai tremblé, je n'ai pas pu bouger..." Hunter: "You're obviously upset. I get that. But I can't understand a word. Is there anyone here who speaks English? A friend?" Marie: "Un ami ? Non, je suis seule ! Vous ne comprenez donc rien ? Mon appareil ! Regardez les photos ! L'homme au manteau noir était là, près de la femme. Elle est disparue, n'est-ce pas ? C'est ça que vous cherchez ?" Hunter: "Lady, you're waving that camera in my face and I don't know why. Just... hold onto it. Tight. Do not delete anything." Marie: "Supprimer ? Non ! Je veux vous donner les images ! Vous devez les voir avant qu'il ne revienne. C'est un monstre... cette ville me terrifie. Je veux rentrer chez moi..." Hunter: "Hunter. ... Yeah. ... Since when? ... Copy, I'm on my way." Marie: "Qu'est-ce que c'est ? Une urgence ? Vous partez ?" Hunter: "I gotta go. Emergency call. You stay right here. Don't move. I'll send an interpreter to the station. Bring that camera. Two hours." Marie: "Non ! Attendez ! Vous ne pouvez pas partir ! Il est encore dehors ! Revenez ! Monsieur !" Hunter: "Station. Two hours. Don't be late."
created_at"2026-04-24T16:51:47.939Z" 4/24/2026, 4:51:47 PM
model"moonshotai/kimi-k2.6-20260420"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency686
moderation_latency(null)
generation_time244453
tokens_prompt316
tokens_completion6360
native_tokens_prompt278
native_tokens_completion6364
native_tokens_completion_images(null)
native_tokens_reasoning5885
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0257201
router(null)
provider_responses
0
endpoint_id"6ebc1d51-2760-4277-8c1e-c8ce9e01c18e"
id"019dc0679976457f1e5e79bcc4bfb4f2"
is_byokfalse
latency682
model_permaslug"moonshotai/kimi-k2.6-20260420"
provider_name"SiliconFlow"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1777049507-H7WWEmDDnB9aehB0BOK1"
session_id(null)
api_type"completions"
id"gen-1777049507-lofPr53ijsQqrxJ4HkGr"
upstream_id"019dc0679976457f1e5e79bcc4bfb4f2"
total_cost0.0257201
cache_discount(null)
upstream_inference_cost0
provider_name"SiliconFlow"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Miss. Detective Hunter, Alborn County. I need to ask you some questions."
detectedLang"en"
heavyLang"en"
scores
en0.8044462741869082
tl0.6357361963190185
fr0.5634191176470589
no0.5539906103286385
it0.5497630331753555
ca0.5221327967806841
da0.4626696832579186
pt0.46145124716553293
ro0.45776255707762553
cs0.4483159117305459
hr0.40401505646173147
sq0.37582128777923784
sv0.36666666666666664
pl0.3546195652173913
es0.3484224965706447
sl0.34210526315789475
yo0.32045779685264664
sk0.3004418262150221
et0.2983751846381093
lv0.2803030303030303
de0.2658423493044822
lt0.2601246105919003
nl0.23387096774193547
tr0.21357615894039736
be0.12844036697247707
hu0.12361623616236161
az0.1171003717472119
is0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
ms0.11048689138576778
reliabletrue
passestrue
1
name"Marie"
dialogue"Pardon ? Je... je ne comprends pas. Je ne parle pas anglais. Pas du tout."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7877501516070345
lt0.6774193548387096
sl0.5981630309988519
ca0.5958429561200923
cs0.5742092457420924
it0.5614035087719298
sq0.5225102319236016
nl0.5145631067961165
ro0.5035460992907801
es0.5021337126600285
en0.5014245014245015
hr0.49784791965566716
de0.48377581120943947
sk0.4496855345911949
tl0.43820224719101125
lv0.42244224422442245
da0.34579439252336447
pt0.34579439252336447
sv0.3320610687022901
no0.317738791423002
yo0.317738791423002
pl0.3110236220472441
tr0.30417495029821073
hu0.2985971943887776
ms0.29577464788732394
eu0.2886178861788618
vi0.22048997772828507
fi0.2009132420091324
az0.16666666666666666
et0.15254237288135594
reliabletrue
passestrue
2
name"Hunter"
dialogue"You don't speak English. Great. Look, did you see anything unusual at the apple festival last night? Another person disappeared."
detectedLang"en"
heavyLang"en"
scores
en0.8046002679767753
tl0.5882352941176471
da0.4813278008298755
no0.4615384615384615
ms0.4336569579288026
fr0.42959582790091266
es0.4067796610169492
nl0.4067796610169492
et0.37855113636363635
de0.37005039596832257
sv0.36777456647398843
it0.3425995492111195
sq0.3425995492111195
pt0.3222308288148722
ro0.29943955164131303
hr0.27506213753106873
cs0.2702251876563803
ca0.2527754056362084
lt0.18452935694315006
sl0.1760828625235405
yo0.17140151515151517
az0.1682509505703422
sk0.1682509505703422
eu0.13708086785009863
lv0.1362290227048371
is0.13280475718533202
hu0.12935323383084577
pl0.12236710130391174
tr0.07112526539278131
fi0.06716417910447761
reliabletrue
passestrue
3
name"Marie"
dialogue"Le festival des pommes ? Oui, j'y étais ! J'ai pris des photos du paysage près de la rivière. Mais il y avait quelque chose d'autre... une silhouette derrière les arbres. J'ai entendu un bruit terrible. J'ai tremblé, je n'ai pas pu bouger..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7952173338618047
ca0.5607820912439784
es0.5032051282051282
it0.4555672637864418
en0.43656852053798617
nl0.4297277409860191
pt0.39310884886452624
da0.3846764589122668
no0.37094155844155846
de0.35870914356640465
ro0.35550935550935553
tl0.29159049360146255
sl0.27127409496944055
yo0.27127409496944055
lt0.2493946731234867
sv0.23907707412862053
cs0.23682914820285572
sq0.23076923076923078
hu0.2226680040120361
lv0.20634920634920634
hr0.1935483870967742
sk0.19312857886517437
az0.18805657412257726
tr0.17728237791932058
ms0.17377398720682302
eu0.1711229946524064
pl0.1702355460385439
et0.15760869565217392
vi0.15346805024576735
fi0.07296650717703348
hi0.04732636754763368
reliabletrue
passestrue
4
name"Hunter"
dialogue"You're obviously upset. I get that. But I can't understand a word. Is there anyone here who speaks English? A friend?"
detectedLang"en"
heavyLang"en"
scores
en0.8129374849143134
tl0.508248730964467
de0.43513119533527694
no0.43389335281227176
nl0.43347953216374274
da0.4297277409860191
sv0.3844320889594917
is0.3426632739609839
cs0.33986371379897784
sq0.33132010353753233
sk0.32842287694974004
hu0.3272569444444444
ro0.3260869565217392
yo0.296094459582198
hr0.2941712204007286
pl0.2850553505535055
ca0.2612011439466158
et0.25480769230769235
it0.23645320197044337
fr0.20918367346938777
fi0.17815482502651114
tr0.1594360086767896
lt0.15760869565217392
pt0.15300546448087432
ms0.14835164835164832
az0.14647577092511013
lv0.14647577092511013
vi0.14647577092511013
es0.14553472987872104
sl0.10404624277456648
be0.08284023668639054
eu0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
5
name"Marie"
dialogue"Un ami ? Non, je suis seule ! Vous ne comprenez donc rien ? Mon appareil ! Regardez les photos ! L'homme au manteau noir était là, près de la femme. Elle est disparue, n'est-ce pas ? C'est ça que vous cherchez ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8194945848375451
ca0.5917750226791654
es0.5122832369942196
ro0.5027624309392266
it0.5005549389567148
pt0.3471953578336557
nl0.3443419135502671
en0.337260677466863
yo0.3150684931506849
no0.2566079295154185
sq0.24916573971078973
lv0.23943661971830987
da0.23251847640704945
tl0.22901199314677329
de0.2227979274611399
lt0.21420256111757857
sl0.1823137492428831
cs0.18082524271844658
eu0.18082524271844658
hu0.1758241758241758
hr0.17380660954712362
tr0.16512059369202228
vi0.15147705845380263
sk0.13682864450127877
fi0.11822338340953624
hi0.10299003322259136
ms0.09819639278557114
sv0.0778688524590164
pl0.06315058986814712
et0.053959355290819896
az0.0445859872611465
reliabletrue
passestrue
6
name"Hunter"
dialogue"Lady, you're waving that camera in my face and I don't know why. Just... hold onto it. Tight. Do not delete anything."
detectedLang"en"
heavyLang"en"
scores
en0.801954053340375
tl0.5897155361050328
ro0.46197991391678617
sq0.40191387559808617
yo0.4009584664536741
sv0.3980738362760835
it0.3936944219886823
no0.38271604938271603
pl0.3723849372384937
nl0.34612031386224934
da0.34325744308231176
ca0.33862433862433866
sl0.3175614194722475
cs0.30167597765363136
pt0.2944496707431797
de0.2809204218600192
sk0.27884615384615385
hr0.2566897918731417
fr0.24849699398797598
et0.24242424242424243
ms0.23076923076923078
tr0.2291880781089414
vi0.1883116883116883
es0.1812227074235808
hu0.16759156492785796
lv0.1657397107897664
az0.1638795986622074
be0.08536585365853659
is0.07749077490774908
lt0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
7
name"Marie"
dialogue"Supprimer ? Non ! Je veux vous donner les images ! Vous devez les voir avant qu'il ne revienne. C'est un monstre... cette ville me terrifie. Je veux rentrer chez moi..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8198522788686723
it0.5473064735174287
ca0.531615925058548
en0.5271867612293144
no0.5224450811843362
es0.4952044422009086
da0.47561615102254856
ro0.47257383966244726
de0.41211052322163433
pt0.40688018979833923
nl0.3954050785973398
sl0.3872549019607844
sv0.36061381074168797
sq0.3548387096774194
tl0.35064935064935066
hr0.33642999336429996
fi0.3270524899057874
hu0.29725931131412503
et0.2810927390366643
lv0.2125984251968504
yo0.21197793538219067
tr0.19743178170144465
cs0.18633034987794952
sk0.1783073130649137
pl0.13043478260869565
lt0.09990999099909992
eu0.08003679852805887
ms0.07749077490774908
az0.059266227657572904
is0.059266227657572904
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter. ... Yeah. ... Since when? ... Copy, I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7940074906367041
tl0.5233968804159446
fr0.4821092278719397
cs0.47115384615384615
pl0.3902439024390244
sk0.3692660550458715
ca0.3648960739030023
et0.358974358974359
fi0.3529411764705882
tr0.3529411764705882
it0.3483412322274882
de0.24242424242424243
hr0.24242424242424243
hi0.233983286908078
da0.22969187675070027
no0.22096317280453256
yo0.21428571428571427
sv0.20289855072463767
nl0.1863905325443787
pt0.1863905325443787
ms0.17664670658682635
ro0.17664670658682635
sl0.17664670658682635
sq0.17664670658682635
reliabletrue
passestrue
9
name"Marie"
dialogue"Qu'est-ce que c'est ? Une urgence ? Vous partez ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8255076142131981
es0.5634920634920635
ca0.5592948717948718
pt0.5499181669394435
ro0.5409015025041736
en0.4246861924686192
it0.394273127753304
tl0.3735763097949886
cs0.3483412322274882
nl0.3436754176610978
sl0.3405275779376499
lv0.3357487922705314
no0.3357487922705314
sq0.3357487922705314
tr0.3276283618581907
yo0.314214463840399
az0.22535211267605632
de0.22535211267605632
eu0.22535211267605632
da0.21428571428571427
lt0.21428571428571427
sv0.21428571428571427
et0.20289855072463767
ms0.20289855072463767
pl0.20289855072463767
hr0.19590643274853803
hu0.1863905325443787
sk0.1863905325443787
reliabletrue
passestrue
10
name"Hunter"
dialogue"I gotta go. Emergency call. You stay right here. Don't move. I'll send an interpreter to the station. Bring that camera. Two hours."
detectedLang"en"
heavyLang"en"
scores
en0.7996336157545225
tl0.6097234611953614
da0.5375264270613108
fr0.5254880694143167
de0.5226404800872886
sv0.5114461194863205
it0.5075970737197524
no0.5
yo0.45550715619166154
nl0.4329228775113415
es0.4182180851063829
pl0.4067796610169492
sq0.4039509536784741
ro0.40313778990450205
ms0.37230989956958394
ca0.358974358974359
hr0.35185185185185186
cs0.34161023325808876
tr0.31853582554517135
sk0.31640625
pt0.3022328548644338
lv0.2762613730355666
hu0.2744610281923715
sl0.27083333333333337
lt0.26716917922948075
et0.22429078014184398
vi0.21171171171171171
fi0.1814780168381665
az0.18071161048689138
eu0.17530631479736097
zh0.08088235294117647
be0.07407407407407407
is0.06716417910447761
uk0.06716417910447761
reliabletrue
passestrue
11
name"Marie"
dialogue"Non ! Attendez ! Vous ne pouvez pas partir ! Il est encore dehors ! Revenez ! Monsieur !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8146275699359622
en0.564528899445764
it0.5571658615136876
ca0.5510204081632653
es0.494949494949495
pt0.4649805447470817
ro0.4644595910418695
sq0.41983122362869196
tr0.36046511627906974
eu0.358974358974359
no0.3428912783751493
lt0.3349455864570738
lv0.31335830212234705
nl0.30904522613065327
az0.26174496644295303
sl0.26174496644295303
hr0.24657534246575344
de0.23611111111111113
da0.22206506364922204
tl0.22206506364922204
ms0.21875
cs0.20863309352517986
hu0.20863309352517986
sv0.20289855072463767
et0.19708029197080293
fi0.13793103448275862
is0.12140575079872205
pl0.11290322580645161
sk0.10277324632952692
yo0.09688013136288999
reliabletrue
passestrue
12
name"Hunter"
dialogue"Station. Two hours. Don't be late."
detectedLang"en"
heavyLang"en"
scores
en0.830444611906556
fr0.6179966044142614
tl0.5622568093385214
yo0.5417515274949084
de0.45652173913043476
lt0.4538834951456311
da0.45255474452554745
sv0.44581280788177335
no0.4109947643979057
nl0.3951612903225807
hu0.34210526315789475
it0.31402439024390244
fi0.267100977198697
ro0.2549668874172185
zh0.2549668874172185
sq0.22945205479452058
az0.21875
cs0.21875
hr0.21875
lv0.21875
pl0.21875
sl0.21875
et0.2077464788732394
ms0.2077464788732394
sk0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue