Run: 2026-02-08-01KGYXGR695FCS71NEP0191YX8

Run Details

Model:
MoonshotAI: Kimi K2.5
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
16.4s
Cost:
$0.002984
Provider:
Fireworks

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: *staring at the camera screen, fingers trembling* "Je ne comprends pas... c'est flou, mais c'était là, j'en suis sûre..." Hunter: "Excuse me. Detective Hunter, Alborn PD. I need to ask you about last night at the Carlson orchard." Marie: *looks up, eyes wide* "Quoi? L'orchard? Oui, j'étais là! J'ai essayé de prendre des photos du coucher de soleil, mais alors j'ai entendu... oh mon Dieu... un bruit terrible, comme un cri étouffé." Hunter: "Ma'am, do you speak English? I'm investigating a disappearance. Did you see anyone suspicious near the equipment shed?" Marie: *clutching the camera to her chest* "Disparition? Oui! J'ai vu quelqu'un... non, quelque chose. Une ombre grande, très grande, près des pommiers. J'ai eu si peur que je n'ai pas bougé. Mon appareil... il a fait un bruit, et puis plus rien." Hunter: "You're shaking. Did something happen to you? Are you injured?" Marie: *voice cracking* "Blessée? Non, mais l'autre personne... elle est partie, non? Emportée? Je voulais appeler la police, mais mon téléphone... il n'y a pas de réseau ici, jamais de réseau dans cette ville! Pourquoi vous me regardez comme ça? Vous ne me comprenez pas!" Hunter: *sighs, rubbing his temples* "This isn't working. Look, stay right here. I'm going to get my radio and find a translator. Don't move." Marie: *frantic* "Non, attendez! Regardez mes photos! La preuve est dedans! C'est près du vieux hangar, là-bas! Vous devez aller voir immédiatement!" Hunter: *phone rings, answers abruptly* "Hunter... Yeah? ...You're kidding. ...I'm five minutes out." *stands up* "Lady, I gotta run. Real emergency. Just... *points to chair* ...stay. Don't leave. I'll send someone who speaks French." Marie: *standing as he leaves* "Quoi? Vous partez? Mais c'est important! Écoutez-moi! Revenez! POLICE! AIDEZ-MOI!"
created_at"2026-02-08T15:22:13.618359+00:00" 2/8/2026, 3:22:13 PM
model"moonshotai/kimi-k2.5-0127"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2131
moderation_latency(null)
generation_time16225
tokens_prompt257
tokens_completion1814
native_tokens_prompt278
native_tokens_completion1935
native_tokens_completion_images(null)
native_tokens_reasoning1574
native_tokens_cached6
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0029844
router(null)
provider_responses
0
id"c4e5b5a9-4925-4a47-970c-c7ef1ad58bf0"
status200
is_byokfalse
latency2131
endpoint_id"5d3540f2-832a-4fde-87b4-b628b65e974c"
provider_name"Fireworks"
model_permaslug"moonshotai/kimi-k2.5-0127"
api_type"completions"
id"gen-1770564116-UesBpbEjh1bpqyg88UiX"
upstream_id"c4e5b5a9-4925-4a47-970c-c7ef1ad58bf0"
total_cost0.0029844
cache_discount0.0000015
upstream_inference_cost0
provider_name"Fireworks"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Je ne comprends pas... c'est flou, mais c'était là, j'en suis sûre..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8055315471045809
ca0.44785276073619634
nl0.4063324538258575
sl0.4007989347536618
it0.3943472409152086
pt0.3943472409152086
lt0.3902439024390244
hr0.3869209809264305
yo0.3580599144079886
sq0.34593023255813954
cs0.337260677466863
en0.3263473053892215
ro0.32228915662650603
es0.3150684931506849
tl0.27184466019417475
de0.25864909390444807
vi0.25864909390444807
sk0.24369747899159663
lv0.18625678119349007
tr0.17279411764705882
pl0.16820702402957485
fi0.16356877323420074
ms0.15730337078651685
hu0.15413533834586465
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me. Detective Hunter, Alborn PD. I need to ask you about last night at the Carlson orchard."
detectedLang"en"
heavyLang"en"
scores
en0.7766379880873594
tl0.6673238048299655
no0.5909090909090909
da0.5216158752657689
it0.4775541795665635
fr0.46343402225755165
sq0.43133951137320975
ro0.4260204081632653
pt0.41659464131374246
nl0.40789473684210525
ca0.40528634361233484
sv0.3874773139745916
yo0.375
cs0.36380772855796417
et0.3565300285986654
es0.34971098265895956
sl0.3316831683168317
hr0.3229689067201605
de0.32228915662650603
pl0.27884615384615385
ms0.24665178571428573
sk0.23208191126279862
lv0.21511627906976746
lt0.1983372921615202
tr0.16044776119402984
fi0.09999999999999999
be0.09395973154362416
hu0.09029649595687331
az0.08536585365853659
is0.08536585365853659
uk0.08536585365853659
vi0.08536585365853659
reliabletrue
passestrue
2
name"Marie"
dialogue"Quoi? L'orchard? Oui, j'étais là! J'ai essayé de prendre des photos du coucher de soleil, mais alors j'ai entendu... oh mon Dieu... un bruit terrible, comme un cri étouffé."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7815040650406504
ca0.5326086956521738
nl0.4424273858921162
pt0.43628736234923965
en0.4186046511627907
da0.41512513601741025
es0.40277777777777773
no0.4021134593993326
it0.37681159420289856
de0.375
tl0.3469015795868773
sv0.30510665804783454
yo0.2652084757347915
ro0.25759668508287287
lv0.24028268551236748
eu0.22939068100358423
lt0.21704297159504732
vi0.19233658903080392
tr0.18188736681887366
sk0.14885193982581155
hu0.12955465587044535
hi0.12601626016260162
cs0.12029459901800327
et0.11522633744855967
sq0.11009933774834438
az0.10491257285595336
sl0.07804459691252144
hr0.06926406926406926
ms0.05536028119507908
fi0.05202821869488536
pl0.05202821869488536
reliabletrue
passestrue
3
name"Hunter"
dialogue"Ma'am, do you speak English? I'm investigating a disappearance. Did you see anyone suspicious near the equipment shed?"
detectedLang"en"
heavyLang"en"
scores
en0.7849014709963918
tl0.5978204462895693
pt0.523955773955774
fr0.5019280205655527
ro0.4709897610921502
hr0.4483985765124555
nl0.4483985765124555
cs0.4375907111756169
no0.42592592592592593
ca0.42379182156133827
it0.421209858103062
ms0.4092987804878049
es0.4038461538461538
sk0.40246723207401697
sq0.3973561430793157
de0.3839427662957075
da0.38148443735035914
sv0.38148443735035914
yo0.3547044129891757
sl0.33986371379897784
et0.31838170624450307
pl0.2889908256880734
hu0.2837338262476894
az0.24463937621832363
is0.21558704453441296
lt0.2115971515768057
vi0.1893305439330544
lv0.15300546448087432
fi0.13600891861761427
tr0.0903755868544601
eu0.08284023668639054
reliabletrue
passestrue
4
name"Marie"
dialogue"Disparition? Oui! J'ai vu quelqu'un... non, quelque chose. Une ombre grande, très grande, près des pommiers. J'ai eu si peur que je n'ai pas bougé. Mon appareil... il a fait un bruit, et puis plus rien."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7988175398259156
ca0.5410266017234919
it0.5220444791260243
en0.5002039983680131
ro0.4499326448136507
es0.4326076887447893
nl0.4304974430497443
da0.4124700239808153
de0.41105769230769235
pt0.3559411146161935
yo0.3539029535864979
sk0.34909670563230605
cs0.32766190998902306
no0.32766190998902306
sv0.3261826182618262
sl0.32057681641708263
tl0.31525992174399103
sq0.26865671641791045
hr0.2575757575757575
et0.24382716049382716
pl0.22172808132147392
lv0.20247395833333334
lt0.1988227599738391
hu0.15400552486187846
fi0.14989590562109645
az0.13120567375886524
tr0.11616161616161616
eu0.11360347322720694
ms0.10714285714285714
hi0.059861857252494245
zh0.059139784946236555
is0.05769230769230769
vi0.05405405405405406
reliabletrue
passestrue
5
name"Hunter"
dialogue"You're shaking. Did something happen to you? Are you injured?"
detectedLang"en"
heavyLang"en"
scores
en0.8281393217231897
tl0.6035940803382664
no0.438622754491018
cs0.3578767123287671
nl0.35121107266435986
da0.3397887323943662
sv0.31444241316270566
de0.31066176470588236
pt0.28435114503816794
ro0.2829827915869981
yo0.267578125
pl0.2647058823529412
sk0.26035502958579887
lv0.2454728370221328
sl0.24395161290322584
hr0.23625254582484725
lt0.21711899791231734
et0.21052631578947367
hu0.20042643923240938
es0.17218543046357618
ms0.17218543046357618
fr0.1591928251121076
is0.1591928251121076
reliabletrue
passestrue
6
name"Marie"
dialogue"Blessée? Non, mais l'autre personne... elle est partie, non? Emportée? Je voulais appeler la police, mais mon téléphone... il n'y a pas de réseau ici, jamais de réseau dans cette ville! Pourquoi vous me regardez comme ça? Vous ne me comprenez pas!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8219373219373219
it0.5726495726495726
ca0.5115597525236079
ro0.4829369183040331
en0.4791666666666667
nl0.4608195542774982
da0.45711183496199786
es0.438622754491018
tl0.427262313860252
no0.42084942084942084
pt0.4195046439628483
hu0.41882991088725297
sq0.3752603082049146
cs0.3744787322768974
de0.36006825938566556
lt0.34210526315789475
tr0.3356953055801594
sl0.3206521739130435
hr0.3150684931506849
ms0.2970946579194002
et0.29111531190926276
sv0.284692417739628
lv0.28435114503816794
sk0.2697176241480039
eu0.2654260528893242
yo0.25999013320177605
fi0.25074925074925075
az0.23547400611620795
pl0.21589127025614221
is0.15682967959527827
vi0.09310761789600969
hi0.049429657794676805
reliabletrue
passestrue
7
name"Hunter"
dialogue"This isn't working. Look, stay right here. I'm going to get my radio and find a translator. Don't move."
detectedLang"en"
heavyLang"en"
scores
en0.8225085458848278
tl0.6245828698553949
pl0.4730679156908665
da0.47058823529411764
no0.4659810126582279
hr0.424061433447099
sk0.41048034934497823
cs0.4089316987740806
fr0.4073748902546093
ro0.40371024734982336
nl0.39839572192513373
sq0.39732142857142855
yo0.3885869565217392
de0.38016528925619836
pt0.3784530386740331
sl0.36619718309859156
lv0.36320754716981135
sv0.36018957345971564
es0.33888344760039174
it0.32499999999999996
lt0.31886982845610495
ca0.2857142857142857
is0.267100977198697
ms0.26390403489640135
az0.2214532871972318
et0.21328671328671328
vi0.18967587034813926
hu0.18772563176895307
tr0.17177914110429449
eu0.1687192118226601
fi0.15307402760351316
reliabletrue
passestrue
8
name"Marie"
dialogue"Non, attendez! Regardez mes photos! La preuve est dedans! C'est près du vieux hangar, là-bas! Vous devez aller voir immédiatement!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.799662589624631
ca0.5681818181818181
en0.5072614107883817
no0.4574528840662478
tl0.4318181818181818
it0.43113772455089816
nl0.41430332922318125
es0.40736119775421087
de0.39759036144578314
da0.375
ro0.3466299862448418
sv0.3452791178497588
pt0.31308749096167754
vi0.26356589147286824
hr0.2418196328810854
lt0.22889610389610393
sq0.20502092050209206
tr0.20435510887772196
yo0.20368818105616093
sl0.20235096557514695
eu0.19423240033927056
ms0.16446789797713282
hu0.15026833631484796
et0.13557779799818015
lv0.1340018231540565
sk0.12764003673094582
is0.12280701754385964
hi0.07497565725413825
fi0.06862745098039216
pl0.06588003933136675
az0.06219151036525173
cs0.06219151036525173
reliabletrue
passestrue
9
name"Hunter"
dialogue"Lady, I gotta run. Real emergency. Just... points to chair ...stay. Don't leave. I'll send someone who speaks French."
detectedLang"en"
heavyLang"en"
scores
en0.7886297376093294
tl0.5740305522914219
it0.4318181818181818
pl0.377147766323024
es0.36067019400352734
da0.3521000893655049
no0.3101807802093245
yo0.308206106870229
pt0.3055555555555556
sv0.30422264875239924
et0.29543245869776485
ca0.29474708171206226
fr0.275
hr0.2602040816326531
cs0.24557752341311131
sk0.21959095801937567
sl0.210239651416122
lv0.2032967032967033
hu0.19444444444444445
lt0.18721973094170402
ro0.1826381059751973
az0.1569767441860465
sq0.1559953434225844
fi0.13381123058542413
nl0.09375000000000001
be0.0880503144654088
tr0.0880503144654088
is0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
10
name"Marie"
dialogue"Quoi? Vous partez? Mais c'est important! Écoutez-moi! Revenez! POLICE! AIDEZ-MOI!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7974068071312804
pt0.5840266222961731
ro0.5594713656387665
en0.558693733451015
ca0.5178399228543876
es0.5145631067961165
tl0.490316004077472
it0.4802494802494803
eu0.4588744588744588
no0.427262313860252
da0.37733499377334995
cs0.3288590604026846
hr0.3197278911564626
nl0.31880108991825606
lt0.31787175989085953
sv0.3160054719562244
sl0.31412894375857336
sq0.3065187239944522
sk0.3055555555555556
tr0.3045897079276773
lv0.24357034795764
de0.24242424242424243
et0.24127465857359634
pl0.2401215805471125
az0.2366412213740458
ms0.2331288343558282
hu0.2163009404388715
fi0.14383561643835618
yo0.10554561717352416
reliabletrue
passestrue