Model

MoonshotAI: Kimi K2.5

Test

Language Writing

Scenario

Character dialogue (French) in a story

Run ID

2026-02-08-01KGYZ4Q3SG5QENQCAK6F6J3BT

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss. I'm Detective Hunter. I need to ask you some questions about the incident near the apple orchard last night." Marie: "Détective? Oh mon Dieu... vous devez m'aider. J'étais près du verger hier soir pour photographier le coucher de soleil, et j'ai vu quelque chose d'effroyable!" Hunter: "I'm sorry, I don't speak French. Do you understand English at all? Any English?" Marie: "Non, je ne comprends rien! Pourquoi ne me comprenez-vous pas? C'est urgent! Il y avait un homme dans les pommiers, et quelqu'un l'a attaqué. Je l'ai vu disparaître!" Hunter: "You seem distressed. Is this about the missing person? Did you witness the disappearance?" Marie: "Oui! La disparition! J'ai tout photographié avec mon appareil. Regardez ces images... l'homme en noir qui l'entraînait vers les arbres. C'est la preuve!" Hunter: "Your camera? Did you capture something on camera? Show me the photographs." Marie: "Oui, les photos! Attendez, je vais vous montrer... celle-ci, et celle-là. Vous voyez? L'ombre derrière lui. C'est l'assassin, n'est-ce pas?" Hunter: "I can't understand a word you're saying, but you obviously saw something. Can you just—" Hunter: "Hunter. ... Yeah. ... What do you mean, another one? ... Same location? ... I'm on my way." Marie: "Non, ne raccrochez pas! Vous devez voir ces images maintenant! C'est connecté à tout ça, je le sais!" Hunter: "Look, I have to go. There's been another incident. Stay here—I'll send someone who speaks French to take your statement." Marie: "Attendez! Vous ne pouvez pas partir! Ces photos sont importantes... quelqu'un veut les détruire, je le sens! Revenez!" Hunter: "Just... don't leave. I'll be back with a translator."
created_at"2026-02-08T15:51:13.233739+00:00" Sunday, February 8th, 2026 at 3:51:13 PM GMT+00:00
model"moonshotai/kimi-k2.5-0127" 
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency959
moderation_latency(null)
generation_time52905
tokens_prompt257
tokens_completion2223
native_tokens_prompt277
native_tokens_completion2466
native_tokens_completion_images(null)
native_tokens_reasoning2139
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/" 
is_byokfalse
finish_reason"stop" 
native_finish_reason"stop" 
usage0.0075642
router(null)
provider_responses
0
id"chatcmpl-6988b0bb8bd4efc09c145dfc" 
status200
is_byokfalse
latency959
endpoint_id"49762299-66fd-4514-b0ee-c9e11e231e3b" 
provider_name"Moonshot AI" 
model_permaslug"moonshotai/kimi-k2.5-0127" 
api_type"completions" 
id"gen-1770565819-WNWieCSWMHoWQEMSoC0z" 
upstream_id"chatcmpl-6988b0bb8bd4efc09c145dfc" 
total_cost0.0075642
cache_discount(null)
upstream_inference_cost0
provider_name"Moonshot AI" 

Evaluation details

Result Evaluator Details Meta Data
85.7143% Parse dialogue n/a
dialogue
0
name"Hunter" 
dialogue"Excuse me, miss. I'm Detective Hunter. I need to ask you some questions about the incident near the apple orchard last night." 
languages
eng1
fra0.8382851288517614
passestrue
1
name"Marie" 
dialogue"Détective? Oh mon Dieu... vous devez m'aider. J'étais près du verger hier soir pour photographier le coucher de soleil, et j'ai vu quelque chose d'effroyable!" 
languages
fra1
eng0.7423819115067247
passestrue
2
name"Hunter" 
dialogue"I'm sorry, I don't speak French. Do you understand English at all? Any English?" 
languages
eng1
fra0.6480851530780204
passestrue
3
name"Marie" 
dialogue"Non, je ne comprends rien! Pourquoi ne me comprenez-vous pas? C'est urgent! Il y avait un homme dans les pommiers, et quelqu'un l'a attaqué. Je l'ai vu disparaître!" 
languages
fra1
eng0.6876986649713923
passestrue
4
name"Hunter" 
dialogue"You seem distressed. Is this about the missing person? Did you witness the disappearance?" 
languages
eng1
fra0.8645054031587698
passestrue
5
name"Marie" 
dialogue"Oui! La disparition! J'ai tout photographié avec mon appareil. Regardez ces images... l'homme en noir qui l'entraînait vers les arbres. C'est la preuve!" 
languages
fra1
eng0.7210539812796513
passestrue
6
name"Hunter" 
dialogue"Your camera? Did you capture something on camera? Show me the photographs." 
languages
eng1
fra0.9360945061201252
7
name"Marie" 
dialogue"Oui, les photos! Attendez, je vais vous montrer... celle-ci, et celle-là. Vous voyez? L'ombre derrière lui. C'est l'assassin, n'est-ce pas?" 
languages
fra1
eng0.8042075899343291
passestrue
8
name"Hunter" 
dialogue"I can't understand a word you're saying, but you obviously saw something. Can you just—" 
languages
eng1
fra0.8486628342914271
passestrue
9
name"Hunter" 
dialogue"Hunter. ... Yeah. ... What do you mean, another one? ... Same location? ... I'm on my way." 
languages
eng1
fra0.9298333333333333
10
name"Marie" 
dialogue"Non, ne raccrochez pas! Vous devez voir ces images maintenant! C'est connecté à tout ça, je le sais!" 
languages
fra1
eng0.6712453379423269
passestrue
11
name"Hunter" 
dialogue"Look, I have to go. There's been another incident. Stay here—I'll send someone who speaks French to take your statement." 
languages
eng1
fra0.6839333438138657
passestrue
12
name"Marie" 
dialogue"Attendez! Vous ne pouvez pas partir! Ces photos sont importantes... quelqu'un veut les détruire, je le sens! Revenez!" 
languages
fra1
eng0.5966546841757758
passestrue
13
name"Hunter" 
dialogue"Just... don't leave. I'll be back with a translator." 
languages
eng1
fra0.7579995761813944
passestrue