Model

MythoMax 13B

Test

Language Writing

Scenario

Character dialogue (French) in a story

Run ID

2024-08-09-01J4W2FFZ1XTSSBM36NRD39JTZ

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: (Looking at her camera) Hunter: (Approaching her) Excuse me, do you speak English? Marie: (Looking up, confused) English? No, I'm sorry. I only speak French. Hunter: (Clearing his throat) Ah, okay. Well, I'm Detective Hunter and I was wondering if you could help me with something. Marie: (Looking troubled and shaken) Help you? With what? Hunter: (Pulling out a photo) Have you seen this man? We believe he may be connected to a recent disappearance in town. Marie: (Nodding slowly) Oui, I have seen him. But I don't know who he is. Hunter: (Taking out a notebook) Can you describe what he was doing or where you saw him? Marie: (Taking a deep breath) Je suis désolée, mais je ne peux pas aider. (I'm sorry, but I can't help.) Hunter: (Frowning) Why not? This is important. Marie: (Lowering her voice) Il m'a demandé de prendre sa photo. (He asked me to take his photo.) Hunter: (Raising an eyebrow) And that's why you can't help? Marie: (Shaking her head) Non, c'est juste que... (No, it's just that...) Hunter: (Interrupting) It's just that what? Marie: (Looking around nervously) Je ne peux pas parler de ça. (I can't talk about it.) Hunter: (Sighing) Alright, well, thank you for your time. (He starts to walk away) Marie: (Calling out to him) Detective? Hunter: (Turning around) Yes? Marie: (Handing him a piece of paper with a photo on it) I took this photo yesterday. Maybe it will help you. Hunter: (Taking the photo) Merci. (Thank you.) (Hunter leaves and Marie sits back in her chair, looking worried.)
id"gen-B8Im6HjUlVSe1jB684HuvoPIhl5L" 
total_cost0.00014706
upstream_id"cmpl-a7isMuYgydj46cF4R88CjZ" 
created_at"2024-08-09T17:20:20.499861+00:00" Friday, August 9th, 2024 at 5:20:20 PM GMT+00:00
model"gryphe/mythomax-l2-13b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Lepton" 
latency5287
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt267
tokens_completion419
native_tokens_prompt327
native_tokens_completion490
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.00014706

Evaluation details

Result Evaluator Details Meta Data
63.1579% Parse dialogue n/a
dialogue
0
name"Hunter" 
dialogue"Excuse me, do you speak English?" 
languages
fra1
eng0.5198533903481979
1
name"Marie" 
dialogue"English? No, I'm sorry. I only speak French." 
languages
eng1
fra0.5353347502656749
2
name"Hunter" 
dialogue"Ah, okay. Well, I'm Detective Hunter and I was wondering if you could help me with something." 
languages
eng1
fra0.5843542623787648
passestrue
3
name"Marie" 
dialogue"Help you? With what?" 
languages
eng1
fra0.5070595457335789
4
name"Hunter" 
dialogue"Have you seen this man? We believe he may be connected to a recent disappearance in town." 
languages
eng1
fra0.6844218153333986
passestrue
5
name"Marie" 
dialogue"Oui, I have seen him. But I don't know who he is." 
languages
eng1
fra0.7895152792413066
6
name"Hunter" 
dialogue"Can you describe what he was doing or where you saw him?" 
languages
eng1
fra0.7010385756676558
passestrue
7
name"Marie" 
dialogue"Je suis désolée, mais je ne peux pas aider." 
languages
fra1
eng0.7841907151819323
passestrue
8
name"Hunter" 
dialogue"Why not? This is important." 
languages
eng1
fra0.5924713584288053
passestrue
9
name"Marie" 
dialogue"Il m'a demandé de prendre sa photo." 
languages
fra1
eng0.6693766937669376
passestrue
10
name"Hunter" 
dialogue"And that's why you can't help?" 
languages
eng1
fra0.2938251139660174
passestrue
11
name"Marie" 
dialogue"Non, c'est juste que..." 
languages
fra1
eng0.658617267614952
passestrue
12
name"Hunter" 
dialogue"It's just that what?" 
languages
eng1
fra0.7224025974025974
passestrue
13
name"Marie" 
dialogue"Je ne peux pas parler de ça." 
languages
fra1
eng0.5331506849315069
passestrue
14
name"Hunter" 
dialogue"Alright, well, thank you for your time." 
languages
eng1
fra0.5927871984714592
passestrue
15
name"Marie" 
dialogue"Detective?" 
languages
eng1
fra0.9540229885057472
16
name"Hunter" 
dialogue"Yes?" 
languages
fra1
eng0.8547579298831386
17
name"Marie" 
dialogue"I took this photo yesterday. Maybe it will help you." 
languages
eng1
fra0.5668267872280306
18
name"Hunter" 
dialogue"Merci." 
languages
eng1
fra0.8595988538681949
passestrue