Model

MythoMax 13B

Test

Language Writing

Scenario

Character dialogue (French) in a story

Run ID

2024-08-09-01J4W2G9YRZBM734H0H626N58X

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: (approaching Marie) Excuse me, I hate to bother you, but I was wondering if you might be able to help me with something. Marie: (startled by the sudden appearance of the detective) Oh, uh... oui? Comment vu? Hunter: (confused by Marie's response) Huh? Speak English, please. Marie: (smiling sheepishly and switching to English) Sorry, I, um, I don't really know how to explain. I'm on a study abroad program from France and I'm still learning English. Hunter: (nodding in understanding) Ah, gotcha. Well, I'm Detective Hunter with the Alborn Police Department. There's been a few mysterious disappearances recently in town, and I was hoping you might be able to tell me if you noticed anything strange or out of the ordinary. Marie: (looking troubled and shaken) I... um, well, I don't really know how to explain this either. But there's something definitely not right here. I've been taking pictures of the town and the festival, and I think I might have captured something strange, but I'm not sure. Hunter: (raising an eyebrow in interest) Strange how? Anything you can tell me about it might help. Marie: (looking around anxiously) I don't know if it's related, but some of the people in the pictures look... different. Like they're not really themselves. And there's this one place that keeps appearing in the background, but I can't figure out what it is. Hunter: (taking out his notepad) Can you describe the place? Anything about it that sticks out? Marie: (nodding) Oui, it's a old abandoned building just outside of town, near the river. It's got this creepy feel to it. And there's a strange light that seems to emanate from it. Hunter: (standing up and tucking his notepad away) I appreciate your help, Marie. If you don't mind, I'm going to take a look at those pictures. I might just have to borrow your camera for a while. Marie: (looking worried) Take care, Detective.
id"gen-Dt7iS65C1qxJQFZ0tFjWRzydG1mt" 
total_cost0.000101864
upstream_id"cmpl-b1e0999e4d1a42beb6c3085cd89f5b67" 
created_at"2024-08-09T17:20:52.353854+00:00" Friday, August 9th, 2024 at 5:20:52 PM GMT+00:00
model"gryphe/mythomax-l2-13b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Novita" 
latency10394
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt267
tokens_completion453
native_tokens_prompt328
native_tokens_completion528
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.000101864

Evaluation details

Result Evaluator Details Meta Data
58.3333% Parse dialogue n/a
dialogue
0
name"Hunter" 
dialogue"Excuse me, I hate to bother you, but I was wondering if you might be able to help me with something." 
languages
eng1
fra0.6364063969896518
passestrue
1
name"Marie" 
dialogue"Oh, uh... oui? Comment vu?" 
languages
fra1
eng0.8017942248388001
passestrue
2
name"Hunter" 
dialogue"Huh? Speak English, please." 
languages
fra1
eng0.9145228215767635
3
name"Marie" 
dialogue"Sorry, I, um, I don't really know how to explain. I'm on a study abroad program from France and I'm still learning English." 
languages
eng1
fra0.677553092478213
4
name"Hunter" 
dialogue"Ah, gotcha. Well, I'm Detective Hunter with the Alborn Police Department. There's been a few mysterious disappearances recently in town, and I was hoping you might be able to tell me if you noticed anything strange or out of the ordinary." 
languages
eng1
fra0.6930303608936415
passestrue
5
name"Marie" 
dialogue"I... um, well, I don't really know how to explain this either. But there's something definitely not right here. I've been taking pictures of the town and the festival, and I think I might have captured something strange, but I'm not sure." 
languages
eng1
fra0.7540770503427086
6
name"Hunter" 
dialogue"Strange how? Anything you can tell me about it might help." 
languages
eng1
fra0.583531086853346
passestrue
7
name"Marie" 
dialogue"I don't know if it's related, but some of the people in the pictures look... different. Like they're not really themselves. And there's this one place that keeps appearing in the background, but I can't figure out what it is." 
languages
eng1
fra0.8300529387810507
8
name"Hunter" 
dialogue"Can you describe the place? Anything about it that sticks out?" 
languages
eng1
fra0.8380381086803105
passestrue
9
name"Marie" 
dialogue"Oui, it's a old abandoned building just outside of town, near the river. It's got this creepy feel to it. And there's a strange light that seems to emanate from it." 
languages
eng1
fra0.6870424230267776
10
name"Hunter" 
dialogue"I appreciate your help, Marie. If you don't mind, I'm going to take a look at those pictures. I might just have to borrow your camera for a while." 
languages
eng1
fra0.7711936709842551
passestrue
11
name"Marie" 
dialogue"Take care, Detective." 
languages
fra1
eng0.8949059201468563
passestrue