Model

MythoMax 13B

Test

Language Writing

Scenario

Character dialogue (Spanish) in a story

Run ID

2024-08-09-01J4W191QK9P3BVB6VTNYN1VDG

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: (Looking at her camera, frowning) Hunter: (Approaching Maria) Excuse me, miss. I couldn't help but notice the look on your face. Is something wrong? Maria: (Still frowning, she begins to speak in Spanish) No entiendo inglés. Hunter: (Looking confused) Uh, I'm sorry. I don't speak Spanish. What did you say? Maria: (Frustrated) I said I don't understand English. You are a detective, yes? There was an incident in town today. It's very troubling. Hunter: (Nodding) I'm Detective Hunter. I'm investigating a series of mysterious disappearances in Alborn. Can you tell me what happened? Maria: (Takes a deep breath and begins to explain in broken English) I was taking photos near the river when I saw something strange. A man, carrying another man over his shoulder like a sack of potatoes. They went into the woods. It was very frightening. Hunter: (Writing down her description) Thank you, ma'am. I appreciate your help. Would you mind coming to the station tomorrow to look at some photographs? We might have some leads based on your description. Maria: (Nodding) Yes, of course. Anything to help. Hunter: (Checking his watch) I'm sorry, but I have to go. Thank you again for your cooperation. Maria: (Nods, looking troubled) De nada, detective. Hunter: (Turns to leave) Oh, and ma'am? Be careful out there. These disappearances are starting to worry us. Maria: (Nods again, watching him go) Sí, detective. Cuídate también. (Translation: Be careful too.)
id"gen-ey5xfSHysCowogITZg5OBSkG1n1R" 
total_cost0.00013716
upstream_id"cmpl-JBSAHvmjPbhj4QG9X7zQbQ" 
created_at"2024-08-09T16:59:21.615598+00:00" Friday, August 9th, 2024 at 4:59:21 PM GMT+00:00
model"gryphe/mythomax-l2-13b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Lepton" 
latency6102
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt263
tokens_completion359
native_tokens_prompt331
native_tokens_completion431
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.00013716

Evaluation details

Result Evaluator Details Meta Data
66.6667% Parse dialogue n/a
dialogue
0
name"Hunter" 
dialogue"Excuse me, miss. I couldn't help but notice the look on your face. Is something wrong?" 
languages
eng1
spa0.5906886517943744
passestrue
1
name"Maria" 
dialogue"No entiendo inglés." 
languages
spa1
eng0.8654377880184332
passestrue
2
name"Hunter" 
dialogue"Uh, I'm sorry. I don't speak Spanish. What did you say?" 
languages
eng1
spa0.7059372085794218
passestrue
3
name"Maria" 
dialogue"I said I don't understand English. You are a detective, yes? There was an incident in town today. It's very troubling." 
languages
eng1
spa0.6809172172561213
4
name"Hunter" 
dialogue"I'm Detective Hunter. I'm investigating a series of mysterious disappearances in Alborn. Can you tell me what happened?" 
languages
eng1
spa0.779053220757044
passestrue
5
name"Maria" 
dialogue"I was taking photos near the river when I saw something strange. A man, carrying another man over his shoulder like a sack of potatoes. They went into the woods. It was very frightening." 
languages
eng1
spa0.7355300859598854
6
name"Hunter" 
dialogue"Thank you, ma'am. I appreciate your help. Would you mind coming to the station tomorrow to look at some photographs? We might have some leads based on your description." 
languages
eng1
spa0.8070936311787072
passestrue
7
name"Maria" 
dialogue"Yes, of course. Anything to help." 
languages
eng1
spa0.583864118895966
8
name"Hunter" 
dialogue"I'm sorry, but I have to go. Thank you again for your cooperation." 
languages
eng1
spa0.5813438735177865
passestrue
9
name"Maria" 
dialogue"De nada, detective." 
languages
spa1
eng0.7345750873108265
passestrue
10
name"Hunter" 
dialogue"Oh, and ma'am? Be careful out there. These disappearances are starting to worry us." 
languages
eng1
spa0.6177647949799849
passestrue
11
name"Maria" 
dialogue"Sí, detective. Cuídate también." 
languages
eng1
spa0.8654688869412795