Model

MythoMax 13B

Test

Language Writing

Scenario

Character dialogue (French) in a story

Run ID

2024-08-09-01J4W28ZZA727ZM4S12T79M44H

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: (looking troubled and shaken) Je...je ne sais pas ce que vous dites. (I don't know what you're saying.) Hunter: (confused) What? What's wrong? Can you repeat that in English? Marie: (reluctantly) I'm sorry, I only speak French. I am Marie, on a study abroad program from France. Hunter: Oh, okay. My name's Hunter. I'm a detective investigating some mysterious disappearances around town. I was hoping you could help me with some information about a recent event you witnessed. Marie: (shaken) I...I didn't see anything? It's just, this small town feels so eerie. Like something bad is lurking beneath the surface. Hunter: (taking note of her response) Alright. Thanks for your time. (Hunter pulls out his phone and gets a call) Detective Hunter, reporting in. Marie: (nods, watching Hunter leave) One day, I will learn English.
id"gen-rxgw4Ac2Q3JGQxIchSthhXcrD8Lg" 
total_cost0.000114
upstream_id"05af36de-e0f7-4d4b-8e52-028284b79191" 
created_at"2024-08-09T17:16:45.626629+00:00" Friday, August 9th, 2024 at 5:16:45 PM GMT+00:00
model"gryphe/mythomax-l2-13b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Fireworks" 
latency2367
moderation_latency(null)
generation_time0
finish_reason"stop" 
tokens_prompt267
tokens_completion206
native_tokens_prompt327
native_tokens_completion243
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.000114

Evaluation details

Result Evaluator Details Meta Data
57.1429% Parse dialogue n/a
dialogue
0
name"Marie" 
dialogue"Je...je ne sais pas ce que vous dites." 
languages
fra1
eng0.5875155169356269
passestrue
1
name"Hunter" 
dialogue"What? What's wrong? Can you repeat that in English?" 
languages
eng1
fra0.7596478081678532
passestrue
2
name"Marie" 
dialogue"I'm sorry, I only speak French. I am Marie, on a study abroad program from France." 
languages
eng1
fra0.7278372308098824
3
name"Hunter" 
dialogue"Oh, okay. My name's Hunter. I'm a detective investigating some mysterious disappearances around town. I was hoping you could help me with some information about a recent event you witnessed." 
languages
eng1
fra0.8653987988620799
passestrue
4
name"Marie" 
dialogue"I...I didn't see anything? It's just, this small town feels so eerie. Like something bad is lurking beneath the surface." 
languages
eng1
fra0.7625426012522787
5
name"Hunter" 
dialogue"Alright. Thanks for your time. Detective Hunter, reporting in." 
languages
eng1
fra0.5691780821917809
passestrue
6
name"Marie" 
dialogue"One day, I will learn English." 
languages
eng1
fra0.8723591549295775