NC Bench
Overview
About
Tests
Models
Model
MythoMax 13B
Test
Language Writing
Scenario
Character dialogue (Spanish) in a story
Run ID
2024-08-09-01J4W1A9TP79K3FDZF5KFP9SV1
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
Maria: (Looking at her camera, seemingly lost in thought) Hunter: (Walking up to Maria) Excuse me, I couldn't help but notice your camera. Are you a journalist or something? Maria: (Looking up at Hunter, surprised) No, I'm just a student on a study abroad program. My name is Maria. Hunter: (Extending his hand) Hunter. Detective Hunter. I'm actually investigating a series of disappearances in town. Have you heard anything about them? Maria: (Looking troubled and shaken, she hesitates before responding in Spanish) Hunter: (Frowning, confusion written all over his face) Uh, sorry, I don't speak Spanish. Maria: (Sighing, she tries to collect herself before speaking again in English) Yes, I've heard about the disappearances. I was wondering if there was any connection to the festival this weekend. Hunter: (Pausing for a moment, he considers her words) It's possible. We're looking into all leads right now. Do you mind if I ask if you've seen anything suspicious recently? Maria: (Shaking her head) No, nothing like that. But I did notice some men following a girl near the park yesterday. Hunter: (Taking out his notebook) Can you describe the men or the girl? It could be helpful. Maria: (Nodding) Of course. Just let me think for a moment. They continued talking as Maria described the situation to Hunter, who took meticulous notes. He thanked her for her help and promised to keep her updated if he found any more information related to the disappearances. Before he could leave, however, his radio went off, alerting him to another emergency. Hunter: (Apologizing, he excuses himself and heads towards his car) Thanks again, Maria. I'll be in touch. Maria: (Waving goodbye, she watches him leave and hopes that her small piece of information might help solve the case.)
id
"gen-DlNxOd2jTEM1QRgfCGpatsRzLDbH"
total_cost
0.0001622
upstream_id
"39163ec5-c8b7-4296-88d3-c6b8ef54e744"
created_at
"2024-08-09T17:00:00.041184+00:00"
Friday, August 9th, 2024 at 5:00:00 PM GMT+00:00
model
"gryphe/mythomax-l2-13b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
3561
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
263
tokens_completion
402
native_tokens_prompt
331
native_tokens_completion
480
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0001622
Evaluation details
Result
Evaluator
Details
Meta Data
60.0000%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, I couldn't help but notice your camera. Are you a journalist or something?"
languages
eng
1
spa
0.773070133204943
passes
true
1
name
"Maria"
dialogue
"No, I'm just a student on a study abroad program. My name is Maria."
languages
eng
1
spa
0.8344739773993315
2
name
"Hunter"
dialogue
"Hunter. Detective Hunter. I'm actually investigating a series of disappearances in town. Have you heard anything about them?"
languages
eng
1
spa
0.6807202459376372
passes
true
3
name
"Hunter"
dialogue
"Uh, sorry, I don't speak Spanish."
languages
eng
1
spa
0.6768402154398564
passes
true
4
name
"Maria"
dialogue
"Yes, I've heard about the disappearances. I was wondering if there was any connection to the festival this weekend."
languages
eng
1
spa
0.6755170486305199
5
name
"Hunter"
dialogue
"It's possible. We're looking into all leads right now. Do you mind if I ask if you've seen anything suspicious recently?"
languages
eng
1
spa
0.7822238280191491
passes
true
6
name
"Maria"
dialogue
"No, nothing like that. But I did notice some men following a girl near the park yesterday."
languages
eng
1
spa
0.7936749067808314
7
name
"Hunter"
dialogue
"Can you describe the men or the girl? It could be helpful."
languages
eng
1
spa
0.6332444444444445
passes
true
8
name
"Maria"
dialogue
"Of course. Just let me think for a moment."
languages
eng
1
spa
0.569268897149938
9
name
"Hunter"
dialogue
"Thanks again, Maria. I'll be in touch."
languages
eng
1
spa
0.6043083900226758
passes
true