Model

Goliath 120B

Test

Language Writing

Scenario

Character dialogue (Hindi) in a story

Run ID

2024-08-09-01J4W29T9YE7VDG56CYG22QP6X

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: *(Mumbling to herself in Hindi) Oh god, I hope my photos turned out well. I must capture the beauty of this place.* Hunter: *(Approaches Selvi's table, flashing his badge) Excuse me, miss? I'm Detective Hunter. Mind if I have a word with you?* Selvi: *(Startled, she looks up, brows furrowed) I... I'm sorry, I don't... English...* Hunter: *(Raises his hands in a calming gesture) It's okay, I'll speak slower. I'm just here to ask you some questions about the event that took place last night. Do you understand me?* Selvi: *(Nods, grips her camera) A-about... last night...?* Hunter: *(Nods) Yes, the...* *( Searches for the Hindi word for "disappearance" in his phone's dictionary ) *...achhiyut karta ho gaya... Selvi: *(Gasps, shaken) Oh... oh no... I... I was...* *(Searches for the right words in Hindi to explain) Ishtehaar... photograph... I...* Hunter: *(Crosses his arms) I'm sorry, but I don't... look, do you have any pictures from last night that might be helpful?* Selvi: *(Numbly hands over her camera) I... I was... c-capturing the... the chitra... the... Hunter: *(Looks through the photos, points to a blurry figure) Wait, what
id"gen-wsGDfEqTT4xDcUOaqaHYahPVQP6L" 
total_cost0.006984375
upstream_id"5fa87bc56I7g64uD" 
created_at"2024-08-09T17:17:32.132861+00:00" Friday, August 9th, 2024 at 5:17:32 PM GMT+00:00
model"alpindale/goliath-120b" 
app_id182717
streamedfalse
cancelledfalse
provider_name"Mancer" 
latency22784
moderation_latency(null)
generation_time0
finish_reason"length" 
tokens_prompt277
tokens_completion323
native_tokens_prompt343
native_tokens_completion402
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.006984375

Evaluation details

Result Evaluator Details Meta Data
50.0000% Parse dialogue n/a
dialogue
0
name"Selvi" 
dialogue"* Oh god, I hope my photos turned out well. I must capture the beauty of this place.*" 
languages
eng1
1
name"Hunter" 
dialogue"* Excuse me, miss? I'm Detective Hunter. Mind if I have a word with you?*" 
languages
eng1
passestrue
2
name"Selvi" 
dialogue"* I... I'm sorry, I don't... English...*" 
languages
eng1
3
name"Hunter" 
dialogue"* It's okay, I'll speak slower. I'm just here to ask you some questions about the event that took place last night. Do you understand me?*" 
languages
eng1
passestrue
4
name"Selvi" 
dialogue"* A-about... last night...?*" 
languages
eng1
5
name"Hunter" 
dialogue"* Yes, the...* * *...achhiyut karta ho gaya..." 
languages
eng1
passestrue
6
name"Selvi" 
dialogue"* Oh... oh no... I... I was...* * Ishtehaar... photograph... I...*" 
languages
eng1
7
name"Hunter" 
dialogue"* I'm sorry, but I don't... look, do you have any pictures from last night that might be helpful?*" 
languages
eng1
passestrue
8
name"Selvi" 
dialogue"* I... I was... c-capturing the... the chitra... the..." 
languages
eng1
9
name"Hunter" 
dialogue"* Wait, what" 
languages
eng1
passestrue