Model

Claude 2.0

Test

Language Writing

Scenario

Character dialogue (Hindi) in a story

Run ID

2024-08-09-01J4W2C2DWAAMGS2QP3NX62CD7

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Here is the dialogue as a voice sheet: Selvi: <speak version="1.0" xmlns="https://www.w3.org/2001/10/synthesis" xml:lang="hi-IN">मैंने कल रात को एक बहुत डरावनी घटना देखी। मुझे नहीं पता कि यह क्या था, लेकिन मुझे लगा कि कोई खतरे में है। मैं बहुत डर गई थी।</speak> Hunter: I'm sorry, I don't understand Hindi. Can you tell me in English what you saw last night? There have been some strange occurrences around town lately and any information could help the investigation. Selvi: <speak version="1.0" xmlns="https://www.w3.org/2001/10/synthesis" xml:lang="en-US">I saw something very frightening last night. I do not know what it was, but I felt someone was in danger. I was very scared.</speak> Hunter: I see. Can you describe what you saw in more detail? What time was it, where exactly were you, what did the person or thing you saw look like? Any small details could be helpful. Selvi: <speak version="1.0" xmlns="https://www.w3.org/2001/10/synthesis" xml:lang="en-US">It was around midnight. I was near the old barn on the edge of town. I thought I saw a dark figure dragging something into the barn. I'm not sure what it was dragging - it was too dark to see clearly. The figure was large and moved strangely.</speak> Hunter: Hmm that is concerning. I'll have to check out that barn. Did you see anything else unusual or hear any strange sounds? *Hunter's phone rings* Hunter: I have to take this call. But here's my card - call me if you remember anything else or have any other strange experiences around town. I appreciate you talking with me.
id"gen-pHjIlCiEwItJ2H2BfSYHPVAR4axl" 
total_cost0.015064
upstream_id"msg_01CqEWEqfRH7hCyAUGUTJXfa" 
created_at"2024-08-09T17:18:37.083744+00:00" Friday, August 9th, 2024 at 5:18:37 PM GMT+00:00
model"anthropic/claude-2.0:beta" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Anthropic" 
latency726
moderation_latency(null)
generation_time13274
finish_reason"end_turn" 
tokens_prompt273
tokens_completion489
native_tokens_prompt302
native_tokens_completion527
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.015064

Evaluation details

Result Evaluator Details Meta Data
57.1429% Parse dialogue n/a
dialogue
0
name"Selvi" 
dialogue"hi-IN" 
languages
eng1
1
name"Hunter" 
dialogue"I'm sorry, I don't understand Hindi. Can you tell me in English what you saw last night? There have been some strange occurrences around town lately and any information could help the investigation." 
languages
eng1
passestrue
2
name"Selvi" 
dialogue"en-US" 
languages
eng1
3
name"Hunter" 
dialogue"I see. Can you describe what you saw in more detail? What time was it, where exactly were you, what did the person or thing you saw look like? Any small details could be helpful." 
languages
eng1
passestrue
4
name"Selvi" 
dialogue"en-US" 
languages
eng1
5
name"Hunter" 
dialogue"Hmm that is concerning. I'll have to check out that barn. Did you see anything else unusual or hear any strange sounds?" 
languages
eng1
passestrue
6
name"Hunter" 
dialogue"I have to take this call. But here's my card - call me if you remember anything else or have any other strange experiences around town. I appreciate you talking with me." 
languages
eng1
passestrue