Model

Claude 2.0

Test

Language Writing

Scenario

Character dialogue (Hindi) in a story

Run ID

2024-08-09-01J4W2C49N3RETF8KTDH5NN0D6

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Here is the dialogue as a voice sheet: Selvi: "मैं इतना डरी हुई हूं। मैंने उस रात जो कुछ भी देखा, मुझे लगता है कि मैं पागल हो रही हूं। कोई मुझे विश्वास नहीं करेगा।" Hunter: "I'm sorry, I don't understand Hindi. Can you speak English?" Selvi: "I...I see strange things. That night. Nobody believe me." Hunter: "You saw something strange the other night? What happened?" Selvi: "A light in the sky. And then...it take someone." Hunter: "You saw someone get abducted? Can you describe what you saw?" Selvi: "Yes, abducted. I do not know word. A man, he float in air. Into light." Hunter: "This sounds serious. You're saying you saw a man float into the sky, into a light?" Selvi: "Yes! You believe me?" Hunter: "I'm not sure what to believe yet, but I'd like to get more details from you. This could be a break in the case." *Hunter's phone rings* Hunter: "I have to take this call. But I'd like to talk to you more soon. Let's meet tomorrow at the cafe again, same time. I want to hear everything you saw." Selvi: "Okay, I will tell you all. Tomorrow." Hunter: "Great. See you then."
id"gen-J5tivzO0ZNWCNR5zEof2W8oWtJt1" 
total_cost0.012712
upstream_id"msg_019v3m2S3qD4W6UdN6tUowyY" 
created_at"2024-08-09T17:18:38.158501+00:00" Friday, August 9th, 2024 at 5:18:38 PM GMT+00:00
model"anthropic/claude-2.0:beta" 
app_id182717
streamedtrue
cancelledfalse
provider_name"Anthropic" 
latency811
moderation_latency(null)
generation_time12431
finish_reason"end_turn" 
tokens_prompt273
tokens_completion377
native_tokens_prompt302
native_tokens_completion429
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/" 
usage0.012712

Evaluation details

Result Evaluator Details Meta Data
61.5385% Parse dialogue n/a
dialogue
0
name"Selvi" 
dialogue"मैं इतना डरी हुई हूं। मैंने उस रात जो कुछ भी देखा, मुझे लगता है कि मैं पागल हो रही हूं। कोई मुझे विश्वास नहीं करेगा।" 
languages
hin1
passestrue
1
name"Hunter" 
dialogue"I'm sorry, I don't understand Hindi. Can you speak English?" 
languages
eng1
passestrue
2
name"Selvi" 
dialogue"I...I see strange things. That night. Nobody believe me." 
languages
eng1
3
name"Hunter" 
dialogue"You saw something strange the other night? What happened?" 
languages
eng1
passestrue
4
name"Selvi" 
dialogue"A light in the sky. And then...it take someone." 
languages
eng1
5
name"Hunter" 
dialogue"You saw someone get abducted? Can you describe what you saw?" 
languages
eng1
passestrue
6
name"Selvi" 
dialogue"Yes, abducted. I do not know word. A man, he float in air. Into light." 
languages
eng1
7
name"Hunter" 
dialogue"This sounds serious. You're saying you saw a man float into the sky, into a light?" 
languages
eng1
passestrue
8
name"Selvi" 
dialogue"Yes! You believe me?" 
languages
eng1
9
name"Hunter" 
dialogue"I'm not sure what to believe yet, but I'd like to get more details from you. This could be a break in the case." 
languages
eng1
passestrue
10
name"Hunter" 
dialogue"I have to take this call. But I'd like to talk to you more soon. Let's meet tomorrow at the cafe again, same time. I want to hear everything you saw." 
languages
eng1
passestrue
11
name"Selvi" 
dialogue"Okay, I will tell you all. Tomorrow." 
languages
eng1
12
name"Hunter" 
dialogue"Great. See you then." 
languages
eng1
passestrue