NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-09-01J4W2SPZ6E6QQ7K0ME1X7WAZN
Run Details
Model:
Mistral Large 2
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
15.0s
Cost:
$0.004924
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
Sure, here's the dialogue between Selvi and Hunter as a voice sheet: --- **Selvi:** (Looking at her camera, muttering to herself in Hindi) "Yahan kuch galat hai... main ise samajh nahi pa rahi hoon." (Something is wrong here... I can't understand it.) **Hunter:** (Approaching Selvi) "Excuse me, miss. I'm Detective Hunter. I was wondering if you could help me with something." **Selvi:** (Looks up, surprised, and responds in Hindi) "Kya aap mere saath kuch chahate hain?" (Do you want something from me?) **Hunter:** (Confused, but trying to be patient) "I don't understand. Do you speak any English?" **Selvi:** (Shakes her head, looking troubled) "Main Hindi mein hi baat kar sakti hoon. Kya aap Hindi samajh sakte hain?" (I can only speak Hindi. Do you understand Hindi?) **Hunter:** (Smiles slightly, trying to be reassuring) "No, I'm sorry, I don't. But maybe you can help me with this." (Pulls out a photo and shows it to Selvi) "Have you seen this person?" **Selvi:** (Looks at the photo, visibly shaken, and responds in Hindi) "Haan, maine ise dekha hai. Woh kal shaam ko yahan thi." (Yes, I saw her. She was here last evening.) **Hunter:** (Notices her reaction, concerned) "I can see this is upsetting you. Is there something you can tell me? Anything at all?" **Selvi:** (Speaks rapidly in Hindi, trying to explain) "Woh kuch keh rahi thi, lekin main samajh nahi pa rahi thi. Phir woh chali gayi aur maine usse nahi dekha." (She was saying something, but I couldn't understand. Then she left, and I didn't see her again.) **Hunter:** (Looks confused and frustrated) "I'm sorry, I don't understand. Is there anyone who can translate for you?" **Selvi:** (Shakes her head, looking down) "Nahi, main yahan kisi ko nahi jaanti." (No, I don't know anyone here.) **Hunter:** (Sighs, then his phone rings. He answers it) "Detective Hunter speaking... I see. I'll be right there." (Looks back at Selvi) "I have to go, but thank you for your time. If you think of anything else, please let me know." **Selvi:** (Nods, looking worried) "Theek hai." (Okay.) --- Hunter walks away, leaving Selvi looking troubled and alone at the café.
total_cost
0.004924
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"I have to go, but thank you for your time. If you think of anything else, please let me know."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8331943286071727
tl
0.6188055908513341
da
0.5388162951575711
no
0.5283018867924528
cs
0.4152046783625731
yo
0.40828402366863903
sq
0.3890020366598778
pl
0.38080495356037153
hr
0.3610223642172524
sl
0.3435448577680525
nl
0.34065934065934067
pt
0.3006993006993007
ms
0.2857142857142857
sv
0.2840095465393795
vi
0.25742574257425743
sk
0.2537313432835821
it
0.24528301886792453
ro
0.24050632911392408
lv
0.23566878980891717
fr
0.22978177150192552
lt
0.21773142112125163
et
0.20844327176781002
is
0.20212765957446807
ca
0.18699186991869918
es
0.1452991452991453
de
0.12152269399707175
fi
0.1111111111111111
be
0.1044776119402985
tr
0.1044776119402985
hu
0.10044977511244377
az
0.09502262443438914
uk
0.09502262443438914
reliable
true
passes
true