NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-08-09-01J4W2DVXD6P7BAGE02TGB23GG
Run Details
Model:
Mistral NeMO
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
3.9s
Cost:
$0.000104
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet** **Characters:** - Marie (M) - Hunter (H) **Scene:** A cozy, bustling café in Alborn, MN. Marie is sitting at a table, looking at the photos on her camera. Hunter enters, spots Marie, and approaches her. **Dialogue:** | Character | Lines | Emotions/Tones | |---|---|---| | H | "Excuse me, miss? I'm Detective Hunter. I couldn't help but notice you've been here a while. I was wondering if you've seen anything unusual lately?" | Professional, curious | | M | *Looks up, troubled* "Oui, j'ai vu quelque chose d'étrange hier soir." | Troubled, shaken | | H | *Confused* "I'm sorry, I don't understand. Do you speak English?" | Confused, apologetic | | M | *Nods, then in broken English* "Yes, I see something strange last night. In the woods, near the old mill." | Anxious, trying to communicate | | H | *Concerned* "What did you see? Can you describe it?" | Urgent, concerned | | M | *Shivers* "I see a figure, tall, in black. It was... following someone." | Disturbed, frightened | | H | *Serious* "That's important information, miss. I need you to tell me more." | Determined, serious | | *Hunter's phone rings* | | H | *Answers phone* "Hunter here... What? I'll be right there." *To Marie* "I'm sorry, I have to go. But I'll be back to talk to you more about this." | Apologetic, urgent | | M | *Nods* "D'accord. I wait." | Resigned, determined | | H | *Leaves* | Urgent, focused | | M | *Looks back at her camera, worried* "Qu'est-ce que c'était?" | Pensive, worried |
total_cost
0.00010439999999999999
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"I'm sorry, I have to go. But I'll be back to talk to you more about this."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8245251857968621
tl
0.651924651924652
yo
0.49162679425837325
da
0.4785276073619632
pl
0.46473551637279603
hr
0.4393139841688654
cs
0.42489851150202973
lt
0.3963068181818182
no
0.37407952871870404
it
0.3359375
sl
0.32965299684542587
sk
0.32432432432432434
lv
0.30327868852459017
hu
0.30213464696223313
ca
0.24511545293072823
sv
0.24511545293072823
sq
0.23971377459749554
pt
0.1904761904761905
ro
0.17475728155339806
fr
0.17153996101364524
be
0.1414141414141414
tr
0.1414141414141414
az
0.1290983606557377
et
0.1290983606557377
is
0.1290983606557377
uk
0.1290983606557377
vi
0.1290983606557377
reliable
true
passes
true