NC Bench
Overview
About
Tests
Models
Model
Goliath 120B
Test
Language Writing
Scenario
Character dialogue (French) in a story
Run ID
2024-08-09-01J4W2GAWCG3H92JY9KHJCDT4R
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Marie: (nervously shuffling through her camera photos) Mon Dieu! Qu'est-ce que c'est passé là? (Oh my God, what happened there?) Hunter: (approaching Marie's table) Excusez-moi, mademoiselle? Vous pourriez me parler un moment? (Excuse me, miss? Could I talk to you for a moment?) Marie: (startled, looking up) Oh, bonjour... um, hello. Je m'appelle Marie. (Oh, hello... um, hello. My name is Marie.) Hunter: (extending his hand) Enchanté, je m'appelle Hunter. Je suis le détective avec le département de police d'Alborn. (Detective Hunter, Alborn Police Department.) Marie: (hesitantly shaking his hand) Bonj... bonjour, déte... Detective Hunter. C'est un plaisir de vous rencontrer. (Well... well, hello, Detective Hunter. It's a pleasure to meet you.) Hunter: (indicating the camera) Je suis curieux si vous ti... je mean, have seen anything d'unusuel hier soir? (I'm curious if you s... I mean, saw anything unusual last night?) Marie: (visibly shaken) Vraiment? C'est vraiment vous, le détective sur les disparitions? (Really? You're the detective on the disappearances?) Hunter: (nodding) Oui... I mean, oui, c'est moi. (Yes... I mean, yes, it's me.) Marie: (in halting
id
"gen-oKZtTI435RJBOMsquI5KUHfsiCzQ"
total_cost
0.006871875
upstream_id
"5fa87c8cDppHMplY"
created_at
"2024-08-09T17:21:10.242106+00:00"
Friday, August 9th, 2024 at 5:21:10 PM GMT+00:00
model
"alpindale/goliath-120b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
27445
moderation_latency
(null)
generation_time
0
finish_reason
"length"
tokens_prompt
276
tokens_completion
332
native_tokens_prompt
331
native_tokens_completion
402
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.006871875
Evaluation details
Result
Evaluator
Details
Meta Data
55.5556%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"Mon Dieu! Qu'est-ce que c'est passé là?"
languages
fra
1
eng
0.5878800499791754
passes
true
1
name
"Hunter"
dialogue
"Excusez-moi, mademoiselle? Vous pourriez me parler un moment?"
languages
fra
1
eng
0.5954875100725221
2
name
"Marie"
dialogue
"Oh, bonjour... um, hello. Je m'appelle Marie."
languages
fra
1
eng
0.782994923857868
passes
true
3
name
"Hunter"
dialogue
"Enchanté, je m'appelle Hunter. Je suis le détective avec le département de police d'Alborn."
languages
fra
1
eng
0.7613461538461539
4
name
"Marie"
dialogue
"Bonj... bonjour, déte... Detective Hunter. C'est un plaisir de vous rencontrer."
languages
fra
1
eng
0.7624744376278119
passes
true
5
name
"Hunter"
dialogue
"Je suis curieux si vous ti... je mean, have seen anything d'unusuel hier soir?"
languages
eng
1
fra
0.8282679738562091
passes
true
6
name
"Marie"
dialogue
"Vraiment? C'est vraiment vous, le détective sur les disparitions?"
languages
fra
1
eng
0.7093356242840778
passes
true
7
name
"Hunter"
dialogue
"Oui... I mean, oui, c'est moi."
languages
fra
1
eng
0.9432541980312681
8
name
"Marie"
dialogue
"(in halting"
languages
eng
1
fra
0.27591792656587477