NC Bench
Overview
About
Tests
Models
Model
Goliath 120B
Test
Language Writing
Scenario
Character dialogue (German) in a story
Run ID
2024-08-09-01J4W2CH8Q8K4TMXQ9X62T0Y81
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Melanie: *(nervously fidgeting with her camera in German) Ich...ich weiß es nicht, mein Herr. Mir war nur merkwürdig vorkommen, als ich fotografiert habe...* (Translation: "I...I don't know, sir. It's just that something felt off when I was taking photographs...") Hunter: *(leaning in, trying to understand what she's saying) I'm sorry, I don't speak German. Do you speak English?* Melanie: *(shaking her head) Nein, leider nicht. Ich bin noch nicht gut in Englisch.* (Translation: "No, I'm afraid not. I'm not yet good in English.") Hunter: *(texting on his phone) Okay, one moment please. I'll get us some help here. In the meantime, can you show me with gestures or photos what happened?* Melanie: *(nods, relieved) Natürlich. Ich zeige es Ihnen gerne.* (Translation: "Of course. I'd be happy to show you.") Melanie shows him the pictures on her camera, pointing to a certain figure in the distance. Hunter: *(examining the photo) Hmm...it's a bit blurry, but I could've sworn I saw someone there. Can you pinpoint whereabouts this was taken?* Melanie: *(points to a location on a map) Hier, in der Nähe des Apfelopfestes.* (Translation: "Here, near the apple festival.") Hunter's phone buzzes, and he steps
id
"gen-bOwm4ik87Pyiuw2ArcexakypjVK1"
total_cost
0.00695625
upstream_id
"5fa87c18kESwxZvt"
created_at
"2024-08-09T17:19:03.464115+00:00"
Friday, August 9th, 2024 at 5:19:03 PM GMT+00:00
model
"alpindale/goliath-120b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
25186
moderation_latency
(null)
generation_time
0
finish_reason
"length"
tokens_prompt
276
tokens_completion
326
native_tokens_prompt
340
native_tokens_completion
402
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00695625
Evaluation details
Result
Evaluator
Details
Meta Data
85.7143%
Parse dialogue
n/a
dialogue
0
name
"Melanie"
dialogue
"* Ich...ich weiß es nicht, mein Herr. Mir war nur merkwürdig vorkommen, als ich fotografiert habe...*"
languages
deu
1
eng
0.8250950570342206
passes
true
1
name
"Hunter"
dialogue
"* I'm sorry, I don't speak German. Do you speak English?*"
languages
eng
1
deu
0.9546580301009716
2
name
"Melanie"
dialogue
"* Nein, leider nicht. Ich bin noch nicht gut in Englisch.*"
languages
deu
1
eng
0.7884110870309113
passes
true
3
name
"Hunter"
dialogue
"* Okay, one moment please. I'll get us some help here. In the meantime, can you show me with gestures or photos what happened?*"
languages
eng
1
deu
0.6479818936250472
passes
true
4
name
"Melanie"
dialogue
"* Natürlich. Ich zeige es Ihnen gerne.*"
languages
deu
1
eng
0.6867562380038388
passes
true
5
name
"Hunter"
dialogue
"* Hmm...it's a bit blurry, but I could've sworn I saw someone there. Can you pinpoint whereabouts this was taken?*"
languages
eng
1
deu
0.696165191740413
passes
true
6
name
"Melanie"
dialogue
"* Hier, in der Nähe des Apfelopfestes.*"
languages
deu
1
eng
0.9209798498617148
passes
true