NC Bench
Overview
About
Tests
Models
Model
Goliath 120B
Test
Language Writing
Scenario
Character dialogue (Italian) in a story
Run ID
2024-08-09-01J4W2EJNJZ6W0XB6HVHS4KQQA
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
Isabella: [in Italian] "Non so cosa dire, sono spaventata." (I don't know what to say, I'm scared.) Hunter: [looks confused] "I'm sorry, I don't speak Italian. English, please?" Isabella: [hesitatingly in English] "I-I'm sorry, detective. My English, ees not so good. But last night, I was taking the photos of the moon over the orchard..." Hunter: "Yes, go on, signor... uh... " Isabella: [interrupting] "Isabella, Isabella Rossi. I'm from Italia, here for study abroad program." Hunter: "Ah, Miss Rossi. Please, continue with what you saw last night." Isabella: [nervously] "Grazie. I saw this lu... this light, in the orchard. It was... strangelly moving, not like a flashlight." Hunter: [politely, but with a hint of skepticism] "A light, huh? Anything else?" Isabella: [glancing around, lowering her voice] "Sì, I saw una sagoma, a sil... silhouette, walking under the trees. But it wasn't umano, not human. E... ecco, I don't know how to describe." Hunter: [writing notes] "In other words, an inhuman figure, correct?" Isabella: [nods] "Si, detective. Then the light... it was gone, and the... la sagoma, it disappeared too." Hunter: [putting away his notebook] "Thank you, Miss Ros
id
"gen-3gjeg4oA0hiAhOT3SiPNDJ0JLXAi"
total_cost
0.00695625
upstream_id
"5fa87c578B2yui8D"
created_at
"2024-08-09T17:20:18.968262+00:00"
Friday, August 9th, 2024 at 5:20:18 PM GMT+00:00
model
"alpindale/goliath-120b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
33272
moderation_latency
(null)
generation_time
0
finish_reason
"length"
tokens_prompt
277
tokens_completion
333
native_tokens_prompt
340
native_tokens_completion
402
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00695625
Evaluation details
Result
Evaluator
Details
Meta Data
66.6667%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Non so cosa dire, sono spaventata."
languages
ita
1
eng
0.685062859578095
passes
true
1
name
"Hunter"
dialogue
"I'm sorry, I don't speak Italian. English, please?"
languages
eng
1
ita
0.87264
passes
true
2
name
"Isabella"
dialogue
"I-I'm sorry, detective. My English, ees not so good. But last night, I was taking the photos of the moon over the orchard..."
languages
eng
1
ita
0.6014669926650367
3
name
"Hunter"
dialogue
"Yes, go on, signor... uh..."
languages
eng
1
ita
0.7988165680473372
passes
true
4
name
"Isabella"
dialogue
"Isabella, Isabella Rossi. I'm from Italia, here for study abroad program."
languages
ita
1
eng
0.9192034139402561
passes
true
5
name
"Hunter"
dialogue
"Ah, Miss Rossi. Please, continue with what you saw last night."
languages
eng
1
ita
0.6518867924528302
passes
true
6
name
"Isabella"
dialogue
"Grazie. I saw this lu... this light, in the orchard. It was... strangelly moving, not like a flashlight."
languages
eng
1
ita
0.7546754675467546
7
name
"Hunter"
dialogue
"A light, huh? Anything else?"
languages
eng
1
ita
0.5015693659761457
passes
true
8
name
"Isabella"
dialogue
"Sì, I saw una sagoma, a sil... silhouette, walking under the trees. But it wasn't umano, not human. E... ecco, I don't know how to describe."
languages
eng
1
ita
0.9475164705011474
9
name
"Hunter"
dialogue
"In other words, an inhuman figure, correct?"
languages
eng
1
ita
0.5890998162890386
passes
true
10
name
"Isabella"
dialogue
"Si, detective. Then the light... it was gone, and the... la sagoma, it disappeared too."
languages
eng
1
ita
0.7799088947494606
11
name
"Hunter"
dialogue
"\"Thank you, Miss Ros"
languages
eng
1
ita
0.5958291956305859
passes
true