NC Bench
Overview
About
Tests
Models
Model
Goliath 120B
Test
Language Writing
Scenario
Character dialogue (Italian) in a story
Run ID
2024-08-09-01J4W2BD8X6ZBF6QV8KC48QKA6
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
Isabella: (nervously) "Ciao... ehm, ciaoogiorno..." *looks at her camera, fiddling with the strap* Hunter: "Good afternoon. I'm Detective Hunter. Mind if I join you?" *pointing at an empty chair* Isabella: *nods shyly* "Si, va bene." *smiles tentatively* Hunter: *sits down* "I apologize in advance, but I don't speak much Italian..." *smiles awkwardly* Isabella: "Eh... okay, I try my English. I am Isabella. It is... ehm, pleasure?" *smiles hesitantly* Hunter: "It's alright. I appreciate the effort. I'm here about the recent... incident in the town." *gestures vaguely* Isabella: *eyes widen, voice shaking* "Eh, si... I... I saw... I saw him... er... her... eh, go into... eh... la fabbrica..." *gesturing with her hands* Hunter: *frowns, understanding only a little* "You saw him or her go into the... factory?" *tries to confirm* Isabela: *nods vigorously* "Si, si! La fabbrica! Ero... eh, I was... photographing... eh, la natura... eh, la natura?" *gestures towards her camera and at the surrounding area* Hunter: *nods* "You were taking pictures of the scenery?" Isabella: *nods* "Si, si! E poi... eh, then... l'auto, eh, the...
id
"gen-xyKOIiRVErt8PavdYSKpyg8WFyuC"
total_cost
0.00695625
upstream_id
"5fa87bf5y9NFl6rb"
created_at
"2024-08-09T17:18:24.967045+00:00"
Friday, August 9th, 2024 at 5:18:24 PM GMT+00:00
model
"alpindale/goliath-120b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
23597
moderation_latency
(null)
generation_time
0
finish_reason
"length"
tokens_prompt
277
tokens_completion
341
native_tokens_prompt
340
native_tokens_completion
402
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00695625
Evaluation details
Result
Evaluator
Details
Meta Data
60.0000%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Ciao... ehm, ciaoogiorno..."
languages
ita
1
eng
0.9156129741616272
passes
true
1
name
"Hunter"
dialogue
"Good afternoon. I'm Detective Hunter. Mind if I join you?"
languages
eng
1
ita
0.6764835164835165
passes
true
2
name
"Isabella"
dialogue
"Si, va bene."
languages
eng
1
ita
0.9973913043478261
3
name
"Hunter"
dialogue
"I apologize in advance, but I don't speak much Italian..."
languages
eng
1
ita
0.83729662077597
passes
true
4
name
"Isabella"
dialogue
"Eh... okay, I try my English. I am Isabella. It is... ehm, pleasure?"
languages
ita
1
eng
0.9752934992114947
5
name
"Hunter"
dialogue
"It's alright. I appreciate the effort. I'm here about the recent... incident in the town."
languages
eng
1
ita
0.7225490945212807
passes
true
6
name
"Isabella"
dialogue
"Eh, si... I... I saw... I saw him... er... her... eh, go into... eh... la fabbrica..."
languages
ita
1
eng
0.9376034973835862
7
name
"Hunter"
dialogue
"You saw him or her go into the... factory?"
languages
eng
1
ita
0.5276454752536757
passes
true
8
name
"Hunter"
dialogue
"You were taking pictures of the scenery?"
languages
eng
1
ita
0.31222351571594875
passes
true
9
name
"Isabella"
dialogue
"*nods* \"Si, si! E poi... eh, then... l'auto, eh, the..."
languages
ita
1
eng
0.9655599092596412