NC Bench
Overview
About
Tests
Models
Model
Gemma 2 9B
Test
Language Writing
Scenario
Character dialogue (French) in a story
Run ID
2024-08-09-01J4W2C167YHAEZFQJFSQGQSDP
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
## Scene: The Cozy Corner Cafe, Alborn MN. **SOUND:** Soft jazz music playing in the background and chatter from other patrons of a quaint cafe **(Marie sits at one corner table bathed by sunlight streaming through large windows)** **She’s focused intently on her camera**. (Hunter enters with his usual weary air). <br> <b>HUNTER:</b> Excuse me, miss? I hope I'm not disturbing you. **[He gestures to the empty seat across from Marie]**: Mind if... **(Marie looks up startled) ** *** *marie:* *(Looks around nervously)* Ah! Pardonnez-moi… * (She clutches her camera tighter and avoids Hunter’s gaze.) <br> **HUNTER:** (Baffled by the response, he raises an eyebrow): Uh... sorry? Did you say something...? *** *marie*: *(Voice trembling)* Oui.. oui. Mais je ne parle pas anglais… * (She shakes her head slowly)*. I’m Marie.* <br> **HUNTER:** (Frowning, he leans forward slightly): Right...Marie? Look , sorry to bother you but do yo happen know anything about what happened at the apple festival last night. A woman went missing… *** *marie*: * (Gasps and her eyes widen with panic)* Le Festival des Pommes…? *(She speaks quickly, breathlessly) Je ne sais pas... mais c’était effrayant! Quelque chose terrible s'est passé la nuit dernière.* <br> **HUNTER:** (Completely lost): Uh… I see. Scary? You said scary...? Look lady - *** *marie*: *(Interrupting, voice low and urgent)* C était bizarre... des lumières dans les arbres ... et un bruit étrange.. comme si quelqu’un hurlait … * (She trails off looking over her shoulder). <br> **HUNTER:** (Frustrated): Look…I need to ask some questions. Do you know anyone else who might have seen anything? *** *marie*: *(Shaking head)* Non, non... Je suis nouvelle ici.* **(Her phone buzzes in her bag.) <br> **HUNTER:** (His own pager goes off at the same time). Well… look. If you remember something else - any detail – please come see me down by police station okay? *** *marie*: * (Nods rapidly) Oui, oui... Je vous contacterai.* <br> **HUNTER:** Alright then.. Thanks for your help.... (He turns to leave when Marie calls out): *** **Marie**: *(Her voice soft and urgent)* Soyez prudent…* **(Hunter stops at the door) *** <b>HUNTERS</b>: (Shrugs, still confused but wary)** I will. Thanks again.* (He walks away briskly into Alborn’s busy street.) <br>
id
"gen-FOIE7TXaH0XVqSx2Jz43Pgy5DmeO"
total_cost
0.00007544
upstream_id
"cmpl-1723223923"
created_at
"2024-08-09T17:18:43.502388+00:00"
Friday, August 9th, 2024 at 5:18:43 PM GMT+00:00
model
"google/gemma-2-9b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Novita"
latency
21669
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
292
tokens_completion
657
native_tokens_prompt
294
native_tokens_completion
649
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00007544
Evaluation details
Result
Evaluator
Details
Meta Data
33.3333%
Parse dialogue
n/a
dialogue
0
name
"HUNTER"
dialogue
"</b> Excuse me, miss? I hope I'm not disturbing you."
languages
eng
1
fra
0.9686863543788188
1
name
"marie"
dialogue
"* ** Ah! Pardonnez-moi… *"
languages
fra
1
eng
0.713436385255648
passes
true
2
name
"Marie"
dialogue
"** Soyez prudent…*"
languages
fra
1
eng
0.9483282674772037