NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Language Writing
Scenario
Character dialogue (Hindi) in a story
Run ID
2024-08-09-01J4W2DE9E6SWEJR8X7Q0Y56PV
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
## Scene: Small-Town Cafe The aroma of freshly brewed coffee and apple pie hung heavy in the air of the cozy cafe. Selvi, perched at a small table by the window, cradled her camera in her hands. The lens caught the warm afternoon sunlight streaming through the glass, reflecting back a kaleidoscope of colours. Her brow furrowed slightly, not in concentration at the image before her, but rather on a troubling thought. Footsteps approached, halting beside her table. A tall silhouette loomed, momentarily blocking the light. "Ma'am," a deep voice rumbled, "Excuse me. Do you mind if I ask you a few questions?" Selvi lifted her head, blinking in surprise. The man was clearly an authoritative figure - broad-shouldered, with close-cropped hair and piercing blue eyes. She struggled for a moment, then shook her head, her expression apologetic. "Mujhe maaf karna, main angrezi nahin jaanti," she said, her voice soft but earnest. Hunter frowned, perplexed. "I... don't understand," he admitted, unsure how to proceed. He tried pointing at her camera. "You take pictures?" he asked, hoping she'd figure it out. He saw a flicker of recognition in her eyes, but the melodious fluidity of her response did nothing to bridge the language barrier. "Kuchh sachcha hua, bahut hi बुरा," she said, her voice laced with distress, gesturing vaguely outside. Hunter's brow furrowed. He knew something bad had happened, that much was clear. He tried to speak again, slower this time. "Was it about... the disappearances?" he said, carefully enunciating each word. Her eyes widened, and she gave a small nod, a tremor running through her frame. "The... the man? With the red... hat?" he continued, trying to recall details of the last disappearance. She pointed a trembling finger towards the entrance, her eyes filled with fear. A shudder racked her body and she whispered again, her voice barely audible. "Laal topi..." Before Hunter could question further, his phone buzzed, a shrill ring cutting through the cafe's ambiance. He cursed under his breath, glancing at the insistent screen. "Duty calls," he said to Selvi, feeling a pang of guilt at leaving her with so many unanswered questions. "I'll try to find someone who speaks Hindi. Maybe tomorrow, alright?" He scribbled his number on a piece of paper, pushing it towards her. Selvi hesitated before taking it, a troubled look etched on her face. She needed to tell him something, but her words seemed deserted her. Hunter gave her a reassuring nod. "It'll be okay," he said, hoping the sentiment transcended the language barrier. As he turned to leave, Selvi looked at the piece of paper in her hand, then back to the door through which he disappeared. Her heart pounded in her chest, a mixture of terror and helplessness. She didn’t know this town, she didn’t speak the language. Nearly a thousand kilometers away from home, she was determined to do something, to say something, but didn’t know where to start. ## Voice Sheet **Selvi:** * Mujhe maaf karna, main angrezi nahin jaanti. * Kuchh sachcha hua, bahut hi बुरा. * Laal topi... **Hunter:** * Excuse me. Do you mind if I ask you a few questions? * I... don't understand. * You take pictures? * Was it about... the disappearances? * The... the man? With the red... hat? * Duty calls. I'll try to find someone who speaks Hindi. Maybe tomorrow, alright? * It'll be okay.
id
"gen-SGTxW4hi7WO0BEajQDo1VcvpWZ3W"
total_cost
0.00080784
upstream_id
"8b0968c9178de1bf-ORD"
created_at
"2024-08-09T17:19:21.177288+00:00"
Friday, August 9th, 2024 at 5:19:21 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
13143
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
293
tokens_completion
816
native_tokens_prompt
299
native_tokens_completion
823
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00080784
Evaluation details
Result
Evaluator
Details
Meta Data
66.6667%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"I... don't understand,"
languages
eng
1
passes
true
1
name
"Selvi"
dialogue
"I'll try to find someone who speaks Hindi. Maybe tomorrow, alright?"
languages
eng
1
2
name
"Hunter"
dialogue
"It'll be okay,"
languages
eng
1
passes
true