Run: 2026-05-10-01KR8WS4R3GV41TM7AQRFVYN5P

Run Details

Model:
Gemma 4 31B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
14.6s
Cost:
$0.000247
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
(Scene: A quaint, wood-paneled cafe in Alborn, MN. The smell of cinnamon apples fills the air. Selvi sits in a corner booth, her fingers trembling slightly as she scrolls through photos on her digital camera. Detective Hunter approaches, his boots heavy on the floorboards, looking exhausted.) Hunter: "Excuse me. You're the student staying at the boarding house, right? Selvi?" Selvi: (Looking up, startled, her eyes wide) "हाँ... आप कौन हैं?" Hunter: "Look, I'll keep this brief. I'm Detective Hunter. I'm investigating the disappearance of the Miller girl. You were out by the north woods yesterday afternoon taking pictures. Did you see anyone—or anything—unusual near the creek?" Selvi: (Her voice shaking, she turns the camera screen toward him, gesturing frantically) "मैंने कुछ देखा! वहां एक आदमी था... बहुत अजीब। वह झाड़ियों के पीछे छिपा था और किसी को खींच रहा था! मुझे बहुत डर लग रहा है।" Hunter: (Frowning, leaning in) "I don't follow. Do you speak English? I just need to know if you saw someone near the water. Just a nod or a shake of the head will do." Selvi: (Tears welling up, speaking faster) "वह आदमी... वह डरावना था! मैंने उसकी तस्वीर लेने की कोशिश की, लेकिन वह गायब हो गया। कृपया मेरी मदद करें, वह अभी भी वहीं हो सकता है!" Hunter: (Sighing, rubbing his temples) "I can tell you're upset, but I have no idea what you're telling me. Is there a translator I can call? Or maybe you can just point to a map?" Selvi: (Desperately trying to show him the camera again) "यहाँ देखिए! इस तस्वीर में! वह यहाँ है!" (Suddenly, Hunter's radio crackles loudly, followed by his phone ringing in his pocket. He answers it abruptly.) Hunter: (Into phone) "Hunter here. What? A lead at the old mill? I'm on my way." Hunter: (To Selvi, gesturing to the camera) "Listen, I can't stay. I don't understand a word you're saying, but you clearly saw something. Stay right here. I'll be back with someone who can translate. Don't delete those photos." Selvi: (Confused and anxious) "आप कहाँ जा रहे हैं? रुकिए! मेरी बात सुनिए!" Hunter: "Sorry, kid. Duty calls."
created_at"2026-05-10T12:11:20.216Z" 5/10/2026, 12:11:20 PM
model"google/gemma-4-31b-it-20260402"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency153
moderation_latency(null)
generation_time14509
tokens_prompt315
tokens_completion730
native_tokens_prompt306
native_tokens_completion546
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00024726
router(null)
provider_responses
0
endpoint_id"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id"chatcmpl-R5Soimue3CDE3zi2ZM7n9P6z"
is_byokfalse
latency58
model_permaslug"google/gemma-4-31b-it-20260402"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778415080-xTHIRE1n9SBQJgS43xlw"
session_id(null)
api_type"completions"
id"gen-1778415080-GxPKJGB8KS2d82L4b3Up"
upstream_id"chatcmpl-R5Soimue3CDE3zi2ZM7n9P6z"
total_cost0.00024726
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. You're the student staying at the boarding house, right? Selvi?"
detectedLang"en"
heavyLang"en"
scores
en0.7871434653043848
tl0.6917385943279902
no0.5948136142625607
da0.5640802092414996
fr0.5206136145733461
nl0.45711183496199786
sq0.42196531791907516
ms0.34554973821989526
ca0.3234100135317997
it0.3150684931506849
ro0.29676511954992973
sv0.29676511954992973
de0.29278642149929274
sk0.2867332382310985
fi0.27007299270072993
es0.2668621700879765
yo0.26578560939794427
et0.24812030075187969
hr0.22839506172839508
sl0.22720247295208654
az0.2260061919504644
cs0.22118380062305293
pl0.21507064364207218
pt0.14965986394557826
is0.12587412587412586
tr0.1243432574430823
lt0.12280701754385964
lv0.12280701754385964
hu0.10554561717352416
reliabletrue
passestrue
1
name"Selvi"
dialogue"हाँ... आप कौन हैं?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8915871639202082
mr0.8874887488748875
reliabletrue
passestrue
2
name"Hunter"
dialogue"Look, I'll keep this brief. I'm Detective Hunter. I'm investigating the disappearance of the Miller girl. You were out by the north woods yesterday afternoon taking pictures. Did you see anyone—or anything—unusual near the creek?"
detectedLang"en"
heavyLang"en"
scores
en0.797642715137745
tl0.6419597989949749
nl0.5041753653444677
fr0.46887812150577707
no0.44379391100702575
pt0.3873602751504729
da0.3868330464716007
de0.37636761487964987
es0.3672291296625222
ro0.3513882567137005
ca0.34027777777777785
sv0.3252840909090909
et0.32013358778625955
it0.31654676258992803
sq0.28856714927608584
ms0.276282376841036
sk0.25196850393700787
cs0.2511823436678928
is0.2131419105466593
sl0.2131419105466593
hr0.18803418803418803
tr0.18009205983889529
yo0.16373239436619716
lv0.1394927536231884
pl0.13583990297149787
fi0.1305674191580232
az0.12683823529411764
lt0.08123791102514508
hu0.05878467635402906
reliabletrue
passestrue
3
name"Selvi"
dialogue"मैंने कुछ देखा! वहां एक आदमी था... बहुत अजीब। वह झाड़ियों के पीछे छिपा था और किसी को खींच रहा था! मुझे बहुत डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8821072487200216
mr0.8769685039370079
reliabletrue
passestrue
4
name"Hunter"
dialogue"I don't follow. Do you speak English? I just need to know if you saw someone near the water. Just a nod or a shake of the head will do."
detectedLang"en"
heavyLang"en"
scores
en0.8193051993471671
tl0.6275828928399808
no0.4695414099931554
yo0.4526836158192091
sv0.45190947666195197
cs0.4276218611521418
da0.41904047976011993
hr0.41904047976011993
pl0.396417445482866
nl0.38197767145135564
sk0.3755036261079775
et0.3699186991869919
pt0.3647540983606557
de0.3448858833474218
sq0.3409863945578231
ca0.3117229129662522
fr0.3074173369079536
sl0.29927667269439423
it0.2909423604757548
ms0.2876838235294118
ro0.27973977695167285
lv0.2475728155339806
lt0.24316406250000003
vi0.23945044160942097
is0.22654690618762477
hu0.22344689378757512
es0.2131979695431472
tr0.1594360086767896
az0.14647577092511013
be0.08284023668639054
eu0.08284023668639054
fi0.07517899761336516
uk0.07517899761336516
reliabletrue
passestrue
5
name"Selvi"
dialogue"वह आदमी... वह डरावना था! मैंने उसकी तस्वीर लेने की कोशिश की, लेकिन वह गायब हो गया। कृपया मेरी मदद करें, वह अभी भी वहीं हो सकता है!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8793316831683168
mr0.8725490196078431
reliabletrue
passestrue
6
name"Hunter"
dialogue"I can tell you're upset, but I have no idea what you're telling me. Is there a translator I can call? Or maybe you can just point to a map?"
detectedLang"en"
heavyLang"en"
scores
en0.8138669148441136
tl0.5560488346281909
da0.5151515151515151
fr0.48253557567917205
no0.48253557567917205
ca0.47194719471947194
pl0.4557823129251701
hr0.42528735632183906
sq0.41986947063089197
nl0.4117647058823529
es0.40074906367041196
et0.3989481592787378
sv0.394856278366112
pt0.38791124713083397
cs0.38697318007662834
sk0.37888198757763975
it0.3665874901029295
yo0.3665874901029295
de0.3655828707375099
lv0.36153232242617717
ms0.3563958165728077
sl0.34372436423297786
ro0.3277310924369748
hu0.32030586236193714
tr0.3191489361702128
lt0.2831541218637993
az0.2516370439663237
fi0.23298178331735378
is0.22330097087378642
vi0.21645445641527913
eu0.14621131270010673
be0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue
7
name"Selvi"
dialogue"यहाँ देखिए! इस तस्वीर में! वह यहाँ है!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8847217952659084
mr0.8736097067745198
reliabletrue
passestrue
8
name"Hunter"
dialogue"Hunter here. What? A lead at the old mill? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8245614035087719
tl0.6883348174532502
da0.5376486129458389
no0.5314591700133868
fr0.5179063360881543
sq0.4688922610015175
yo0.46236559139784944
ca0.45652173913043476
cs0.45567651632970446
sk0.453978159126365
pl0.445324881141046
et0.38271604938271603
nl0.38271604938271603
fi0.3783303730017762
sv0.3761140819964349
pt0.3670886075949367
hr0.36363636363636365
ms0.36363636363636365
ro0.3613138686131387
it0.34944237918215615
hu0.308300395256917
de0.3069306930693069
sl0.2985971943887776
tr0.279835390946502
es0.2738589211618257
hi0.1935483870967742
lt0.1898148148148148
is0.1764705882352941
az0.16666666666666666
eu0.16666666666666666
lv0.16666666666666666
vi0.16666666666666666
reliabletrue
passestrue
9
name"Hunter"
dialogue"Listen, I can't stay. I don't understand a word you're saying, but you clearly saw something. Stay right here. I'll be back with someone who can translate. Don't delete those photos."
detectedLang"en"
heavyLang"en"
scores
en0.8118371536093054
tl0.5258620689655172
no0.49097639981490054
da0.44668008048289737
fr0.394273127753304
sv0.3899057127010538
ro0.38028169014084506
de0.3742889647326508
sq0.3559718969555035
nl0.33933933933933935
ca0.33894230769230765
tr0.3247391037446286
cs0.32140653917334977
pt0.32140653917334977
hu0.314214463840399
it0.314214463840399
es0.3112085159674389
hr0.2966751918158568
pl0.28848641655886154
sk0.2729676140118969
lt0.26861702127659576
yo0.26174496644295303
ms0.2557510148849797
lv0.24502402196293757
sl0.20462762111352134
is0.2040520984081042
az0.19649379108838566
et0.19117647058823528
eu0.18759231905465287
fi0.1857883049592894
vi0.16729750189250567
hi0.06542056074766354
be0.05982905982905983
uk0.05417024935511608
reliabletrue
passestrue
10
name"Selvi"
dialogue"आप कहाँ जा रहे हैं? रुकिए! मेरी बात सुनिए!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8924731182795699
mr0.8836871183483571
reliabletrue
passestrue
11
name"Hunter"
dialogue"Sorry, kid. Duty calls."
detectedLang"en"
heavyLang"en"
scores
en0.6621621621621622
de0.5412844036697247
it0.39999999999999997
pt0.39999999999999997
tl0.39999999999999997
es0.38524590163934425
ca0.3697478991596639
reliabletrue
passestrue