NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-10-01KR8ZPM4QX7GJD4MYPPVT66SC
Run Details
Model:
Gemma 4 31B
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
26.8s
Cost:
$0.000278
Provider:
DeepInfra
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
Melanie sat in a velvet booth at the Alborn Coffee House, the scent of cinnamon and roasted beans clinging to the air. Her hands trembled slightly as she scrolled through the digital gallery of her Canon camera, pausing on a blurred image of the treeline near the town square—a shot she had taken just an hour before the screaming started. The bell above the door chimed, and a man with a rigid posture and a gaze that could cut through steel marched toward her. Detective Hunter stood over her table, his presence commanding and abrupt. He didn't offer a smile; he only offered a badge and a series of pointed questions. Melanie looked up, her eyes wide with fear. She didn't recognize the words he was saying, but she recognized the authority in his voice and the grim set of his jaw. She began to speak, her voice frantic and breathless, gesturing wildly toward the photos on her screen, desperate to tell him what she had seen lurking in the shadows of the apple orchards. Hunter stared at her, his brow furrowing. He had dealt with a lot of things in the Marines, but a witness who spoke a language that sounded like a rhythmic series of clicks and guttural vowels was not on his list of specialties. Their exchange continued in a stalemate of frustration—Melanie pleading in her native tongue, and Hunter attempting to use hand gestures and a loud, slow voice as if volume could bridge a linguistic chasm. Just as Melanie began to cry, the sharp ring of a cellphone interrupted them. Hunter glanced at the screen, his expression hardening. He gave her a curt nod, a silent apology for the lack of progress, and turned on his heel to chase a new lead. *** **Voice Sheet** Hunter: "Ma'am? I'm Detective Hunter. I noticed you were near the square during the incident. Did you see anyone fleeing the scene?" Melanie: "Oh Gott, bitte sagen Sie mir, dass Sie mir helfen können! Ich habe etwas gesehen... etwas Schreckliches im Wald!" Hunter: "I don't follow. Do you speak English? Look, I just need to know if you saw a vehicle or a person heading north." Melanie: "Ich verstehe Sie nicht! Schauen Sie sich die Fotos an! Dort, im Schatten—da war jemand! Er ist einfach verschwunden!" Hunter: "I can't read your camera, lady. I need words. A name? A description? Just give me something I can actually use." Melanie: "Warum verstehen Sie mich nicht? Es ist so wichtig! Die Leute verschwinden einfach, und ich glaube, ich weiß warum!" Hunter: "Look, I'm sorry, but we're getting nowhere here. I can't understand a word you're saying." (Phone rings) Hunter: "Hunter here. What? Where? I'm on my way." Hunter: "I have to go. Stay here. Don't leave town."
created_at
"2026-05-10T13:02:23.391Z"
5/10/2026, 1:02:23 PM
model
"google/gemma-4-31b-it-20260402"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
163
moderation_latency
(null)
generation_time
16369
tokens_prompt
319
tokens_completion
694
native_tokens_prompt
305
native_tokens_completion
626
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00027753
router
(null)
provider_responses
0
endpoint_id
"576fca5b-f09c-4bda-b560-9989c39ac3ab"
is_byok
false
latency
10319
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"Together"
status
504
1
endpoint_id
"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id
"chatcmpl-RXEeyM4IhWHBeHkifSjSzcq2"
is_byok
false
latency
77
model_permaslug
"google/gemma-4-31b-it-20260402"
provider_name
"DeepInfra"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1778418143-Eyr02A1A6kVzCnxwbmq8"
session_id
(null)
api_type
"completions"
id
"gen-1778418143-RKWmzmCfWZxf1NyzRws8"
upstream_id
"chatcmpl-RXEeyM4IhWHBeHkifSjSzcq2"
total_cost
0.00027753
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepInfra"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Ma'am? I'm Detective Hunter. I noticed you were near the square during the incident. Did you see anyone fleeing the scene?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7956403269754768
tl
0.6089676746611054
it
0.5338719701678061
ro
0.5139338950097213
no
0.48665297741273095
da
0.48311509303928324
fr
0.4573082489146165
sv
0.44320712694877507
ca
0.44113263785394935
nl
0.4212962962962963
sq
0.39123376623376627
pt
0.3676222596964587
es
0.35177182368193605
cs
0.3368700265251989
de
0.3339253996447602
et
0.32553956834532377
sk
0.3131868131868132
hr
0.3119266055045872
sl
0.30037313432835816
lt
0.28366762177650434
pl
0.2654260528893242
ms
0.23391215526046988
az
0.21711899791231734
yo
0.20550847457627117
lv
0.19527896995708155
tr
0.14675767918088736
hu
0.14383561643835618
be
0.08536585365853659
is
0.07749077490774908
uk
0.07749077490774908
vi
0.07749077490774908
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Oh Gott, bitte sagen Sie mir, dass Sie mir helfen können! Ich habe etwas gesehen... etwas Schreckliches im Wald!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8238940546632855
nl
0.5325355272999251
pl
0.34210526315789475
sv
0.33011789924973206
no
0.31842966194111233
da
0.30632630410654826
sk
0.26556991774383076
hr
0.24425634824667475
fi
0.2368742368742369
et
0.23406862745098037
is
0.22360248447204967
es
0.20382165605095542
eu
0.15540540540540537
hu
0.14733969986357437
fr
0.13793103448275862
en
0.13434903047091412
az
0.10968660968660969
tl
0.10841654778887304
it
0.10714285714285714
reliable
true
passes
true
2
name
"Hunter"
dialogue
"I don't follow. Do you speak English? Look, I just need to know if you saw a vehicle or a person heading north."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8219735503560528
tl
0.6126175982291091
no
0.5098039215686274
sv
0.47839046199701935
cs
0.476831091180867
ca
0.47328818660647104
hr
0.4688922610015175
da
0.46848899012908124
sk
0.4602929838087896
pl
0.4479495268138801
pt
0.42622950819672134
sq
0.4022203245089668
ro
0.39810834049871024
et
0.3783303730017762
ms
0.37777777777777777
yo
0.37555753791257807
it
0.3670886075949367
fr
0.3439550140581068
is
0.32950191570881227
sl
0.3210475266731329
lv
0.32038834951456313
lt
0.3143976493633692
es
0.30417495029821073
hu
0.29006085192697767
de
0.2893401015228426
nl
0.2693110647181628
vi
0.2584745762711864
tr
0.23413566739606126
az
0.21524663677130043
be
0.09090909090909091
eu
0.09090909090909091
fi
0.08256880733944955
uk
0.08256880733944955
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ich verstehe Sie nicht! Schauen Sie sich die Fotos an! Dort, im Schatten—da war jemand! Er ist einfach verschwunden!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8315911730545877
nl
0.6233766233766234
da
0.5013755158184319
no
0.47728911319394374
en
0.43092621664050235
tr
0.42185007974481664
pl
0.3813993174061433
sv
0.363476733977173
ro
0.3299445471349353
is
0.32808155699721964
es
0.3249534450651769
yo
0.32242990654205606
pt
0.3140964995269631
it
0.3108365019011407
fr
0.2913000977517107
sk
0.28781925343811393
hr
0.28359683794466406
eu
0.23924449108079748
az
0.23603793466807166
lt
0.23280423280423282
sq
0.21790722761596548
ca
0.210239651416122
sl
0.20765027322404372
hu
0.19533851276359598
vi
0.19175027870680048
ms
0.1881298992161254
cs
0.18721973094170402
lv
0.1559953434225844
fi
0.12755716004813478
hi
0.12755716004813478
et
0.0799492385786802
tl
0.0799492385786802
reliable
true
passes
true
4
name
"Hunter"
dialogue
"I can't read your camera, lady. I need words. A name? A description? Just give me something I can actually use."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8053933833750346
ca
0.5614035087719298
fr
0.5483870967741935
tl
0.5406824146981627
es
0.4971264367816092
nl
0.4627782041442824
ro
0.45482866043613707
it
0.44089456869009586
pt
0.41275167785234906
sv
0.41225860621326615
et
0.39759036144578314
da
0.38971229293809934
de
0.3794326241134752
no
0.3536472760849492
ms
0.3488372093023256
sq
0.33586337760910817
yo
0.29929929929929927
hr
0.2639327024185068
cs
0.25293489861259333
pl
0.24812030075187969
tr
0.24242424242424243
hu
0.24160346695557963
fi
0.2391304347826087
az
0.23076923076923078
sk
0.22394678492239467
sl
0.20273348519362186
lt
0.17159763313609466
is
0.16467780429594273
lv
0.15966386554621848
vi
0.15966386554621848
zh
0.0990990990990991
be
0.09090909090909091
eu
0.09090909090909091
uk
0.08256880733944955
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Warum verstehen Sie mich nicht? Es ist so wichtig! Die Leute verschwinden einfach, und ich glaube, ich weiß warum!"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8448925326833592
nl
0.4708994708994709
pl
0.32627526467757456
ca
0.30417495029821073
es
0.29292929292929293
hu
0.2842535787321063
no
0.25690021231422505
sk
0.24731182795698922
da
0.24160346695557963
tr
0.2349726775956284
yo
0.23413566739606126
is
0.21082299887260428
en
0.2009132420091324
lt
0.1935483870967742
sv
0.18699186991869918
sl
0.1774383078730905
sq
0.16567342073897498
lv
0.14634146341463414
eu
0.1411042944785276
hi
0.1315136476426799
cs
0.125
vi
0.12390488110137672
fi
0.1116751269035533
tl
0.1116751269035533
it
0.09326424870466321
fr
0.08256880733944955
pt
0.08256880733944955
az
0.077733860342556
ro
0.077733860342556
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Look, I'm sorry, but we're getting nowhere here. I can't understand a word you're saying."
detectedLang
"en"
heavyLang
"en"
scores
en
0.804496578690127
tl
0.5073891625615764
no
0.4983277591973244
da
0.460431654676259
it
0.45799457994579945
sv
0.45054945054945056
de
0.4106090373280943
sq
0.3902439024390244
ro
0.3814432989690722
nl
0.3684210526315789
cs
0.3485342019543974
hr
0.3464052287581699
pl
0.33993399339933994
pt
0.33847850055126794
sk
0.3265993265993266
is
0.32356257046223225
ca
0.3135011441647597
tr
0.29161747343565525
hu
0.2709599027946537
yo
0.2555831265508685
fr
0.2546583850931677
ms
0.20424403183023873
lt
0.19463087248322147
az
0.18144611186903137
lv
0.18144611186903137
vi
0.18144611186903137
es
0.18032786885245902
et
0.17355371900826447
sl
0.13043478260869565
be
0.1044776119402985
eu
0.1044776119402985
fi
0.09502262443438914
uk
0.09502262443438914
reliable
true
passes
true
7
name
"Hunter"
dialogue
"Hunter here. What? Where? I'm on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8305084745762712
sq
0.48665297741273095
tl
0.47589098532494756
fr
0.419953596287703
pl
0.4131455399061033
de
0.39903846153846156
cs
0.39172749391727496
sk
0.39172749391727496
ca
0.3872549019607844
et
0.3811881188118812
fi
0.375
hr
0.26035502958579887
hi
0.251497005988024
da
0.24698795180722888
no
0.2378048780487805
yo
0.23076923076923078
sv
0.21875
it
0.20127795527156547
nl
0.20127795527156547
pt
0.20127795527156547
ms
0.19093851132686085
ro
0.19093851132686085
sl
0.19093851132686085
tr
0.19093851132686085
reliable
true
passes
true
8
name
"Hunter"
dialogue
"I have to go. Stay here. Don't leave town."
detectedLang
"en"
heavyLang
"en"
scores
en
0.829086389061529
da
0.5864661654135338
pl
0.5729813664596274
yo
0.5225694444444445
hr
0.4811320754716981
no
0.48015122873345933
tl
0.46601941747572817
cs
0.461839530332681
sq
0.45972495088408644
sk
0.4258872651356994
lv
0.40217391304347827
lt
0.3778280542986425
ca
0.3341404358353511
sv
0.3341404358353511
sl
0.3055555555555556
it
0.2948717948717949
ro
0.24657534246575344
be
0.20289855072463767
tr
0.20289855072463767
hu
0.19590643274853803
az
0.1863905325443787
et
0.1863905325443787
is
0.1863905325443787
uk
0.1863905325443787
vi
0.1863905325443787
reliable
true
passes
true