NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-20-01KHY90AKCFDCRY9T4PR74W2VC
Run Details
Model:
Gemma 3 27B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
15.5s
Cost:
$0.000293
Provider:
Nebius
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
## Voice Sheet: Scene - Alborn Cafe **Setting:** A small, brightly lit cafe in Alborn, Minnesota. Mid-morning. The scent of coffee and apple pie hangs in the air. **Characters:** Marie (30, French student, speaks *only* French), Hunter (35, Detective, speaks *only* English). --- **Marie:** (Eyes glued to the back of her camera, meticulously reviewing photos. She’s picking at a pastry, mostly untouched. A visible tremor in her hands. She looks genuinely distressed.) “…Oh là là… Non, non, non… C’est impossible.” ( *Oh dear God… No, no, no… This is impossible.*) **Hunter:** (Approaches her table, pulling out a chair. He’s dressed in plain clothes, but his posture is all business.) “Excuse me, miss? I’m Detective Hunter. Mind if I ask you a quick question?” **Marie:** (Looks up, startled, eyes wide with fear. She automatically clutches her camera tighter.) “Pardon? Je… je ne comprends pas.” ( *Excuse me? I… I don’t understand.*) **Hunter:** (Frowning slightly.) “Uh… right. Look, I’m investigating what happened down at Old Man Hemlock’s orchard last night. You were… around the general area, I understand?” **Marie:** (Her voice breaks, trembling. She gestures vaguely with her hand, her brow furrowed.) “La ferme… La ferme Hemlock… C’était terrible… une ombre… et puis… plus rien.” (*The farm… Hemlock farm… It was terrible… a shadow… and then… nothing.*) **Hunter:** (Blank stare. He runs a hand through his hair.) “Shadow? ‘Terrible’? Look, I need specifics. Did you *see* anything? Anyone?” **Marie:** (Shakes her head vehemently, tears welling in her eyes. She struggles to find the right words, speaking faster and faster in French.) “Non, non! Juste… une forme sombre… il a disparu! Comme… avalé par la nuit! C'était effrayant!” (*No, no! Just… a dark shape… He disappeared! Like… swallowed by the night! It was frightening!*) **Hunter:** (Leans forward, trying a different tack, speaking slowly and loudly as if that will somehow translate.) “Disappeared? A… person? You saw a person disappear?” **Marie:** (Nods vigorously, still distraught.) “Oui! Un vieil homme! Il parlait… il parlait de… de légendes… des bois… et d’une ancienne malédiction!” (*Yes! An old man! He was talking… he was talking about… about legends… the woods… and an ancient curse!*) **Hunter:** (Massaging his temples. This is going nowhere fast.) “Legends? Curse? Okay, this is getting us nowhere. Look, do you speak English?” **Marie:** (Looks down at her hands, shaking her head sadly.) “Non. Je suis française. Je ne parle pas anglais.” (*No. I am French. I do not speak English.*) **Hunter:** (Sighs, frustrated. He's about to ask if she knows anyone who *can* translate when his phone buzzes.) “Hold on a second.” (Answers the phone) "Hunter… Yeah… What?! Another one?… Where?... Okay, I'm on my way." (To Marie, abruptly) “Sorry, gotta run. This is… important.” **Marie:** (Looks up, still deeply upset, reaching out a hand as if to stop him.) “Attendez! S'il vous plaît! Je peux… je peux peut-être aider!” (*Wait! Please! I can… I can maybe help!*) **Hunter:** (Already halfway out of his chair.) “Look, I appreciate the… offer. But right now, I need to go. Maybe we can talk later.” (Turns and hurries out of the cafe, leaving Marie staring after him, clutching her camera, her face etched with worry.) ---
created_at
"2026-02-20T19:39:08.797Z"
2/20/2026, 7:39:08 PM
model
"google/gemma-3-27b-it"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
225
moderation_latency
(null)
generation_time
15334
tokens_prompt
341
tokens_completion
932
native_tokens_prompt
292
native_tokens_completion
880
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0002932
router
(null)
provider_responses
0
endpoint_id
"db3af039-8c6e-4b32-bbf5-c858d644d1b5"
id
"chatcmpl-b166febd103e4be682223600a777d5a1"
is_byok
false
latency
225
model_permaslug
"google/gemma-3-27b-it"
provider_name
"Nebius"
status
200
api_type
"completions"
id
"gen-1771616348-yqT8t63TCcNt9xxbJflm"
upstream_id
"chatcmpl-b166febd103e4be682223600a777d5a1"
total_cost
0.0002932
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Marie"
dialogue
"“…Oh là là… Non, non, non… C’est impossible.”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7863247863247863
it
0.6918335901386748
en
0.5959595959595959
ca
0.5798319327731093
nl
0.5024875621890548
es
0.49874686716791977
tl
0.4444444444444444
vi
0.43977591036414565
pt
0.3265993265993266
ro
0.3220338983050847
yo
0.3055555555555556
eu
0.30313588850174217
da
0.250936329588015
no
0.250936329588015
sq
0.250936329588015
sv
0.250936329588015
reliable
true
passes
true
1
name
"Hunter"
dialogue
"“Excuse me, miss? I’m Detective Hunter. Mind if I ask you a quick question?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7977197499080544
tl
0.6306245802552047
fr
0.5997088791848617
it
0.5880149812734082
pt
0.5358649789029536
sv
0.49725776965265084
no
0.4958753437213565
ro
0.4954128440366973
ca
0.4825964252116651
sq
0.4791666666666667
da
0.4701348747591522
es
0.4701348747591522
cs
0.4130202774813233
nl
0.40604751619870405
de
0.39293598233995586
hr
0.3663594470046083
hu
0.3612078977932636
et
0.359720605355064
sl
0.3559718969555035
yo
0.35217903415783275
pl
0.29577464788732394
fi
0.2857142857142857
ms
0.2724867724867725
tr
0.2724867724867725
sk
0.26861702127659576
lt
0.20863309352517986
is
0.2005813953488372
az
0.19472913616398244
lv
0.19472913616398244
vi
0.19472913616398244
zh
0.12280701754385964
be
0.11290322580645161
eu
0.11290322580645161
uk
0.10277324632952692
reliable
true
passes
true
2
name
"Marie"
dialogue
"“Pardon? Je… je ne comprends pas.”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7695852534562212
lt
0.6763754045307443
ca
0.6460176991150443
cs
0.6219281663516069
nl
0.6062992125984252
sl
0.6007984031936128
it
0.5943204868154158
hr
0.5867768595041323
tl
0.5771670190274841
sq
0.54337899543379
en
0.5215311004784688
ro
0.5169082125603864
es
0.5085995085995086
yo
0.4490358126721763
de
0.43977591036414565
sk
0.42028985507246375
pt
0.37888198757763975
lv
0.33993399339933994
tr
0.3197278911564626
pl
0.3127147766323024
fi
0.3055555555555556
ms
0.29577464788732394
hu
0.2907801418439716
reliable
true
passes
true
3
name
"Hunter"
dialogue
"“Uh… right. Look, I’m investigating what happened down at Old Man Hemlock’s orchard last night. You were… around the general area, I understand?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8012136430215526
tl
0.7034030596315954
no
0.5709123757904245
da
0.5476190476190477
nl
0.5306324110671937
sv
0.4930629669156884
de
0.43486020226055916
ro
0.39451880178457616
fr
0.3457300275482094
it
0.33797909407665505
cs
0.32814710042432815
ca
0.3185078909612626
pt
0.31752873563218387
sk
0.3100944081336238
hr
0.3014705882352941
sq
0.29157345264727813
ms
0.2725880551301685
lt
0.2669753086419753
yo
0.25723221266614543
es
0.24662965900079303
az
0.24060751398880897
is
0.22448979591836735
et
0.22067268252666117
pl
0.21939194741166804
lv
0.20235096557514695
tr
0.18594687232219365
sl
0.1659350307287094
be
0.06862745098039216
hu
0.06588003933136675
eu
0.06219151036525173
uk
0.06219151036525173
vi
0.06219151036525173
fi
0.058473736372646176
reliable
true
passes
true
4
name
"Marie"
dialogue
"“La ferme… La ferme Hemlock… C’était terrible… une ombre… et puis… plus rien.”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7981157469717362
ca
0.5860165593376264
it
0.5553359683794467
es
0.5081967213114754
tl
0.43890274314214467
ro
0.41709844559585496
da
0.3894165535956581
no
0.38524590163934425
en
0.38016528925619836
sv
0.35251798561151076
sq
0.33234421364985167
et
0.3283582089552239
yo
0.16974169741697415
vi
0.15730337078651685
tr
0.14772727272727273
is
0.14448669201520914
pt
0.13793103448275862
nl
0.12959381044487428
az
0.12280701754385964
de
0.12280701754385964
hu
0.12280701754385964
fi
0.11591355599214145
pl
0.11591355599214145
reliable
true
passes
true
5
name
"Hunter"
dialogue
"“Shadow? ‘Terrible’? Look, I need specifics. Did you anything? Anyone?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7739829231541939
tl
0.53125
sq
0.5005549389567148
it
0.4353826850690088
ca
0.4155844155844156
hr
0.38524590163934425
da
0.37413073713490963
sv
0.3732590529247911
et
0.3706293706293706
pl
0.36886395511921455
cs
0.36079545454545453
ro
0.358974358974359
fr
0.3553008595988539
no
0.3161094224924012
es
0.27884615384615385
lt
0.24114671163575044
lv
0.24114671163575044
nl
0.23469387755102045
hu
0.22413793103448276
az
0.21875
yo
0.16201117318435754
ms
0.14772727272727273
pt
0.13793103448275862
sk
0.13793103448275862
be
0.1346153846153846
tr
0.1346153846153846
de
0.12280701754385964
is
0.12280701754385964
uk
0.12280701754385964
vi
0.12280701754385964
sl
0.11937377690802348
fi
0.11591355599214145
reliable
true
passes
true
6
name
"Marie"
dialogue
"“Non, non! Juste… une forme sombre… il a disparu! Comme… avalé par la nuit! C'était effrayant!”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7852971487461353
it
0.6319199057714959
ca
0.5869134170522141
es
0.5461147421931736
ro
0.5283018867924528
pt
0.5136186770428015
tl
0.4813278008298755
en
0.48003327787021627
et
0.4164332399626517
sk
0.410933081998115
da
0.3984600577478344
no
0.37810945273631835
cs
0.3756243756243756
nl
0.3635437881873727
sq
0.32795698924731176
eu
0.31768558951965065
lv
0.3154435925520263
sv
0.3093922651933701
de
0.2937853107344633
az
0.28734321550741165
hr
0.2816091954022989
tr
0.2672919109026964
sl
0.26297169811320753
hu
0.259478672985782
yo
0.25239234449760767
ms
0.23218673218673216
pl
0.21580928481806777
vi
0.19768934531450577
lt
0.1925064599483204
is
0.1883116883116883
fi
0.09156976744186046
reliable
true
passes
true
7
name
"Hunter"
dialogue
"“Disappeared? A… person? You saw a person disappear?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7937293729372937
ms
0.5826377295492488
it
0.5454545454545454
tl
0.5353159851301116
fr
0.5265151515151516
pt
0.5265151515151516
cs
0.5183044315992292
nl
0.5
sv
0.4791666666666667
no
0.4769874476987448
ca
0.4747899159663866
ro
0.47145877378435525
da
0.46808510638297873
es
0.46808510638297873
sq
0.46808510638297873
hu
0.4669509594882729
de
0.4600431965442765
eu
0.4553376906318083
is
0.4553376906318083
sk
0.43052391799544415
hr
0.40617577197149646
pl
0.3961352657004831
lt
0.3811881188118812
lv
0.3670886075949367
tr
0.3654822335025381
az
0.3403693931398417
et
0.32795698924731176
yo
0.32249322493224936
sl
0.2647058823529412
vi
0.21875
fi
0.20127795527156547
reliable
true
passes
true
8
name
"Marie"
dialogue
"“Oui! Un vieil homme! Il parlait… il parlait de… de légendes… des bois… et d’une ancienne malédiction!”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8071582844800989
ca
0.5938921377517868
da
0.578272604588394
no
0.541452677916361
it
0.5397643593519882
de
0.4734625105307498
en
0.4349005424954792
et
0.42502299908003677
ro
0.421831637372803
es
0.4196843082636954
sv
0.4120413922859831
pt
0.39202334630350194
nl
0.38057482656095143
hu
0.37311935807422264
yo
0.31917211328976036
az
0.284077892325315
tr
0.27829099307159355
sk
0.27409988385598144
fi
0.2707117852975496
lv
0.26556991774383076
ms
0.2433414043583535
sq
0.24242424242424243
tl
0.2368742368742369
cs
0.20584498094027956
zh
0.10968660968660969
eu
0.10071942446043164
pl
0.09682080924855492
hr
0.09156976744186046
lt
0.09156976744186046
sl
0.09156976744186046
reliable
true
passes
true
9
name
"Hunter"
dialogue
"“Legends? Curse? Okay, this is getting us nowhere. Look, do you speak English?”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7904719894133215
tl
0.6100164203612479
de
0.4957537154989384
ro
0.4540229885057471
pt
0.45150115473441105
nl
0.4099378881987578
hr
0.40846824408468246
sq
0.3807040417209909
cs
0.3708609271523179
no
0.3384401114206128
hu
0.3271954674220963
sk
0.2973372781065089
yo
0.29420505200594355
sl
0.2846385542168675
is
0.2601246105919003
it
0.2601246105919003
fr
0.2554858934169279
ms
0.2554858934169279
ca
0.24242424242424243
es
0.24242424242424243
sv
0.24242424242424243
pl
0.2313915857605178
da
0.22889610389610393
vi
0.18941979522184302
eu
0.16812609457092817
reliable
true
passes
true
10
name
"Marie"
dialogue
"“Non. Je suis française. Je ne parle pas anglais.”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8075689544579858
sl
0.6651785714285715
ca
0.6277915632754343
it
0.6129032258064515
sq
0.604221635883905
cs
0.5956873315363882
hr
0.5856353591160222
lt
0.5850622406639004
en
0.5535714285714286
sk
0.5440729483282675
nl
0.5419847328244275
lv
0.5121951219512195
ro
0.5106035889070147
yo
0.44751381215469616
pl
0.4318181818181818
de
0.42418426103646834
pt
0.42418426103646834
hu
0.42196531791907516
es
0.42084942084942084
tr
0.4186046511627907
ms
0.40711462450592883
eu
0.3576017130620985
et
0.3197278911564626
no
0.3087557603686636
az
0.3071593533487298
da
0.29577464788732394
sv
0.29577464788732394
fi
0.22680412371134018
tl
0.18256130790190736
is
0.16434540389972147
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Hunter… Yeah… What?! Another one?… Where?... Okay, I'm on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8100922409115573
tl
0.5967741935483871
pl
0.4290375203915171
fr
0.3408662900188324
hr
0.3333333333333333
de
0.3217054263565891
cs
0.3150684931506849
sk
0.3150684931506849
da
0.3137254901960784
ca
0.3110236220472441
et
0.3055555555555556
fi
0.3
sq
0.2813141683778234
es
0.2222222222222222
hi
0.1935483870967742
no
0.1822429906542056
yo
0.1764705882352941
sv
0.16666666666666666
it
0.15254237288135594
nl
0.15254237288135594
pt
0.15254237288135594
ms
0.14425427872860636
ro
0.14425427872860636
sl
0.14425427872860636
tr
0.14425427872860636
reliable
true
passes
true
12
name
"Marie"
dialogue
"“Attendez! S'il vous plaît! Je peux… je peux peut-être aider!”"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8108108108108109
nl
0.445324881141046
ca
0.44178628389154706
en
0.42528735632183906
de
0.4186046511627907
no
0.38917975567190227
it
0.34210526315789475
sl
0.33078393881453155
hr
0.328214971209213
es
0.325626204238921
da
0.31906614785992216
yo
0.317738791423002
cs
0.29577464788732394
tl
0.29435483870967744
sk
0.29292929292929293
sv
0.2886178861788618
tr
0.2768595041322314
pl
0.20634920634920634
pt
0.19540229885057472
lv
0.1784037558685446
az
0.16467780429594273
ro
0.16467780429594273
et
0.1566265060240964
reliable
true
passes
true
13
name
"Hunter"
dialogue
"“Look, I appreciate the… offer. But right now, I need to go. Maybe we can talk later.”"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8241687979539642
tl
0.6308724832214766
no
0.5513866231647635
da
0.5469522240527183
pl
0.4990892531876139
nl
0.4791666666666667
fr
0.4670542635658915
yo
0.4670542635658915
sv
0.45436507936507936
de
0.42105263157894735
it
0.4167550371155886
et
0.3365500603136309
hr
0.3167701863354037
cs
0.3002544529262086
tr
0.289405684754522
ca
0.28104575163398693
sq
0.27821522309711283
sk
0.27055702917771884
lv
0.25170068027210885
ro
0.2434662998624484
lt
0.2329149232914923
pt
0.21203438395415475
az
0.20289855072463767
sl
0.18032786885245902
es
0.13657770800627944
ms
0.12420382165605094
hi
0.12140575079872205
be
0.11290322580645161
hu
0.1085899513776337
is
0.10277324632952692
uk
0.10277324632952692
vi
0.10277324632952692
reliable
true
passes
true