Run: 2026-05-10-01KR8X8Y7SEWCCPS9EMDVN8QFK

Run Details

Model:
Gemma 4 31B
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
43.1s
Cost:
$0.000274
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Miss? I'm Detective Hunter. I noticed you were hanging around the town square yesterday afternoon." Marie: "Oui? Pardon?" Hunter: "I'm investigating a disappearance. A woman went missing near the orchard around four o'clock. You're a photographer—did you happen to capture anything unusual on your camera?" Marie: "Oh mon Dieu... vous parlez de la femme? Je l'ai vue! Elle avait l'air terrifiée, elle courait vers les bois comme si quelque chose la poursuivait." Hunter: "I'm sorry, I didn't catch a word of that. Do you speak English?" Marie: "Je... je ne comprends pas. Anglais? Non. Je suis française. S'il vous plaît, écoutez-moi, c'est important! J'ai pris une photo, mais c'est flou... je crois qu'il y avait quelqu'un derrière elle." Hunter: "Look, I can tell you're shaken up, but you're speaking a different language. Can you just show me the camera? The photos?" Marie: "L'appareil? Oui, regardez... voyez-vous cette ombre? C'était là. C'était horrible. Je tremble encore rien qu'en y pensant." Hunter: "I have no idea what you're saying, but you look like you've seen a ghost. Stay right here. I'll find someone who can translate, or I'll come back with—" (Hunter's phone rings; he answers it abruptly) Hunter: "Hunter here. What? Now? I'm on my way." Hunter: (To Marie) "Listen, I have to go. An emergency. Don't leave town, and for heaven's sake, don't delete those photos. I'll be back." Marie: "Attendez! Ne partez pas! Je ne sais pas quoi faire!"
created_at"2026-05-10T12:19:57.824Z" 5/10/2026, 12:19:57 PM
model"google/gemma-4-31b-it-20260402"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency378
moderation_latency(null)
generation_time43104
tokens_prompt316
tokens_completion399
native_tokens_prompt314
native_tokens_completion423
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0002743
router(null)
provider_responses
0
endpoint_id"576fca5b-f09c-4bda-b560-9989c39ac3ab"
id"oiXVoC9-4nba6j-9f98e52e8346c4d5"
is_byokfalse
latency378
model_permaslug"google/gemma-4-31b-it-20260402"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778415597-Hnfq6w5YO5RbIcLOXaUD"
session_id(null)
api_type"completions"
id"gen-1778415597-ftvHfYKttuAR1RlLR5oZ"
upstream_id"oiXVoC9-4nba6j-9f98e52e8346c4d5"
total_cost0.0002743
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Miss? I'm Detective Hunter. I noticed you were hanging around the town square yesterday afternoon."
detectedLang"en"
heavyLang"en"
scores
en0.7833881087541081
tl0.6541030534351144
it0.4961779013203613
no0.47728911319394374
nl0.47080291970802923
sq0.41390460792239286
fr0.4120032441200324
ro0.4057377049180328
da0.39883913764510776
pt0.3938127090301004
es0.3803418803418803
ca0.34210526315789475
sv0.32745825602968465
ms0.29060665362035226
cs0.2602040816326531
sk0.23442449841605068
tr0.23442449841605068
sl0.22790202342917998
hr0.22126745435016112
yo0.21109902067464634
lv0.20066152149944874
de0.19175027870680048
hu0.19175027870680048
et0.17893544733861835
pl0.14806110458284372
fi0.09375000000000001
be0.0880503144654088
az0.0799492385786802
is0.0799492385786802
lt0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
1
name"Marie"
dialogue"Oui? Pardon?"
detectedLang"lt"
heavyLang"fr"
scores
lt0.6341463414634145
fr0.5833333333333334
tl0.5833333333333334
cs0.5714285714285714
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm investigating a disappearance. A woman went missing near the orchard around four o'clock. You're a photographer—did you happen to capture anything unusual on your camera?"
detectedLang"en"
heavyLang"en"
scores
en0.7946428571428571
tl0.6261378413524057
fr0.5506057053536537
nl0.47703501591632563
no0.42842942345924456
ms0.4126659856996936
it0.4093477144324602
hr0.3902439024390244
pt0.3837084673097535
de0.3833780160857909
ro0.37363834422657954
cs0.37295528898582336
da0.3684788577704558
ca0.3546576879910213
sv0.35101580135440186
es0.3413516609392898
sq0.3310063990692263
yo0.33061699650756693
sk0.31710213776722085
et0.3097238895558223
sl0.29447852760736193
fi0.2721518987341772
is0.2409240924092409
pl0.21981004070556312
lt0.213406292749658
lv0.18555240793201136
az0.18032786885245902
hu0.17857142857142858
hi0.12280701754385964
tr0.06275468622656886
eu0.05737704918032788
vi0.05737704918032788
reliabletrue
passestrue
3
name"Marie"
dialogue"Oh mon Dieu... vous parlez de la femme? Je l'ai vue! Elle avait l'air terrifiée, elle courait vers les bois comme si quelque chose la poursuivait."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8158379373848987
en0.4926719278466742
ca0.48483113909559244
it0.4845360824742268
no0.42675159235668786
es0.42418426103646834
nl0.4121489222730242
ro0.3971868720696584
da0.3710691823899371
tl0.35344827586206895
yo0.3440233236151603
sq0.3055555555555556
de0.2805755395683453
sl0.27826784282277467
sk0.2730210016155089
cs0.26769731489015464
az0.2474916387959866
pt0.2398648648648649
lt0.21052631578947367
sv0.2077464788732394
hr0.20634920634920634
hu0.20141969831410825
pl0.19427036705461057
et0.18404351767905713
tr0.14853358561967833
fi0.14448669201520914
ms0.12280701754385964
vi0.08536585365853659
hi0.07975460122699386
eu0.07216494845360825
lv0.06152241918665276
reliabletrue
passestrue
4
name"Hunter"
dialogue"I'm sorry, I didn't catch a word of that. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8167752442996742
tl0.6147260273972602
cs0.49888641425389757
hr0.496080627099664
it0.47976878612716767
yo0.46871310507674147
pt0.46808510638297873
no0.46492271105826394
pl0.4538834951456311
sv0.44717444717444715
sk0.4260204081632653
sq0.4178525226390685
ro0.4007989347536618
de0.39759036144578314
da0.3860845839017735
ca0.3784530386740331
vi0.3515850144092219
is0.3353028064992614
hu0.33135215453194655
sl0.3181818181818182
fr0.3161094224924012
nl0.303405572755418
tr0.24623115577889448
lt0.24369747899159663
ms0.23076923076923078
az0.22813036020583194
lv0.22813036020583194
es0.22680412371134018
et0.21875
be0.1346153846153846
eu0.1346153846153846
fi0.12280701754385964
uk0.12280701754385964
reliabletrue
passestrue
5
name"Marie"
dialogue"Je... je ne comprends pas. Anglais? Non. Je suis française. S'il vous plaît, écoutez-moi, c'est important! J'ai pris une photo, mais c'est flou... je crois qu'il y avait quelqu'un derrière elle."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8165209244222361
ca0.4897959183673469
en0.48577680525164113
it0.4183168316831683
es0.3854602510460251
pt0.381578947368421
nl0.35757244395844723
ro0.3490304709141274
tl0.31765389082462253
lt0.3055555555555556
cs0.28440925700365405
sq0.28397318708104813
sl0.2795830778663397
hr0.23502604166666669
de0.2103494623655914
da0.2023082145281738
no0.19795221843003413
sk0.19685577580314423
pl0.1845940319222762
lv0.17889587700908455
yo0.17136812411847674
tr0.16784702549575073
sv0.15223665223665225
eu0.12444113263785396
hu0.11454408440090429
ms0.10849772382397571
vi0.07698350353495681
fi0.06967537608867774
et0.06225059856344772
hi0.06150159744408946
az0.050888529886914384
is0.04781199351701783
reliabletrue
passestrue
6
name"Hunter"
dialogue"Look, I can tell you're shaken up, but you're speaking a different language. Can you just show me the camera? The photos?"
detectedLang"en"
heavyLang"en"
scores
en0.8075902335456476
tl0.642152023692004
fr0.576271186440678
nl0.5611380145278451
no0.5121130551816959
ca0.5101351351351351
it0.4784172661870503
ro0.4757772957339118
sv0.46136701337295694
sq0.4057377049180328
es0.39633638634471274
ms0.3938127090301004
pt0.3861134631668078
de0.3776824034334764
lt0.3766122098022356
et0.3561278863232682
cs0.34270172257479603
da0.34150772025431425
yo0.34150772025431425
hr0.3068833652007648
pl0.28851815505397443
is0.28781925343811393
lv0.2691532258064516
sk0.2676767676767676
sl0.2494824016563147
tr0.23603793466807166
hu0.2352320675105485
az0.22459893048128343
eu0.16953035509736541
fi0.15990730011587484
vi0.15501165501165504
hi0.09600997506234414
be0.0880503144654088
uk0.0799492385786802
reliabletrue
passestrue
7
name"Marie"
dialogue"L'appareil? Oui, regardez... voyez-vous cette ombre? C'était là. C'était horrible. Je tremble encore rien qu'en y pensant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7987421383647799
es0.4440583738707436
ca0.3993993993993994
en0.3635640413683373
nl0.3563958165728077
it0.355877616747182
sl0.25442684063373716
vi0.24170616113744076
yo0.23882017126546146
da0.23298178331735378
de0.23224568138195778
tl0.23224568138195778
pl0.19678714859437751
no0.1902834008097166
pt0.18781725888324874
eu0.18450560652395515
hr0.17610710607621008
cs0.15522703273495247
sk0.15343915343915343
lt0.14984059511158343
ro0.14984059511158343
sv0.1443850267379679
hu0.1294885745375408
fi0.1111111111111111
sq0.0990990990990991
tr0.09297052154195011
et0.08151549942594719
lv0.08151549942594719
az0.07084785133565621
ms0.07084785133565621
reliabletrue
passestrue
8
name"Hunter"
dialogue"I have no idea what you're saying, but you look like you've seen a ghost. Stay right here. I'll find someone who can translate, or I'll come back with—"
detectedLang"en"
heavyLang"en"
scores
en0.8115036622145627
tl0.554253693326541
no0.42585301837270345
ca0.4216787838730998
it0.41471571906354515
da0.40476190476190477
es0.3686868686868687
hr0.358974358974359
tr0.35185185185185186
fr0.3330792682926829
pt0.3325705568268498
ro0.31156569630212433
sq0.30167597765363136
pl0.3005595523581135
cs0.29943955164131303
sk0.289195775792039
lv0.2744610281923715
yo0.24242424242424243
ms0.24045138888888892
az0.23513986013986016
sv0.2290748898678414
hu0.20309653916211293
vi0.20164233576642335
lt0.19503219871205152
de0.19205909510618652
et0.17452830188679244
sl0.1455078125
is0.1362290227048371
eu0.13537549407114624
nl0.13194444444444445
be0.07407407407407407
fi0.06716417910447761
uk0.06716417910447761
reliabletrue
passestrue
9
name"Hunter"
dialogue"Hunter here. What? Now? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8294162244124338
tl0.5022123893805309
fr0.44581280788177335
pl0.43890274314214467
cs0.41709844559585496
sk0.41709844559585496
sq0.4140625
ca0.412532637075718
et0.4063324538258575
fi0.39999999999999997
de0.281150159744409
hr0.281150159744409
hi0.27184466019417475
da0.267100977198697
no0.25742574257425743
yo0.25
sv0.23728813559322032
it0.21875
nl0.21875
pt0.21875
ms0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
10
name"Hunter"
dialogue"Listen, I have to go. An emergency. Don't leave town, and for heaven's sake, don't delete those photos. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.799786438868126
tl0.5410036719706242
da0.5350278983261004
no0.4996664442961974
yo0.4460856720827179
pl0.410377358490566
fr0.40570522979397783
it0.34895833333333337
ro0.34325744308231176
de0.33920704845814975
pt0.33920704845814975
sv0.33035714285714285
sq0.3267504488330341
es0.32493249324932494
lt0.3237150586113616
hu0.3169398907103825
lv0.3131868131868132
hr0.3055555555555556
nl0.3049119555143651
cs0.2850333651096282
tr0.27395934172313646
ca0.2690058479532163
sk0.2596248766041461
sl0.2537313432835821
eu0.22760041194644695
fi0.20042643923240938
vi0.18655097613882862
et0.15540540540540537
is0.1506228765571914
ms0.09638554216867469
hi0.09310761789600969
be0.08536585365853659
az0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
11
name"Marie"
dialogue"Attendez! Ne partez pas! Je ne sais pas quoi faire!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7994652406417112
ca0.6231155778894472
nl0.6108949416342413
it0.5529061102831594
sl0.5508982035928144
hr0.5391705069124424
en0.5384615384615384
sq0.5081967213114754
cs0.49324324324324326
lt0.4800693240901213
es0.469964664310954
lv0.455535390199637
de0.4545454545454546
tl0.4392523364485981
tr0.4296577946768061
yo0.42528735632183906
no0.4152046783625731
sk0.4094488188976378
ro0.3963782696177062
pt0.3775933609958506
pl0.3492407809110629
da0.3435448577680525
ms0.33920704845814975
hu0.3258426966292135
sv0.3181818181818182
et0.3103448275862069
fi0.22680412371134018
az0.21052631578947367
eu0.21052631578947367
reliabletrue
passestrue