Run: 2026-09-02-01M1HJDJFX0S3GZJR1PM43JM1X

Run Details

Model:
Gemini 3.8 Flash (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
9.2s
Cost:
$0.008407
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Detective Hunter, Alborn Sheriff's Department. Mind if I ask you a few questions?" Marie: "Pardon ? Je... je ne comprends pas. Vous êtes de la police ?" Hunter: "Right. Look, I'm looking into what happened down by the old Miller apple orchard yesterday evening. A witness saw a woman with a professional-looking camera near the tree line around dusk. That wouldn't happen to be you, would it?" Marie: "Le verger... Oui ! J'étais là-bas pour photographier le coucher de soleil. Mais il s'est passé quelque chose d'affreux. Un homme... il a disparu dans les arbres. J'ai entendu un cri !" Hunter: "Whoa, slow down. Uh... Parlez-vous... wait, no. You don't speak English? French? Spanish? What is that?" Marie: "Regardez l'écran ! J'essayais de cadrer le paysage, et puis cette silhouette est apparue... J'ai eu tellement peur. Je crois qu'il était blessé, il y avait quelqu'un d'autre avec lui !" Hunter: "Ma'am, I don't know a lick of whatever language that is. Silhouette? Did you say silhouette? Did you see Arthur Pendelton out there? Tall guy, red flannel jacket, gray beard?" Marie: "Non, non, je ne connais pas ce nom ! Il y avait du sang sur les branches, monsieur. Vous devez me croire, ce n'était pas une bête sauvage !" Hunter: "Blood? Did you just make a gesture like... Look, just let me see the camera. Camera. Can I see the pictures?" Marie: "Non ! Ne la touchez pas ! C'est tout ce que j'ai comme preuve. Pourquoi vous me regardez comme ça ? Vous pensez que c'est moi ?" Hunter: "Easy, easy. Hands where I can see 'em. I'm not taking your gear, lady. I just need to see what's on the screen. Do you have a translation app on your phone? Phone? Cellular device?" Marie: "Mon téléphone n'a plus de batterie depuis ce matin... S'il vous plaît, écoutez-moi ! Quelqu'un est en grand danger dans cette ville !" Hunter: "Okay, we're getting nowhere fast. Just stay calm, sit tight, and—" Hunter: "Hold on. Detective Hunter... Yeah, Jim, go ahead... Where? Behind the cider mill? Don't let anyone touch the perimeter, I'm two minutes away." Hunter: "Listen to me. Stay right here. Ici. Don't leave this cafe, don't leave town. I'm coming back with the French teacher from the high school. Understand? Stay." Marie: "Monsieur ? Attendez ! Ne me laissez pas toute seule !"
created_at"2026-09-02T17:24:41.608Z" 9/2/2026, 5:24:41 PM
model"google/gemini-3.8-flash-20260902"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1769
moderation_latency(null)
generation_time9122
tokens_prompt303
tokens_completion1195
native_tokens_prompt284
native_tokens_completion2185
native_tokens_completion_images0
native_tokens_reasoning1557
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.00840675
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788369881-d6TRxBsZ2MfN6ANApzEB"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788369881-x31iH9p581pMTKxSdLmG"
upstream_id"2VuYaqyDKeLUjMcPkdD0iAw"
provider_responses
0
endpoint_id"d376f781-516d-42f9-936d-46f19abca6cc"
id"2VuYaqyDKeLUjMcPkdD0iAw"
is_byokfalse
latency1769
model_permaslug"google/gemini-3.8-flash-20260902"
provider_name"Google AI Studio"
status200
total_cost0.00840675
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, Alborn Sheriff's Department. Mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7521246458923513
fr0.5739500912964091
tl0.5627732667083073
ca0.5460440985732815
it0.5286195286195287
sq0.5145631067961165
pt0.5014245014245015
ro0.49964260185847037
no0.4615384615384615
es0.4431185361972952
sv0.4171523730224813
nl0.4062765055131467
cs0.39130434782608703
da0.38811188811188807
de0.381078691423519
hr0.3524514338575393
hu0.3482309124767225
et0.30624380574826565
sl0.3027888446215139
pl0.2985971943887776
ms0.2950654582074521
yo0.2776057791537668
az0.27461139896373055
sk0.27461139896373055
lt0.23413566739606126
tr0.2273730684326711
fi0.16467780429594273
is0.16467780429594273
lv0.15966386554621848
vi0.15966386554621848
be0.09090909090909091
eu0.09090909090909091
uk0.08256880733944955
reliabletrue
passestrue
1
name"Marie"
dialogue"Pardon ? Je... je ne comprends pas. Vous êtes de la police ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8033560566334557
ca0.6698943661971831
ro0.6505125815470643
it0.6458923512747876
es0.6189024390243903
tl0.6145940390544706
nl0.5932754880694143
cs0.5767494356659142
lt0.5738636363636364
sl0.5525059665871122
sq0.5514354066985646
en0.5476477683956574
hr0.5465538089480049
yo0.4820441988950276
pt0.4762569832402235
de0.4477172312223858
sk0.4460856720827179
no0.4292237442922375
tr0.4131455399061033
hu0.4038155802861685
ms0.37913907284768217
da0.3578767123287671
sv0.35121107266435986
lv0.33862433862433866
pl0.3231046931407942
fi0.31444241316270566
eu0.3042671614100185
az0.2690058479532163
et0.19181034482758622
vi0.1830065359477124
reliabletrue
passestrue
2
name"Hunter"
dialogue"Right. Look, I'm looking into what happened down by the old Miller apple orchard yesterday evening. A witness saw a woman with a professional-looking camera near the tree line around dusk. That wouldn't happen to be you, would it?"
detectedLang"en"
heavyLang"en"
scores
en0.8058458062694155
tl0.6007549361207898
nl0.4894170070553286
no0.48015122873345933
da0.4751908396946565
de0.46622670807453415
fr0.45436507936507936
sv0.43555008210180624
cs0.3730050159598723
it0.37157221206581353
es0.3610594795539034
ca0.3474133839582344
yo0.33284813197476953
ro0.33122568093385213
pt0.3125
ms0.2766964755391899
sk0.2744063324538259
hu0.2724867724867725
sq0.2713301536830948
lv0.2583603020496224
hr0.23611111111111113
pl0.23440979955456567
az0.22665916760404947
lt0.21113023522662075
tr0.21067738231917338
et0.2061200923787529
is0.20011634671320536
fi0.16767554479418886
sl0.16616130988477865
eu0.04844290657439446
vi0.04844290657439446
reliabletrue
passestrue
3
name"Marie"
dialogue"Le verger... Oui ! J'étais là-bas pour photographier le coucher de soleil. Mais il s'est passé quelque chose d'affreux. Un homme... il a disparu dans les arbres. J'ai entendu un cri !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8089066134928546
ca0.5429252782193958
en0.49627682873412177
it0.494949494949495
es0.44631680308136734
pt0.4439071566731141
ro0.389920424403183
da0.38105489773950485
de0.37397931409907453
no0.36639118457300274
nl0.3251173708920188
yo0.3150684931506849
hu0.28169893816364777
sv0.26611359285258457
tr0.26517571884984026
tl0.2414248021108179
cs0.23230974632843793
lv0.22766957689724648
az0.21981004070556312
sk0.21070693205216195
et0.20634920634920634
ms0.20194309507286606
eu0.17739628040057226
vi0.16485112563543936
sl0.15254237288135594
lt0.15066469719350073
sq0.15066469719350073
fi0.10921766072811773
is0.10852713178294573
hr0.08874801901743265
pl0.08366533864541834
hi0.06275468622656886
reliabletrue
passestrue
4
name"Hunter"
dialogue"Whoa, slow down. Uh... Parlez-vous... wait, no. You don't speak English? French? Spanish? What is that?"
detectedLang"en"
heavyLang"en"
scores
en0.7839158211198798
tl0.44336882865440463
no0.3561030235162374
nl0.3443557582668187
es0.33831990794016115
pt0.33831990794016115
hu0.33679354094579006
fr0.2936117936117936
hr0.2909987669543773
it0.29012345679012347
ro0.27854454203262236
de0.2776381909547738
ca0.2721518987341772
sv0.2684478371501272
da0.25997425997426
lv0.2483660130718954
sk0.21875
tr0.203601108033241
pl0.19804741980474197
cs0.19692737430167598
sq0.19467787114845939
ms0.19014084507042253
yo0.1726618705035971
is0.13793103448275862
az0.10852713178294573
et0.0987460815047022
lt0.0987460815047022
sl0.0987460815047022
reliabletrue
passestrue
5
name"Marie"
dialogue"Regardez l'écran ! J'essayais de cadrer le paysage, et puis cette silhouette est apparue... J'ai eu tellement peur. Je crois qu'il était blessé, il y avait quelqu'un d'autre avec lui !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8037984617799404
ro0.44982394366197187
it0.4120413922859831
en0.3857493857493857
nl0.37779990044798406
no0.34895833333333337
da0.3343982960596379
es0.32138979370249726
ca0.31880108991825606
de0.3131868131868132
hu0.3032329988851728
yo0.26122931442080377
sl0.22408441961514589
cs0.22311995027967682
tr0.22263681592039805
tl0.20025591810620602
hr0.19820397690827452
pt0.19458762886597938
sk0.17709019091507572
pl0.17382683410442828
sv0.1677762982689747
et0.1638795986622074
az0.16163648558014757
sq0.09420289855072464
vi0.07270029673590504
is0.058734939759036146
fi0.05374716124148372
eu0.05303030303030303
ms0.04798172124904798
reliabletrue
passestrue
6
name"Hunter"
dialogue"Ma'am, I don't know a lick of whatever language that is. Silhouette? Did you say silhouette? Did you see Arthur Pendelton out there? Tall guy, red flannel jacket, gray beard?"
detectedLang"en"
heavyLang"en"
scores
en0.7668738898756661
tl0.5136637332098194
no0.3697478991596639
nl0.36823104693140796
fr0.3558282208588957
da0.35304990757855825
de0.32388924661944624
yo0.3234536082474227
hu0.3208279430789133
sv0.31862426995457493
ro0.2837653478854025
is0.27735719201651754
et0.26264044943820225
sq0.25531914893617025
ca0.25
it0.24406047516198706
hr0.2369186046511628
cs0.23076923076923078
es0.21758569299552907
pt0.2164179104477612
ms0.2087415222305953
pl0.18032786885245902
tr0.17904612978889758
lt0.16534181240063595
sk0.16134185303514376
fi0.13793103448275862
sl0.13580246913580246
eu0.12353923205342236
az0.11242603550295857
lv0.11242603550295857
vi0.11242603550295857
be0.0625
uk0.05660377358490566
reliabletrue
passestrue
7
name"Marie"
dialogue"Non, non, je ne connais pas ce nom ! Il y avait du sang sur les branches, monsieur. Vous devez me croire, ce n'était pas une bête sauvage !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8236331569664903
ca0.4561933534743202
en0.4538834951456311
it0.43820224719101125
es0.40672379696769945
sl0.3728222996515679
ro0.3487698986975398
lt0.3343195266272189
de0.3333333333333333
hr0.32685115931189235
no0.3258426966292135
sq0.3001555209953344
nl0.2930086410054988
pt0.2890995260663507
da0.27710843373493976
vi0.2493744787322769
cs0.24242424242424243
tl0.2417860151642797
pl0.22077922077922074
eu0.20283436669619131
sk0.1847826086956522
lv0.18256130790190736
sv0.17050691244239632
tr0.16512059369202228
ms0.15730337078651685
fi0.1533396048918156
yo0.1533396048918156
az0.11330049261083745
et0.09547738693467336
hu0.0835030549898167
zh0.0778688524590164
reliabletrue
passestrue
8
name"Hunter"
dialogue"Blood? Did you just make a gesture like... Look, just let me see the camera. Camera. Can I see the pictures?"
detectedLang"en"
heavyLang"en"
scores
en0.8078938176737689
ca0.5883233532934131
fr0.5756172839506173
it0.5416666666666666
tl0.5350803043110736
ro0.5258620689655172
no0.5209059233449477
et0.5179666958808063
sv0.49308755760368667
sq0.4776828110161444
nl0.46601941747572817
da0.4433198380566802
cs0.4370522006141249
es0.42886812045690553
yo0.41113490364025695
de0.40796555435952636
sl0.39759036144578314
hr0.3799323562570462
pt0.3670886075949367
ms0.35064935064935066
pl0.29577464788732394
tr0.289405684754522
hu0.28848641655886154
is0.2838541666666667
lv0.2819843342036553
az0.2763157894736842
sk0.26861702127659576
lt0.20863309352517986
fi0.2005813953488372
vi0.19472913616398244
be0.11290322580645161
eu0.11290322580645161
uk0.10277324632952692
reliabletrue
passestrue
9
name"Marie"
dialogue"Non ! Ne la touchez pas ! C'est tout ce que j'ai comme preuve. Pourquoi vous me regardez comme ça ? Vous pensez que c'est moi ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8182290314204104
ca0.5492594977462975
it0.5403808273145109
es0.5
ro0.43684633950120677
en0.41373534338358464
sq0.3986254295532647
nl0.38217122683142096
pt0.32367149758454106
no0.3197278911564626
sl0.29435483870967744
lt0.2776057791537668
tl0.2738589211618257
et0.2576882290562036
ms0.24650161463939718
hr0.2265193370165746
lv0.19908466819221968
da0.19632606199770378
fi0.18887601390498263
tr0.11838790931989925
yo0.11616161616161616
eu0.11054637865311309
vi0.10714285714285714
cs0.10485933503836317
hu0.10485933503836317
sk0.0979381443298969
az0.08015768725361366
sv0.08015768725361366
reliabletrue
passestrue
10
name"Hunter"
dialogue"Easy, easy. Hands where I can see 'em. I'm not taking your gear, lady. I just need to see what's on the screen. Do you have a translation app on your phone? Phone? Cellular device?"
detectedLang"en"
heavyLang"en"
scores
en0.8029982702287142
tl0.6375530410183876
fr0.5462594068171758
da0.5274319963116644
sv0.4862155388471178
de0.48074974670719356
no0.46558915537017725
pl0.45157838416265383
nl0.4471413160733549
et0.4447453954496208
sk0.44414316702819956
cs0.4355726872246696
yo0.4302390216787104
hr0.41125789775990806
ca0.4044160371876816
sq0.4030285381479325
tr0.40093512565751016
pt0.3784111582777441
fi0.35494021397105097
sl0.3471337579617834
ro0.3382827630729503
vi0.31208053691275167
lv0.27867698803659396
is0.2771509167842031
it0.2704626334519573
es0.2694226657163222
az0.2540029112081513
ms0.2540029112081513
lt0.23564504101416855
eu0.19607843137254902
hu0.17868589743589747
hi0.07574391343552751
zh0.06987295825771324
be0.0639269406392694
uk0.057904411764705885
reliabletrue
passestrue
11
name"Marie"
dialogue"Mon téléphone n'a plus de batterie depuis ce matin... S'il vous plaît, écoutez-moi ! Quelqu'un est en grand danger dans cette ville !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8085835180334475
da0.592274678111588
no0.5020964360587002
en0.48565240931239845
sv0.4817239498090562
nl0.46838276440962506
ro0.4677871148459384
de0.46599213041034293
it0.4647887323943662
tl0.4341870160810006
ca0.4263285024154589
es0.38471502590673573
sq0.339819318971508
fi0.3035190615835778
pt0.28678678678678676
hu0.27866362946089596
tr0.2686682063125481
et0.23694779116465864
sl0.22067268252666117
cs0.21681780708985984
yo0.20368818105616093
eu0.18594687232219365
lt0.1810344827586207
hr0.1753472222222222
is0.1717523975588492
ms0.1717523975588492
sk0.16299559471365638
lv0.13636363636363635
az0.13557779799818015
hi0.07587548638132297
pl0.06862745098039216
reliabletrue
passestrue
12
name"Hunter"
dialogue"Okay, we're getting nowhere fast. Just stay calm, sit tight, and—"
detectedLang"en"
heavyLang"en"
scores
en0.7579083279535184
tl0.5398773006134969
no0.47844228094575797
de0.46351931330472107
da0.4360902255639098
sv0.4221879815100154
yo0.31569343065693434
it0.3081180811808118
et0.21383647798742136
nl0.21383647798742136
ms0.19527896995708155
sq0.17218543046357618
ca0.17035398230088497
is0.16666666666666666
fr0.1648106904231626
hr0.1515837104072398
pt0.1515837104072398
ro0.1515837104072398
reliabletrue
passestrue
13
name"Hunter"
dialogue"Hold on. Detective Hunter... Yeah, Jim, go ahead... Where? Behind the cider mill? Don't let anyone touch the perimeter, I'm two minutes away."
detectedLang"en"
heavyLang"en"
scores
en0.783469438257857
tl0.5503597122302158
fr0.4988545246277205
da0.45380774032459426
no0.39320388349514557
ca0.3885394828791055
de0.38811188811188807
ro0.3763364219529579
sv0.37230989956958394
nl0.3718592964824121
sq0.36777456647398843
sl0.36224489795918363
cs0.34407796101949023
pt0.32432432432432434
et0.3227554179566564
es0.3005595523581135
it0.3
ms0.28513071895424835
fi0.25021422450728364
hr0.24307958477508654
yo0.22839506172839508
pl0.22566371681415928
tr0.22083704363312553
sk0.19871794871794873
eu0.13877952755905512
lt0.12236710130391174
hi0.08759124087591241
az0.07309322033898305
lv0.06316916488222697
reliabletrue
passestrue
14
name"Hunter"
dialogue"Listen to me. Stay right here. Ici. Don't leave this cafe, don't leave town. I'm coming back with the French teacher from the high school. Understand? Stay."
detectedLang"en"
heavyLang"en"
scores
en0.809380776340111
tl0.6373626373626373
no0.5459548706659328
da0.5172615564657694
nl0.5015105740181268
de0.47982345523329134
fr0.45652173913043476
sv0.3964886613021215
sq0.3204283360790774
it0.3164871582435791
cs0.30788590604026844
es0.30613961312026916
sk0.3055555555555556
pt0.29062768701633707
yo0.27821522309711283
pl0.25339366515837103
sl0.24519670631290025
fi0.2417279411764706
ms0.22535211267605632
ro0.22169811320754715
lv0.20135527589545013
hr0.18799212598425197
is0.14860681114551083
eu0.12420382165605094
lt0.11194833153928956
et0.10326086956521739
ca0.10228509249183897
hu0.08839779005524862
tr0.07511210762331838
reliabletrue
passestrue
15
name"Marie"
dialogue"Monsieur ? Attendez ! Ne me laissez pas toute seule !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.820574162679426
sq0.507227332457293
it0.4827586206896552
en0.4813278008298755
nl0.4688385269121813
lt0.4658119658119659
ca0.45652173913043476
es0.4195046439628483
no0.3822075782537067
sl0.3654822335025381
lv0.3231046931407942
pt0.31569343065693434
ms0.3093922651933701
fi0.3029739776951673
et0.29906542056074764
tr0.29775280898876405
hr0.23155737704918034
ro0.21383647798742136
de0.1935483870967742
cs0.17943107221006563
da0.17943107221006563
hu0.17943107221006563
tl0.17035398230088497
sv0.14772727272727273
reliabletrue
passestrue