Run: 2026-05-10-01KR8XFABE7PYHX4W0HAYXKACV

Run Details

Model:
Gemma 4 26B (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
50.4s
Cost:
$0.000924
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss? Detective Hunter. I saw you out with your camera earlier. Were you near the north orchard last night?" Marie: "Oh mon Dieu... c'était terrifiant. Je n'arrive pas à m'en remettre." Hunter: "I'm sorry? I didn't catch any of that. Do you speak English?" Marie: "Je ne comprends pas. Vous parlez anglais ?" Hunter: "No, I don't. Look, I'm just trying to ask if you saw anything unusual. People have been going missing, and I'm checking everyone who was out late." Marie: "Je ne sais pas ce que vous voulez. Je ne parle pas votre langue, Monsieur." Hunter: "Right. Sorry. You're shaking, though. Are you alright? Did something happen to you?" Marie: "J'ai vu quelque chose... quelque chose de sombre près des arbres. Je tremble encore rien qu'en y pensant." Hunter: "Look, I'm not trying to intimidate you, but if you've got information—" Hunter: "(Answering phone) Hunter here. ... Yeah, I'm on it. I'll be there in ten minutes. Copy that." Hunter: "Sorry. Duty calls. Just... stay safe, okay?" Marie: "S'il vous plaît, partez... j'ai peur."
created_at"2026-05-10T12:23:26.838Z" 5/10/2026, 12:23:26 PM
model"google/gemma-4-26b-a4b-it-20260403"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency195
moderation_latency(null)
generation_time49747
tokens_prompt316
tokens_completion2493
native_tokens_prompt299
native_tokens_completion2655
native_tokens_completion_images(null)
native_tokens_reasoning2204
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00092363
router(null)
provider_responses
0
endpoint_id"d71c6981-347d-4622-a86b-2c9e5d0f2c6c"
id"chatcmpl-R7Ig4QrIUBzlSYIdO9ML8Uit"
is_byokfalse
latency94
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778415806-AWFJ07ZA7O2EyoeZUB18"
session_id(null)
api_type"completions"
id"gen-1778415806-I6a3AisuwJ842nMGKAjx"
upstream_id"chatcmpl-R7Ig4QrIUBzlSYIdO9ML8Uit"
total_cost0.00092363
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss? Detective Hunter. I saw you out with your camera earlier. Were you near the north orchard last night?"
detectedLang"en"
heavyLang"en"
scores
en0.7954866008462623
tl0.68117854001759
no0.5211360634081902
fr0.5111260957518543
ro0.46651949963208245
nl0.4593586875466071
it0.4482496194824962
ms0.43092621664050235
da0.4232299124900557
sq0.41390460792239286
ca0.39784053156146176
es0.3907563025210084
sv0.375
pt0.35954063604240283
de0.35152057245080504
yo0.26988922457200404
cs0.2602040816326531
et0.24479166666666666
sl0.22790202342917998
hr0.22126745435016112
tr0.15105386416861827
pl0.14806110458284372
fi0.09375000000000001
sk0.0903387703889586
be0.0880503144654088
hu0.0845959595959596
az0.0799492385786802
is0.0799492385786802
lt0.0799492385786802
lv0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passestrue
1
name"Marie"
dialogue"Oh mon Dieu... c'était terrifiant. Je n'arrive pas à m'en remettre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7887010676156584
en0.46808510638297873
nl0.4626696832579186
yo0.37335092348284965
sq0.36918990703851257
ca0.34119278779472956
da0.32142857142857145
pt0.3014705882352941
sv0.28892215568862273
lt0.2846385542168675
sl0.2669753086419753
hr0.2647058823529412
it0.24363057324840762
pl0.24000000000000002
cs0.23633440514469453
no0.23633440514469453
sk0.23387096774193547
de0.2313915857605178
ms0.15026833631484796
hi0.1410488245931284
ro0.1410488245931284
es0.12844036697247707
az0.1171003717472119
et0.1171003717472119
hu0.1171003717472119
fi0.11048689138576778
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry? I didn't catch any of that. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8167313497197067
tl0.6031746031746031
hr0.4378306878306878
no0.43029490616621985
cs0.4264507422402159
sv0.41460055096418735
it0.40559440559440557
yo0.39544807965860596
ca0.38936781609195403
pl0.3876080691642651
pt0.37591776798825255
sq0.371301775147929
de0.3511450381679389
da0.33176100628930816
sk0.32432432432432434
vi0.2904841402337229
ro0.27597955706984667
is0.26343154246100525
nl0.22867513611615245
sl0.22018348623853207
fr0.17635658914728683
ms0.1448692152917505
be0.1414141414141414
tr0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
et0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
3
name"Marie"
dialogue"Je ne comprends pas. Vous parlez anglais ?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7971976401179941
ca0.6523388116308471
lt0.649234693877551
sl0.6175243393602224
sq0.5820668693009119
cs0.5749613601236476
it0.5743034055727554
nl0.5743034055727554
ro0.5634920634920635
en0.5614035087719298
hr0.5578778135048231
sk0.5098039215686274
es0.49168207024029575
lv0.4821092278719397
de0.4444444444444444
pt0.40217391304347827
tl0.3792325056433409
yo0.3721461187214612
pl0.3648960739030023
tr0.3574766355140187
hu0.3514150943396226
ms0.3483412322274882
fi0.24242424242424243
az0.20289855072463767
et0.1863905325443787
da0.17664670658682635
no0.17664670658682635
sv0.17664670658682635
reliabletrue
passestrue
4
name"Hunter"
dialogue"No, I don't. Look, I'm just trying to ask if you saw anything unusual. People have been going missing, and I'm checking everyone who was out late."
detectedLang"en"
heavyLang"en"
scores
en0.8302358827734097
tl0.5658135283363803
da0.35767410412440837
no0.35374149659863946
sv0.34797529169526425
ca0.30758017492711365
nl0.302496328928047
yo0.3014705882352941
ms0.27756653992395436
hr0.2725880551301685
pt0.2697924673328209
pl0.26127527216174184
et0.2607003891050583
lv0.24960505529225907
cs0.24841772151898736
sk0.23694779116465864
is0.2313915857605178
de0.22194922194922193
it0.21487603305785125
sq0.19763513513513514
es0.18384879725085912
lt0.1495076096687556
tr0.14259927797833935
fr0.13083257090576395
az0.11873840445269015
sl0.11297852474323063
ro0.08653846153846154
fi0.07587548638132297
be0.06862745098039216
hu0.06588003933136675
uk0.06219151036525173
vi0.06219151036525173
reliabletrue
passestrue
5
name"Marie"
dialogue"Je ne sais pas ce que vous voulez. Je ne parle pas votre langue, Monsieur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8196392785571143
sl0.494949494949495
ca0.48335246842709534
it0.469964664310954
ro0.4630071599045346
nl0.4492044063647491
hr0.4353826850690088
lt0.42159383033419023
es0.4201030927835051
pt0.4102228047182176
sq0.39759036144578314
cs0.3935309973045822
ms0.34210526315789475
de0.3382352941176471
yo0.3343195266272189
sk0.32330827067669177
lv0.2647058823529412
pl0.2598684210526316
tr0.2537313432835821
no0.25124792013311154
hu0.24874791318864775
da0.24496644295302009
et0.23857868020304565
en0.23469387755102045
fi0.16356877323420074
is0.15730337078651685
eu0.14772727272727273
az0.1346153846153846
tl0.12280701754385964
sv0.11591355599214145
reliabletrue
passestrue
6
name"Hunter"
dialogue"Right. Sorry. You're shaking, though. Are you alright? Did something happen to you?"
detectedLang"en"
heavyLang"en"
scores
en0.8173182316404822
tl0.6355685131195336
no0.4232987312572088
da0.34810951760104303
pt0.33244325767690247
de0.3270524899057874
yo0.29676511954992973
cs0.29478138222849076
nl0.28876244665718354
sv0.25595238095238093
ro0.22839506172839508
fr0.2248062015503876
pl0.2125984251968504
sk0.20886075949367086
lv0.19614147909967844
sl0.19484702093397743
hr0.1883116883116883
lt0.17218543046357618
it0.16666666666666666
hu0.15824915824915825
es0.13494809688581316
ms0.13494809688581316
is0.1243432574430823
reliabletrue
passestrue
7
name"Marie"
dialogue"J'ai vu quelque chose... quelque chose de sombre près des arbres. Je tremble encore rien qu'en y pensant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8139880952380952
ca0.611076540136901
es0.5311327831957989
en0.47567114093959734
de0.41259398496240596
nl0.3984600577478344
pt0.39671814671814676
it0.37996031746031744
sl0.3040089086859688
yo0.2913832199546485
da0.2889647326507395
sv0.28489702517162474
ro0.2568370986920333
pl0.23873325213154686
hr0.21482412060301506
no0.21383647798742136
tl0.21085858585858586
sq0.19458762886597938
cs0.19041450777202074
sk0.1883116883116883
lt0.18407310704960833
az0.16555407209612816
ms0.16555407209612816
tr0.1355463347164592
vi0.1355463347164592
hu0.13434903047091412
et0.10201149425287356
lv0.10201149425287356
eu0.10071942446043164
reliabletrue
passestrue
8
name"Hunter"
dialogue"Look, I'm not trying to intimidate you, but if you've got information—"
detectedLang"en"
heavyLang"en"
scores
en0.8033940397350994
tl0.6379573170731707
fr0.5467557251908397
sv0.520686175580222
de0.519716885743175
da0.4897959183673469
cs0.42702050663449936
sl0.40624999999999994
no0.3964421855146125
ro0.39490445859872614
yo0.3933588761174968
pl0.3807040417209909
nl0.37989556135770236
it0.37745740498034075
sk0.3632707774798928
lv0.3572395128552098
hr0.35020519835841313
lt0.3457300275482094
tr0.3185078909612626
az0.29629629629629634
sq0.29629629629629634
et0.29210134128166915
pt0.2543171114599686
es0.24603174603174602
ca0.23633440514469453
eu0.22003284072249588
fi0.14721723518850988
zh0.1394927536231884
hu0.1171003717472119
ms0.1171003717472119
reliabletrue
passestrue
9
name"Hunter"
dialogue"Hunter here. ... Yeah, I'm on it. I'll be there in ten minutes. Copy that."
detectedLang"en"
heavyLang"en"
scores
en0.7995283018867925
de0.5667686034658511
tl0.5319383259911894
sq0.47595561035758327
nl0.46741854636591484
fr0.45161290322580644
yo0.4509043927648579
pl0.4444444444444444
ca0.4186046511627907
et0.41135734072022156
sl0.4014084507042254
it0.39458689458689455
ro0.38936781609195403
lt0.38848920863309355
cs0.3694362017804154
sk0.3694362017804154
sv0.3675595238095238
fi0.3431221020092735
ms0.3122977346278317
hr0.2672413793103448
da0.2595818815331011
no0.25438596491228066
pt0.22867513611615245
hu0.21586715867158673
lv0.16829745596868884
az0.1650294695481336
hi0.1650294695481336
es0.1361788617886179
tr0.121900826446281
reliabletrue
passestrue
10
name"Hunter"
dialogue"Sorry. Duty calls. Just... stay safe, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.7324613555291319
tl0.47674418604651164
de0.44029850746268656
ca0.4230769230769231
et0.3119266055045872
sv0.3119266055045872
it0.30769230769230765
pt0.30769230769230765
es0.29467084639498436
reliabletrue
passestrue
11
name"Marie"
dialogue"S'il vous plaît, partez... j'ai peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7809419496166484
ca0.5215311004784688
it0.33554817275747506
es0.3265993265993266
pt0.3265993265993266
ro0.3220338983050847
en0.3103448275862069
az0.2857142857142857
de0.2857142857142857
eu0.2857142857142857
tl0.2857142857142857
nl0.2779783393501805
da0.2727272727272727
lt0.2727272727272727
sv0.2727272727272727
lv0.2647058823529412
no0.2647058823529412
sq0.2647058823529412
et0.25925925925925924
ms0.25925925925925924
pl0.25925925925925924
hr0.250936329588015
sl0.250936329588015
tr0.250936329588015
cs0.23954372623574144
hu0.23954372623574144
sk0.23954372623574144
yo0.2277992277992278
reliabletrue
passestrue