Run: 2026-02-25-01KJ958P7JQXG8BFPF9MVM1EE2

Run Details

Model:
Gemini 2.5 Flash Lite (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
18.2s
Cost:
$0.001743
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Oh, mon Dieu... oui. J'étais... dehors. Près de la rivière. C'était... épouvantable." Hunter: "Épouvantable? I... I don't understand. Did you see something? Someone? What was it?" Marie: "Je l'ai vu. Dans les bois... près des grands arbres. Une... une présence. Pas humaine. Elle bougeait... si vite. Très vite. Je... j'ai eu tellement peur." Hunter: "A... person? Running? In the woods? Yesterday?" Marie: "Ce n'était pas normal. L'ombre… elle... oh, c'est trop difficile." Hunter: "Look, I gotta go. Something big just came up. Is there... can you show me a picture? Or write anything down? Anything at all useful?"
created_at"2026-02-25T01:05:27.291Z" 2/25/2026, 1:05:27 AM
model"google/gemini-2.5-flash-lite"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1173
moderation_latency(null)
generation_time18170
tokens_prompt316
tokens_completion2263
native_tokens_prompt284
native_tokens_completion4287
native_tokens_completion_images0
native_tokens_reasoning4121
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.0017432
router(null)
provider_responses
0
endpoint_id"ce839073-aa24-4f29-8358-15b319bd05ec"
is_byokfalse
latency1173
model_permaslug"google/gemini-2.5-flash-lite"
provider_name"Google AI Studio"
status200
api_type"completions"
id"gen-1771981527-IKEm6mEbGJJQDtlQltyp"
upstream_id(null)
total_cost0.0017432
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Oh, mon Dieu... oui. J'étais... dehors. Près de la rivière. C'était... épouvantable."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7882986913010007
ca0.5631453534551231
es0.5132743362831859
pt0.42528735632183906
nl0.4073275862068965
ro0.4066882416396979
en0.3936052921719956
tl0.38684503901895206
it0.375
da0.2637215528781794
no0.2597577388963661
lt0.25775978407557354
yo0.25271739130434784
sv0.24965893587994542
ms0.22096317280453256
sq0.2040520984081042
lv0.15644171779141106
tr0.15123456790123457
hu0.1499227202472952
fi0.140625
vi0.13249211356466878
hi0.12420382165605094
eu0.11290322580645161
de0.1085899513776337
az0.10277324632952692
reliabletrue
passestrue
1
name"Hunter"
dialogue"Épouvantable? I... I don't understand. Did you see something? Someone? What was it?"
detectedLang"en"
heavyLang"en"
scores
en0.8088685015290519
tl0.5374653098982424
no0.4692144373673036
da0.46808510638297873
sv0.4553376906318083
es0.3983152827918171
de0.3842364532019704
nl0.3842364532019704
ca0.3834771886559803
cs0.34810951760104303
fr0.3464052287581699
yo0.3333333333333333
pt0.3270524899057874
et0.31787175989085953
ro0.31787175989085953
sq0.3055555555555556
pl0.28977272727272724
ms0.25484351713859915
sk0.24357034795764
lv0.2295839753466872
hr0.21752738654147105
is0.21507064364207218
lt0.20886075949367086
it0.18699186991869918
fi0.15254237288135594
be0.12280701754385964
tr0.12280701754385964
hu0.11816578483245149
az0.11190053285968028
uk0.11190053285968028
vi0.11190053285968028
reliabletrue
passestrue
2
name"Marie"
dialogue"Je l'ai vu. Dans les bois... près des grands arbres. Une... une présence. Pas humaine. Elle bougeait... si vite. Très vite. Je... j'ai eu tellement peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8078714485328365
ca0.6016417189763399
en0.48853068815871054
no0.4459368703828072
nl0.4414353419092756
sq0.42105263157894735
de0.41737288135593226
pt0.41029306647605435
sl0.40347071583514105
cs0.39692982456140347
es0.3911439114391144
ro0.3792325056433409
yo0.3692660550458715
tl0.3574766355140187
da0.35697583787996884
sk0.35344827586206895
hr0.35039370078740156
sv0.2580935251798561
pl0.21652421652421652
lt0.21203438395415475
it0.20366795366795365
et0.17828685258964144
tr0.16328600405679514
fi0.15036045314109164
az0.13793103448275862
hu0.13612565445026178
is0.11194833153928956
ms0.0924092409240924
lv0.07511210762331838
reliabletrue
passestrue
3
name"Hunter"
dialogue"A... person? Running? In the woods? Yesterday?"
detectedLang"en"
heavyLang"en"
scores
en0.8133167392657125
tl0.7014925373134329
nl0.679144385026738
sv0.6474735605170389
no0.5973154362416108
da0.589041095890411
ro0.5488721804511278
de0.5454545454545454
it0.5454545454545454
is0.5153473344103393
yo0.511400651465798
ms0.5033112582781457
sq0.4983277591973244
fr0.48186528497409326
pt0.4809688581314879
pl0.45255474452554745
sl0.4485294117647059
ca0.4296577946768061
es0.4230769230769231
hu0.42196531791907516
az0.4152046783625731
cs0.3890020366598778
sk0.38650306748466257
hr0.3630573248407643
lt0.33920704845814975
lv0.3258426966292135
tr0.32432432432432434
et0.2890995260663507
eu0.1891891891891892
vi0.1891891891891892
fi0.17355371900826447
reliabletrue
passestrue
4
name"Marie"
dialogue"Ce n'était pas normal. L'ombre… elle... oh, c'est trop difficile."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8044178554993097
it0.5641025641025641
ca0.4904076738609112
ro0.4627054361567636
es0.442257217847769
en0.4385733157199472
nl0.3928571428571429
tl0.34210526315789475
ms0.3338557993730407
sq0.3055555555555556
lt0.2659758203799654
tr0.24911660777385158
az0.23835125448028674
de0.23835125448028674
pt0.23835125448028674
eu0.1361788617886179
lv0.1361788617886179
da0.1290983606557377
fi0.1290983606557377
no0.1290983606557377
cs0.121900826446281
et0.121900826446281
hr0.121900826446281
pl0.121900826446281
sk0.121900826446281
sl0.121900826446281
sv0.121900826446281
reliabletrue
passestrue
5
name"Hunter"
dialogue"Look, I gotta go. Something big just came up. Is there... can you show me a picture? Or write anything down? Anything at all useful?"
detectedLang"en"
heavyLang"en"
scores
en0.8161764705882353
tl0.6003996003996004
it0.48320413436692505
sq0.4576271186440678
no0.4038748137108793
ro0.38791124713083397
et0.3860322333077513
hu0.377431906614786
yo0.37205651491365777
fr0.3700787401574803
nl0.36908517350157727
sv0.3610223642172524
ca0.3485342019543974
de0.3265993265993266
da0.3254637436762226
pt0.3237531699070161
pl0.2976294995610184
hr0.2963940193491645
sl0.2920353982300885
cs0.2825112107623318
es0.2805755395683453
sk0.26199261992619927
fi0.23809523809523808
is0.22330097087378642
ms0.21951219512195122
tr0.21875
lt0.21337266470009833
az0.2079207920792079
lv0.14255091103965703
vi0.14255091103965703
be0.08045977011494253
eu0.08045977011494253
uk0.07300115874855156
reliabletrue
passestrue