Run: 2026-02-25-01KJ95WCKNT8H2B3HGN84SNEXH

Run Details

Model:
Gemini 2.5 Flash Lite (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
28.3s
Cost:
$0.002151
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Oh, Dio mio. Ho visto... qualcosa di orribile. Non riesco a crederci. Lo stomaco mi si stringe solo a pensarci. Una figura... nell'ombra. Stava andando via di fretta. Non ho visto bene il viso, ma..." Hunter: "Excuse me. Detective Hunter. I'm investigating a recent incident near Willow Creek. Were you in that area yesterday evening?" Isabella: "Lì! La macchina è andata via... poi ho visto una figura. Era buio. Tremavo." Hunter: "A figure? Did you take a picture of it?" Isabella: "Sì, ma non è chiaro. Non riesco a... a far capire cosa ho visto. Ho paura." Hunter: "Look, I have to go. This is critical." Hunter: "I can't understand you, and I have to go. If you can find someone who speaks English, or write anything down, call this number. It's the station. This is important."
created_at"2026-02-25T01:16:12.794Z" 2/25/2026, 1:16:12 AM
model"google/gemini-2.5-flash-lite"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1243
moderation_latency(null)
generation_time28273
tokens_prompt321
tokens_completion5707
native_tokens_prompt288
native_tokens_completion5306
native_tokens_completion_images0
native_tokens_reasoning5103
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.0021512
router(null)
provider_responses
0
endpoint_id"ce839073-aa24-4f29-8358-15b319bd05ec"
is_byokfalse
latency1243
model_permaslug"google/gemini-2.5-flash-lite"
provider_name"Google AI Studio"
status200
api_type"completions"
id"gen-1771982172-1DZCIlQtZtPKzalwVY4i"
upstream_id(null)
total_cost0.0021512
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Oh, Dio mio. Ho visto... qualcosa di orribile. Non riesco a crederci. Lo stomaco mi si stringe solo a pensarci. Una figura... nell'ombra. Stava andando via di fretta. Non ho visto bene il viso, ma..."
detectedLang"it"
heavyLang"it"
scores
it0.781021897810219
es0.585205668855859
ca0.5694294940796556
pt0.5321637426900585
ro0.5157384987893463
fr0.5012468827930174
sk0.4384651380439869
sl0.3939393939393939
no0.393633148054573
tl0.3798449612403101
hr0.3723849372384937
en0.37073938122705824
cs0.3644067796610169
yo0.36068193926478426
de0.33738266151297625
da0.33518005540166207
lt0.29036073329390893
sv0.27754364840457557
nl0.2624462200368777
sq0.25696594427244585
et0.24623115577889448
pl0.23906150919467345
lv0.23371647509578544
fi0.2302758178319436
ms0.22730199613651
vi0.21875
hu0.21208141825344715
is0.18973666441593517
eu0.18311776718856365
az0.17012448132780084
tr0.162595952547104
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me. Detective Hunter. I'm investigating a recent incident near Willow Creek. Were you in that area yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.7937894226103833
tl0.657258064516129
nl0.6517820565342073
ro0.6136363636363636
it0.5812807881773399
pt0.5582120582120582
fr0.5528669121514992
es0.5285635052689961
sv0.5264623955431754
no0.5170454545454546
ca0.507531865585168
de0.5043731778425656
sl0.49941107184923444
da0.4988207547169811
cs0.4455316373124592
sq0.4170096021947874
sk0.39155332856120256
hr0.3726937269372694
ms0.33852140077821014
az0.3291239147592739
et0.3285939968404423
lt0.2796610169491525
pl0.2784380305602716
is0.2753623188405797
yo0.2576419213973799
hu0.20187793427230047
fi0.18815663801337154
lv0.1414141414141414
tr0.13793103448275862
eu0.07608695652173912
vi0.07608695652173912
reliabletrue
passestrue
2
name"Isabella"
dialogue"Lì! La macchina è andata via... poi ho visto una figura. Era buio. Tremavo."
detectedLang"it"
heavyLang"it"
scores
it0.7847610848041326
ca0.6727748691099475
es0.6410624551328068
ro0.5737425404944586
pt0.5640802092414996
no0.4547437295528899
fr0.44812362030905084
en0.43438914027149317
tl0.3924665856622114
sq0.375
sl0.34554973821989526
yo0.3150684931506849
de0.302649930264993
da0.29775280898876405
lt0.2784992784992785
sk0.26793557833089315
nl0.24357034795764
ms0.2378048780487805
cs0.1749174917491749
et0.1624790619765494
eu0.14965986394557826
fi0.14965986394557826
vi0.14383561643835618
sv0.13793103448275862
hr0.13194444444444445
is0.12587412587412586
lv0.12587412587412586
reliabletrue
passestrue
3
name"Hunter"
dialogue"A figure? Did you take a picture of it?"
detectedLang"en"
heavyLang"en"
scores
en0.8252969951083159
tl0.6987951807228916
yo0.602543720190779
fr0.6006389776357828
ro0.5928338762214984
sq0.5503597122302158
de0.5370370370370371
it0.5283018867924528
sl0.497991967871486
no0.48240165631469983
ca0.4600431965442765
cs0.45652173913043476
pt0.4553376906318083
es0.44567627494456763
hr0.44196428571428575
nl0.43946188340807174
is0.3961352657004831
hu0.3842364532019704
lv0.3842364532019704
da0.36061381074168797
sk0.34210526315789475
pl0.29577464788732394
lt0.24698795180722888
tr0.23547400611620795
az0.21875
eu0.21875
vi0.21875
et0.20127795527156547
fi0.20127795527156547
ms0.20127795527156547
sv0.20127795527156547
reliabletrue
passestrue
4
name"Isabella"
dialogue"Sì, ma non è chiaro. Non riesco a... a far capire cosa ho visto. Ho paura."
detectedLang"it"
heavyLang"it"
scores
it0.8188405797101449
ca0.571836346336822
es0.5544554455445544
yo0.527806925498426
en0.5243128964059197
ro0.49888641425389757
pt0.4730679156908665
sk0.46745562130177515
fr0.4630071599045346
no0.43037974683544306
tl0.40318302387267907
cs0.34593023255813954
hu0.34593023255813954
lt0.3430656934306569
da0.33920704845814975
pl0.3202416918429003
sl0.2834394904458599
et0.265905383360522
eu0.25864909390444807
fi0.25124792013311154
vi0.2474916387959866
is0.24623115577889448
de0.24369747899159663
lv0.2398648648648649
sq0.23339011925042585
ms0.2214532871972318
hr0.199288256227758
tr0.14611005692599618
az0.1346153846153846
nl0.1346153846153846
sv0.12280701754385964
reliabletrue
passestrue
5
name"Hunter"
dialogue"Look, I have to go. This is critical."
detectedLang"en"
heavyLang"en"
scores
en0.8372395833333334
yo0.6679946879150066
tl0.6334310850439883
da0.609375
pl0.5961227786752827
ca0.5948136142625607
ro0.5606326889279437
it0.5291902071563088
lv0.5088408644400786
hr0.504950495049505
no0.503968253968254
cs0.48559670781893005
pt0.4845360824742268
hu0.4692144373673036
es0.46808510638297873
sk0.44933920704845814
lt0.4004796163069544
nl0.38875305623471884
fr0.38271604938271603
is0.38271604938271603
sv0.3556701030927836
sq0.34895833333333337
sl0.32614555256064687
be0.21875
tr0.21875
az0.20127795527156547
et0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
6
name"Hunter"
dialogue"I can't understand you, and I have to go. If you can find someone who speaks English, or write anything down, call this number. It's the station. This is important."
detectedLang"en"
heavyLang"en"
scores
en0.8293224099675712
tl0.60967993754879
da0.573924158500213
no0.5260663507109005
sv0.4805194805194805
yo0.4675186368477103
fr0.42528735632183906
nl0.42296595499134443
ro0.4033412887828162
de0.34725848563968675
ca0.3390614672835426
pl0.33774834437086093
et0.3373094764744864
sk0.331997327989312
it0.3265993265993266
cs0.3155373032169747
sq0.3084370677731674
hr0.2805755395683453
lt0.2779783393501805
ms0.274310595065312
sl0.2418498862774829
is0.2372234935163997
hu0.2366412213740458
tr0.2223950233281493
es0.21568627450980393
pt0.21568627450980393
lv0.19871794871794873
az0.1687448046550291
fi0.07578558225508317
zh0.07149489322191271
be0.06542056074766354
uk0.059266227657572904
vi0.059266227657572904
reliabletrue
passestrue