Run: 2026-02-25-01KJ94JPDG435FD8JV176YDYGV

Run Details

Model:
Gemini 2.5 Flash (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
11.4s
Cost:
$0.006036
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Mi scusi, signore. Non parlo inglese. Non capisco." Hunter: "Excuse me, ma'am. Detective Hunter. Mind if I ask you a few questions about the recent... events in town?" Hunter: "Recent events. Disappearances. Have you seen anything... unusual? People? Strange cars?" Isabella: "Oh, Dio mio... Sì, sì, ho sentito. È... è terribile! Io... io ho visto qualcosa, sì. Ma non so cosa fosse... molto strano, una macchina scura... vicino al vecchio mulino, sì. Ho delle foto, forse?" Hunter: "Photos? You... have photos? For me?" Isabella: "Sì, queste! Guarda! Era così strano! Ho pensato fosse solo un'ombra, o un errore, ma ora... *certo* che è strano. Una macchina, lì, dove non dovrebbe essere..." Hunter: "Look, I... I need to take this. Stay here, okay? Don't move. We... we need to talk more about this. Fotos. Crucial." Hunter: "Hunter. What have you got?"
created_at"2026-02-25T00:53:26.583Z" 2/25/2026, 12:53:26 AM
model"google/gemini-2.5-flash"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1434
moderation_latency(null)
generation_time11403
tokens_prompt321
tokens_completion1350
native_tokens_prompt288
native_tokens_completion2380
native_tokens_completion_images0
native_tokens_reasoning2139
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.0060364
router(null)
provider_responses
0
endpoint_id"16c01e26-9b91-4d22-b487-ed35634b017d"
is_byokfalse
latency1433
model_permaslug"google/gemini-2.5-flash"
provider_name"Google AI Studio"
status200
api_type"completions"
id"gen-1771980806-yBCXyYmygjva9eNV4Odm"
upstream_id(null)
total_cost0.0060364
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Mi scusi, signore. Non parlo inglese. Non capisco."
detectedLang"it"
heavyLang"it"
scores
it0.7838616714697406
es0.6644295302013423
fr0.5821727019498607
pt0.5664739884393063
en0.5184590690208668
ca0.4991652754590985
yo0.4863013698630137
ro0.45155393053016457
sk0.41972920696324956
cs0.4117647058823529
sq0.3630573248407643
sl0.34065934065934067
hu0.336283185840708
tl0.33035714285714285
pl0.3258426966292135
hr0.3197278911564626
et0.3181818181818182
tr0.30394431554524365
de0.29906542056074764
nl0.29906542056074764
da0.29245283018867924
no0.29245283018867924
sv0.29245283018867924
eu0.2248062015503876
az0.1891891891891892
lt0.17355371900826447
ms0.17355371900826447
lv0.16434540389972147
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter. Mind if I ask you a few questions about the recent... events in town?"
detectedLang"en"
heavyLang"en"
scores
en0.8004953219592735
fr0.6180189673340358
it0.5992260917634052
tl0.5938375350140056
ca0.5611380145278451
ro0.5560318432333129
nl0.551638837353123
sv0.5425867507886435
pt0.5307443365695793
es0.4641537324464154
no0.4641537324464154
da0.4573353293413174
sq0.4461420932009167
cs0.4232299124900557
sl0.41813804173354735
de0.3855932203389831
yo0.3561278863232682
pl0.3462578899909829
hr0.3444846292947558
ms0.33118081180811804
sk0.32683379758588665
hu0.30019305019305015
et0.2988394584139265
lv0.24083769633507857
az0.23036093418259024
lt0.2229367631296892
tr0.22126745435016112
fi0.15990730011587484
is0.15990730011587484
vi0.15501165501165504
be0.0880503144654088
eu0.0880503144654088
uk0.0799492385786802
reliabletrue
passestrue
2
name"Hunter"
dialogue"Recent events. Disappearances. Have you seen anything... unusual? People? Strange cars?"
detectedLang"en"
heavyLang"en"
scores
en0.8010849909584087
fr0.5726495726495726
tl0.5659037095501184
nl0.4878957169459963
da0.47569113441372735
ca0.434737923946557
pt0.434737923946557
it0.3692660550458715
ms0.3648960739030023
sv0.359720605355064
cs0.3574766355140187
es0.3574766355140187
ro0.35370152761457113
no0.32014833127317677
lv0.30467762326169406
de0.3037974683544304
sk0.30203045685279184
et0.22969187675070027
sq0.22425952045133993
hr0.21652421652421652
sl0.21540656205420827
pl0.2109038737446198
lt0.19117647058823528
is0.1085899513776337
az0.09688013136288999
tr0.09688013136288999
reliabletrue
passestrue
3
name"Isabella"
dialogue"Oh, Dio mio... Sì, sì, ho sentito. È... è terribile! Io... io ho visto qualcosa, sì. Ma non so cosa fosse... molto strano, una macchina scura... vicino al vecchio mulino, sì. Ho delle foto, forse?"
detectedLang"it"
heavyLang"it"
scores
it0.8010610079575596
es0.5310546060858691
ca0.506578947368421
de0.46479543292102765
no0.46479543292102765
pt0.44933920704845814
tl0.43467336683417085
en0.4198040226921093
da0.4143675169182717
ro0.4106862231534835
fr0.4094488188976378
nl0.34820393974507535
sl0.3343195266272189
sk0.3218806509945751
yo0.3119266055045872
et0.29819089207735494
ms0.2933417085427136
hr0.267578125
eu0.2519946808510638
fi0.22627235213204952
pl0.21438547486033518
lt0.2083040112596763
sq0.19006479481641467
cs0.18062636562272394
is0.17642752562225475
sv0.16974169741697415
lv0.15413533834586465
az0.1412213740458015
vi0.1359447004608295
hu0.1141732283464567
tr0.09783480352846832
reliabletrue
passestrue
4
name"Hunter"
dialogue"Photos? You... have photos? For me?"
detectedLang"en"
heavyLang"en"
scores
en0.8259860788863108
da0.6710526315789473
fr0.6453900709219859
pt0.6287128712871286
tl0.6268656716417911
no0.6240601503759399
es0.5481927710843374
nl0.5081967213114754
sq0.49664429530201337
et0.3877551020408163
sl0.3697478991596639
ms0.358974358974359
it0.34782608695652173
lt0.34782608695652173
cs0.34210526315789475
hi0.33920704845814975
fi0.3333333333333333
ca0.3212669683257918
de0.3212669683257918
lv0.3212669683257918
reliabletrue
passestrue
5
name"Isabella"
dialogue"Sì, queste! Guarda! Era così strano! Ho pensato fosse solo un'ombra, o un errore, ma ora... certo che è strano. Una macchina, lì, dove non dovrebbe essere..."
detectedLang"it"
heavyLang"it"
scores
it0.8189045936395759
es0.5653095843935538
ca0.5640153126329222
pt0.5553145336225597
ro0.5313214449016918
fr0.47327852004110993
en0.44504602057390363
yo0.4202488687782805
tl0.40888119953863894
sk0.3597751405371643
de0.34879288437102923
hr0.33699870633893925
no0.33224755700325737
ms0.30272108843537415
sl0.297945205479452
az0.28720445062586925
lv0.2761299435028249
et0.2735648476257973
eu0.2694226657163222
lt0.26680972818311877
sq0.24963396778916547
da0.2316341829085457
cs0.22816265060240964
pl0.22758100979653353
nl0.21636085626911314
tr0.20726991492652744
sv0.11485319516407601
hu0.07407407407407407
vi0.07071622846781504
is0.06135531135531135
reliabletrue
passestrue
6
name"Hunter"
dialogue"Look, I... I need to take this. Stay here, okay? Don't move. We... we need to talk more about this. Fotos. Crucial."
detectedLang"en"
heavyLang"en"
scores
en0.8153359127682026
tl0.5470232959447799
pl0.44620253164556967
hr0.4324324324324324
ca0.4140625
da0.41275167785234906
sq0.4094488188976378
sl0.40273037542662116
nl0.38668224299065423
es0.3823529411764706
lv0.37796208530805686
ro0.375
no0.373508353221957
lt0.37125748502994016
cs0.36594202898550726
sk0.34045226130653267
et0.3354430379746835
pt0.31994818652849744
it0.3181818181818182
yo0.29906542056074764
de0.2768595041322314
sv0.27285318559556787
fr0.22794117647058826
tr0.21052631578947367
az0.18856259659969088
be0.11764705882352942
hu0.11317567567567569
is0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
7
name"Hunter"
dialogue"Hunter. What have you got?"
detectedLang"en"
heavyLang"en"
scores
en0.8348017621145375
da0.604221635883905
tl0.4915254237288135
de0.3697478991596639
cs0.34210526315789475
no0.34210526315789475
fr0.32432432432432434
sv0.3181818181818182
it0.29577464788732394
nl0.29577464788732394
pt0.29577464788732394
ca0.2822966507177033
ms0.2822966507177033
ro0.2822966507177033
sl0.2822966507177033
sq0.2822966507177033
tr0.2822966507177033
reliabletrue
passestrue