Run: 2026-05-10-01KR90M2R27N6F2XGKEHGV8YYZ

Run Details

Model:
Gemma 4 26B (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
13.5s
Cost:
$0.000921
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, Miss? Sorry to bother you, but I'm Detective Hunter. I was wondering if you saw anything unusual out by the apple orchards yesterday evening?" Maria: "¡Fue espantoso! No puedo dejar de temblar... algo se movía entre las sombras, algo que no era humano. No quería tomar la foto, pero no pude evitarlo." Hunter: "I... I’m sorry? I didn't catch that. Do you speak English?" Maria: "No hablo inglés. Lo siento mucho, estoy muy nerviosa. Todo esto es una pesadilla, este pueblo me da miedo." Hunter: "Look, I don't want to push you, but you look completely shaken up. Are you alright? Did something happen to you?" Maria: (Gesturing frantically toward her camera screen) "¡Por favor! ¡Mire la foto! ¡Tiene que ver lo que la cámara capturó! ¡Dígame que no estoy loca!" Hunter: "Is that... wait, let me see. Is that a person in the background of your shot? What the hell is that shadow?" (Hunter's phone rings loudly, vibrating against the wooden cafe table) Hunter: "I have to take this—it's the station. Listen, just stay put, okay? I'll find someone who can translate and come back to you. Just stay right here."
created_at"2026-05-10T13:18:28.618Z" 5/10/2026, 1:18:28 PM
model"google/gemma-4-26b-a4b-it-20260403"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency162
moderation_latency(null)
generation_time12697
tokens_prompt317
tokens_completion2177
native_tokens_prompt299
native_tokens_completion2205
native_tokens_completion_images(null)
native_tokens_reasoning1871
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00092087
router(null)
provider_responses
0
endpoint_id"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id"chatcmpl-b4c9dc62847dcf85"
is_byokfalse
latency152
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778419108-NqmtmOgigWhEBxngWk54"
session_id(null)
api_type"completions"
id"gen-1778419108-0BubMDNNkmOYRHMISSq4"
upstream_id"chatcmpl-b4c9dc62847dcf85"
total_cost0.00092087
cache_discount(null)
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, Miss? Sorry to bother you, but I'm Detective Hunter. I was wondering if you saw anything unusual out by the apple orchards yesterday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.782653694887187
tl0.6001523229246002
nl0.5255309534568459
da0.5218579234972678
no0.5026054002842255
sv0.44620253164556967
fr0.42622950819672134
it0.3986254295532647
de0.38917975567190227
sq0.36823104693140796
pt0.358974358974359
es0.3581907090464548
ms0.3510506798516687
cs0.32992980216975115
ro0.31729518855656696
yo0.284741144414169
pl0.265220433869839
ca0.26419060967063773
sk0.2446043165467626
sl0.24187725631768955
hr0.23469387755102045
et0.2003046458492003
lv0.14979757085020243
is0.14145543744889613
lt0.1372226787181594
tr0.10941475826972011
fi0.06666666666666668
be0.0625
hu0.05998209489704566
az0.05660377358490566
uk0.05660377358490566
vi0.05660377358490566
reliabletrue
passestrue
1
name"Maria"
dialogue"¡Fue espantoso! No puedo dejar de temblar... algo se movía entre las sombras, algo que no era humano. No quería tomar la foto, pero no pude evitarlo."
detectedLang"es"
heavyLang"es"
scores
es0.800487696741299
pt0.6729651162790697
ca0.6506211180124224
it0.5594713656387665
fr0.5275590551181102
ro0.4690265486725664
tl0.4568497284248642
no0.33184855233853006
sl0.32075471698113206
en0.31297709923664124
yo0.2913385826771654
sv0.2879746835443038
hr0.2868462757527734
da0.27999999999999997
lv0.2647058823529412
sq0.26350245499181674
ms0.26108374384236455
eu0.2353440951571793
sk0.22813036020583194
az0.22746781115879824
tr0.22680412371134018
pl0.20353982300884957
nl0.1935483870967742
cs0.1780821917808219
de0.1262135922330097
fi0.10179640718562875
hu0.09729187562688066
vi0.08536585365853659
is0.07881269191402251
et0.06152241918665276
reliabletrue
passestrue
2
name"Hunter"
dialogue"I... I’m sorry? I didn't catch that. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8102466793168881
tl0.6453900709219859
hr0.4528043775649795
cs0.441340782122905
sv0.42938659058487877
it0.42028985507246375
pl0.4020926756352765
pt0.3902439024390244
sq0.38556067588325654
no0.3620414673046252
da0.3453355155482815
sk0.33774834437086093
vi0.30313588850174217
yo0.2920353982300885
ro0.28825622775800713
de0.2687385740402194
ca0.25650557620817843
sl0.23076923076923078
fr0.18533604887983707
ms0.15254237288135594
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
et0.13606911447084233
is0.13606911447084233
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
reliabletrue
passestrue
3
name"Maria"
dialogue"No hablo inglés. Lo siento mucho, estoy muy nerviosa. Todo esto es una pesadilla, este pueblo me da miedo."
detectedLang"es"
heavyLang"es"
scores
es0.8046875
pt0.5976394849785408
it0.5657209033005212
ca0.5291902071563088
tl0.399519615692554
sk0.3786246893123446
no0.31444241316270566
ro0.2917847025495751
lt0.28639391056137015
sq0.28639391056137015
hr0.2829827915869981
de0.28023032629558536
hu0.2795389048991354
sl0.2774566473988439
tr0.2625368731563422
lv0.25074925074925075
et0.2492492492492493
fr0.24698795180722888
da0.23857868020304565
yo0.2203742203742204
en0.20382165605095542
fi0.20382165605095542
ms0.20382165605095542
cs0.18566775244299674
sv0.17400881057268722
vi0.17035398230088497
pl0.15540540540540537
eu0.14187643020594967
az0.12383177570093458
nl0.10071942446043164
is0.08200734394124846
reliabletrue
passestrue
4
name"Hunter"
dialogue"Look, I don't want to push you, but you look completely shaken up. Are you alright? Did something happen to you?"
detectedLang"en"
heavyLang"en"
scores
en0.8142989786443825
tl0.6175908221797323
no0.46619217081850534
nl0.4657168299198575
ro0.4117647058823529
da0.40357852882703776
cs0.3902439024390244
ca0.3576017130620985
sv0.35205183585313177
it0.34210526315789475
yo0.33184855233853006
fr0.3212669683257918
pt0.3212669683257918
sk0.3197278911564626
es0.31584948688711517
pl0.30313588850174217
hr0.2982456140350877
de0.2797118847539016
sl0.24146649810366622
lv0.23566878980891717
lt0.21773142112125163
hu0.21156373193166886
sq0.18256130790190736
fi0.11504424778761062
ms0.11504424778761062
be0.1044776119402985
tr0.1044776119402985
az0.09502262443438914
et0.09502262443438914
is0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
5
name"Maria"
dialogue"¡Por favor! ¡Mire la foto! ¡Tiene que ver lo que la cámara capturó! ¡Dígame que no estoy loca!"
detectedLang"es"
heavyLang"es"
scores
es0.7808764940239044
pt0.6674727932285368
ca0.6303763440860215
it0.555735056542811
fr0.494949494949495
sq0.4776828110161444
no0.4300518134715026
ro0.4028230184581976
nl0.34679334916864607
en0.314214463840399
tl0.31335830212234705
yo0.2939666238767651
lv0.260752688172043
vi0.2413793103448276
sk0.23184357541899442
tr0.23076923076923078
hr0.22535211267605632
sl0.20520231213872833
pl0.2005813953488372
et0.19825072886297376
da0.19708029197080293
fi0.12140575079872205
sv0.10569105691056911
de0.10277324632952692
cs0.09688013136288999
reliabletrue
passestrue
6
name"Hunter"
dialogue"Is that... wait, let me see. Is that a person in the background of your shot? What the hell is that shadow?"
detectedLang"en"
heavyLang"en"
scores
en0.8142250530785563
tl0.6119733924611973
nl0.5895230648944488
yo0.5102611940298507
sv0.5009505703422054
no0.49177153920619554
ms0.4702320887991927
sq0.4593202883625128
de0.45764462809917356
it0.45595854922279794
sl0.45426195426195426
is0.42622950819672134
et0.42434210526315785
da0.41666666666666663
hu0.41536748329621387
fr0.4134078212290503
pt0.41077441077441074
ro0.4101123595505618
es0.38016528925619836
cs0.36594202898550726
pl0.3208279430789133
ca0.3009320905459388
az0.2886178861788618
sk0.2647058823529412
hr0.2456896551724138
lt0.22680412371134018
lv0.2164179104477612
tr0.21524663677130043
fi0.2081447963800905
eu0.11764705882352942
vi0.11764705882352942
reliabletrue
passestrue
7
name"Hunter"
dialogue"I have to take this—it's the station. Listen, just stay put, okay? I'll find someone who can translate and come back to you. Just stay right here."
detectedLang"en"
heavyLang"en"
scores
en0.819094304388422
tl0.647887323943662
da0.5783460282916213
no0.5362058647516457
sv0.4826435246995994
yo0.45993031358885017
hr0.4584206848357792
it0.4267751479289941
de0.3996901626646011
sq0.3987587276958883
fr0.3954758190327613
cs0.39167974882260603
pl0.37297734627831713
nl0.3459915611814346
lv0.3409863945578231
ro0.33873720136518776
sk0.3318965517241379
sl0.329004329004329
ca0.3213660245183888
tr0.30243024302430244
lt0.2850553505535055
et0.2674858223062382
fi0.25837320574162675
az0.25265188042430087
pt0.22188755020080322
es0.21953675730110775
ms0.20185375901132854
eu0.19186652763295098
vi0.16306695464362853
hu0.1594360086767896
is0.14647577092511013
zh0.0903755868544601
be0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue