Run: 2026-05-10-01KR90BSFC9PAGCVG0MNHT13YV

Run Details

Model:
Gemma 4 26B (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
49.7s
Cost:
$0.001531
Provider:
Parasail

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. I'm Detective Hunter. I heard you were out by the woods yesterday with your camera. Did you see anything unusual?" Melanie: [Voice trembling, sounding shaken] "Es war schrecklich. Ich habe etwas im Gebüsch gesehen... es war so unheimlich. Ich kann nicht aufhören zu zittern." *(It was terrible. I saw something in the bushes... it was so eerie. I can't stop shaking.)* Hunter: [Looking confused] "I’m sorry? I don’t speak... German? Do you speak English?" Melanie: "Nein. Ich verstehe Sie nicht. Ich spreche kein Englisch." *(No. I don't understand you. I speak no English.)* Hunter: [Sighing, adopting a no-nonsense tone] "Look, I'm investigating some disappearances. Did you see anyone? A person, maybe?" Melanie: [Gesturing frantically toward her camera screen] "Hier. Sehen Sie das? In diesem Bild... da ist etwas." *(Here. Do you see that? In this picture... there is something.)* Hunter: [Leaning in to examine the small LCD screen] "Wait—is that someone in the trees? I can't tell. Was that near the old mill?" Melanie: "Es war so schnell. Ich konnte nur abdrücken. Es fühlte sich an, als würde der Wald selbst mich beobachten." *(It was so fast. I could only click the shutter. It felt as if the forest itself was watching me.)* Hunter: [Phone rings loudly in his pocket; he answers with a sharp tone] "Dammit. I have to take this. It's the station. Sorry, miss."
created_at"2026-05-10T13:13:56.981Z" 5/10/2026, 1:13:56 PM
model"google/gemma-4-26b-a4b-it-20260403"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency171
moderation_latency(null)
generation_time38371
tokens_prompt319
tokens_completion3692
native_tokens_prompt303
native_tokens_completion3730
native_tokens_completion_images(null)
native_tokens_reasoning3324
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00153139
router(null)
provider_responses
0
endpoint_id"e22ce918-7adb-4e4f-b2e2-c6c5b3066b69"
is_byokfalse
latency724
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"NextBit"
status429
1
endpoint_id"d99bcbe6-bec3-4991-965e-45fea79fe63c"
is_byokfalse
latency10319
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"DekaLLM"
status504
2
endpoint_id"91f05fe1-9a18-4bcf-8cfa-093c369d8cea"
id"chatcmpl-bc6c93377a9e8177"
is_byokfalse
latency162
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"Parasail"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778418836-Bu78rr849kFjbTvaLgkV"
session_id(null)
api_type"completions"
id"gen-1778418836-NgJYqV6W5wRwXFXfzdSV"
upstream_id"chatcmpl-bc6c93377a9e8177"
total_cost0.00153139
cache_discount(null)
upstream_inference_cost0
provider_name"Parasail"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. I'm Detective Hunter. I heard you were out by the woods yesterday with your camera. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7970978848991638
tl0.5897563401292889
sq0.4258872651356994
ms0.42267319804058784
it0.41654879773691655
ro0.40390173410404623
nl0.3902439024390244
fr0.3820224719101124
no0.3721461187214612
ca0.36733128834355827
da0.36244204018547144
es0.3559718969555035
sv0.34523809523809523
et0.3441971383147853
pt0.32542927228127555
cs0.3187448389760529
de0.2282507015902713
pl0.2282507015902713
sl0.20596727622714148
sk0.20135527589545013
hr0.19980601357904945
yo0.1903827281648675
tr0.13522012578616352
fi0.08333333333333334
be0.0782122905027933
hu0.07511210762331838
az0.07094594594594594
is0.07094594594594594
lt0.07094594594594594
lv0.07094594594594594
uk0.07094594594594594
vi0.07094594594594594
reliabletrue
passestrue
1
name"Melanie"
dialogue"Es war schrecklich. Ich habe etwas im Gebüsch gesehen... es war so unheimlich. Ich kann nicht aufhören zu zittern."
detectedLang"de"
heavyLang"de"
scores
de0.8173754239499087
nl0.3670886075949367
sk0.3217054263565891
en0.317738791423002
sv0.29006085192697767
pl0.23329682365826945
no0.19168591224018475
tl0.19075144508670522
sl0.1774383078730905
ca0.17355371900826447
es0.17355371900826447
yo0.15254237288135594
lv0.14634146341463414
eu0.1411042944785276
hr0.12718204488778054
hu0.12718204488778054
cs0.125
vi0.12390488110137672
lt0.11504424778761062
fi0.1116751269035533
is0.10025706940874037
tr0.10025706940874037
reliabletrue
passestrue
2
name"Hunter"
dialogue"I’m sorry? I don’t speak... German? Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8047891723060906
tl0.6956168831168832
hr0.4688385269121813
ro0.4627507163323783
sq0.46120689655172414
cs0.4573082489146165
it0.44362017804154297
sv0.42748091603053434
pl0.41770186335403725
pt0.40570522979397783
no0.37707641196013286
ca0.3718592964824121
da0.36006825938566556
sk0.35233160621761656
vi0.3169398907103825
yo0.3055555555555556
de0.2816091954022989
ms0.27466150870406186
tr0.27184466019417475
az0.2618110236220473
sl0.24242424242424243
nl0.17218543046357618
be0.15730337078651685
es0.15730337078651685
hu0.1515837104072398
et0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
3
name"Melanie"
dialogue"Nein. Ich verstehe Sie nicht. Ich spreche kein Englisch."
detectedLang"de"
heavyLang"de"
scores
de0.8243853487205218
nl0.6111111111111112
ro0.40273037542662116
pl0.3934142114384749
no0.38811188811188807
en0.38596491228070173
sk0.3554327808471455
lt0.3230174081237911
hr0.2985971943887776
da0.28716904276985744
it0.28716904276985744
is0.279835390946502
sv0.2723492723492723
sl0.2391304347826087
cs0.2222222222222222
hu0.17061611374407584
ms0.17061611374407584
es0.15254237288135594
fr0.15254237288135594
pt0.15254237288135594
az0.14425427872860636
ca0.14425427872860636
sq0.14425427872860636
reliabletrue
passestrue
4
name"Hunter"
dialogue"Look, I'm investigating some disappearances. Did you see anyone? A person, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.8044096728307255
tl0.5982468955441929
pt0.5729813664596274
fr0.5703125
ro0.49168207024029575
ca0.4878957169459963
it0.4845360824742268
nl0.4670542635658915
es0.45436507936507936
sv0.439918533604888
no0.4387755102040817
et0.4335736354273944
de0.4324045407636739
ms0.42287513116474296
cs0.4204425711275026
hr0.40540540540540543
is0.38684503901895206
da0.3861607142857143
sq0.3806306306306307
sk0.37286202964652226
lv0.3444576877234803
lt0.3373493975903614
az0.3099121706398996
hu0.28478543563068925
sl0.2819843342036553
pl0.22969187675070027
tr0.207492795389049
fi0.18154761904761904
yo0.17787742899850523
eu0.11290322580645161
vi0.11290322580645161
reliabletrue
passestrue
5
name"Melanie"
dialogue"Hier. Sehen Sie das? In diesem Bild... da ist etwas."
detectedLang"de"
heavyLang"de"
scores
de0.8461174242424242
sl0.5220588235294118
pl0.5090634441087614
pt0.473257698541329
nl0.44349315068493156
it0.43965517241379315
eu0.4237588652482269
ro0.39138576779026213
sv0.3890977443609023
tr0.375
az0.36893203883495146
yo0.3340163934426229
tl0.32432432432432434
en0.3229166666666667
hr0.26636568848758463
hi0.2459396751740139
da0.21686746987951808
no0.214975845410628
fi0.21307506053268765
fr0.21307506053268765
ms0.1875
es0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
6
name"Hunter"
dialogue"Wait—is that someone in the trees? I can't tell. Was that near the old mill?"
detectedLang"en"
heavyLang"en"
scores
en0.8252467105263158
nl0.5563674321503131
yo0.5350109409190372
tl0.5261984392419176
sv0.4318181818181818
de0.38494934876989867
it0.3813682678311499
no0.3609022556390977
ca0.358974358974359
ro0.3531202435312024
hu0.34210526315789475
da0.33800623052959505
sq0.3328100470957614
pl0.33070866141732286
et0.2772108843537415
is0.2672413793103448
sl0.2659758203799654
ms0.2647058823529412
az0.256993006993007
hr0.24645390070921988
cs0.19811320754716982
es0.1550695825049702
fr0.1550695825049702
pt0.1550695825049702
sk0.1448692152917505
be0.1414141414141414
tr0.1414141414141414
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
7
name"Melanie"
dialogue"Es war so schnell. Ich konnte nur abdrücken. Es fühlte sich an, als würde der Wald selbst mich beobachten."
detectedLang"de"
heavyLang"de"
scores
de0.8321313106192489
en0.34908389585342336
nl0.3465634075508229
no0.29906542056074764
ca0.2879746835443038
sk0.2541436464088398
tr0.25083240843507215
yo0.24581005586592178
sv0.23556058890147225
vi0.23556058890147225
ms0.21052631578947367
da0.19161676646706588
sl0.18280871670702178
es0.17883211678832117
lv0.15094339622641512
pl0.14556962025316456
eu0.13350449293966624
hu0.13127413127413126
ro0.12564766839378239
lt0.11879895561357702
az0.11533420707732633
tl0.11533420707732633
fr0.10596026490066225
sq0.10239361702127658
reliabletrue
passestrue
8
name"Hunter"
dialogue"Dammit. I have to take this. It's the station. Sorry, miss."
detectedLang"en"
heavyLang"en"
scores
en0.8177083333333334
tl0.7043918918918919
da0.651394422310757
sv0.5963091118800461
no0.5911214953271028
yo0.5818399044205496
pl0.4807121661721069
hr0.4760479041916168
it0.4760479041916168
cs0.460708782742681
fr0.453125
sq0.44356120826709056
sk0.4290375203915171
sl0.4281045751633987
lv0.41471571906354515
lt0.40878378378378377
nl0.39759036144578314
de0.35064935064935066
ro0.3230174081237911
ca0.2827868852459016
ms0.2813141683778234
tr0.2693110647181628
az0.2647058823529412
et0.2584745762711864
pt0.2222222222222222
fi0.1898148148148148
zh0.18032786885245902
be0.16666666666666666
hu0.1606714628297362
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue