Run: 2026-05-10-01KR8WCVH9T0738HPBWNY1HTE7

Run Details

Model:
Gemma 4 26B (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 3s
Cost:
$0.001375
Provider:
Cloudflare

Evaluation summary

Score Evaluator
Details Link
60.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Detective Hunter. Did you see anything unusual near the orchard last night?" Selvi: "Maine... maine wahan kuch dekha. Woh bahut daravna tha. Mujhe abhi bhi bahut darr lag raha hai." [I... I saw something there. It was very scary. I am still feeling very scared.] Hunter: "I’m sorry? I didn’t catch that. Do you speak English?" Selvi: "Nahi. Mujhe English nahi aati." [No. I don't know English.] Hunter: "Look, I'm just trying to ask if you saw anyone. Anyone out of place?" Selvi: "Nahi, mujhe samajh nahi aa raha. Kya aap phir se bol sakte hain?" [No, I don't understand. Can you say that again?] Hunter: "I... [Gestures toward the orchard]... Did you see... a person?" Selvi: "Yeh dekhiye! Maine ise capture kiya hai." [Look at this! I captured it.] Hunter: "What? Let me see that. Wait... is that a silhouette in the trees?" Hunter: "Dammit, I have to take this. I'll be back. Just... stay here, okay?"
created_at"2026-05-10T12:04:37.553Z" 5/10/2026, 12:04:37 PM
model"google/gemma-4-26b-a4b-it-20260403"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency328
moderation_latency(null)
generation_time62568
tokens_prompt315
tokens_completion4240
native_tokens_prompt316
native_tokens_completion4477
native_tokens_completion_images(null)
native_tokens_reasoning3991
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0013747
router(null)
provider_responses
0
endpoint_id"e2a16fa6-1f65-413e-9ecb-93901089ddb1"
id"id-1778414677780"
is_byokfalse
latency235
model_permaslug"google/gemma-4-26b-a4b-it-20260403"
provider_name"Cloudflare"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778414677-Izl0evx3bWaSWOXSVPn2"
session_id(null)
api_type"completions"
id"gen-1778414677-OuBkRGt2xW6BeCM2BTbr"
upstream_id"id-1778414677780"
total_cost0.0013747
cache_discount(null)
upstream_inference_cost0
provider_name"Cloudflare"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
60.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Detective Hunter. Did you see anything unusual near the orchard last night?"
detectedLang"en"
heavyLang"en"
scores
en0.7860863095238095
tl0.6239372138652715
fr0.5034542314335061
no0.46161048689138573
sq0.45394112060778735
nl0.4471153846153846
et0.4373776908023483
pt0.40904419321685515
ms0.39537329127234494
es0.3830472103004292
de0.35825892857142855
da0.3561030235162374
it0.3546576879910213
ro0.35101580135440186
ca0.2936117936117936
sv0.2721518987341772
sl0.27122940430925224
yo0.23941798941798942
cs0.20689655172413793
fi0.11538461538461538
hr0.1043613707165109
tr0.09305993690851734
reliabletrue
passestrue
1
name"Selvi"
dialogue"Maine... maine wahan kuch dekha. Woh bahut daravna tha. Mujhe abhi bhi bahut darr lag raha hai."
detectedLang"ms"
heavyLang"la"
scores
ms0.38524590163934425
de0.38162544169611307
et0.3667068757539204
tl0.36286407766990286
fi0.3234536082474227
sq0.29718875502008035
fr0.2837653478854025
en0.2369186046511628
vi0.23020527859237538
ro0.21875
hr0.1758241758241758
sl0.1758241758241758
it0.16
no0.15730337078651685
sv0.15048543689320387
lv0.1435562805872757
eu0.14075286415711946
nl0.12790697674418602
yo0.1264559068219634
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I’m sorry? I didn’t catch that. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8143294014853648
tl0.6740797546012269
hr0.4378306878306878
cs0.4264507422402159
sv0.41460055096418735
it0.40559440559440557
pl0.3876080691642651
pt0.37591776798825255
sq0.371301775147929
no0.34815950920245403
da0.33176100628930816
sk0.32432432432432434
vi0.2904841402337229
tr0.2857142857142857
yo0.2796610169491525
ro0.27597955706984667
de0.256993006993007
ca0.24511545293072823
sl0.22018348623853207
fr0.17635658914728683
ms0.1448692152917505
be0.1414141414141414
hu0.1361788617886179
az0.1290983606557377
et0.1290983606557377
is0.1290983606557377
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
3
name"Selvi"
dialogue"Nahi. Mujhe English nahi aati."
detectedLang"en"
heavyLang"tl"
scores
en0.5867768595041323
eu0.5238095238095238
no0.35344827586206895
da0.32432432432432434
de0.32432432432432434
hr0.32432432432432434
ms0.32432432432432434
ro0.32432432432432434
sv0.32432432432432434
reliabletrue
passesfalse
4
name"Hunter"
dialogue"Look, I'm just trying to ask if you saw anyone. Anyone out of place?"
detectedLang"en"
heavyLang"en"
scores
en0.8314369995785925
tl0.6518711923411662
cs0.46949602122015915
sv0.4038748137108793
yo0.38461538461538464
pl0.3464052287581699
no0.33665008291873966
fr0.3288590604026846
da0.31153184165232356
ca0.2673992673992674
ro0.26605504587155965
sk0.24812030075187969
nl0.23954372623574144
lv0.23371647509578544
sl0.23224568138195778
hr0.2248062015503876
lt0.20634920634920634
et0.20318725099601595
ms0.2
is0.18200408997955012
de0.17184265010351968
es0.14712153518123666
pt0.14712153518123666
reliabletrue
passestrue
5
name"Selvi"
dialogue"Nahi, mujhe samajh nahi aa raha. Kya aap phir se bol sakte hain?"
detectedLang"no"
heavyLang"no"
scores
no0.49528936742934054
eu0.4469026548672566
sq0.438622754491018
da0.4038155802861685
et0.3951612903225807
fi0.35456110154905335
sv0.30683918669131244
sk0.2829827915869981
cs0.2661448140900196
hr0.2618110236220473
sl0.26035502958579887
es0.25742574257425743
ro0.24242424242424243
pt0.24089068825910928
fr0.22520661157024793
yo0.2219917012448133
is0.21383647798742136
nl0.21052631578947367
it0.20550847457627117
lv0.20550847457627117
tl0.20550847457627117
ca0.20382165605095542
de0.19700214132762314
ms0.1591928251121076
reliablefalse
passesfalse
6
name"Hunter"
dialogue"I... ... Did you see... a person?"
detectedLang"en"
heavyLang"en"
scores
en0.8208802456499489
cs0.6812386156648452
no0.6806569343065694
sv0.6777163904235728
ca0.6753246753246753
tl0.674721189591078
da0.6722846441947566
et0.6698113207547169
sq0.6691871455576559
it0.6520874751491053
ro0.6413934426229507
hr0.6391752577319588
pl0.6236559139784946
hu0.6203904555314533
pt0.6136865342163355
is0.6085011185682326
sk0.5986238532110092
es0.5569620253164557
lt0.5535714285714286
tr0.5501285347043702
de0.5489690721649484
lv0.5430809399477807
yo0.5406824146981627
fr0.5345744680851064
az0.5231607629427792
ms0.4631901840490798
nl0.453125
vi0.4318181818181818
sl0.33962264150943394
be0.2857142857142857
eu0.2857142857142857
fi0.2647058823529412
uk0.2647058823529412
reliabletrue
passestrue
7
name"Selvi"
dialogue"Yeh dekhiye! Maine ise capture kiya hai."
detectedLang"fr"
heavyLang"ber"
scores
fr0.6130030959752323
en0.5867768595041323
et0.5229007633587787
de0.4658119658119659
it0.42660550458715596
yo0.423963133640553
fi0.3946731234866829
tl0.39320388349514557
vi0.3857493857493857
ro0.37027707808564225
tr0.32249322493224936
lv0.26035502958579887
hr0.25595238095238093
sl0.24242424242424243
ca0.2331288343558282
es0.2331288343558282
pt0.2331288343558282
sq0.22118380062305293
reliabletrue
passesfalse
8
name"Hunter"
dialogue"What? Let me see that. Wait... is that a silhouette in the trees?"
detectedLang"en"
heavyLang"en"
scores
en0.8073959938366717
nl0.6287128712871286
it0.5460048426150121
sl0.5381773399014779
yo0.5364647713226205
hu0.5335820895522388
et0.5330012453300125
fr0.5259165613147914
no0.5052770448548813
tl0.4959677419354839
da0.471830985915493
de0.4460856720827179
ms0.4444444444444444
sq0.4427934621099554
ro0.42835365853658536
sv0.3980738362760835
cs0.39418416801292405
ca0.3862520458265139
es0.3842364532019704
pt0.37810945273631835
pl0.33510638297872336
is0.3081180811808118
tr0.29775280898876405
az0.29111531190926276
fi0.2690058479532163
sk0.25742574257425743
hr0.2299794661190965
lt0.17943107221006563
eu0.15730337078651685
lv0.15730337078651685
vi0.15730337078651685
reliabletrue
passestrue
9
name"Hunter"
dialogue"Dammit, I have to take this. I'll be back. Just... stay here, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8035914702581369
tl0.609375
da0.527027027027027
sv0.5070422535211268
yo0.4883040935672514
lt0.44356120826709056
pl0.42716857610474634
hr0.42148760330578516
no0.42052980132450335
cs0.40273037542662116
sq0.4006849315068493
ca0.3805309734513274
sk0.36823104693140796
sl0.36247723132969034
lv0.34579439252336447
hu0.3445692883895131
et0.32038834951456313
it0.24731182795698922
ro0.20454545454545453
be0.16666666666666666
tr0.16666666666666666
az0.15254237288135594
is0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue