Run: 2026-05-10-01KR8ZC5FYW7R0ANKBN0PX5G9Z

Run Details

Model:
Gemma 4 31B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
16.2s
Cost:
$0.000176
Provider:
Novita

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. Miss? I'm Detective Hunter. I noticed you were near the town square yesterday afternoon. Did you happen to see anything unusual around the old mill?" Selvi: "क्या आप जानते हैं कि वह कहाँ गया? मैंने उसे वहाँ देखा था, वह बहुत डरा हुआ लग रहा था... मुझे बहुत डर लग रहा है।" Hunter: "I'm sorry, I didn't catch that. Do you speak English? Look, I just need to know if you saw a man in a grey coat. Just a yes or no?" Selvi: "मुझे समझ नहीं आ रहा आप क्या कह रहे हैं! कृपया मेरी मदद करें, वह आदमी अचानक गायब हो गया और वहां सिर्फ यह कैमरा बचा था। यह सब बहुत भयानक था!" Hunter: "Right. No English. Great. Look, I can see you're shaken up, but I can't help you if I don't know what's going on. You have a camera—did you take any photos of the area?" Selvi: "हाँ! हाँ, तस्वीरें हैं! लेकिन मैं आपको कैसे समझाऊं? वह आदमी... वह चिल्ला रहा था!" Hunter: "I'm guessing that 'yes' meant you've got photos. Listen, I'd love to stay and figure this out, but—" *(Phone rings)* Hunter: "Detective Hunter here. What? Another one? Where? I'm on my way. Look, stay right here. Don't move. I'll be back with someone who can actually translate for us."
created_at"2026-05-10T12:56:40.71Z" 5/10/2026, 12:56:40 PM
model"google/gemma-4-31b-it-20260402"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency733
moderation_latency(null)
generation_time16120
tokens_prompt315
tokens_completion483
native_tokens_prompt319
native_tokens_completion329
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00017626
router(null)
provider_responses
0
endpoint_id"69279254-6a96-4e9d-abc6-ea76e6bf8e97"
id"29b6cea065dbf7b4e4ec33f56809987c"
is_byokfalse
latency733
model_permaslug"google/gemma-4-31b-it-20260402"
provider_name"Novita"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778417800-x2VKO4OlxgpiWwx7ARbq"
session_id(null)
api_type"completions"
id"gen-1778417800-ulOTzxL9RnF0FHJTL0ST"
upstream_id"29b6cea065dbf7b4e4ec33f56809987c"
total_cost0.00017626
cache_discount(null)
upstream_inference_cost0
provider_name"Novita"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. Miss? I'm Detective Hunter. I noticed you were near the town square yesterday afternoon. Did you happen to see anything unusual around the old mill?"
detectedLang"en"
heavyLang"en"
scores
en0.7917967936706225
tl0.6011168727562823
no0.4391475042063937
it0.4165694282380397
da0.4026284348864994
sq0.3796526054590571
nl0.35608499678042493
pt0.3540051679586563
es0.3429697766097241
fr0.3368700265251989
ro0.3311036789297659
sv0.31224209078404397
et0.3021632937892533
cs0.2784992784992785
ca0.2737835875090778
ms0.2732558139534884
sk0.26144756277695713
sl0.250936329588015
yo0.24868519909842227
hr0.24357034795764
lv0.2331288343558282
de0.2069785884218874
pl0.2069785884218874
lt0.143101970865467
hu0.13867355727820846
tr0.11426040744021257
fi0.06976744186046512
be0.06542056074766354
az0.059266227657572904
is0.059266227657572904
uk0.059266227657572904
vi0.059266227657572904
reliabletrue
passestrue
1
name"Selvi"
dialogue"क्या आप जानते हैं कि वह कहाँ गया? मैंने उसे वहाँ देखा था, वह बहुत डरा हुआ लग रहा था... मुझे बहुत डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.880987801249628
mr0.8710924911376088
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry, I didn't catch that. Do you speak English? Look, I just need to know if you saw a man in a grey coat. Just a yes or no?"
detectedLang"en"
heavyLang"en"
scores
en0.8107016658253408
tl0.5824053452115813
sv0.5161290322580645
pl0.4710860366713681
hr0.46808510638297873
it0.46120689655172414
no0.44320712694877507
cs0.43566591422121903
sk0.4261667941851569
pt0.41588785046728977
da0.4075829383886255
yo0.4042891183478951
lv0.39710610932475876
ca0.39320388349514557
sl0.39271255060728744
de0.38875305623471884
ro0.3713327745180218
et0.32855863921217543
lt0.313815187557182
nl0.3029739776951673
sq0.30102516309412863
ms0.29245283018867924
fr0.27606177606177607
es0.26398429833169773
vi0.2454728370221328
tr0.23857868020304565
hu0.2291880781089414
az0.22440537745604963
is0.15540540540540537
be0.08536585365853659
eu0.08536585365853659
fi0.07749077490774908
uk0.07749077490774908
reliabletrue
passestrue
3
name"Selvi"
dialogue"मुझे समझ नहीं आ रहा आप क्या कह रहे हैं! कृपया मेरी मदद करें, वह आदमी अचानक गायब हो गया और वहां सिर्फ यह कैमरा बचा था। यह सब बहुत भयानक था!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8758110300081103
mr0.8607796340493238
reliabletrue
passestrue
4
name"Hunter"
dialogue"Right. No English. Great. Look, I can see you're shaken up, but I can't help you if I don't know what's going on. You have a camera—did you take any photos of the area?"
detectedLang"en"
heavyLang"en"
scores
en0.8268469656992085
tl0.5694956949569495
ca0.4590417310664606
no0.4182825484764543
fr0.4081172491544532
nl0.37425506555423127
sv0.37125748502994016
da0.3566176470588235
yo0.3538461538461538
ro0.3474207582349285
it0.3462017434620174
hr0.32778489116517284
et0.3
es0.29906542056074764
de0.2948287441235729
cs0.27083333333333337
pl0.27083333333333337
sk0.2595204513399154
pt0.25426136363636365
lv0.24187725631768955
tr0.2290748898678414
ms0.21348314606741572
sq0.2128935532233883
is0.17776037588097104
lt0.1764705882352941
hu0.17517674783974863
fi0.16864608076009502
az0.16666666666666666
sl0.13793103448275862
hi0.13294797687861273
vi0.11242603550295857
be0.0625
eu0.0625
uk0.05660377358490566
reliabletrue
passestrue
5
name"Selvi"
dialogue"हाँ! हाँ, तस्वीरें हैं! लेकिन मैं आपको कैसे समझाऊं? वह आदमी... वह चिल्ला रहा था!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8819864048338368
mr0.8787820015515904
reliabletrue
passestrue
6
name"Hunter"
dialogue"I'm guessing that 'yes' meant you've got photos. Listen, I'd love to stay and figure this out, but—"
detectedLang"en"
heavyLang"en"
scores
en0.7967479674796748
tl0.6408045977011495
fr0.4813278008298755
no0.41259398496240596
da0.4013409961685824
nl0.3641912512716175
de0.34279705573080965
lv0.3086283185840708
yo0.27409988385598144
is0.26122931442080377
es0.2532855436081242
pt0.2532855436081242
ro0.251497005988024
pl0.24425634824667475
cs0.2368742368742369
hr0.23406862745098037
sk0.23406862745098037
fi0.23124231242312424
lt0.22744128553770088
sl0.22360248447204967
sv0.20886075949367086
ca0.19146183699870634
sq0.1830065359477124
it0.1699867197875166
eu0.15768194070080863
ms0.14965986394557826
hu0.11347517730496455
hi0.10968660968660969
tr0.09682080924855492
reliabletrue
passestrue
7
name"Hunter"
dialogue"Detective Hunter here. What? Another one? Where? I'm on my way. Look, stay right here. Don't move. I'll be back with someone who can actually translate for us."
detectedLang"en"
heavyLang"en"
scores
en0.8246087425796006
tl0.5981038746908491
ca0.4094488188976378
pt0.3944099378881987
fr0.3875628140703518
es0.38446969696969696
ro0.3697478991596639
da0.3564356435643564
no0.3512974051896207
de0.3308167467398765
sq0.2919389978213508
hr0.28044280442804426
it0.2772424017790956
pl0.2545871559633027
cs0.23046566692975531
nl0.2243436754176611
yo0.20988654781199353
sk0.18682235195996663
et0.1792929292929293
tr0.1695059625212947
ms0.16737830913748933
sv0.16737830913748933
sl0.15948275862068964
lt0.1551126516464471
fi0.13333333333333333
az0.1224122412241224
hu0.10714285714285714
vi0.08278457196613359
hi0.07932011331444759
eu0.06429942418426103
lv0.06429942418426103
reliabletrue
passestrue