Run: 2026-05-10-01KR90N6VEB7MZGPYX4V2ZEJE3

Run Details

Model:
Gemma 4 31B (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 5s
Cost:
$0.000590
Provider:
DeepInfra

Evaluation summary

Score Evaluator
Details Link
63.64% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me. I'm Detective Hunter. I noticed you were out by the north orchards yesterday afternoon. Did you see anyone walking toward the treeline around four o'clock?" Selvi: (Voice trembling) "Maine use dekha... woh kuch kheench raha tha. Maine apni zindagi mein kabhi aisa kuch nahi dekha. Main bahut dari hui hoon." *(I saw him... he was dragging something. I have never seen anything like it in my life. I am very scared.)* Hunter: (Frowning) "I’m sorry, I don’t speak... whatever that is. Do you speak English? Any English at all?" Selvi: (Shaking her head, frantic) "Mujhe aapki baat samajh nahi aa rahi. Kya aap meri baat samajh sakte hain? Yeh bahut zaroori hai, kripya meri madad karein!" *(I don't understand you. Can you understand me? This is very important, please help me!)* Hunter: (Sighing, pointing to his badge) "Look, I'm a cop. *Police*. Do you understand 'police'? Did you see something? Yes or no?" Selvi: (Nodding vigorously) "Haan! Haan! Woh wahan tha! Maine photo lene ki koshish ki, lekin main darr gayi." *(Yes! Yes! He was there! I tried to take a photo, but I got scared.)* Hunter: (Gesturing to her camera) "Is it in there? The photo? Just show me the screen." Selvi: (Confused, clutching the camera to her chest) "Aap kya keh rahe hain? Main aapko kaise bataun?" *(What are you saying? How do I tell you?)* Hunter: (Rubbing his temples) "Great. Just great. I can tell you're shaken up, but we are getting nowhere here without a translator." (Hunter's phone rings loudly) Hunter: (Answering abruptly) "Hunter here. What? Now? I'm in the middle of something. Fine, I'm on my way." Hunter: (To Selvi, gesturing for her to stay put) "Stay right here. Don't leave this table. I'll be back with someone who can actually talk to you."
created_at"2026-05-10T13:19:05.59Z" 5/10/2026, 1:19:05 PM
model"google/gemma-4-31b-it-20260402"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency171
moderation_latency(null)
generation_time64817
tokens_prompt315
tokens_completion1376
native_tokens_prompt304
native_tokens_completion1449
native_tokens_completion_images(null)
native_tokens_reasoning913
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00059014
router(null)
provider_responses
0
endpoint_id"69279254-6a96-4e9d-abc6-ea76e6bf8e97"
is_byokfalse
latency54
model_permaslug"google/gemma-4-31b-it-20260402"
provider_name"Novita"
status429
1
endpoint_id"4149ab03-3b69-45a0-b94c-6c253b8641a1"
id"chatcmpl-RsOl1w6ererWX0HuCrsgy3yf"
is_byokfalse
latency49
model_permaslug"google/gemma-4-31b-it-20260402"
provider_name"DeepInfra"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer(null)
request_id"req-1778419145-OkFDmukp36N5ExfVd8iX"
session_id(null)
api_type"completions"
id"gen-1778419145-GdtzdwpHX8nrEBf5JWO6"
upstream_id"chatcmpl-RsOl1w6ererWX0HuCrsgy3yf"
total_cost0.00059014
cache_discount(null)
upstream_inference_cost0
provider_name"DeepInfra"
response_cache_source_id(null)

Evaluation details

Result Evaluator Details Meta Data
63.64% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me. I'm Detective Hunter. I noticed you were out by the north orchards yesterday afternoon. Did you see anyone walking toward the treeline around four o'clock?"
detectedLang"en"
heavyLang"en"
scores
en0.7903164315669081
tl0.6409921671018277
no0.48308270676691734
nl0.41798941798941797
da0.4152046783625731
fr0.3998908892525914
pt0.3844432008953554
et0.3525603296056504
it0.3464052287581699
es0.325567136725935
sq0.3176178660049628
pl0.30203045685279184
ro0.298469387755102
cs0.28802588996763756
sv0.27821522309711283
sk0.2767915844838922
de0.2661774516344229
ca0.25524712254570076
ms0.24190213645761546
tr0.20232052211747645
sl0.19883466860888566
yo0.19708029197080293
hr0.19413919413919412
lv0.1419656786271451
fi0.11717495987158909
is0.1085899513776337
be0.05982905982905983
hu0.05741216795201371
az0.05417024935511608
lt0.05417024935511608
uk0.05417024935511608
vi0.05417024935511608
ja0.05090595340811044
reliabletrue
passestrue
1
name"Selvi"
dialogue"Maine use dekha... woh kuch kheench raha tha. Maine apni zindagi mein kabhi aisa kuch nahi dekha. Main bahut dari hui hoon."
detectedLang"en"
heavyLang"la"
scores
en0.4531933508311461
et0.42075996292863765
fr0.3908382066276803
de0.358974358974359
sq0.26210153482880755
tl0.2255266418835192
ms0.21085858585858586
eu0.20886075949367086
fi0.20685279187817257
ro0.19041450777202074
lv0.12342215988779803
reliablefalse
passesfalse
2
name"Hunter"
dialogue"I’m sorry, I don’t speak... whatever that is. Do you speak English? Any English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8237071860308933
tl0.6823956442831215
no0.5120817843866171
da0.47657028913260224
sv0.4134078212290503
hr0.38668224299065423
pt0.38452520515826494
sq0.38089622641509435
cs0.37574316290130794
it0.35344827586206895
yo0.35185185185185186
ca0.34045226130653267
pl0.33879093198992444
nl0.31994818652849744
hu0.29624664879356566
sk0.279835390946502
vi0.24892703862660948
ro0.23580786026200873
is0.22794117647058826
et0.22337278106508876
de0.21524663677130043
sl0.18604651162790697
fr0.12060301507537688
ms0.12060301507537688
be0.11764705882352942
tr0.11764705882352942
az0.10714285714285714
lt0.10714285714285714
lv0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe aapki baat samajh nahi aa rahi. Kya aap meri baat samajh sakte hain? Yeh bahut zaroori hai, kripya meri madad karein!"
detectedLang"et"
heavyLang"tl"
scores
et0.3783303730017762
sq0.35838680109990834
tl0.328214971209213
eu0.3020937188434696
no0.2950654582074521
is0.21875
nl0.21171171171171171
sv0.20903954802259886
de0.19540229885057472
da0.18793503480278423
vi0.18319719953325553
fi0.12935323383084577
cs0.125
it0.125
lv0.12170639899623588
pl0.10025706940874037
sk0.10025706940874037
sl0.10025706940874037
ms0.0920881971465629
reliablefalse
passesfalse
4
name"Hunter"
dialogue"Look, I'm a cop. Police. Do you understand 'police'? Did you see something? Yes or no?"
detectedLang"en"
heavyLang"en"
scores
en0.8016660055533519
tl0.5644599303135889
cs0.5491433724075744
sk0.5450409463148316
pt0.5378927911275416
no0.5251661918328585
hr0.5004995004995005
pl0.49443882709807885
ca0.4834710743801653
da0.4807892004153686
es0.4577006507592191
ro0.4375703037120359
sl0.42660550458715596
it0.42594718714121704
sv0.4206257242178447
fr0.4165694282380397
de0.40476190476190477
nl0.4004796163069544
et0.39172749391727496
lv0.3670886075949367
sq0.3514915693904021
tr0.32157394843962006
hu0.3160054719562244
ms0.3084370677731674
yo0.2826398852223816
vi0.26578560939794427
lt0.25261584454409564
eu0.24698795180722888
is0.2295839753466872
fi0.22720247295208654
az0.2248062015503876
reliabletrue
passestrue
5
name"Selvi"
dialogue"Haan! Haan! Woh wahan tha! Maine photo lene ki koshish ki, lekin main darr gayi."
detectedLang"fr"
heavyLang"de"
scores
fr0.5192307692307693
en0.49037372593431483
fi0.43396226415094336
tl0.39189189189189183
ms0.35064935064935066
de0.3333333333333333
et0.265905383360522
az0.25742574257425743
sl0.2537313432835821
eu0.24623115577889448
ro0.24623115577889448
hu0.2119089316987741
sq0.20634920634920634
yo0.20071047957371224
da0.1891891891891892
tr0.18772563176895307
cs0.16356877323420074
is0.16356877323420074
lv0.16356877323420074
hi0.14611005692599618
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Is it in there? The photo? Just show me the screen."
detectedLang"en"
heavyLang"en"
scores
en0.8298429319371728
nl0.6683673469387755
tl0.6586134453781514
yo0.5460893854748603
sq0.5454545454545454
fr0.5248538011695907
de0.5
sv0.468954248366013
no0.44539249146757676
sl0.4268077601410935
ms0.4217081850533808
it0.411231884057971
et0.37739463601532564
es0.35258964143426297
pt0.336734693877551
fi0.3285123966942149
hu0.32150313152400833
ro0.30406852248394006
is0.22062350119904073
cs0.21307506053268765
lv0.20924574209245742
az0.20537897310513448
pl0.20537897310513448
da0.1935483870967742
ca0.19154228855721395
hi0.19154228855721395
reliabletrue
passestrue
7
name"Selvi"
dialogue"Aap kya keh rahe hain? Main aapko kaise bataun?"
detectedLang"fr"
heavyLang"fi"
scores
fr0.4727592267135325
eu0.43396226415094336
en0.3710691823899371
fi0.25925925925925924
tl0.25742574257425743
de0.20634920634920634
et0.20634920634920634
ca0.1935483870967742
es0.1935483870967742
ms0.1935483870967742
pt0.1935483870967742
ro0.1935483870967742
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Great. Just great. I can tell you're shaken up, but we are getting nowhere here without a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8206084959816302
nl0.5397643593519882
ro0.5300751879699248
tl0.5181187355435621
sv0.48559670781893005
sq0.45934256055363326
no0.45462478184991273
ca0.44592198581560283
pl0.42974452554744524
it0.4292237442922375
hr0.41424554826616683
de0.3648373983739837
et0.35765673175745116
pt0.35765673175745116
da0.34895833333333337
cs0.32138979370249726
tr0.3146929824561403
fr0.3131868131868132
ms0.3047830923248054
az0.30089485458612975
sk0.29775280898876405
hu0.26297169811320753
vi0.26122931442080377
is0.2541766109785203
lt0.2532855436081242
sl0.251497005988024
es0.25059952038369304
yo0.24789410348977134
lv0.24242424242424243
eu0.17979002624671916
be0.10071942446043164
fi0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
9
name"Hunter"
dialogue"Hunter here. What? Now? I'm in the middle of something. Fine, I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8317127898279731
tl0.5856353591160222
nl0.5412844036697247
no0.48921679909194093
yo0.4597839135654262
de0.4140625
da0.4109947643979057
it0.4094488188976378
ms0.39189189189189183
pl0.36619718309859156
fr0.3653032440056418
sv0.3617021276595745
sq0.34497816593886466
sl0.3212669683257918
ro0.3087557603686636
cs0.26350245499181674
sk0.26350245499181674
ca0.2598684210526316
et0.2549668874172185
fi0.25
pt0.23857868020304565
is0.16512059369202228
hr0.16356877323420074
az0.15730337078651685
hi0.15730337078651685
es0.14772727272727273
tr0.11591355599214145
reliabletrue
passestrue
10
name"Hunter"
dialogue"Stay right here. Don't leave this table. I'll be back with someone who can actually talk to you."
detectedLang"en"
heavyLang"en"
scores
en0.8281078107810781
tl0.6198296836982969
fr0.3648373983739837
es0.36224489795918363
yo0.33932346723044393
ca0.31842966194111233
lt0.2568370986920333
cs0.25059952038369304
sl0.23406862745098037
hr0.22934648581997535
no0.2264851485148515
da0.22166874221668745
ro0.20785804816223066
pt0.20483460559796438
tr0.20483460559796438
de0.18725617685305593
nl0.18725617685305593
pl0.17763157894736845
sk0.17437252311756934
lv0.16331994645247658
hu0.15768194070080863
sq0.13793103448275862
ms0.11095305832147938
az0.10968660968660969
reliabletrue
passestrue