Run: 2026-09-03-01M1KRECVXVJH6M7XW886R0N20

Run Details

Model:
Gemini 3.7 Flash (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
8.8s
Cost:
$0.005594
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Detective Hunter, local PD. Mind if I ask you a few questions? We had an incident out near the old cider mill yesterday evening, and someone mentioned seeing a photographer in the area." Selvi: "माफ़ कीजिए... मुझे अंग्रेज़ी नहीं आती। आप... आप पुलिस से हैं? (Maaf kijiye... mujhe angrezi nahi aati. Aap... aap police se hain?)" Hunter: "Ma'am? English? Do you speak any English? I just need to know if you were near the orchard road around sunset." Selvi: "वहां... वहां जंगल में कोई था। मैंने कुछ बहुत भयानक देखा। वो आदमी... वो ठीक नहीं लग रहा था, और फिर वह अचानक गायब हो गया!" Hunter: "Whoa, easy. Slow down. Look, I don't understand what you're saying. I'm getting nothing here. Did you see someone out there? A man?" Selvi: "तस्वीरें... मैंने बस तस्वीरें लेने की कोशिश की थी, लेकिन वह बहुत डरावना था। मुझे बहुत डर लग रहा है! कृपया मेरी बात समझिए!" Hunter: "Camera? You're pointing at your camera. Did you take photos of the tree line? Can you show me the display?" Selvi: "नहीं, वो... वो परछाई! क्या आप उस लापता लड़के को ढूंढ रहे हैं? मैंने उसकी आवाज़ सुनी थी!" Hunter: "Damn it, I don't speak Hindi. Not a single word. Look, just stay calm. Don't touch any of the files on that memory card. I’m going to call dispatch and see if we have an interpreter on call—" Hunter: "Hunter speaking. Go ahead." Hunter: "What? Where? Near Miller's Creek? ...Understood. Secure the perimeter, I'm two minutes out." Hunter: "Ma'am, I have to go. Stay right here in town, don't delete anything on that camera. I'll be back for you."
created_at"2026-09-03T13:48:28.932Z" 9/3/2026, 1:48:28 PM
model"google/gemini-3.7-flash-20260813"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2460
moderation_latency(null)
generation_time8737
tokens_prompt302
tokens_completion1059
native_tokens_prompt289
native_tokens_completion1434
native_tokens_completion_images0
native_tokens_reasoning999
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
service_tier"default"
usage0.00559425
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788443308-bS9F3zlIyZ6fu7czXlBB"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788443308-7CA4oztxd6TSfnuBpn76"
upstream_id"rXqZatitBY6b9MoPyYqlwAE"
provider_responses
0
endpoint_id"dd072012-3274-417d-97e3-e290cba37e31"
id"rXqZatitBY6b9MoPyYqlwAE"
is_byokfalse
latency2460
model_permaslug"google/gemini-3.7-flash-20260813"
provider_name"Google AI Studio"
status200
total_cost0.00559425
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Detective Hunter, local PD. Mind if I ask you a few questions? We had an incident out near the old cider mill yesterday evening, and someone mentioned seeing a photographer in the area."
detectedLang"en"
heavyLang"en"
scores
en0.7887864823348695
tl0.5882000598981731
fr0.5731139397702577
nl0.5476973684210527
ro0.5392091152815014
it0.5370370370370371
ca0.4666408068269976
pt0.46601941747572817
es0.44286871961102103
sv0.43555008210180624
no0.42660550458715596
da0.42420435510887766
de0.3888888888888889
sq0.33798748194511313
yo0.30167597765363136
sl0.29918450560652393
ms0.28123366440146363
cs0.2717161016949153
pl0.26194310252281267
hu0.24574876577070764
hr0.24325811777655476
et0.24158852730281305
az0.23864894795127353
tr0.20104590354445093
sk0.19402110199296602
is0.15280345040049292
vi0.14965986394557826
fi0.12974683544303797
lt0.1291956934768841
eu0.11233053582956747
lv0.08819628647214854
hi0.05303030303030303
be0.04844290657439446
uk0.04381084840055633
reliabletrue
passestrue
1
name"Selvi"
dialogue"माफ़ कीजिए... मुझे अंग्रेज़ी नहीं आती। आप... आप पुलिस से हैं?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8867069486404834
mr0.8811410459587956
reliabletrue
passestrue
2
name"Hunter"
dialogue"Ma'am? English? Do you speak any English? I just need to know if you were near the orchard road around sunset."
detectedLang"en"
heavyLang"en"
scores
en0.8024027821688271
tl0.5503597122302158
no0.4922826969943136
da0.4469026548672566
sv0.43946188340807174
cs0.41697761194029853
hr0.41697761194029853
yo0.3955512572533849
pl0.3926141885325559
ca0.35765673175745116
sk0.34963579604578565
sq0.3448637316561845
et0.3272335844994618
sl0.27829099307159355
lv0.22839506172839508
vi0.21777221526908636
lt0.21085858585858586
ro0.20584498094027956
nl0.2028061224489796
pt0.1997439180537772
fr0.19665809768637532
ms0.1935483870967742
de0.19041450777202074
it0.15540540540540537
be0.10071942446043164
tr0.10071942446043164
hu0.09682080924855492
az0.09156976744186046
is0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
3
name"Selvi"
dialogue"वहां... वहां जंगल में कोई था। मैंने कुछ बहुत भयानक देखा। वो आदमी... वो ठीक नहीं लग रहा था, और फिर वह अचानक गायब हो गया!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8794259498882484
mr0.869725470259278
reliabletrue
passestrue
4
name"Hunter"
dialogue"Whoa, easy. Slow down. Look, I don't understand what you're saying. I'm getting nothing here. Did you see someone out there? A man?"
detectedLang"en"
heavyLang"en"
scores
en0.8168498168498168
tl0.5027967681789932
no0.46308724832214765
da0.4448299791811242
de0.4421199442119944
sv0.43622269203664554
nl0.36
it0.3371996685998343
cs0.3327773144286906
sq0.32432432432432434
ro0.3162393162393162
hr0.2844364937388193
pl0.27862939585211904
et0.27007299270072993
sk0.26672777268560954
is0.2640294388224471
pt0.2626728110599078
ca0.25512104283054005
tr0.23591212989493793
lv0.23150816522574447
lt0.2300288739172281
ms0.2248062015503876
hu0.2179863147605083
es0.2079207920792079
yo0.2047713717693837
az0.14255091103965703
vi0.14255091103965703
fr0.12758996728462377
sl0.10112359550561797
be0.08045977011494253
eu0.08045977011494253
fi0.07300115874855156
uk0.07300115874855156
reliabletrue
passestrue
5
name"Selvi"
dialogue"तस्वीरें... मैंने बस तस्वीरें लेने की कोशिश की थी, लेकिन वह बहुत डरावना था। मुझे बहुत डर लग रहा है! कृपया मेरी बात समझिए!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8804542737597131
mr0.8734977862112587
reliabletrue
passestrue
6
name"Hunter"
dialogue"Camera? You're pointing at your camera. Did you take photos of the tree line? Can you show me the display?"
detectedLang"en"
heavyLang"en"
scores
en0.810042946812025
tl0.6856205576817933
fr0.5232172470978441
nl0.5188284518828451
no0.4739249771271729
it0.4534220532319392
de0.4523809523809524
pt0.41742654508611954
ms0.4120654396728016
ro0.40843621399176955
es0.3960084033613445
ca0.37158469945355194
da0.36393805309734517
sq0.339080459770115
sv0.29447852760736193
cs0.28125
yo0.2767295597484277
lt0.22402159244264505
sl0.22402159244264505
is0.2219215155615697
et0.1417910447761194
pl0.13793103448275862
az0.11809815950920245
hi0.11809815950920245
tr0.11809815950920245
fi0.11538461538461538
lv0.10990712074303406
sk0.10714285714285714
hr0.1043613707165109
reliabletrue
passestrue
7
name"Selvi"
dialogue"नहीं, वो... वो परछाई! क्या आप उस लापता लड़के को ढूंढ रहे हैं? मैंने उसकी आवाज़ सुनी थी!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8797877632233461
mr0.8713398402839396
reliabletrue
passestrue
8
name"Hunter"
dialogue"Damn it, I don't speak Hindi. Not a single word. Look, just stay calm. Don't touch any of the files on that memory card. I’m going to call dispatch and see if we have an interpreter on call—"
detectedLang"en"
heavyLang"en"
scores
en0.8093088418430884
tl0.6210949582431178
fr0.46808510638297873
ca0.4474515110509698
yo0.42542213883677304
de0.40185546874999994
it0.40185546874999994
sq0.3992153016184404
sv0.3989205103042198
et0.38811188811188807
no0.3819374369323915
ro0.3813131313131313
es0.3665977249224405
da0.3656136716727084
sk0.3599791013584117
nl0.34561965811965817
ms0.3417517463729178
pl0.34139784946236557
cs0.32469680264608597
hr0.30516165626772546
tr0.29190751445086704
lv0.29149797570850206
pt0.2768595041322314
hu0.23628428927680795
sl0.22320862396956245
lt0.21018697614442294
is0.20967741935483872
vi0.19934640522875816
eu0.1728561782579338
fi0.14812239221140475
az0.14035087719298248
hi0.11679884643114635
be0.05405405405405406
uk0.04891304347826087
reliabletrue
passestrue
9
name"Hunter"
dialogue"Hunter speaking. Go ahead."
detectedLang"en"
heavyLang"en"
scores
en0.798590130916415
tl0.696969696969697
de0.45652173913043476
nl0.4520547945205479
no0.45054945054945056
ms0.42196531791907516
fr0.41690962099125367
sv0.41348973607038125
pt0.40119760479041916
pl0.35064935064935066
lt0.30313588850174217
da0.2907801418439716
yo0.2779783393501805
is0.26199261992619927
it0.23954372623574144
ca0.2277992277992278
ro0.2277992277992278
sl0.2277992277992278
sq0.2277992277992278
tr0.2277992277992278
reliabletrue
passestrue
10
name"Hunter"
dialogue"What? Where? Near Miller's Creek? ...Understood. Secure the perimeter, I'm two minutes out."
detectedLang"en"
heavyLang"en"
scores
en0.8003472222222222
tl0.5244003308519438
no0.5176174496644296
da0.49825479930191974
sv0.47296058661778184
es0.45652173913043476
nl0.4549763033175355
de0.45394112060778735
fr0.40782698249227595
et0.38568376068376065
sq0.3830472103004292
ca0.35101580135440186
ms0.33526011560693636
ro0.2953431372549019
sk0.2866004962779156
fi0.27398989898989895
tr0.25997425997426
it0.2580645161290322
pt0.24540682414698162
cs0.21662125340599456
pl0.19692737430167598
sl0.18785310734463279
hr0.1797432239657632
lt0.17503586800573886
yo0.15689149560117305
ja0.14814814814814814
az0.13403614457831325
hu0.13403614457831325
is0.13273001508295626
lv0.09305993690851734
reliabletrue
passestrue
11
name"Hunter"
dialogue"Ma'am, I have to go. Stay right here in town, don't delete anything on that camera. I'll be back for you."
detectedLang"en"
heavyLang"en"
scores
en0.8097309051372655
tl0.6234534696073158
da0.49640287769784175
yo0.4807121661721069
no0.4795539033457249
pl0.4341147938561034
ro0.4318181818181818
it0.4102780117944398
ca0.3670886075949367
sq0.3642143505903724
sv0.360146252285192
cs0.35720844811753905
sl0.3333333333333333
hr0.3288590604026846
nl0.29929929929929927
de0.2950654582074521
et0.29435483870967744
lt0.2849846782431052
sk0.2849846782431052
hu0.2768595041322314
fr0.27007299270072993
ms0.24324324324324328
lv0.20903954802259886
es0.19168591224018475
pt0.19168591224018475
fi0.1764705882352941
az0.17355371900826447
tr0.17159763313609466
hi0.10714285714285714
be0.09090909090909091
is0.08256880733944955
uk0.08256880733944955
vi0.08256880733944955
reliabletrue
passestrue