Run: 2025-11-18-01KACP5SW9R4J3EZ1VR42WQJ7C

Run Details

Model:
Gemini 3 Pro (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
20.6s
Cost:
$0.026798
Provider:
Google AI Studio

Evaluation summary

Score Evaluator
Details Link
53.85% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet Sequence** **Context:** *Hunter approaches Selvi at a small cafe in Alborn. Selvi is gripping her digital camera tight, her hands trembling. Hunter stands over her table, flashing his badge.* **Hunter:** "Excuse me, Miss. Sorry to interrupt your coffee. I'm Detective Hunter. I’ve seen you walking around town with that camera near the festival grounds." **Selvi:** (Startled, clutching camera closer) "Ji? Aap... aap mujhse baat kar rahe hain?" *[Translation: Yes? You... are you talking to me?]* **Hunter:** ( pauses, realizing the language barrier immediately) "English? Do you speak English? I need to know if you were near the apple orchards yesterday evening. Before the storm hit." **Selvi:** (Eyes widening, shaken) "Mujhe... mujhe English nahi aati. Par maine wahan kuch dekha tha. Jungle mein... woh aadmi..." *[Translation: I... I don't know English. But I saw something there. In the forest... that man...]* **Hunter:** (Frowns, louder and slower) "The. Orchards. Trees. Did you see a girl? About this tall. Blue dress." **Selvi:** (Breathing fast, pointing a shaking finger at her camera's LCD screen, though it is turned off) "Photo. Maine photo lee thi. Lekin main dar gayi thi, isliye bhaag aayi. Woh bahut... ajeeb lag raha tha." *[Translation: Photo. I took a photo. But I got scared, so I ran away. He looked very... strange.]* **Hunter:** (Run a hand down his face, frustrated) "Look, I don't understand. 'Photo'? You have photos?" **Selvi:** (Nods vigorously, tears forming) "Haan, photo. Chehra nahi dikha, par parchhai thi. Khoon... mujhe laga wahan khoon tha." *[Translation: Yes, photo. Couldn't see the face, but there was a shadow. Blood... I thought there was blood there.]* **Hunter:** (Leans in, trying to read her body language) "Okay, you're upset. I get that. Stay here. Don't go anywhere. I need to find a translator app or something." **Selvi:** (Whispering, looking around the cafe paranoiacally) "Please, woh wapas aayega. Meri madad kijiye." *[Translation: Please, he will come back. Help me.]* **Hunter:** (Phone rings sharply in his pocket. He pulls it out.) "Hunter here. ... What? Another one? Yeah. Yeah, I'm on my way." **(Hunter looks back at Selvi, torn.)** **Hunter:** "I have to go. Stay. Here. We aren't done." **Selvi:** (Watch him back away, confusingly pleading) "Nahi, mat jayiye! Suniye!" *[Translation: No, don't go! Listen!]*
created_at"2025-11-18T23:53:28.237385+00:00" 11/18/2025, 11:53:28 PM
model"google/gemini-3-pro-preview-20251117"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2491
moderation_latency(null)
generation_time20528
tokens_prompt273
tokens_completion1280
native_tokens_prompt289
native_tokens_completion2185
native_tokens_completion_images0
native_tokens_reasoning1522
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"STOP"
usage0.026798
api_type"completions"
id"gen-1763509987-NPaRETX6inAmveKfhNgb"
upstream_id(null)
total_cost0.026798
cache_discount(null)
upstream_inference_cost0
provider_name"Google AI Studio"

Evaluation details

Result Evaluator Details Meta Data
53.85% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, Miss. Sorry to interrupt your coffee. I'm Detective Hunter. I’ve seen you walking around town with that camera near the festival grounds."
detectedLang"en"
heavyLang"en"
scores
en0.7803559360216265
tl0.6562059238363893
fr0.49586349534643226
it0.47097124253933803
no0.45255474452554745
pt0.4475920679886685
nl0.43739180611656087
ms0.41616766467065874
ro0.4126506024096385
es0.4033047735618115
sv0.3970315398886827
ca0.3962848297213622
da0.38833124215809284
sl0.38173747622067217
sq0.3769968051118211
cs0.35855263157894735
de0.3308167467398765
hr0.3238557558945908
pl0.29090909090909095
sk0.25
lt0.23946957878315134
et0.22741679873217116
lv0.2174959871589085
yo0.20016406890894176
az0.15948275862068964
fi0.12398921832884095
hu0.12320143884892087
tr0.11844484629294756
eu0.07757805108798486
is0.06787762906309751
vi0.06069364161849711
reliabletrue
passestrue
1
name"Selvi"
dialogue"Ji? Aap... aap mujhse baat kar rahe hain?"
detectedLang"sl"
heavyLang"af"
scores
sl0.5604395604395604
eu0.40828402366863903
lt0.3610223642172524
cs0.33993399339933994
tr0.3333333333333333
reliablefalse
passesfalse
2
name"Hunter"
dialogue"English? Do you speak English? I need to know if you were near the apple orchards yesterday evening. Before the storm hit."
detectedLang"en"
heavyLang"en"
scores
en0.8004404073768235
sv0.5692216280451574
no0.5543945912722803
da0.5448838669177652
tl0.5166666666666667
nl0.4384198295894655
cs0.3813993174061433
hr0.3813993174061433
yo0.36067019400352734
sk0.35954063604240283
pl0.35783879539415414
it0.34210526315789475
de0.33668801463860937
sl0.3179680150517403
fr0.3166823751178134
sq0.31214421252371916
ro0.25564681724846
pt0.25334706488156544
es0.240041928721174
et0.21790722761596548
lv0.2032967032967033
vi0.1935483870967742
is0.19265033407572385
lt0.18721973094170402
ms0.17142857142857143
hu0.16474654377880185
ca0.15990730011587484
be0.0880503144654088
tr0.0880503144654088
az0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe... mujhe English nahi aati. Par maine wahan kuch dekha tha. Jungle mein... woh aadmi..."
detectedLang"en"
heavyLang"vi"
scores
en0.4723618090452261
de0.471830985915493
fr0.450261780104712
ms0.375
tl0.3566176470588235
fi0.3234536082474227
lv0.31640625
ro0.29435483870967744
da0.2391304347826087
eu0.2391304347826087
sv0.2391304347826087
et0.2369186046511628
sq0.1822429906542056
lt0.1758241758241758
no0.13509060955518945
hr0.12060301507537688
reliablefalse
passesfalse
4
name"Hunter"
dialogue"The. Orchards. Trees. Did you see a girl? About this tall. Blue dress."
detectedLang"en"
heavyLang"en"
scores
en0.8096446700507615
tl0.6183206106870229
et0.47058823529411764
fr0.4396014943960149
de0.40711462450592883
no0.40554821664464996
yo0.4007989347536618
da0.3935309973045822
cs0.38101788170563966
ca0.3440233236151603
sv0.3161094224924012
es0.3066255778120185
hu0.25742574257425743
nl0.2549668874172185
sq0.25
ms0.23857868020304565
pt0.23728813559322032
ro0.23599320882852293
az0.23339011925042585
sk0.22413793103448276
it0.2173913043478261
hr0.199288256227758
pl0.1891891891891892
sl0.16666666666666666
lt0.15413533834586465
tr0.14611005692599618
is0.14285714285714285
eu0.1346153846153846
lv0.1346153846153846
vi0.1346153846153846
fi0.12280701754385964
reliabletrue
passestrue
5
name"Selvi"
dialogue"Photo. Maine photo lee thi. Lekin main dar gayi thi, isliye bhaag aayi. Woh bahut... ajeeb lag raha tha."
detectedLang"fr"
heavyLang"vi"
scores
fr0.44751381215469616
en0.4191674733785092
et0.336283185840708
de0.3348115299334811
ro0.3142857142857143
fi0.2998833138856476
sq0.27007299270072993
tl0.20948616600790515
vi0.2052980132450331
eu0.19678714859437751
lt0.17355371900826447
ms0.14893617021276595
tr0.14893617021276595
no0.14040114613180515
es0.1341991341991342
pt0.1341991341991342
sv0.1341991341991342
cs0.12790697674418602
is0.12790697674418602
lv0.12790697674418602
hi0.1137370753323486
nl0.1137370753323486
reliablefalse
passesfalse
6
name"Hunter"
dialogue"Look, I don't understand. 'Photo'? You have photos?"
detectedLang"en"
heavyLang"en"
scores
en0.798636926889715
da0.643640350877193
no0.576271186440678
cs0.5220588235294118
sv0.5178041543026707
tl0.48
fr0.453781512605042
de0.44821731748726656
nl0.4337979094076655
ca0.39138576779026213
pl0.385633270321361
ro0.33537832310838445
sk0.33127572016460904
lt0.3055555555555556
hr0.2995689655172413
is0.29653679653679654
lv0.2919389978213508
sq0.2919389978213508
it0.26136363636363635
yo0.2111650485436893
es0.19753086419753088
pt0.19753086419753088
hi0.19154228855721395
be0.17721518987341772
tr0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
et0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
7
name"Selvi"
dialogue"Haan, photo. Chehra nahi dikha, par parchhai thi. Khoon... mujhe laga wahan khoon tha."
detectedLang"fr"
heavyLang"vi"
scores
fr0.4473684210526315
tl0.373508353221957
ms0.31640625
en0.2456896551724138
eu0.2391304347826087
lv0.22794117647058826
vi0.22794117647058826
sq0.1822429906542056
is0.1758241758241758
no0.1758241758241758
pt0.15322580645161288
ro0.15322580645161288
da0.15048543689320387
sv0.15048543689320387
cs0.1435562805872757
fi0.1435562805872757
hi0.12790697674418602
ca0.125
es0.125
it0.125
reliablefalse
passesfalse
8
name"Hunter"
dialogue"Okay, you're upset. I get that. Stay here. Don't go anywhere. I need to find a translator app or something."
detectedLang"en"
heavyLang"en"
scores
en0.7950819672131147
tl0.5702885205647636
pl0.46605644546147984
da0.4350282485875706
sq0.4313566206336312
hr0.41225860621326615
no0.3902439024390244
cs0.37888198757763975
yo0.375
sk0.36189608021877845
ro0.35779816513761464
et0.3548387096774194
de0.35424354243542433
pt0.33899905571293676
ca0.33269780743565297
sl0.3210475266731329
lv0.3150684931506849
sv0.3143976493633692
lt0.3110236220472441
it0.3020937188434696
es0.2907801418439716
fr0.28205128205128205
ms0.27159209157127995
is0.2537313432835821
hu0.24160346695557963
vi0.23995656894679696
tr0.23076923076923078
nl0.2222222222222222
az0.21524663677130043
fi0.1935483870967742
eu0.16367980884109917
be0.09090909090909091
uk0.08256880733944955
reliabletrue
passestrue
9
name"Selvi"
dialogue"Please, woh wapas aayega. Meri madad kijiye."
detectedLang"en"
heavyLang"de"
scores
en0.45750452079566006
tl0.4371482176360225
et0.41972920696324956
sv0.25925925925925924
es0.25
pt0.25
ro0.25
reliablefalse
passesfalse
10
name"Hunter"
dialogue"Hunter here. ... What? Another one? Yeah. Yeah, I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8177399756986633
tl0.5792426367461431
pl0.46714031971580816
fr0.37629937629937626
hr0.3684210526315789
cs0.3492407809110629
sk0.3492407809110629
da0.34782608695652173
sq0.3464052287581699
ca0.34497816593886466
et0.33920704845814975
fi0.3333333333333333
es0.25
de0.22680412371134018
hi0.21875
no0.20634920634920634
yo0.2
sv0.1891891891891892
it0.17355371900826447
nl0.17355371900826447
pt0.17355371900826447
ms0.16434540389972147
ro0.16434540389972147
sl0.16434540389972147
tr0.16434540389972147
reliabletrue
passestrue
11
name"Hunter"
dialogue"I have to go. Stay. Here. We aren't done."
detectedLang"en"
heavyLang"en"
scores
en0.8127340823970037
pl0.6537396121883656
da0.609375
hr0.5667244367417678
no0.5659722222222222
tl0.5551601423487544
yo0.5462794918330308
lt0.4887525562372188
cs0.48559670781893005
sq0.4834710743801653
sv0.45652173913043476
sk0.44933920704845814
lv0.42528735632183906
et0.39320388349514557
ro0.39320388349514557
ca0.3556701030927836
nl0.34210526315789475
sl0.32614555256064687
it0.3150684931506849
be0.21875
tr0.21875
hu0.21135646687697163
az0.20127795527156547
is0.20127795527156547
uk0.20127795527156547
vi0.20127795527156547
reliabletrue
passestrue
12
name"Selvi"
dialogue"Nahi, mat jayiye! Suniye!"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5238095238095238
tr0.4117647058823529
is0.358974358974359
lt0.3333333333333333
ms0.3333333333333333
no0.3333333333333333
sk0.3333333333333333
sv0.3333333333333333
reliablefalse
passesfalse