Run: 2026-02-08-01KGYYAGGG3YY03B9VCSE3KB7G

Run Details

Model:: Claude Sonnet 4.5
Test:: Language Writing
Scenario:: Character dialogue (Hindi) in a story
Duration:: 16.7s
Cost:: $0.013656
Provider:: Amazon Bedrock

Evaluation summary

Score	Evaluator	Details Link
50.00%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Selvi">
Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Hindi, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Hindi, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Selvi and Hunter as a voice sheet:

Selvi: "..."
Hunter: "..."

Model response

# Voice Sheet: Cafe Scene

**Selvi:** *[looking at camera, muttering to herself]* "Yeh tasveer... kuch ajeeb hai..."

**Hunter:** "Excuse me, miss. I'm Detective Hunter. Mind if I ask you a few questions?"

**Selvi:** *[looks up, startled]* "Kya? Aap kaun hain?"

**Hunter:** "I'm investigating the disappearances in town. Were you at the apple festival last night?"

**Selvi:** *[agitated, speaking rapidly]* "Haan, haan, main wahan thi! Maine kuch dekha... ek aadmi... woh achanak gayab ho gaya! Main dar gayi thi!"

**Hunter:** *[confused, speaking slowly]* "I... don't understand. Do you speak English?"

**Selvi:** *[frustrated, gesturing to her camera]* "Dekho! Dekho yeh photo! Yahan... yeh aadmi thi, phir woh nahi thi!"

**Hunter:** "Your camera? You have photos?"

**Selvi:** *[nodding vigorously]* "Haan! Photo! Lekin... lekin koi mujhe samajh nahi raha!"

**Hunter:** *[rubbing his temples]* "Okay, okay. Let me see the camera. May I?"

**Selvi:** *[hesitant, protective]* "Mera camera... aap... theek hai." *[hands it over reluctantly]*

**Hunter:** *[scrolling through photos]* "These are from the festival... Wait, what's this? Who is that in the background?"

**Selvi:** *[pointing urgently]* "Wahi! Wahi! Woh aadmi! Main gawah hoon!"

**Hunter:** "A witness... you're a witness. But I can't understand a damn word you're saying."

**Selvi:** *[calmer, trying gestures]* "Main... student. India se."

**Hunter:** "India. Right. This is going to be a problem."

**Selvi:** *[worried]* "Problem? Kya problem? Main madad karna chahti hoon!"

**Hunter:** "Look, I need to find someone who can translate. Do you have anyone here who speaks Hindi?"

**Selvi:** *[shakes head sadly]* "Nahi... main akeli hoon yahaan."

**Hunter:** *[sighs]* "Great. Just great."

*[Hunter's phone rings]*

**Hunter:** *[answers]* "Hunter here. What? Another one? When? I'll be right there." *[hangs up, stands quickly]*

**Selvi:** *[concerned]* "Kya hua? Aap kahan ja rahe hain?"

**Hunter:** "I have to go. Don't leave town. I'll find a translator and come back. Understand? Stay. Here."

**Selvi:** *[confused but nods]* "Stay... haan, main samajh gayi. Main yahaan rahungi."

**Hunter:** *[pointing to camera]* "Keep that camera safe. That might be evidence."

**Selvi:** *[clutching camera]* "Evidence... shukriya. Dhanyavaad."

**Hunter:** *[already walking away]* "I'll be back."

**Selvi:** *[quietly, to herself]* "Bhagwan, mujhe bachao. Yeh jagah bahut darawani hai..."

---

*[End of scene]*

Evaluation details

Result

Evaluator

Details

Meta Data

50.00%

Parse dialogue

n/a

dialogue

name

"Selvi"

dialogue

"Yeh tasveer... kuch ajeeb hai..."

detectedLang

"vi"

heavyLang

"et"

scores

vi	0.4728915662650602
nl	0.4006849315068493
it	0.36363636363636365

reliable

false

passes

false

name

"Hunter"

dialogue

"Excuse me, miss. I'm Detective Hunter. Mind if I ask you a few questions?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7945768282662284
fr	0.6214988644965935
it	0.6108949416342413
tl	0.5918367346938775
ca	0.5670995670995671
pt	0.5594713656387665
ro	0.5192307692307693
sq	0.5029821073558649
es	0.4939271255060729
no	0.4813278008298755
sv	0.4669509594882729
nl	0.44382647385984425
cs	0.43630214205186024
da	0.4298745724059293
hr	0.38875305623471884
hu	0.3834771886559803
et	0.38195302843016066
sl	0.37810945273631835
de	0.3234100135317997
pl	0.3160054719562244
ms	0.2917847025495751
tr	0.2917847025495751
yo	0.2917847025495751
sk	0.2877492877492877
lt	0.2248062015503876
fi	0.2163009404388715
is	0.2163009404388715
az	0.21011058451816747
lv	0.21011058451816747
vi	0.21011058451816747
be	0.12280701754385964
eu	0.12280701754385964
uk	0.11190053285968028

reliable

true

passes

true

name

"Selvi"

dialogue

"Kya? Aap kaun hain?"

detectedLang

"eu"

heavyLang

"fi"

scores

eu	0.5798319327731093

reliable

true

passes

false

name

"Hunter"

dialogue

"I'm investigating the disappearances in town. Were you at the apple festival last night?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7993311036789298
tl	0.6879875195007801
fr	0.6312231100184389
nl	0.6034368803701256
it	0.5495495495495496
no	0.5426829268292682
pt	0.5241871530531325
de	0.5196156925540432
da	0.5161290322580645
ms	0.49324324324324326
sv	0.4910941475826972
es	0.4884910485933504
ro	0.48674080410607357
ca	0.45652173913043476
sl	0.43767572633552015
hr	0.40298507462686567
cs	0.3969849246231156
et	0.35344827586206895
sq	0.35205183585313177
az	0.34782608695652173
yo	0.3095512082853855
sk	0.29906542056074764
lt	0.29577464788732394
lv	0.25650557620817843
pl	0.19678714859437751
is	0.18699186991869918
fi	0.16897506925207756
hu	0.10044977511244377

reliable

true

passes

true

name

"Selvi"

dialogue

"Haan, haan, main wahan thi! Maine kuch dekha... ek aadmi... woh achanak gayab ho gaya! Main dar gayi thi!"

detectedLang

"ms"

heavyLang

"vi"

scores

ms	0.45
tl	0.4264859228362878
fr	0.4186046511627907
ro	0.3333333333333333
en	0.3226600985221675
fi	0.31335830212234705
de	0.29032258064516125
pt	0.2597577388963661
tr	0.2537313432835821
et	0.2286115007012623
vi	0.2198581560283688
lt	0.1863905325443787
ca	0.1791044776119403
no	0.16792738275340394
sk	0.16792738275340394
cs	0.16158536585365854
it	0.16158536585365854
nl	0.15384615384615385
eu	0.15254237288135594
hu	0.15254237288135594
es	0.14463452566096424
lv	0.13793103448275862
hr	0.13249211356466878

reliable

false

passes

false

name

"Hunter"

dialogue

"I... don't understand. Do you speak English?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8113207547169812
no	0.6359223300970874
da	0.6305418719211823
sv	0.5839112343966713
cs	0.5714285714285714
pl	0.5363214837712519
hr	0.5245641838351823
tl	0.5184590690208668
sk	0.49409780775716694
de	0.4690265486725664
sq	0.455535390199637
ro	0.44029850746268656
nl	0.3723849372384937
vi	0.3670886075949367
yo	0.3548387096774194
pt	0.34210526315789475
ca	0.3150684931506849
is	0.3135011441647597
sl	0.2857142857142857
it	0.27710843373493976
ms	0.1935483870967742
be	0.1891891891891892
tr	0.1891891891891892
hu	0.18256130790190736
az	0.17355371900826447
et	0.17355371900826447
lt	0.17355371900826447
lv	0.17355371900826447
uk	0.17355371900826447

reliable

true

passes

true

name

"Selvi"

dialogue

"Dekho! Dekho yeh photo! Yahan... yeh aadmi thi, phir woh nahi thi!"

detectedLang

"tl"

heavyLang

"ber"

scores

tl	0.3902439024390244
fr	0.36893203883495146
en	0.344758064516129
eu	0.336734693877551
vi	0.3229166666666667
ms	0.29805615550755943
cs	0.21307506053268765
fi	0.21307506053268765
hi	0.19154228855721395

reliable

false

passes

false

name

"Hunter"

dialogue

"Your camera? You have photos?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7911694510739856
tl	0.6354166666666666
fr	0.5958429561200923
es	0.5056497175141244
ca	0.4971264367816092
it	0.47447447447447455
ro	0.47447447447447455
ms	0.4615384615384615
da	0.45652173913043476
nl	0.45652173913043476
de	0.4496855345911949
sv	0.31906614785992216
lt	0.3137254901960784
pt	0.3137254901960784
cs	0.308300395256917
hi	0.3055555555555556
lv	0.2886178861788618

reliable

true

passes

true

name

"Selvi"

dialogue

"Haan! Photo! Lekin... lekin koi mujhe samajh nahi raha!"

detectedLang

"eu"

heavyLang

"tl"

scores

eu	0.5098039215686274
et	0.4495412844036697
fi	0.39759036144578314
fr	0.3877551020408163
is	0.3877551020408163
tl	0.3670886075949367
en	0.3630573248407643
no	0.25
lv	0.24433249370277077
cs	0.22680412371134018
da	0.2227979274611399
sv	0.21052631578947367
hi	0.20424403183023873
ms	0.19137466307277629

reliable

false

passes

false

name

"Hunter"

dialogue

"Okay, okay. Let me see the camera. May I?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7745490981963927
tl	0.6887966804979253
sq	0.6153846153846154
it	0.6107266435986158
no	0.5953237410071942
et	0.593128390596745
sv	0.5697896749521989
da	0.5664739884393063
yo	0.5647969052224371
ro	0.5243128964059197
fr	0.5212765957446809
nl	0.5202558635394456
ca	0.5161290322580645
ms	0.5098039215686274
cs	0.49095022624434387
es	0.471830985915493
sl	0.4617224880382775
vi	0.4094488188976378
hr	0.3818681318681319
pl	0.358974358974359
pt	0.281150159744409
fi	0.25
de	0.24242424242424243
sk	0.24242424242424243
be	0.23728813559322032
tr	0.23728813559322032
hu	0.22945205479452058
az	0.21875
is	0.21875
lt	0.21875
lv	0.21875
uk	0.21875

reliable

true

passes

true

name

"Selvi"

dialogue

"Mera camera... aap... theek hai."

detectedLang

"it"

heavyLang

"af"

scores

it	0.5958429561200923
sv	0.5165745856353591
nl	0.5084269662921348
ro	0.47447447447447455
vi	0.4728915662650602
ca	0.36823104693140796
es	0.3613138686131387
en	0.3027888446215139
fr	0.3027888446215139
de	0.29149797570850206
ms	0.29149797570850206
tl	0.29149797570850206

reliable

true

passes

false

name

"Hunter"

dialogue

"These are from the festival... Wait, what's this? Who is that in the background?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8436985850608753
tl	0.6277429467084639
nl	0.5514636449480642
it	0.4836956521739131
sv	0.4662921348314607
ro	0.46206115515288787
sl	0.41789215686274506
ms	0.4114002478314746
yo	0.39873417721518983
sq	0.3933588761174968
no	0.3725231175693527
da	0.3581081081081081
fr	0.3510928961748634
hu	0.31752873563218387
de	0.31358381502890176
ca	0.302496328928047
az	0.2983751846381093
hr	0.2973372781065089
pt	0.2973372781065089
cs	0.2824773413897281
es	0.27811550151975684
pl	0.23633440514469453
lt	0.2096505823627288
et	0.20435510887772196
sk	0.19898819561551434
is	0.16225749559082892
fi	0.1171003717472119
lv	0.1171003717472119

reliable

true

passes

true

name

"Selvi"

dialogue

"Wahi! Wahi! Woh aadmi! Main gawah hoon!"

detectedLang

"ms"

heavyLang

"de"

scores

ms	0.40828402366863903
tl	0.3442622950819672
en	0.3311036789297659
fr	0.3055555555555556
de	0.2805755395683453

reliable

false

passes

false

name

"Hunter"

dialogue

"A witness... you're a witness. But I can't understand a damn word you're saying."

detectedLang

"en"

heavyLang

"en"

scores

en	0.7938144329896907
da	0.5947315096251267
no	0.5614035087719298
tl	0.5449374288964732
sv	0.5073891625615764
cs	0.49748743718592964
de	0.4557823129251701
pl	0.43582510578279265
ro	0.4310099573257468
sk	0.4211287988422576
ca	0.4065281899109792
hr	0.38556067588325654
nl	0.38271604938271603
tr	0.38176197836166925
it	0.375
hu	0.3579454253611557
is	0.3464052287581699
lv	0.34210526315789475
sq	0.33993399339933994
yo	0.33993399339933994
fr	0.33884297520661155
lt	0.26605504587155965
pt	0.25925925925925924
az	0.24953095684803
vi	0.24953095684803
es	0.24812030075187969
et	0.23954372623574144
sl	0.1836734693877551
be	0.14893617021276595
eu	0.14893617021276595
fi	0.13606911447084233
ms	0.13606911447084233
uk	0.13606911447084233

reliable

true

passes

true

name

"Selvi"

dialogue

"Main... student. India se."

detectedLang

"fr"

heavyLang

"id"

scores

fr	0.7345132743362832
en	0.7321428571428571
sq	0.7211895910780669
no	0.7005988023952096
cs	0.6945010183299388
ro	0.6887966804979253
it	0.6767241379310345
sv	0.6527777777777778
da	0.6519721577726217
es	0.6487119437939111
nl	0.6487119437939111
de	0.6462264150943396
hr	0.6420047732696896
yo	0.6394230769230769
pt	0.635036496350365
sl	0.625
ca	0.6231155778894472
sk	0.5562130177514794
tl	0.5562130177514794
ms	0.5
az	0.4915254237288135
pl	0.47735191637630664
et	0.46236559139784944
lt	0.46236559139784944
lv	0.46236559139784944
fi	0.40476190476190477
eu	0.3951612903225807
tr	0.29577464788732394
hu	0.2822966507177033

reliable

true

passes

false

name

"Hunter"

dialogue

"India. Right. This is going to be a problem."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8316934230968409
yo	0.6886973180076629
tl	0.6467391304347825
no	0.618991793669402
hu	0.6012269938650306
da	0.5886075949367089
hr	0.576271186440678
nl	0.5757180156657963
lt	0.5678191489361702
cs	0.5566166439290586
sl	0.5566166439290586
sk	0.5504840940525588
pl	0.5467224546722455
de	0.5227606461086637
es	0.5227606461086637
pt	0.5213549337260678
it	0.5163690476190477
fr	0.5112781954887218
lv	0.500768049155146
ro	0.4749596122778676
az	0.4706840390879479
sv	0.4706840390879479
ca	0.4610281923714759
sq	0.459234608985025
ms	0.3959107806691449
tr	0.38446969696969696
et	0.3737957610789981
eu	0.34077079107505076
is	0.3394308943089431
vi	0.17721518987341772
fi	0.16237113402061853

reliable

true

passes

true

name

"Selvi"

dialogue

"Problem? Kya problem? Main madad karna chahti hoon!"

detectedLang

"sv"

heavyLang

"tlh"

scores

sv	0.5919881305637982
et	0.5183887915936953
tl	0.5045045045045045
pl	0.494485294117647
en	0.48015122873345933
de	0.4554455445544555
no	0.43298969072164945
sl	0.43298969072164945
nl	0.3721461187214612
fr	0.367816091954023
hr	0.36046511627906974
ro	0.36046511627906974
da	0.3559718969555035
az	0.3514150943396226
fi	0.289405684754522
is	0.2647058823529412
cs	0.22969187675070027
ms	0.22969187675070027
es	0.21875
sk	0.21875
it	0.21428571428571427
lv	0.21428571428571427
ca	0.207492795389049
pt	0.207492795389049
lt	0.20289855072463767
sq	0.19590643274853803
hu	0.1863905325443787
tr	0.1863905325443787

reliable

true

passes

false

name

"Hunter"

dialogue

"Look, I need to find someone who can translate. Do you have anyone here who speaks Hindi?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8118371536093054
tl	0.6232876712328766
da	0.5013599274705349
hr	0.4825964252116651
sq	0.4811320754716981
cs	0.4791666666666667
et	0.4731800766283525
pl	0.462890625
sk	0.4204425711275026
no	0.416135881104034
it	0.39226519337016574
pt	0.36342592592592593
yo	0.3544600938967136
sl	0.3529411764705882
ca	0.34523809523809523
vi	0.3226600985221675
ro	0.3184634448574969
lv	0.314214463840399
lt	0.298469387755102
tr	0.2763157894736842
az	0.26568758344459276
sv	0.2637215528781794
is	0.22644163150492264
es	0.2198581560283688
fr	0.12698412698412698
hi	0.12420382165605094
be	0.11290322580645161
de	0.1085899513776337
eu	0.1085899513776337
hu	0.1085899513776337
nl	0.10277324632952692
uk	0.10277324632952692
ms	0.09688013136288999

reliable

true

passes

true

name

"Selvi"

dialogue

"Nahi... main akeli hoon yahaan."

detectedLang

"eu"

heavyLang

"tl"

scores

eu	0.4852941176470589
fi	0.375
en	0.3613138686131387
fr	0.3346007604562738
de	0.308300395256917

reliable

false

passes

false

name

"Hunter"

dialogue

"Great. Just great."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8373101952277657
et	0.576271186440678
sv	0.576271186440678
ro	0.5714285714285714
ca	0.506578947368421

reliable

true

passes

true

name

"Hunter"

dialogue

"Hunter here. What? Another one? When? I'll be right there."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8297665369649806
tl	0.5646766169154229
de	0.49275362318840576
sq	0.40374787052810895
da	0.4006849315068493
yo	0.3445692883895131
no	0.3027888446215139
fr	0.29435483870967744
hu	0.2505353319057816
lt	0.24242424242424243
es	0.2222222222222222
hr	0.19908466819221968
pl	0.19908466819221968
sv	0.16666666666666666
it	0.15254237288135594
nl	0.15254237288135594
pt	0.15254237288135594
ca	0.14425427872860636
ms	0.14425427872860636
ro	0.14425427872860636
sl	0.14425427872860636
tr	0.14425427872860636

reliable

true

passes

true

name

"Selvi"

dialogue

"Kya hua? Aap kahan ja rahe hain?"

detectedLang

"tl"

heavyLang

"tl"

scores

tl	0.5807127882599581
fi	0.546485260770975
et	0.4350282485875706
eu	0.40828402366863903
ms	0.40828402366863903
lv	0.36507936507936506
ca	0.35275080906148865
de	0.3055555555555556
sk	0.29577464788732394
da	0.2857142857142857
pl	0.2857142857142857
sl	0.2857142857142857
sq	0.2727272727272727
sv	0.2727272727272727
yo	0.2727272727272727

reliable

false

passes

false

name

"Hunter"

dialogue

"I have to go. Don't leave town. I'll find a translator and come back. Understand? Stay. Here."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8163526030022358
da	0.6318822023047375
no	0.5643939393939393
tl	0.5570107858243452
pl	0.5450949367088607
sv	0.48057813911472447
yo	0.47440585009140773
cs	0.47053406998158376
hr	0.4606003752345216
sk	0.4580584354382658
it	0.4471153846153846
ro	0.4465832531280077
sq	0.4406614785992217
de	0.4066047471620227
nl	0.3966421825813221
ca	0.3777056277056277
sl	0.3653421633554084
lv	0.358974358974359
lt	0.3546576879910213
pt	0.3282710280373832
et	0.2996345919610231
hu	0.27944862155388467
vi	0.2776381909547738
is	0.26937738246505716
tr	0.267515923566879
es	0.26658163265306123
fr	0.2551813471502591
az	0.25032594524119944
ms	0.2414248021108179
eu	0.19241573033707865
be	0.10852713178294573
fi	0.0987460815047022
uk	0.0987460815047022

reliable

true

passes

true

name

"Selvi"

dialogue

"Stay... haan, main samajh gayi. Main yahaan rahungi."

detectedLang

"et"

heavyLang

"et"

scores

et	0.4887525562372188
fi	0.4553376906318083
en	0.44933920704845814
ms	0.4469026548672566
is	0.28977272727272724
no	0.2857142857142857
lv	0.2795389048991354
tl	0.2795389048991354
fr	0.26035502958579887
da	0.25595238095238093
sv	0.24242424242424243
de	0.2378048780487805

reliable

false

passes

false

name

"Hunter"

dialogue

"Keep that camera safe. That might be evidence."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8078266946191475
tl	0.564873417721519
fr	0.5506535947712418
es	0.48308270676691734
yo	0.47718631178707227
it	0.46601941747572817
ro	0.4554455445544555
pt	0.4387755102040817
ca	0.38752783964365256
cs	0.36194895591647336
de	0.34679334916864607
lv	0.34210526315789475
nl	0.34210526315789475
no	0.33894230769230765
hu	0.298469387755102
lt	0.289405684754522
sv	0.22969187675070027
sl	0.21428571428571427
da	0.21203438395415475
ms	0.207492795389049
sk	0.207492795389049
sq	0.19590643274853803
tr	0.19590643274853803

reliable

true

passes

true

name

"Selvi"

dialogue

"Evidence... shukriya. Dhanyavaad."

detectedLang

"en"

heavyLang

"rn"

scores

en	0.5553359683794467
pt	0.4886363636363637
fr	0.4538834951456311
sq	0.43324937027707805
es	0.412532637075718
cs	0.4094488188976378
lv	0.3885869565217392
az	0.34210526315789475
tl	0.27184466019417475
it	0.267100977198697
sl	0.25
ca	0.24242424242424243
ro	0.24242424242424243
sk	0.24242424242424243
nl	0.22945205479452058
no	0.22945205479452058
tr	0.22945205479452058
yo	0.22945205479452058

reliable

false

passes

false

name

"Hunter"

dialogue

"I'll be back."

detectedLang

"en"

heavyLang

"en"

scores

en	0.7857142857142857
hu	0.609375
lt	0.5989304812834225
yo	0.5945945945945946
tl	0.5714285714285714

reliable

true

passes

true

name

"Selvi"

dialogue

"Bhagwan, mujhe bachao. Yeh jagah bahut darawani hai..."

detectedLang

"tl"

heavyLang

"ber"

scores

tl	0.35456110154905335
pl	0.34210526315789475
ms	0.3042671614100185
vi	0.2951127819548872
et	0.2299794661190965
sq	0.21875
de	0.21052631578947367
it	0.21052631578947367
sv	0.21052631578947367
eu	0.18655097613882862
yo	0.16851441241685144

reliable

false

passes

false