Run: 2026-05-27-01KSMEW0HXCZX2AED6Y0D171GG

Run Details

Model:: Skyfall 36B V2
Test:: Language Writing
Scenario:: Character dialogue (Hindi) in a story
Duration:: 10.5s
Cost:: $0.000615
Provider:: Parasail

Evaluation summary

Score	Evaluator	Details Link
58.82%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Selvi">
Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Hindi, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Hindi, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Selvi and Hunter as a voice sheet:

Selvi: "..."
Hunter: "..."

Model response

```
Selvi: "..."
Hunter: "Alborn Police Department, Detective Hunter speaking. How can I help you, ma'am?"

He flashed his badge to the young woman at the cafe, making her jump slightly. Her dark eyes widened as she took in the stern look on his face and his broad, muscular frame.

Selvi: "Hindi phrases, lots."
Noticing the unfamiliar words tumbling from her lips, Selvi ducked her head shyly. She gestured at her camera.

Hunter: "This is a police investigation, miss. Did you witness something? Were you here on the night of the 14th?"

Selvi bit her lip and nodded. "Hindi, család, Indians."

Hunter: "...Where are you from, miss? And what exactly did you see that night? We need you to be as specific as possible. Alborn has never seen anything like this before. I need your help."

Selvi: "Ok, Cuba hindi-inédt ése. More. Indians."

Hunter: "...Right. Alright, let me get this straight. ... You saw a group of Indians? Okay. Going to a bar? Got it. ... And you passed one on your way here. Where did you see this person, exactly?"
```

Hunter: "I see. And did anything unusual or suspicious seem to happen? To or with this person you encountered? Any idea who or where they could have gone?"

Selvi: "... Selvi hindi."

Hunter: "...Alright, Selvi. One last thing. On the 14th, remember? Did you see anything then, even if it seems unimportant to you? Sights, sounds, anything at all can help. This town has never dealt with disappearances like this. We are trying to keep the peace until everything is solved. The local Police is stretched to its limit in preventing panic."

Selvi: "...More police."

Hunter: "Unfortunately the town simply cannot afford more salaries. We're already taxed to the limit from the increase of tourists in recent months. We do have a detective from the neighboring town helping us however. And the State Troopers will come once the frequency of searches justifies the cost. You wouldn't happen to have a lead on some easy money to improve the funding would you?"

Selvi: "Hindi camera."

As Selvi spoke, Hunter received a frantic call on his cell phone and immediately stood. "...Yes, I understand. On my way. ... Selvi, miss. I must cut this short. I have leads to pursue. ... Thank you, and stay safe."

With that Hunter made a hurry for the door. "Any other thing I might need from you will come at a later time. For now stay safe and around the people."

With that, he left the cafe and locked the phone into position.

Selvi: "...Alone."
```

Evaluation details

Result

Evaluator

Details

Meta Data

58.82%

Parse dialogue

n/a

dialogue

name	"Selvi"
dialogue	"..."
detectedLang	""
heavyLang	""
scores
reliable	false
passes	true

name

"Hunter"

dialogue

"Alborn Police Department, Detective Hunter speaking. How can I help you, ma'am?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7755102040816326
tl	0.6867881548974943
ro	0.5723172628304821
ca	0.564528899445764
fr	0.5299145299145299
no	0.5274914089347079
it	0.4845360824742268
sq	0.47817836812144215
cs	0.47619047619047616
sv	0.4751908396946565
da	0.45652173913043476
pt	0.44612286002014095
hr	0.4427558257345492
nl	0.42886812045690553
de	0.42528735632183906
az	0.38684503901895206
es	0.3692660550458715
ms	0.36416184971098264
lt	0.3574766355140187
sk	0.34679334916864607
sl	0.3436754176610978
pl	0.3381468110709988
tr	0.3357487922705314
hu	0.271523178807947
et	0.21652421652421652
lv	0.21652421652421652
yo	0.21428571428571427
is	0.19590643274853803
eu	0.14596273291925466
fi	0.13249211356466878
be	0.11290322580645161
uk	0.10277324632952692
vi	0.10277324632952692

reliable

true

passes

true

name

"Selvi"

dialogue

"Hindi phrases, lots."

detectedLang

"tl"

heavyLang

"fr"

scores

tl	0.713302752293578
et	0.5733788395904437
it	0.44933920704845814
is	0.43946188340807174
en	0.4292237442922375
sq	0.410377358490566
lv	0.39903846153846156
hi	0.3842364532019704
ca	0.3718592964824121
es	0.3718592964824121
fr	0.3718592964824121
pt	0.3718592964824121

reliable

true

passes

false

name

"Hunter"

dialogue

"This is a police investigation, miss. Did you witness something? Were you here on the night of the 14th?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8271570796460178
tl	0.7225920994229916
fr	0.5915032679738562
yo	0.557991513437058
nl	0.5394252026529108
cs	0.5181187355435621
da	0.5003996802557954
de	0.4987971130713713
no	0.4967793880837359
ro	0.4712351945854484
pt	0.4541484716157206
hr	0.4469026548672566
sk	0.4444444444444444
sv	0.4228993536472761
ca	0.42075996292863765
sq	0.4186046511627907
it	0.41369606003752346
fi	0.4120413922859831
et	0.410377358490566
es	0.4098205854579792
hu	0.3811881188118812
sl	0.37686939182452645
ms	0.36804853387259856
is	0.3379237288135593
lv	0.3272335844994618
lt	0.3206521739130435
pl	0.30709534368070956
az	0.2961711711711712
eu	0.20785804816223066
tr	0.1925064599483204
hi	0.11847672778561354
zh	0.10968660968660969
vi	0.10071942446043164

reliable

true

passes

true

name

"Selvi"

dialogue

"Hindi, család, Indians."

detectedLang

"tl"

heavyLang

"en"

scores

tl	0.7115384615384616
en	0.5750708215297451
it	0.5440729483282675
ca	0.53125
sq	0.506578947368421
et	0.504950495049505
hu	0.4791666666666667
is	0.3951612903225807
hi	0.34210526315789475
es	0.33920704845814975
fr	0.33920704845814975
ms	0.32432432432432434
pt	0.32432432432432434
ro	0.32432432432432434
az	0.3181818181818182
yo	0.3181818181818182
nl	0.3087557603686636
no	0.3087557603686636
cs	0.29577464788732394
da	0.29577464788732394
de	0.29577464788732394
sv	0.29577464788732394
tr	0.29577464788732394
hr	0.2822966507177033
lt	0.2822966507177033
lv	0.2822966507177033
sk	0.2822966507177033
sl	0.2822966507177033

reliable

true

passes

false

name

"Hunter"

dialogue

"...Where are you from, miss? And what exactly did you see that night? We need you to be as specific as possible. Alborn has never seen anything like this before. I need your help."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8312710911136107
tl	0.5754144763445208
no	0.3738819320214669
yo	0.362089914945322
da	0.34863523573200994
sq	0.3429286608260325
ca	0.3379571248423708
fr	0.328214971209213
ro	0.31282722513089006
pl	0.29624664879356566
hu	0.29435483870967744
lt	0.29245283018867924
hr	0.27486187845303867
it	0.2693110647181628
cs	0.2682926829268293
et	0.26160337552742613
sv	0.26004228329809725
lv	0.2446043165467626
pt	0.2374727668845316
sk	0.21933085501858735
nl	0.21583271097834206
sl	0.19663351185921957
ms	0.19230769230769232
es	0.14772727272727273
de	0.1264559068219634
be	0.0625
tr	0.0625
az	0.05660377358490566
is	0.05660377358490566
uk	0.05660377358490566
vi	0.05660377358490566

reliable

true

passes

true

name

"Selvi"

dialogue

"Ok, Cuba hindi-inédt ése. More. Indians."

detectedLang

"tl"

heavyLang

"en"

scores

tl	0.5967741935483871
en	0.5697074010327022
ms	0.423963133640553
it	0.4172494172494172
es	0.414519906323185
fr	0.414519906323185
ca	0.40476190476190477
tr	0.3946731234866829
sk	0.38875305623471884
sq	0.3811881188118812
et	0.3796526054590571
sl	0.37027707808564225
hr	0.3540051679586563
pl	0.3093922651933701
is	0.2816091954022989
hi	0.2378048780487805
pt	0.22360248447204967
ro	0.22360248447204967
az	0.21875
yo	0.21875
nl	0.21135646687697163
no	0.21135646687697163
cs	0.20127795527156547
da	0.20127795527156547
de	0.20127795527156547
sv	0.20127795527156547
lt	0.19093851132686085
lv	0.19093851132686085

reliable

true

passes

false

name

"Hunter"

dialogue

"...Right. Alright, let me get this straight. ... You saw a group of Indians? Okay. Going to a bar? Got it. ... And you passed one on your way here. Where did you see this person, exactly?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8225062122825701
tl	0.6338337605272794
fr	0.452354874041621
no	0.44842801985659125
yo	0.4327850255246738
sq	0.43117178612059154
de	0.42857142857142855
cs	0.42296595499134443
et	0.419953596287703
da	0.40828402366863903
ms	0.3800371977681339
hr	0.37888198757763975
is	0.37772246421904176
ca	0.37733499377334995
nl	0.3634627625716105
it	0.3556701030927836
sl	0.3552546744036106
pl	0.3540051679586563
sk	0.3519118600129617
pt	0.3514915693904021
lv	0.32523616734143057
es	0.3229519295870007
ro	0.3093922651933701
sv	0.30699930699930694
lt	0.2774566473988439
fi	0.22360248447204967
tr	0.21011058451816747
az	0.20508744038155804
hu	0.1796554552912223
hi	0.07749077490774908
eu	0.06542056074766354
vi	0.06542056074766354

reliable

true

passes

true

name

"Hunter"

dialogue

"I see. And did anything unusual or suspicious seem to happen? To or with this person you encountered? Any idea who or where they could have gone?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8238747553816046
tl	0.5575221238938053
da	0.4461538461538462
no	0.40318302387267907
ca	0.3617021276595745
cs	0.34450109249817923
ms	0.3430656934306569
sq	0.3382352941176471
fr	0.336283185840708
es	0.31921331316187596
pt	0.31454683929931454
de	0.3114001530221882
hu	0.3108728943338438
sv	0.3108728943338438
et	0.3060909791827294
yo	0.2641046606704824
pl	0.26229508196721313
hr	0.25864909390444807
it	0.2353440951571793
nl	0.23076923076923078
sk	0.22613929492691315
ro	0.225473321858864
lv	0.22413793103448276
lt	0.20983318700614575
is	0.17958067456700091
tr	0.13211186113789777
az	0.11937377690802348
sl	0.11851126346718903
be	0.07216494845360825
uk	0.06542056074766354
vi	0.06542056074766354

reliable

true

passes

true

name

"Selvi"

dialogue

"... Selvi hindi."

detectedLang

"tl"

heavyLang

"no"

scores

tl	0.7566909975669099
da	0.5283018867924528
fi	0.5238095238095238
it	0.504950495049505
is	0.494949494949495
et	0.4845360824742268
no	0.48186528497409326
sq	0.46524064171123
hi	0.43820224719101125
ca	0.4350282485875706

reliable

true

passes

false

name

"Hunter"

dialogue

"...Alright, Selvi. One last thing. On the 14th, remember? Did you see anything then, even if it seems unimportant to you? Sights, sounds, anything at all can help. This town has never dealt with disappearances like this. We are trying to keep the peace until everything is solved. The local Police is stretched to its limit in preventing panic."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8060915626182368
tl	0.5853559870550161
nl	0.4493687886113349
fr	0.4324473975636766
no	0.41428571428571426
ro	0.36961869618696186
ca	0.3510604621715733
da	0.35023771790808245
it	0.3187105350614822
yo	0.3175765645805593
sv	0.3062605752961083
pt	0.30437733288089586
et	0.2906574394463668
sk	0.29041190723433713
sl	0.2847173761339846
ms	0.26864074206207633
pl	0.26628489620615603
cs	0.2531876138433516
de	0.24935920908092274
hr	0.24604634056638472
es	0.24158342582315948
sq	0.23134608173978252
lv	0.19765166340508808
hu	0.19639357114856917
is	0.18972332015810278
lt	0.16189697465249386
fi	0.14369256474519632
az	0.10323709536307961
tr	0.06775807185084129
be	0.046511627906976744
eu	0.043843283582089554
hi	0.039362699156513595

reliable

true

passes

true

name

"Selvi"

dialogue

"...More police."

detectedLang

"en"

heavyLang

"en"

scores

en	0.800531914893617
sl	0.7692307692307693
hr	0.7663551401869159
cs	0.708171206225681
ro	0.701195219123506
it	0.6887966804979253
tl	0.6887966804979253
fr	0.6835443037974683
sk	0.6767241379310345
eu	0.5562130177514794
da	0.5454545454545454
et	0.5426829268292682
lv	0.5426829268292682
no	0.5426829268292682
sv	0.5426829268292682
pl	0.5398773006134969
lt	0.5370370370370371
nl	0.5341614906832298
fi	0.5283018867924528
ms	0.5222929936305732
sq	0.5222929936305732
de	0.5161290322580645
az	0.5
es	0.5
hu	0.5
ca	0.4897959183673469
tr	0.4897959183673469
pt	0.4827586206896552

reliable

true

passes

false

name

"Hunter"

dialogue

"Unfortunately the town simply cannot afford more salaries. We're already taxed to the limit from the increase of tourists in recent months. We do have a detective from the neighboring town helping us however. And the State Troopers will come once the frequency of searches justifies the cost. You wouldn't happen to have a lead on some easy money to improve the funding would you?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.800073536170604
tl	0.587443095599393
fr	0.48459715639810425
it	0.4661266568483063
ro	0.4661266568483063
nl	0.44015444015444016
ca	0.41907051282051283
pt	0.41311386940097133
de	0.39834024896265563
es	0.3713872832369942
da	0.356318437407517
no	0.336283185840708
sv	0.32745825602968465
hr	0.3249534450651769
sq	0.3106180665610142
sk	0.3057772103415257
yo	0.30131705750080306
sl	0.29314267143321415
cs	0.29291287386215864
pl	0.2847747451496218
ms	0.27956276912885064
fi	0.2676767676767676
et	0.2032967032967033
lt	0.19918998527245949
lv	0.18017338861666038
eu	0.12369057211925866
az	0.11405295315682282
tr	0.10750923266311038
hu	0.10309278350515463
vi	0.07682512733446518
is	0.07011543394613082
hi	0.03718459495351926

reliable

true

passes

true

name

"Selvi"

dialogue

"Hindi camera."

detectedLang

"tl"

heavyLang

"tl"

scores

tl	0.7929606625258799
it	0.7222222222222222
ro	0.6124031007751938
ca	0.504950495049505
es	0.49748743718592964
is	0.494949494949495
et	0.4845360824742268
sq	0.46524064171123
sv	0.45054945054945056
hi	0.43820224719101125
en	0.4318181818181818
fr	0.4318181818181818
nl	0.4318181818181818
de	0.4186046511627907
ms	0.4186046511627907

reliable

true

passes

false

name

"Selvi"

dialogue

"...Yes, I understand. On my way. ... Selvi, miss. I must cut this short. I have leads to pursue. ... Thank you, and stay safe."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8111680604262207
tl	0.5780590717299579
da	0.5342648037258815
no	0.4791666666666667
cs	0.44400317712470216
pl	0.42386831275720166
sk	0.3934142114384749
yo	0.36247723132969034
sv	0.33269780743565297
hr	0.3288590604026846
ca	0.30966469428007887
fi	0.27083333333333337
et	0.2366412213740458
vi	0.2290748898678414
de	0.21612541993281076
it	0.21524663677130043
fr	0.20993227990970656
lv	0.20903954802259886
nl	0.20273348519362186
lt	0.19261822376009227
ro	0.1898148148148148
is	0.16367980884109917
sq	0.1606714628297362
sl	0.14738124238733252
hi	0.10714285714285714
be	0.09090909090909091
tr	0.09090909090909091
hu	0.08735332464146023
az	0.08256880733944955
uk	0.08256880733944955

reliable

true

passes

false

name

"Hunter"

dialogue

"Any other thing I might need from you will come at a later time. For now stay safe and around the people."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8448581560283688
tl	0.6910856134157105
da	0.5742092457420924
no	0.5518565941101152
yo	0.40978077571669475
nl	0.39810834049871024
ca	0.3676603432700994
de	0.36536718041704447
it	0.36479128856624315
pt	0.3524514338575393
sv	0.3427230046948357
fr	0.3269230769230769
hr	0.32367149758454106
cs	0.3103448275862069
pl	0.3048659384309831
sq	0.2886178861788618
et	0.27461139896373055
ro	0.24650161463939718
hu	0.24160346695557963
ms	0.23830250272034822
sk	0.22394678492239467
tr	0.17355371900826447
lt	0.17159763313609466
is	0.16467780429594273
az	0.15966386554621848
lv	0.15966386554621848
vi	0.15966386554621848
es	0.15865384615384615
sl	0.11392405063291139
hi	0.0979381443298969
be	0.09090909090909091
eu	0.09090909090909091
fi	0.08256880733944955
uk	0.08256880733944955

reliable

true

passes

true

name

"Selvi"

dialogue

"...Alone."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8062015503875969
it	0.635036496350365
fr	0.6062992125984252
pl	0.6062992125984252

reliable

false

passes

true