Run: 2026-09-23-01M37HZHA6TC0NVDJ3362ECEJS

Run Details

Model:: GPT-6 Sol
Test:: Language Writing
Scenario:: Character dialogue (Hindi) in a story
Duration:: 6.8s
Cost:: $0.003564
Provider:: OpenAI

Evaluation summary

Score	Evaluator	Details Link
100.00%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Selvi">
Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Hindi, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Hindi, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Selvi and Hunter as a voice sheet:

Selvi: "..."
Hunter: "..."

Model response

Hunter: "Is this seat taken? I’m Detective Hunter. I’m asking around about what happened near the apple orchard last night."

Selvi: "नहीं, बैठिए। मैंने वहाँ कुछ देखा था, पर मुझे समझ नहीं आया कि वह क्या था।"

Hunter: "I’m sorry—I don’t speak Hindi. Were you at the orchard?"

Selvi: "मैं तस्वीरें लेने गई थी। रोशनी अच्छी थी।" 

Hunter: "Your camera. Did you get a picture of anything?"

Selvi: "शायद। मैंने अभी तक तस्वीरें नहीं देखीं। एक औरत पेड़ों के बीच खड़ी थी, फिर अचानक गायब हो गई।"

Hunter: "I can tell you’re upset. Was someone there with you?"

Selvi: "नहीं। मैं अकेली थी। मैंने उसकी आवाज़ सुनी थी—वह मदद माँग रही थी।"

Hunter: "Okay. We’re not getting very far like this." 

Selvi: "मुझे माफ़ कीजिए। काश मैं आपको समझा पाती।"

Hunter: "Don’t apologize. Keep the pictures, all right? I’ll find someone who can translate."

Selvi: "हाँ। तस्वीरें यहीं हैं।"

Hunter: "That’s my phone. I have to take this." 

Selvi: "क्या आप वापस आएँगे?"

Hunter: "I’ll be back. Stay somewhere you feel safe."

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Parse dialogue

n/a

dialogue

name

"Hunter"

dialogue

"Is this seat taken? I’m Detective Hunter. I’m asking around about what happened near the apple orchard last night."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8096290837632032
tl	0.6466028271773825
nl	0.519826517967782
fr	0.4850498338870432
no	0.4305657604702424
de	0.41641566265060237
sv	0.3657937806873977
es	0.2986425339366516
it	0.29159049360146255
da	0.2909423604757548
ro	0.28637200736648255
pt	0.28174235403151066
yo	0.27973977695167285
ca	0.2357001972386588
sq	0.2288557213930348
sl	0.2083758937691522
is	0.17377398720682302
hu	0.16576964477933262
ms	0.15021929824561403
sk	0.0914419695193435
et	0.0903755868544601
cs	0.08500590318772137
hr	0.07957244655581948
tr	0.07074340527577938

reliable

true

passes

true

name

"Selvi"

dialogue

"नहीं, बैठिए। मैंने वहाँ कुछ देखा था, पर मुझे समझ नहीं आया कि वह क्या था।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8828920570264766
mr	0.8747822299651568

reliable

true

passes

true

name

"Hunter"

dialogue

"I’m sorry—I don’t speak Hindi. Were you at the orchard?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.7920743639921722
tl	0.7650635710337202
no	0.5246085011185682
da	0.4798041615667074
it	0.4272237196765499
sq	0.4129834254143646
sv	0.3369734789391576
yo	0.3134087237479806
cs	0.30098684210526316
is	0.2747440273037543
nl	0.2722602739726028
et	0.2697594501718213
fr	0.2647058823529412
hr	0.24645390070921988
ca	0.24511545293072823
pl	0.22867513611615245
pt	0.1904761904761905
ro	0.17475728155339806
hi	0.1550695825049702
ms	0.1550695825049702
de	0.15
sk	0.1448692152917505
be	0.1414141414141414
tr	0.1414141414141414
hu	0.1361788617886179
az	0.1290983606557377
lt	0.1290983606557377
lv	0.1290983606557377
uk	0.1290983606557377
vi	0.1290983606557377

reliable

true

passes

true

name

"Selvi"

dialogue

"मैं तस्वीरें लेने गई थी। रोशनी अच्छी थी।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8817407757805109
mr	0.8741610738255033

reliable

true

passes

true

name

"Hunter"

dialogue

"Your camera. Did you get a picture of anything?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8162803843979649
tl	0.6733668341708542
ro	0.5357142857142857
it	0.531700288184438
fr	0.48412698412698413
yo	0.482484076433121
de	0.4741100323624596
ms	0.4724025974025974
nl	0.45561139028475717
is	0.44821731748726656
sq	0.42781690140845074
ca	0.4227353463587922
es	0.41546762589928055
cs	0.3925233644859813
hr	0.37858508604206503
sl	0.34343434343434337
no	0.33537832310838445
hu	0.32432432432432434
sv	0.30851063829787234
pt	0.3010752688172043
sk	0.2857142857142857
pl	0.24418604651162787
lt	0.20147420147420148
tr	0.19154228855721395
da	0.181360201511335
az	0.17721518987341772
eu	0.17721518987341772
lv	0.17721518987341772
vi	0.17721518987341772
et	0.16237113402061853
fi	0.16237113402061853

reliable

true

passes

true

name

"Selvi"

dialogue

"शायद। मैंने अभी तक तस्वीरें नहीं देखीं। एक औरत पेड़ों के बीच खड़ी थी, फिर अचानक गायब हो गई।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.880227890716043
mr	0.8742694032893843

reliable

true

passes

true

name

"Hunter"

dialogue

"I can tell you’re upset. Was someone there with you?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8122183274912369
de	0.44196428571428575
tl	0.3811881188118812
ca	0.3644067796610169
sq	0.36115843270868825
cs	0.32795698924731176
yo	0.3169398907103825
tr	0.2816091954022989
no	0.27884615384615385
az	0.27184466019417475
da	0.2704280155642024
hr	0.2704280155642024
sv	0.2690058479532163
nl	0.2632612966601179
pl	0.251497005988024
it	0.23469387755102045
fi	0.21875
ro	0.1935483870967742
es	0.17218543046357618
ms	0.17218543046357618
pt	0.17218543046357618
sk	0.1610738255033557
be	0.15730337078651685
hu	0.1515837104072398
et	0.14383561643835618
is	0.14383561643835618
lt	0.14383561643835618
lv	0.14383561643835618
uk	0.14383561643835618
vi	0.14383561643835618

reliable

true

passes

true

name

"Selvi"

dialogue

"नहीं। मैं अकेली थी। मैंने उसकी आवाज़ सुनी थी—वह मदद माँग रही थी।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.881808838643371
mr	0.8738204959403116

reliable

true

passes

true

name

"Hunter"

dialogue

"Okay. We’re not getting very far like this."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8230714791224345
tl	0.6693121693121694
no	0.5335820895522388
it	0.5098039215686274
nl	0.28977272727272724
ms	0.2668621700879765
da	0.258160237388724
de	0.24242424242424243
sv	0.24242424242424243
tr	0.2378048780487805
is	0.23076923076923078
hr	0.21135646687697163
pt	0.21135646687697163
ro	0.21135646687697163

reliable

true

passes

true

name

"Selvi"

dialogue

"मुझे माफ़ कीजिए। काश मैं आपको समझा पाती।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8842949706880593
mr	0.8763600395647874

reliable

true

passes

true

name

"Hunter"

dialogue

"Don’t apologize. Keep the pictures, all right? I’ll find someone who can translate."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8069822087948976
tl	0.6174318030605456
no	0.47584320875113945
fr	0.46261682242990654
da	0.40228690228690234
ro	0.40166493236212286
de	0.37971952535059333
sq	0.36252771618625274
ca	0.358974358974359
nl	0.3321718931475029
sv	0.3282710280373832
it	0.3203309692671395
et	0.2987804878048781
pt	0.2758186397984887
hr	0.2571059431524548
az	0.2551813471502591
yo	0.23941798941798942
es	0.21232876712328766
lv	0.20689655172413793
lt	0.19804741980474197
pl	0.19692737430167598
tr	0.1958041958041958
ms	0.19241573033707865
cs	0.1843971631205674
sk	0.17739628040057226
sl	0.1726618705035971
vi	0.13273001508295626
eu	0.1043613707165109

reliable

true

passes

true

name

"Selvi"

dialogue

"हाँ। तस्वीरें यहीं हैं।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8841059602649006
mr	0.8819163292847504

reliable

true

passes

true

name

"Hunter"

dialogue

"That’s my phone. I have to take this."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8355263157894737
tl	0.6849942726231385
da	0.6283783783783783
pl	0.5621019108280255
cs	0.5393634840871022
sk	0.5132743362831859
hr	0.4811320754716981
no	0.48015122873345933
sq	0.45972495088408644
yo	0.44889779559118237
it	0.4387755102040817
sl	0.41983122362869196
vi	0.416135881104034
lv	0.40217391304347827
nl	0.38752783964365256
lt	0.3778280542986425
ca	0.3341404358353511
sv	0.3341404358353511
ro	0.24657534246575344
fr	0.233983286908078
de	0.21428571428571427
be	0.20289855072463767
tr	0.20289855072463767
hu	0.19590643274853803
az	0.1863905325443787
et	0.1863905325443787
is	0.1863905325443787
uk	0.1863905325443787

reliable

true

passes

true

name

"Selvi"

dialogue

"क्या आप वापस आएँगे?"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8821372446306966
mr	0.872737556561086

reliable

true

passes

true

name

"Hunter"

dialogue

"I’ll be back. Stay somewhere you feel safe."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8261694058154235
tl	0.5027124773960217
hu	0.298469387755102
lt	0.289405684754522
yo	0.2857142857142857
cs	0.22096317280453256
de	0.22096317280453256
es	0.22096317280453256
pt	0.22096317280453256
sq	0.22096317280453256

reliable

true

passes

true