Run: 2026-02-16-01KHKRVCYNX7146HB1KE2AZED7

Run Details

Model:: Stealth: Aurora Alpha
Test:: Language Writing
Scenario:: Character dialogue (Hindi) in a story
Duration:: 2.5s

Evaluation summary

Score	Evaluator	Details Link
100.00%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Selvi">
Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Hindi, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Hindi, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Selvi and Hunter as a voice sheet:

Selvi: "..."
Hunter: "..."

Model response

Selvi: "मैं यहाँ बैठकर अपने कैमरे से इस शहर की सड़कों को देख रही हूँ, लेकिन कुछ अजीब महसूस हो रहा है।"  
Hunter: "Excuse me, miss… I'm looking for any information about the recent disappearances."  
Selvi: "मैंने देखा है कि पिछले हफ़्ते में दो लोग यहाँ से गए, और फिर कभी नहीं लौटे।"  
Hunter: "I don't understand. Can you speak English?"  
Selvi: "माफ़ कीजिए, मैं अंग्रेज़ी नहीं बोलती।"  
Hunter: "Alright, can you tell me what you saw?"  
Selvi: "मैंने एक अंधेरी गली में एक आदमी को देखी, वह बहुत जल्दी चल रहा था और फिर वह गली से गायब हो गया।"  
Hunter: "Did you see anything else? Any clues?"  
Selvi: "मैंने एक छोटा कागज़ टुकड़ा पाया, पर वह बहुत धुंधला था।"  
Hunter: "Thanks. I need to check this."  
[Hunter’s phone buzzes]  
Hunter: "Excuse me, I have to take this. I’ll be back."  
Selvi: "धन्यवाद।"

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Parse dialogue

n/a

dialogue

name

"Selvi"

dialogue

"मैं यहाँ बैठकर अपने कैमरे से इस शहर की सड़कों को देख रही हूँ, लेकिन कुछ अजीब महसूस हो रहा है।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8812078479460453
mr	0.8721122112211221

reliable

true

passes

true

name

"Hunter"

dialogue

"Excuse me, miss… I'm looking for any information about the recent disappearances."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8026767330130405
fr	0.658956109134045
tl	0.6091094493541809
nl	0.5913290689410092
da	0.5403677058353318
pt	0.5355411954765752
sv	0.5340356564019448
no	0.5240066225165563
ca	0.49781659388646293
de	0.43682664054848186
sq	0.42557442557442554
es	0.4156504065040651
it	0.3960084033613445
ms	0.3596881959910913
cs	0.33526011560693636
sk	0.33449074074074076
ro	0.3298368298368299
sl	0.3282710280373832
yo	0.32590855803048063
pl	0.28214731585518105
et	0.27398989898989895
lv	0.2730720606826802
lt	0.267515923566879
hr	0.2609254498714653
fi	0.2144808743169399
eu	0.18899858956276447
az	0.1797432239657632
zh	0.11809815950920245
is	0.10990712074303406
tr	0.10852713178294573
hu	0.0987460815047022

reliable

true

passes

true

name

"Selvi"

dialogue

"मैंने देखा है कि पिछले हफ़्ते में दो लोग यहाँ से गए, और फिर कभी नहीं लौटे।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8848684210526315
mr	0.8656429942418427

reliable

true

passes

true

name

"Hunter"

dialogue

"I don't understand. Can you speak English?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8140111593304401
no	0.6359223300970874
da	0.6305418719211823
sv	0.5839112343966713
tl	0.5184590690208668
cs	0.4708994708994709
de	0.4690265486725664
ro	0.44029850746268656
ca	0.4174757281553398
hr	0.4129158512720157
pl	0.40476190476190477
nl	0.3723849372384937
sk	0.3492407809110629
tr	0.3288590604026846
az	0.3181818181818182
is	0.3135011441647597
sq	0.3087557603686636
it	0.27710843373493976
yo	0.2248062015503876
ms	0.1935483870967742
be	0.1891891891891892
hu	0.18256130790190736
et	0.17355371900826447
lt	0.17355371900826447
lv	0.17355371900826447
uk	0.17355371900826447
vi	0.17355371900826447

reliable

true

passes

true

name

"Selvi"

dialogue

"माफ़ कीजिए, मैं अंग्रेज़ी नहीं बोलती।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8872310895211658
mr	0.8776815957847196

reliable

true

passes

true

name

"Hunter"

dialogue

"Alright, can you tell me what you saw?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8062015503875969
ms	0.4791666666666667
tl	0.47229551451187335
fr	0.4520547945205479
no	0.4520547945205479
sq	0.42528735632183906
es	0.33774834437086093
et	0.3220338983050847
pt	0.3055555555555556
sl	0.3055555555555556
nl	0.29577464788732394
it	0.2857142857142857
cs	0.2805755395683453
az	0.2779783393501805
ca	0.2779783393501805
tr	0.2779783393501805
fi	0.2727272727272727
da	0.27007299270072993
de	0.27007299270072993
yo	0.27007299270072993

reliable

true

passes

true

name

"Selvi"

dialogue

"मैंने एक अंधेरी गली में एक आदमी को देखी, वह बहुत जल्दी चल रहा था और फिर वह गली से गायब हो गया।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8810310641110377
mr	0.8718496369073045

reliable

true

passes

true

name

"Hunter"

dialogue

"Did you see anything else? Any clues?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8131539611360238
sq	0.4444444444444444
tl	0.4075829383886255
et	0.40476190476190477
ca	0.34725848563968675
cs	0.2378048780487805
ms	0.2378048780487805

reliable

true

passes

true

name

"Selvi"

dialogue

"मैंने एक छोटा कागज़ टुकड़ा पाया, पर वह बहुत धुंधला था।"

detectedLang

"hi"

heavyLang

"hi"

scores

hi	0.8786653185035389
mr	0.8786162249645965

reliable

true

passes

true

name

"Hunter"

dialogue

"Thanks. I need to check this."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8347107438016529
tl	0.6447602131438721
pl	0.5661605206073753
hr	0.5604395604395604
no	0.5594713656387665
da	0.5485327313769752
cs	0.5412844036697247
yo	0.5283018867924528
vi	0.5098039215686274
sk	0.504950495049505
et	0.5024875621890548
lv	0.4805194805194805
lt	0.4550408719346049
ca	0.40828402366863903
sv	0.40828402366863903
sq	0.40119760479041916
sl	0.37694704049844235
it	0.36507936507936506
nl	0.358974358974359
ro	0.3103448275862069
be	0.25925925925925924
tr	0.25925925925925924
hu	0.250936329588015
az	0.23954372623574144
is	0.23954372623574144
uk	0.23954372623574144

reliable

true

passes

true

name

"Hunter"

dialogue

"Excuse me, I have to take this. I’ll be back."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8122653316645806
tl	0.6432818073721759
da	0.5652173913043478
no	0.5348837209302325
yo	0.526813880126183
sl	0.4889267461669506
sq	0.4845360824742268
lt	0.48186528497409326
pl	0.46524064171123
hr	0.4594594594594595
cs	0.44029850746268656
sk	0.40476190476190477
it	0.3939393939393939
lv	0.3814432989690722
hu	0.38016528925619836
et	0.34497816593886466
ca	0.3150684931506849
sv	0.3150684931506849
es	0.2537313432835821
fr	0.23273657289002556
ro	0.23076923076923078
pt	0.22680412371134018
ms	0.21875
nl	0.21875
fi	0.2
be	0.1891891891891892
tr	0.1891891891891892
az	0.17355371900826447
is	0.17355371900826447
uk	0.17355371900826447
vi	0.17355371900826447

reliable

true

passes

true

name

"Selvi"

dialogue

"धन्यवाद।"

detectedLang

"mr"

heavyLang

"hi"

scores

mr	0.868559411146162
hi	0.8657357679914071

reliable

true

passes

true