Run: 2026-02-16-01KHKRT4C0753WYYTZTDPPKC51

Run Details

Model:: Stealth: Aurora Alpha
Test:: Language Writing
Scenario:: Character dialogue (Italian) in a story
Duration:: 2.1s

Evaluation summary

Score	Evaluator	Details Link
100.00%	Parse dialogue	(details)

Model input

System

You are an expert novel author in the cozy mystery genre.

Take the following details about characters/locations/... into account:
<character name="Isabella">
Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English.
She enjoys landscape photography and is always seen with her camera.
</character>
<character name="Hunter">
Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN.
He is a former marine and has a no-nonsense attitude.
Hunter has no knowledge of Italian, not even basic phrases.
</character>
<location name="Alborn, MN">
Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival.
</location>

User/Human

Write the following scene:

Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town.
She responds troubled and shaken in Italian, and Hunter looks confused.

They talk for a while, until Hunter gets a call and has to leave.

Return the dialogue between Isabella and Hunter as a voice sheet:

Isabella: "..."
Hunter: "..."

Model response

Isabella: "Non riesco a credere a quello che è successo ieri sera, al festival delle mele."  
Hunter: "Excuse me, are you Isabella? I'm Detective Hunter. Did you notice anything strange at the apple festival?"  
Isabella: "C'era una luce strana, quasi come un bagliore che si è spento subito dopo."  
Hunter: "A light? What do you mean?"  
Isabella: "Ho sentito un sussurro, come se qualcuno chiamasse il suo nome, ma non riuscivo a capire."  
Hunter: "I'm sorry, I don't understand. Could you… maybe point to where you saw it?"  
Isabella: "Mi sono girata, ma la gente era sparita, come se il vento l'avesse portata via."  
Hunter: "Alright, I’ll note that. If you remember anything else, please let me know."  
Hunter: *(phone vibrates)* "Hold on, I have to take this."  
Hunter: "Sorry, I have to go. Stay safe, Isabella."  
Isabella: "Grazie, spero che tutto si risolva presto."  

Evaluation details

Result

Evaluator

Details

Meta Data

100.00%

Parse dialogue

n/a

dialogue

name

"Isabella"

dialogue

"Non riesco a credere a quello che è successo ieri sera, al festival delle mele."

detectedLang

"it"

heavyLang

"it"

scores

it	0.8236614299454954
fr	0.6360026472534744
ro	0.5925925925925926
ca	0.5665878644602049
da	0.5617529880478088
en	0.5546558704453441
pt	0.5469522240527183
es	0.5295124037639007
nl	0.5115452930728241
de	0.47817836812144215
no	0.4538232373386296
ms	0.4433198380566802
tl	0.43064182194616984
fi	0.3806306306306307
sv	0.37286202964652226
cs	0.3670886075949367
hr	0.3626882966396292
et	0.3574766355140187
sl	0.3349455864570738
yo	0.3184634448574969
eu	0.3150684931506849
sk	0.31077694235588976
hu	0.28848641655886154
lt	0.2744063324538259
sq	0.26861702127659576
az	0.25474254742547425
pl	0.233983286908078
tr	0.21540656205420827
lv	0.19472913616398244
is	0.12
vi	0.11290322580645161

reliable

true

passes

true

name

"Hunter"

dialogue

"Excuse me, are you Isabella? I'm Detective Hunter. Did you notice anything strange at the apple festival?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.770133164235891
tl	0.6314184036603966
fr	0.6001103143960287
it	0.559805707346691
no	0.546875
da	0.5252128356254093
es	0.5205026455026455
ro	0.5088075880758808
sq	0.5084745762711865
nl	0.504442925495557
pt	0.4511733535200606
sv	0.4444444444444444
de	0.43798449612403106
ca	0.43270735524256654
ms	0.4273301737756714
cs	0.4100895036615134
sl	0.40280065897858325
hr	0.37821612349914235
et	0.33118081180811804
sk	0.27860696517412936
fi	0.2706237424547284
lv	0.2579324462640737
lt	0.210239651416122
az	0.19623059866962306
pl	0.16281755196304848
tr	0.13997627520759193
yo	0.12860576923076922
hu	0.0845959595959596
is	0.0845959595959596

reliable

true

passes

true

name

"Isabella"

dialogue

"C'era una luce strana, quasi come un bagliore che si è spento subito dopo."

detectedLang

"it"

heavyLang

"it"

scores

it	0.8247078464106845
es	0.5955315870570108
ro	0.5325022261798753
ca	0.515235457063712
fr	0.4728915662650602
tl	0.4330453563714903
pt	0.42622950819672134
sk	0.42560175054704596
ms	0.4179600886917961
yo	0.4114349775784753
sq	0.4094488188976378
cs	0.40878378378378377
en	0.3462017434620174
sl	0.3429286608260325
hr	0.3286445012787723
no	0.3137254901960784
lt	0.3110236220472441
lv	0.3110236220472441
tr	0.3055555555555556
de	0.22566371681415928
is	0.22566371681415928
az	0.1935483870967742
pl	0.12935323383084577
nl	0.12790697674418602
sv	0.12060301507537688
da	0.11764705882352942
et	0.10102739726027396

reliable

true

passes

true

name

"Hunter"

dialogue

"A light? What do you mean?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8333333333333334
tl	0.667300380228137
cs	0.6621621621621622
pt	0.6284501061571126
yo	0.6076233183856502
sk	0.5995423340961099
pl	0.5862884160756502
hr	0.5700245700245701
sl	0.5454545454545454
fr	0.5218579234972678
sq	0.5192307692307693
vi	0.5084269662921348
hu	0.4712990936555891
da	0.45482866043613707
no	0.4514106583072101
de	0.44620253164556967
ro	0.44267515923566875
ca	0.4372990353697749
es	0.4299674267100977
it	0.41666666666666663
lt	0.31906614785992216
tr	0.3055555555555556
is	0.3
az	0.2857142857142857
eu	0.2857142857142857
lv	0.2857142857142857
nl	0.2857142857142857
et	0.2647058823529412
fi	0.2647058823529412
ms	0.2647058823529412
sv	0.2647058823529412

reliable

true

passes

true

name

"Isabella"

dialogue

"Ho sentito un sussurro, come se qualcuno chiamasse il suo nome, ma non riuscivo a capire."

detectedLang

"it"

heavyLang

"it"

scores

it	0.8050389922015597
fr	0.6171967020023557
ca	0.5904221802142408
ro	0.5718050065876153
pt	0.5303468208092486
en	0.5123780945236309
es	0.47538337368845845
no	0.39138576779026213
yo	0.38679245283018865
cs	0.365234375
tl	0.36336924583741426
az	0.33264887063655035
sk	0.3319630010277493
tr	0.3229166666666667
fi	0.3186582809224318
et	0.28414096916299564
da	0.282560706401766
sq	0.27697441601779754
hr	0.2737430167597766
eu	0.27048260381593714
hu	0.268018018018018
lv	0.26719278466741825
de	0.2655367231638418
lt	0.2554410080183276
sl	0.2545871559633027
sv	0.2520138089758343
pl	0.2459396751740139
ms	0.24418604651162787
vi	0.18546365914786966
nl	0.17721518987341772
is	0.10344827586206896

reliable

true

passes

true

name

"Hunter"

dialogue

"I'm sorry, I don't understand. Could you… maybe point to where you saw it?"

detectedLang

"en"

heavyLang

"en"

scores

en	0.8184647302904563
da	0.5703764320785597
tl	0.5621351125938282
no	0.5120817843866171
pl	0.45083682008368203
cs	0.4312026002166848
sv	0.3993135011441648
fr	0.37574316290130794
yo	0.36363636363636365
sq	0.362089914945322
sk	0.3581907090464548
de	0.34045226130653267
lv	0.34045226130653267
hr	0.3269230769230769
it	0.2905405405405405
nl	0.2532005689900427
lt	0.24132947976878616
ro	0.23802612481857763
ca	0.2081447963800905
is	0.20694864048338368
sl	0.1873065015479876
ms	0.16
pt	0.16
be	0.11764705882352942
tr	0.11764705882352942
hu	0.11317567567567569
az	0.10714285714285714
et	0.10714285714285714
uk	0.10714285714285714
vi	0.10714285714285714

reliable

true

passes

true

name

"Isabella"

dialogue

"Mi sono girata, ma la gente era sparita, come se il vento l'avesse portata via."

detectedLang

"it"

heavyLang

"it"

scores

it	0.8089614449461617
es	0.6776084407971864
ro	0.6735905044510386
fr	0.6615384615384615
pt	0.6585971446306642
ca	0.649234693877551
no	0.5370370370370371
da	0.5362563237774031
sq	0.4986326344576117
et	0.466537342386033
sk	0.462890625
en	0.46131243878550443
cs	0.44500504540867813
sv	0.44388270980788674
tl	0.4427558257345492
hr	0.43820224719101125
yo	0.4376278118609407
sl	0.4008714596949891
ms	0.39091915836101887
nl	0.36562860438292966
de	0.35672514619883045
lt	0.34679334916864607
pl	0.314214463840399
hu	0.2948717948717949
tr	0.28104575163398693
az	0.2403314917127072
fi	0.2329149232914923
eu	0.23184357541899442
vi	0.22752808988764048
lv	0.21316165951359084
is	0.12420382165605094

reliable

true

passes

true

name

"Hunter"

dialogue

"Alright, I’ll note that. If you remember anything else, please let me know."

detectedLang

"en"

heavyLang

"en"

scores

en	0.8154981549815498
tl	0.5877988458367683
fr	0.42196531791907516
no	0.4026284348864994
ms	0.40119760479041916
sl	0.3909866017052376
da	0.3834771886559803
nl	0.35064935064935066
yo	0.34469200524246396
sv	0.3333333333333333
sq	0.3315508021390375
de	0.3150684931506849
cs	0.2753623188405797
hu	0.26144756277695713
et	0.2570579494799406
is	0.23547400611620795
sk	0.20382165605095542
es	0.16943521594684383
ro	0.16666666666666666
pt	0.14965986394557826
it	0.13793103448275862
fi	0.13043478260869565

reliable

true

passes

true

name

"Hunter"

dialogue

"Hold on, I have to take this."

detectedLang

"en"

heavyLang

"en"

scores

en	0.84375
da	0.741506646971935
tl	0.7083333333333333
pl	0.6634615384615385
hr	0.6621621621621622
cs	0.6399176954732511
yo	0.630801687763713
sk	0.6145374449339206
no	0.5920745920745921
ca	0.5752427184466019
et	0.5535714285714286
sl	0.5320855614973261
lv	0.5138888888888888
lt	0.4883040935672514
fi	0.4615384615384615
sv	0.44089456869009586
sq	0.4336569579288026
it	0.396551724137931
fr	0.38380281690140844
ro	0.33962264150943394
hi	0.32432432432432434
be	0.2857142857142857
tr	0.2857142857142857
hu	0.2768595041322314
az	0.2647058823529412
is	0.2647058823529412
uk	0.2647058823529412
vi	0.2647058823529412

reliable

true

passes

true

name

"Hunter"

dialogue

"Sorry, I have to go. Stay safe, Isabella."

detectedLang

"en"

heavyLang

"en"

scores

en	0.7524752475247525
tl	0.6180555555555556
da	0.5864661654135338
pl	0.5729813664596274
it	0.5723172628304821
yo	0.5225694444444445
hr	0.4811320754716981
no	0.48015122873345933
ca	0.472168905950096
sv	0.4649805447470817
cs	0.461839530332681
sq	0.4410569105691057
sk	0.4258872651356994
lv	0.40217391304347827
lt	0.3778280542986425
et	0.34679334916864607
fi	0.3226600985221675
sl	0.3055555555555556
pt	0.26666666666666666
ro	0.24657534246575344
es	0.23184357541899442
be	0.20289855072463767
tr	0.20289855072463767
hu	0.19590643274853803
az	0.1863905325443787
is	0.1863905325443787
uk	0.1863905325443787
vi	0.1863905325443787

reliable

true

passes

true

name

"Isabella"

dialogue

"Grazie, spero che tutto si risolva presto."

detectedLang

"it"

heavyLang

"it"

scores

it	0.8208955223880597
ro	0.563953488372093
es	0.5581737849779087
tl	0.5145631067961165
sk	0.5
sl	0.49238578680203043
cs	0.46236559139784944
fr	0.455535390199637
pt	0.4485294117647059
ca	0.40357852882703776
sq	0.39759036144578314
yo	0.38271604938271603
hr	0.3697478991596639
ms	0.3684210526315789
lt	0.3644067796610169
no	0.35064935064935066
et	0.34782608695652173
fi	0.33035714285714285
de	0.3181818181818182
pl	0.23857868020304565
en	0.22879177377892032
eu	0.2227979274611399
sv	0.21052631578947367
nl	0.2
da	0.18256130790190736
lv	0.17355371900826447
az	0.16434540389972147

reliable

true

passes

true