Run: 2026-02-24-01KJ8VTK7JGHAQNGYEJ5XZWX3X

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
46.0s
Cost:
$0.003203
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: (in Italian, looking up from her camera, slightly startled) "Sì? Mi dica." Hunter: (approaching, showing badge) "Detective Hunter. Mind if I ask you a few questions about the recent disappearances in town?" Isabella: (confused, shakes head) "Mi dispiace, non parlo inglese. Solo italiano." Hunter: (sighs, runs a hand through his hair) "You don't speak English. Of course. Okay. Disappearances. Missing people." (makes a gesture of someone vanishing) Isabella: (eyes widening, understanding the gesture) "Scomparsi? Sì, ho sentito parlare. È spaventoso." Hunter: "You've heard? Good. Have you seen anything? Noticed anything unusual?" (points to her camera) "With your camera, maybe?" Isabella: (clutching her camera protectively, voice trembling) "Le foto... sì. Ieri al tramonto, stavo fotografando il vecchio mulino fuori città. C'era qualcuno nei boschi... una figura. E poi, niente." Hunter: (leaning in, trying to comprehend) "Photos? Woods? Show me." Isabella: (fumbling with the camera) "Non so se dovrei... sembrava in pericolo. Ho chiamato, ma non ha risposto." Hunter: (phone starts ringing) "Hold that thought." (answers) "Hunter. Yeah. What? Another call? At the festival grounds? I'll be right there." (to Isabella) "I have to go. Don't leave town. I'll be back with a translator." Isabella: (standing up, alarmed) "Aspetti! Ho la foto! La persona nei boschi... assomigliava a una delle ragazze scomparse!" Hunter: (already walking away, calls back) "I don't understand! Just stay put!"
created_at"2026-02-24T22:20:28.282Z" 2/24/2026, 10:20:28 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2531
moderation_latency(null)
generation_time45950
tokens_prompt321
tokens_completion1946
native_tokens_prompt370
native_tokens_completion1817
native_tokens_completion_images(null)
native_tokens_reasoning1555
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0032032
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"ab7d775b-3867-4481-a73f-8d97c992f037"
is_byokfalse
latency106
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971628-hsRn7078pWJ91B7ZovJU"
upstream_id"ab7d775b-3867-4481-a73f-8d97c992f037"
total_cost0.0032032
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Sì? Mi dica."
detectedLang"yo"
heavyLang"it"
scores
yo0.7734138972809668
it0.7330960854092526
sl0.5508982035928144
es0.5398773006134969
hu0.53125
ro0.53125
cs0.5222929936305732
sk0.5222929936305732
hr0.5098039215686274
pl0.5098039215686274
tr0.4897959183673469
ca0.46428571428571425
fr0.46428571428571425
reliabletrue
passestrue
1
name"Hunter"
dialogue"Detective Hunter. Mind if I ask you a few questions about the recent disappearances in town?"
detectedLang"en"
heavyLang"en"
scores
en0.815422477440525
fr0.6525990735975296
it0.5991686460807601
tl0.5884146341463414
ca0.5833333333333334
nl0.5502998001332444
ro0.5487967914438503
pt0.5433017591339648
sv0.5395634379263302
da0.4453574363188167
es0.4435284418796373
cs0.4407622203811102
no0.4094488188976378
sq0.3924392439243924
sl0.3907942238267148
yo0.37267657992565056
de0.36380772855796417
pl0.3626062322946175
hr0.36079545454545453
ms0.3559160305343511
sk0.3427458617332035
hu0.3154158215010142
az0.24327354260089684
et0.2407199100112486
lt0.23556058890147225
lv0.23469387755102045
tr0.23382519863791143
is0.16974169741697415
vi0.1646039603960396
be0.09395973154362416
eu0.09395973154362416
fi0.08536585365853659
uk0.08536585365853659
reliabletrue
passestrue
2
name"Isabella"
dialogue"Mi dispiace, non parlo inglese. Solo italiano."
detectedLang"it"
heavyLang"it"
scores
it0.798636926889715
es0.7113676731793961
pt0.5896464646464646
fr0.5554035567715458
sk0.4969040247678019
ro0.49455676516329705
ca0.4881889763779528
en0.48083067092651754
sq0.468954248366013
yo0.4610281923714759
cs0.45652173913043476
sl0.40909090909090906
pl0.4036697247706422
hr0.38095238095238093
de0.375
tr0.36893203883495146
hu0.3186582809224318
et0.3010752688172043
az0.28414096916299564
lt0.2793791574279379
nl0.2793791574279379
ms0.27293064876957496
no0.27293064876957496
da0.26636568848758463
sv0.26636568848758463
eu0.2111650485436893
tl0.1875
fi0.15364583333333331
lv0.15364583333333331
reliabletrue
passestrue
3
name"Hunter"
dialogue"You don't speak English. Of course. Okay. Disappearances. Missing people."
detectedLang"en"
heavyLang"en"
scores
en0.8045347928068803
tl0.6268656716417911
fr0.5387453874538745
nl0.4487320837927233
ms0.358974358974359
no0.3412384716732542
is0.32523616734143057
de0.31224209078404397
pt0.3112947658402204
ca0.3084370677731674
da0.29676511954992973
sv0.251497005988024
ro0.2401215805471125
it0.2331288343558282
yo0.1843393148450245
sq0.1624790619765494
es0.15110356536502548
cs0.13494809688581316
fi0.13494809688581316
lv0.1289198606271777
hr0.12587412587412586
az0.11504424778761062
et0.11504424778761062
reliabletrue
passestrue
4
name"Isabella"
dialogue"Scomparsi? Sì, ho sentito parlare. È spaventoso."
detectedLang"it"
heavyLang"it"
scores
it0.7895077720207254
no0.5566166439290586
ca0.5303468208092486
yo0.48494453248811414
ro0.4741100323624596
da0.4025735294117647
fr0.3992606284658041
pt0.3992606284658041
es0.39478584729981375
en0.3879472693032015
sk0.35770750988142297
lt0.35000000000000003
cs0.34210526315789475
sv0.33264887063655035
ms0.30851063829787234
de0.29653679653679654
nl0.2919389978213508
az0.2903930131004367
sq0.2903930131004367
tr0.27293064876957496
eu0.20537897310513448
hu0.1709183673469388
pl0.1709183673469388
et0.16237113402061853
fi0.16237113402061853
hr0.16237113402061853
sl0.16237113402061853
tl0.16237113402061853
lv0.15364583333333331
reliabletrue
passestrue
5
name"Hunter"
dialogue"With your camera, maybe?"
detectedLang"en"
heavyLang"en"
scores
en0.7875354107648725
ms0.6031746031746031
tl0.6031746031746031
it0.512987012987013
ro0.512987012987013
ca0.40476190476190477
es0.39759036144578314
sv0.35344827586206895
fr0.336283185840708
nl0.336283185840708
de0.32432432432432434
reliabletrue
passestrue
6
name"Isabella"
dialogue"Le foto... sì. Ieri al tramonto, stavo fotografando il vecchio mulino fuori città. C'era qualcuno nei boschi... una figura. E poi, niente."
detectedLang"it"
heavyLang"it"
scores
it0.8036784459599091
es0.5943637916310845
ro0.5484790874524715
pt0.5158002038735984
ca0.5087900723888314
fr0.4583808437856328
no0.4164619164619165
de0.41212871287128716
da0.38311688311688313
sl0.37376400791034936
nl0.36241610738255037
sq0.3546195652173913
tl0.3466299862448418
lt0.33239634574841886
sk0.32239657631954355
yo0.2983751846381093
cs0.2803030303030303
hr0.2652745552977572
lv0.2537313432835821
en0.23817161186848435
tr0.22952149229521493
pl0.21939194741166804
et0.20435510887772196
az0.19966301600673966
ms0.19627749576988157
sv0.16003536693191867
hu0.15555555555555556
eu0.15480427046263345
fi0.14645103324348607
is0.1316270566727605
reliabletrue
passestrue
7
name"Hunter"
dialogue"Photos? Woods? Show me."
detectedLang"en"
heavyLang"en"
scores
en0.7893258426966292
tl0.6503496503496503
fr0.6453900709219859
pt0.620253164556962
nl0.6073298429319371
es0.5481927710843374
sq0.49664429530201337
et0.3877551020408163
no0.3775933609958506
sl0.3697478991596639
ms0.358974358974359
it0.34782608695652173
lt0.34782608695652173
hi0.33920704845814975
fi0.3333333333333333
ca0.3212669683257918
de0.3212669683257918
lv0.3212669683257918
reliabletrue
passestrue
8
name"Isabella"
dialogue"Non so se dovrei... sembrava in pericolo. Ho chiamato, ma non ha risposto."
detectedLang"it"
heavyLang"it"
scores
it0.796983758700696
ro0.599236641221374
ca0.5796637309847879
sl0.5366284201235658
pt0.5047169811320754
hr0.48224852071005914
tl0.4755244755244755
fr0.46862348178137647
no0.467005076142132
en0.4491080797481637
es0.44208289054197664
ms0.4360902255639098
yo0.4318181818181818
cs0.43058568329718006
sk0.4211686879823594
sv0.41666666666666663
fi0.3823529411764706
lt0.3429286608260325
de0.33879093198992444
sq0.32605905006418484
et0.3234536082474227
nl0.29435483870967744
hu0.279835390946502
pl0.26675977653631283
vi0.25213675213675213
da0.22794117647058826
eu0.14215686274509806
az0.13793103448275862
lv0.10102739726027396
tr0.10102739726027396
reliabletrue
passestrue
9
name"Hunter"
dialogue"I have to go. Don't leave town. I'll be back with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8183760683760685
tl0.5933014354066986
pl0.5897683397683398
da0.579624134520277
yo0.5549738219895288
hr0.5360262008733625
no0.5131729667812142
lt0.5017584994138335
cs0.5011737089201878
sk0.48296836982968366
ro0.4785276073619632
sq0.4537275064267352
ca0.4509043927648579
hu0.4444444444444444
sl0.4378306878306878
lv0.4310575635876841
sv0.43029490616621985
it0.4162087912087912
pt0.39801699716713884
ms0.380466472303207
et0.36661698956780925
vi0.34210526315789475
tr0.33070866141732286
es0.32965299684542587
de0.3210862619808307
nl0.32
fr0.3167202572347267
az0.3111831442463533
is0.24511545293072823
eu0.24377224199288253
be0.1414141414141414
fi0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
10
name"Isabella"
dialogue"Aspetti! Ho la foto! La persona nei boschi... assomigliava a una delle ragazze scomparse!"
detectedLang"it"
heavyLang"it"
scores
it0.7975352112676056
ca0.6472392638036809
es0.6117488183659688
fr0.5313773431132844
ro0.515993265993266
no0.5122985581000848
tl0.45652173913043476
pt0.43125618199802174
de0.4180161943319838
sk0.3947368421052632
en0.39345991561181426
sq0.39345991561181426
cs0.3823845327604726
da0.35825892857142855
et0.3443557582668187
is0.33679354094579006
nl0.3321718931475029
lv0.3298368298368299
lt0.31952662721893493
fi0.3187203791469194
ms0.2866004962779156
hr0.2857142857142857
pl0.2830423940149626
tr0.2776381909547738
hu0.2758186397984887
yo0.2684478371501272
sl0.22506738544474394
eu0.21875
vi0.21124828532235942
sv0.20689655172413793
az0.18323863636363635
reliabletrue
passestrue
11
name"Hunter"
dialogue"I don't understand! Just stay put!"
detectedLang"en"
heavyLang"en"
scores
en0.809322033898305
sv0.6671597633136095
no0.6626686656671664
da0.6616541353383458
hr0.5398773006134969
ca0.4886363636363637
pl0.4755244755244755
de0.4617224880382775
cs0.45652173913043476
nl0.44168734491315137
et0.4230769230769231
ro0.42159383033419023
sk0.41709844559585496
tl0.39189189189189183
is0.3784530386740331
sq0.3732590529247911
it0.3382352941176471
yo0.27884615384615385
be0.23728813559322032
tr0.23728813559322032
hu0.22945205479452058
az0.21875
lt0.21875
lv0.21875
uk0.21875
vi0.21875
reliabletrue
passestrue