Run: 2026-02-24-01KJ8V8K99HBQQDB7WW48P0PT8

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
27.4s
Cost:
$0.002145
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
62.50% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Haan, main wahan thi. Lekin maine kuch aisa nahi dekha jisse aapko madad mile." (Yes, I was there. But I didn't see anything that would help you.) Hunter: "I'm sorry, I don't understand. Do you speak English?" Selvi: "Mujhe dar lag raha hai. Mainne kuch ajeeb dekha... ek aadmi... usne mujhe dekh liya." (I'm scared. I saw something strange... a man... he saw me.) Hunter: "Look, I need to know if you saw anything unusual. Can you show me your photos?" Selvi: "Wohi aadmi hai. Main use clear se capture nahi kar payi." (That's the man. I couldn't capture him clearly.) Hunter: "I wish I knew what you were saying." [Phone rings] Hunter: "Hunter... What? Another one? Where? I'm on my way." Hunter: "I have to go. Thank you for your time. I'll... I'll find someone who can translate."
created_at"2026-02-24T22:10:38.512Z" 2/24/2026, 10:10:38 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2017
moderation_latency(null)
generation_time27349
tokens_prompt315
tokens_completion1228
native_tokens_prompt371
native_tokens_completion1155
native_tokens_completion_images(null)
native_tokens_reasoning1016
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0021448
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"9c1f7faa-37a2-43a5-b443-0096c1fb7c9a"
is_byokfalse
latency111
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971038-87xWnmEBjO4rLm7MaMQh"
upstream_id"9c1f7faa-37a2-43a5-b443-0096c1fb7c9a"
total_cost0.0021448
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
62.50% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Haan, main wahan thi. Lekin maine kuch aisa nahi dekha jisse aapko madad mile."
detectedLang"fr"
heavyLang"tl"
scores
fr0.43058568329718006
et0.4230769230769231
tl0.39724454649827784
fi0.396551724137931
de0.37796208530805686
eu0.37275985663082434
en0.33290978398983484
ms0.31640625
vi0.22794117647058826
ro0.21875
pt0.16798732171156894
sv0.16666666666666666
da0.15730337078651685
no0.15730337078651685
is0.1435562805872757
lv0.1435562805872757
it0.13651315789473684
reliablefalse
passesfalse
1
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.5161290322580645
pl0.4806094182825485
hr0.4688385269121813
sk0.438622754491018
de0.4140625
pt0.40570522979397783
sq0.4009584664536741
ro0.3862520458265139
it0.3644067796610169
nl0.3218806509945751
vi0.3169398907103825
yo0.3055555555555556
ca0.2690058479532163
is0.267578125
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
2
name"Selvi"
dialogue"Mujhe dar lag raha hai. Mainne kuch ajeeb dekha... ek aadmi... usne mujhe dekh liya."
detectedLang"de"
heavyLang"et"
scores
de0.32239657631954355
et0.309593023255814
no0.2994100294985251
ro0.29629629629629634
nl0.2714723926380368
fi0.2692307692307693
sv0.26356589147286824
vi0.24841772151898736
lt0.2096505823627288
tr0.1908006814310051
it0.1739130434782609
es0.16373239436619716
pt0.16373239436619716
fr0.16225749559082892
en0.15630550621669628
lv0.15630550621669628
tl0.14721723518850988
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Look, I need to know if you saw anything unusual. Can you show me your photos?"
detectedLang"en"
heavyLang"en"
scores
en0.8115827052756843
tl0.5548266166822867
ms0.4674887892376681
et0.4583808437856328
sq0.4457409568261376
no0.42073170731707316
pt0.40401505646173147
cs0.39797211660329534
ca0.37582128777923784
fr0.3649732620320856
pl0.3546195652173913
es0.3528610354223433
lv0.35020519835841313
hr0.3493150684931507
lt0.34210526315789475
da0.3384401114206128
sv0.3338008415147265
nl0.32814710042432815
yo0.32045779685264664
sl0.3055555555555556
sk0.3004418262150221
it0.291044776119403
tr0.23633440514469453
az0.22764227642276424
ro0.1592920353982301
hi0.1394927536231884
fi0.13636363636363635
de0.13003663003663005
be0.12844036697247707
hu0.12361623616236161
is0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
4
name"Selvi"
dialogue"Wohi aadmi hai. Main use clear se capture nahi kar payi."
detectedLang"en"
heavyLang"tl"
scores
en0.6621621621621622
fr0.5238095238095238
sl0.5125348189415042
es0.4664634146341463
it0.4470774091627172
hr0.3848857644991213
pt0.35779816513761464
sq0.3433395872420263
yo0.3371212121212121
ca0.32950191570881227
eu0.32038834951456313
vi0.30966469428007887
de0.2985971943887776
cs0.279835390946502
ro0.25531914893617025
fi0.22566371681415928
tr0.2222222222222222
da0.2081447963800905
sv0.19724770642201836
tl0.18604651162790697
no0.1764705882352941
reliabletrue
passesfalse
5
name"Hunter"
dialogue"I wish I knew what you were saying."
detectedLang"en"
heavyLang"en"
scores
en0.8341625207296849
tl0.5584988962472406
cs0.47780678851174935
tr0.4594594594594595
no0.42028985507246375
da0.41002949852507375
hr0.41002949852507375
ca0.40828402366863903
sv0.40828402366863903
sq0.40119760479041916
pl0.38650306748466257
it0.36507936507936506
ro0.3103448275862069
yo0.30313588850174217
sk0.2647058823529412
be0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passestrue
6
name"Hunter"
dialogue"Hunter... What? Another one? Where? I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8326826547685443
tl0.5792426367461431
pl0.46714031971580816
fr0.37629937629937626
hr0.3684210526315789
de0.3562231759656652
cs0.3492407809110629
sk0.3492407809110629
da0.34782608695652173
ca0.34497816593886466
et0.33920704845814975
fi0.3333333333333333
sq0.3135011441647597
es0.25
hi0.21875
no0.20634920634920634
yo0.2
sv0.1891891891891892
it0.17355371900826447
nl0.17355371900826447
pt0.17355371900826447
ms0.16434540389972147
ro0.16434540389972147
sl0.16434540389972147
tr0.16434540389972147
reliabletrue
passestrue
7
name"Hunter"
dialogue"I have to go. Thank you for your time. I'll... I'll find someone who can translate."
detectedLang"en"
heavyLang"en"
scores
en0.8195288753799391
da0.6236133122028527
tl0.6031746031746031
no0.5681818181818181
hr0.5010504201680672
pl0.48030634573304154
cs0.4398584905660377
pt0.40846824408468246
yo0.38788659793814434
vi0.38391699092088194
ca0.3790849673202614
sk0.35983827493261455
ro0.3510928961748634
it0.3475274725274725
lv0.3466299862448418
lt0.3300423131170663
tr0.3065693430656934
sq0.302496328928047
az0.2952522255192878
sv0.2931547619047619
sl0.27480916030534347
es0.24603174603174602
ms0.2238562091503268
et0.20435510887772196
fr0.14414414414414414
be0.12844036697247707
de0.12361623616236161
eu0.12361623616236161
hu0.12361623616236161
is0.1171003717472119
nl0.1171003717472119
uk0.1171003717472119
reliabletrue
passestrue