Run: 2026-02-24-01KJ8W3STARM5ARXCRQK05GMTQ

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
49.3s
Cost:
$0.003482
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Voice Sheet: Melanie: "Entschuldigung? Ich verstehe nicht." [Sorry? I don't understand.] Hunter: "You don't speak English? Great. I'm investigating a disappearance. Were you out taking pictures last night?" Melanie: "Ich war gestern Abend am Fluss. Ich habe Fotos gemacht." [I was at the river last night. I took photos.] Hunter: "The river? Did you see anything unusual? Anyone?" Melanie: "Ich habe etwas gesehen... auf den Fotos. Etwas... seltsam." [I saw something... in the photos. Something... strange.] Hunter: "What is it? What did you see?" Melanie: "Da ist eine Gestalt... im Nebel. Ich glaube, es war eine Person." [There is a figure... in the fog. I think it was a person.] Hunter: "A person? Can you show me where?" Melanie: "Am alten Bootshaus. Aber es war dunkel." [At the old boathouse. But it was dark.] Hunter: "The old boathouse? Okay. I need to take a look at those photos. Can I...?" (His phone rings.) "Hold on." (Into phone) "Hunter. Yeah? Where? I'm on my way." (To Melanie) "I have to go. Stay here. I'll find you later."
created_at"2026-02-24T22:25:29.938Z" 2/24/2026, 10:25:29 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2177
moderation_latency(null)
generation_time49208
tokens_prompt319
tokens_completion2170
native_tokens_prompt370
native_tokens_completion1991
native_tokens_completion_images(null)
native_tokens_reasoning1891
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0034816
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"c250ce55-ac81-4e3a-8c25-fb52cde1bcba"
is_byokfalse
latency351
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971929-4W3jBKPRQLHOKgiMgYnu"
upstream_id"c250ce55-ac81-4e3a-8c25-fb52cde1bcba"
total_cost0.0034816
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Entschuldigung? Ich verstehe nicht."
detectedLang"de"
heavyLang"de"
scores
de0.8314950980392156
nl0.6137640449438203
sk0.31077694235588976
pl0.2948717948717949
ms0.289405684754522
cs0.26666666666666666
lt0.21875
hu0.207492795389049
it0.207492795389049
is0.19590643274853803
en0.1863905325443787
es0.1863905325443787
fr0.1863905325443787
no0.1863905325443787
pt0.1863905325443787
az0.17664670658682635
ca0.17664670658682635
ro0.17664670658682635
sq0.17664670658682635
sv0.17664670658682635
reliabletrue
passestrue
1
name"Hunter"
dialogue"You don't speak English? Great. I'm investigating a disappearance. Were you out taking pictures last night?"
detectedLang"en"
heavyLang"en"
scores
en0.8102590944778854
tl0.6554182509505704
fr0.5385105028644176
ro0.5156980627922512
nl0.4972260748959778
no0.47080291970802923
de0.46651949963208245
pt0.43972179289026275
it0.40230832646331405
sv0.39834024896265563
da0.39784053156146176
ca0.3845500848896435
hr0.3813993174061433
et0.3766122098022356
cs0.35954063604240283
sk0.3544078361531611
ms0.34802158273381295
sl0.3255813953488372
es0.3217960710944809
sq0.3062200956937799
is0.2814667988107037
yo0.2579324462640737
lv0.2352320675105485
pl0.22542735042735043
lt0.2229367631296892
fi0.21790722761596548
az0.2059145673603505
tr0.18355855855855857
hu0.17707150964812712
eu0.0880503144654088
vi0.0880503144654088
reliabletrue
passestrue
2
name"Melanie"
dialogue"Ich war gestern Abend am Fluss. Ich habe Fotos gemacht."
detectedLang"de"
heavyLang"de"
scores
de0.8113207547169812
nl0.5813397129186603
en0.5185694635488307
ro0.42716857610474634
pt0.4006849315068493
es0.38917975567190227
ca0.38596491228070173
sk0.35304990757855825
pl0.3320610687022901
fr0.3137254901960784
sv0.30966469428007887
it0.2985971943887776
lt0.29006085192697767
lv0.2768595041322314
hi0.19908466819221968
is0.18604651162790697
ms0.1822429906542056
tl0.18032786885245902
tr0.16666666666666666
cs0.1606714628297362
hr0.1606714628297362
sl0.1606714628297362
et0.15254237288135594
sq0.15254237288135594
az0.14425427872860636
da0.14425427872860636
no0.14425427872860636
reliabletrue
passestrue
3
name"Hunter"
dialogue"The river? Did you see anything unusual? Anyone?"
detectedLang"en"
heavyLang"en"
scores
en0.8107163657542223
tl0.6289954337899544
et0.4583333333333333
ms0.417562724014337
da0.38446969696969696
no0.36399217221135033
yo0.358974358974359
sq0.3538767395626242
sv0.3460764587525151
ca0.33537832310838445
pt0.3257261410788381
es0.3186582809224318
fr0.3143459915611814
it0.21875
nl0.20537897310513448
cs0.1935483870967742
de0.1792929292929293
reliabletrue
passestrue
4
name"Melanie"
dialogue"Ich habe etwas gesehen... auf den Fotos. Etwas... seltsam."
detectedLang"de"
heavyLang"de"
scores
de0.8226950354609929
et0.4827586206896552
eu0.4434137291280148
nl0.4318181818181818
da0.4117647058823529
no0.40828402366863903
sv0.40828402366863903
sk0.3890020366598778
pl0.3670886075949367
cs0.3492407809110629
es0.3227990970654628
lt0.3227990970654628
pt0.3227990970654628
ca0.3087557603686636
lv0.3087557603686636
fi0.22680412371134018
fr0.21052631578947367
en0.19137466307277629
tr0.1891891891891892
hr0.18256130790190736
sl0.18256130790190736
it0.17355371900826447
sq0.17355371900826447
az0.16434540389972147
ro0.16434540389972147
reliabletrue
passestrue
5
name"Hunter"
dialogue"What is it? What did you see?"
detectedLang"en"
heavyLang"en"
scores
en0.8517786561264822
yo0.5664739884393063
et0.53125
nl0.5145631067961165
hu0.506578947368421
tl0.506578947368421
is0.38016528925619836
lv0.3644067796610169
sq0.3644067796610169
cs0.34210526315789475
reliabletrue
passestrue
6
name"Melanie"
dialogue"Da ist eine Gestalt... im Nebel. Ich glaube, es war eine Person."
detectedLang"de"
heavyLang"de"
scores
de0.8054979253112033
no0.5404411764705882
es0.50199203187251
sk0.49118046132971505
pt0.4863013698630137
pl0.471830985915493
da0.4695898161244696
ca0.4627507163323783
en0.43009118541033436
it0.4292237442922375
hr0.42660550458715596
tr0.4113029827315541
lt0.410377358490566
sv0.410377358490566
ro0.3718592964824121
is0.36332767402376914
tl0.34895833333333337
lv0.34210526315789475
nl0.31066176470588236
az0.3055555555555556
hu0.3055555555555556
fr0.3042671614100185
sq0.2829827915869981
cs0.28023032629558536
eu0.24849699398797598
sl0.24698795180722888
hi0.2203742203742204
ms0.19006479481641467
yo0.16666666666666666
vi0.14383561643835618
et0.1359447004608295
reliabletrue
passestrue
7
name"Hunter"
dialogue"A person? Can you show me where?"
detectedLang"en"
heavyLang"en"
scores
en0.819277108433735
sq0.6646795827123696
pt0.6631736526946107
tl0.6341463414634145
es0.5886654478976234
no0.5863970588235294
nl0.576271186440678
ca0.5738636363636364
it0.5656370656370656
fr0.5647969052224371
de0.563953488372093
cs0.5445344129554657
ms0.5108695652173912
sv0.5054945054945055
ro0.49776785714285715
tr0.4955156950672646
da0.4943820224719101
hu0.49324324324324326
et0.49095022624434387
is0.48156682027649766
az0.4779582366589328
sk0.45652173913043476
sl0.44168734491315137
hr0.4318181818181818
pl0.42159383033419023
lt0.4063324538258575
lv0.39189189189189183
fi0.38016528925619836
yo0.34593023255813954
eu0.23728813559322032
vi0.23728813559322032
reliabletrue
passestrue
8
name"Melanie"
dialogue"Am alten Bootshaus. Aber es war dunkel."
detectedLang"de"
heavyLang"de"
scores
de0.799416484318016
en0.5009074410163339
no0.4376278118609407
ca0.43298969072164945
es0.42827442827442824
ro0.40860215053763443
nl0.34679334916864607
sv0.3325242718446602
da0.3309002433090025
lv0.3037974683544304
hu0.27055702917771884
lt0.2486338797814208
hi0.2403314917127072
pt0.19590643274853803
fr0.17664670658682635
it0.17664670658682635
ms0.17664670658682635
sk0.17664670658682635
sl0.17664670658682635
tr0.17664670658682635
reliabletrue
passestrue
9
name"Hunter"
dialogue"I have to go. Stay here. I'll find you later."
detectedLang"en"
heavyLang"en"
scores
en0.8164218958611482
da0.6798603026775321
pl0.6180555555555556
tl0.585843373493976
no0.5564516129032259
cs0.533106960950764
yo0.5225694444444445
hr0.4811320754716981
sq0.45972495088408644
sv0.44889779559118237
nl0.4318181818181818
sk0.4258872651356994
lv0.40217391304347827
lt0.3778280542986425
de0.36194895591647336
ca0.3341404358353511
sl0.3055555555555556
it0.2948717948717949
ro0.24657534246575344
hi0.21652421652421652
fr0.20520231213872833
pt0.20520231213872833
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
vi0.1863905325443787
reliabletrue
passestrue