Run: 2026-02-24-01KJ8VHPCHJ4CDVBCKQJF87TTF

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
1m 3s
Cost:
$0.004771
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Melanie: "Entschuldigung, ich verstehe nicht. Sprechen Sie Deutsch?" Hunter: "I'm sorry, I don't speak German. Do you speak English?" Melanie: "Nein, nur Deutsch. Was ist passiert? Ich habe gehört, dass jemand vermisst wird. Es ist beunruhigend." Hunter: "I can't understand you. Look, I just need to know if you saw anything unusual yesterday by the river. You have a camera; maybe you captured something." Melanie: "Meine Kamera... ich habe viele Bilder gemacht. Aber ich habe nichts Ungewöhnliches gesehen. Nur die Landschaft. Jetzt bin ich besorgt." Hunter: "This isn't working. Do you have a friend who can translate?" Melanie: "Ich weiß nicht, was ich tun soll. Vielleicht kann ich die Fotos zeigen?" Hunter: "Photos? Yes, show me the photos." Hunter: "This one here, by the old oak tree. Do you remember seeing anyone there?" Melanie: "Dort? Ich erinnere mich an einen Mann, der spazieren ging. Aber er war allein. Es war nichts Besonderes." Hunter: "A man? Can you describe him?" Melanie: "Er trug eine braune Jacke und eine Mütze. Ich habe nicht genau hingesehen." Hunter: "Hold on. Hunter... What? Where? I'll be right there. I have to go. Thank you for your time. I'll need to talk to you again with a translator." Melanie: "Auf Wiedersehen. Ich hoffe, Sie finden die vermisste Person."
created_at"2026-02-24T22:15:36.601Z" 2/24/2026, 10:15:36 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2068
moderation_latency(null)
generation_time63271
tokens_prompt319
tokens_completion3008
native_tokens_prompt370
native_tokens_completion2797
native_tokens_completion_images(null)
native_tokens_reasoning2671
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0047712
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"11c0b8c0-b3b4-4194-bfb4-83cd6627a842"
is_byokfalse
latency99
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971336-LOGHSWjmY5BwQDy6ptGI"
upstream_id"11c0b8c0-b3b4-4194-bfb4-83cd6627a842"
total_cost0.0047712
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Entschuldigung, ich verstehe nicht. Sprechen Sie Deutsch?"
detectedLang"de"
heavyLang"de"
scores
de0.8372271160474913
nl0.5473908413205538
pl0.34815950920245403
sk0.3122977346278317
lt0.28209459459459457
sv0.2796610169491525
ca0.2722602739726028
da0.256993006993007
it0.24911660777385158
no0.247787610619469
is0.24242424242424243
en0.236983842010772
ms0.2085661080074488
sl0.20560747663551404
cs0.1904761904761905
hr0.1533864541832669
hu0.1448692152917505
es0.1290983606557377
fr0.1290983606557377
pt0.1290983606557377
az0.121900826446281
ro0.121900826446281
sq0.121900826446281
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm sorry, I don't speak German. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.798503166378814
tl0.5911214953271028
hr0.48604992657856094
ro0.47994056463595847
sq0.47839046199701935
cs0.47447447447447455
it0.460708782742681
sv0.4444444444444444
pl0.4345718901453958
pt0.42244224422442245
no0.3934142114384749
ca0.38811188811188807
da0.3761140819964349
sk0.36823104693140796
vi0.3320610687022901
yo0.32038834951456313
de0.29577464788732394
ms0.2886178861788618
tr0.2857142857142857
az0.2753623188405797
sl0.25531914893617025
nl0.1822429906542056
be0.16666666666666666
es0.16666666666666666
hu0.1606714628297362
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
reliabletrue
passestrue
2
name"Melanie"
dialogue"Nein, nur Deutsch. Was ist passiert? Ich habe gehört, dass jemand vermisst wird. Es ist beunruhigend."
detectedLang"de"
heavyLang"de"
scores
de0.8115199034981907
nl0.4885433715220949
ca0.40926275992438566
en0.39379243452958296
sv0.34963579604578565
tr0.3124312431243124
it0.31015452538631344
fr0.2985409652076319
no0.2905788876276958
ms0.28815489749430523
da0.2857142857142857
pt0.284077892325315
yo0.21875
es0.19041450777202074
et0.17654808959156787
sk0.16555407209612816
lv0.1610738255033557
pl0.15540540540540537
az0.15081521739130435
hi0.14500683994528044
hu0.14030261348005504
lt0.1270949720670391
tl0.10968660968660969
ro0.10714285714285714
fi0.0994236311239193
is0.09420289855072464
reliabletrue
passestrue
3
name"Hunter"
dialogue"I can't understand you. Look, I just need to know if you saw anything unusual yesterday by the river. You have a camera; maybe you captured something."
detectedLang"en"
heavyLang"en"
scores
en0.8071309424520434
da0.5485602733040508
sv0.5040214477211796
no0.48725055432372505
tl0.4662435083669937
ca0.45266272189349116
cs0.4167717528373266
nl0.4009067357512954
et0.38209752839011357
pl0.3779421654337592
sk0.37668463611859837
es0.36730506155950754
yo0.3620689655172413
fr0.3508771929824561
it0.3458274398868458
de0.3392857142857143
ms0.3359655419956928
ro0.33261183261183264
pt0.3277616279069767
sq0.293353705118411
hr0.28405572755417957
lv0.21610169491525424
lt0.2120954003407155
hu0.19425087108013936
is0.1864555848724714
sl0.1857394366197183
tr0.13712686567164178
az0.12570888468809074
vi0.12570888468809074
be0.07035175879396985
eu0.07035175879396985
fi0.06376518218623482
uk0.06376518218623482
reliabletrue
passestrue
4
name"Melanie"
dialogue"Meine Kamera... ich habe viele Bilder gemacht. Aber ich habe nichts Ungewöhnliches gesehen. Nur die Landschaft. Jetzt bin ich besorgt."
detectedLang"de"
heavyLang"de"
scores
de0.8241371730050561
nl0.6146435452793835
no0.4038748137108793
sv0.39439818319454956
ms0.3735317149569303
da0.31565440547476475
eu0.27404718693284935
fr0.25925925925925924
sk0.250936329588015
en0.24457034938621341
tr0.2438563327032136
fi0.22405431619786614
tl0.21414538310412573
pl0.21337266470009833
is0.1935483870967742
cs0.1811668372569089
es0.1794871794871795
it0.15522703273495247
ro0.15522703273495247
az0.13232104121475055
ca0.1130820399113082
et0.1031390134529148
sq0.0990990990990991
yo0.0990990990990991
hr0.08779931584948689
ru0.08466819221967964
sl0.07940161104718067
reliabletrue
passestrue
5
name"Hunter"
dialogue"This isn't working. Do you have a friend who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8203861697350696
tl0.6658312447786132
pt0.5277449822904369
nl0.51278928136419
cs0.5012468827930174
hr0.4805194805194805
sk0.4482758620689655
pl0.4428969359331476
ro0.43342776203966005
de0.42938659058487877
no0.42363112391930835
ca0.4186046511627907
da0.41348973607038125
sl0.4020926756352765
vi0.4020926756352765
fr0.40119760479041916
it0.39668174962292607
sq0.394856278366112
tr0.35170178282009723
es0.34318555008210183
az0.33993399339933994
yo0.32998324958123953
sv0.3254637436762226
hu0.2805755395683453
lt0.27140255009107467
is0.2673992673992674
eu0.25512104283054005
lv0.25512104283054005
et0.23371647509578544
ms0.23371647509578544
fi0.13606911447084233
reliabletrue
passestrue
6
name"Melanie"
dialogue"Ich weiß nicht, was ich tun soll. Vielleicht kann ich die Fotos zeigen?"
detectedLang"de"
heavyLang"de"
scores
de0.8371335504885994
nl0.6306555863342567
yo0.4186046511627907
fi0.37791601866251945
no0.36908517350157727
en0.355877616747182
es0.35379644588045234
sk0.32318104906937395
pl0.30313588850174217
sv0.3019197207678883
cs0.2945326278659612
lt0.26335174953959484
pt0.26335174953959484
ca0.250936329588015
lv0.250936329588015
ms0.18032786885245902
fr0.16666666666666666
is0.16317991631799164
tr0.14893617021276595
hr0.14346895074946467
sl0.14346895074946467
et0.13606911447084233
it0.13606911447084233
sq0.13606911447084233
az0.12854030501089325
da0.12854030501089325
ro0.12854030501089325
reliabletrue
passestrue
7
name"Hunter"
dialogue"Photos? Yes, show me the photos."
detectedLang"en"
heavyLang"en"
scores
en0.808673469387755
fr0.7005988023952096
nl0.6781115879828327
tl0.6535796766743649
pt0.620253164556962
sq0.601063829787234
no0.5535714285714286
es0.5481927710843374
ms0.5192307692307693
yo0.4163424124513619
et0.3877551020408163
sl0.3697478991596639
it0.34782608695652173
lt0.34782608695652173
da0.34210526315789475
sv0.34210526315789475
hi0.33920704845814975
fi0.3333333333333333
ca0.3212669683257918
de0.3212669683257918
lv0.3212669683257918
reliabletrue
passestrue
8
name"Hunter"
dialogue"This one here, by the old oak tree. Do you remember seeing anyone there?"
detectedLang"en"
heavyLang"en"
scores
en0.8212269476853594
tl0.6054817275747508
sk0.4546498277841562
yo0.4405182567726737
sq0.4398584905660377
pl0.42284325637910086
cs0.4186046511627907
de0.4128553770086526
da0.40550688360450565
nl0.36241610738255037
no0.35983827493261455
ms0.3457300275482094
sl0.343015214384509
sv0.32432432432432434
hr0.3035190615835778
fr0.2725880551301685
hu0.2714723926380368
pt0.24722662440570525
is0.2448330683624801
vi0.18941979522184302
et0.1410488245931284
reliabletrue
passestrue
9
name"Melanie"
dialogue"Dort? Ich erinnere mich an einen Mann, der spazieren ging. Aber er war allein. Es war nichts Besonderes."
detectedLang"de"
heavyLang"de"
scores
de0.8282694848084543
nl0.6043822276323798
no0.5703899537343027
da0.5343839541547278
fr0.3902439024390244
is0.3387589013224822
ro0.33537832310838445
en0.32920536635706915
eu0.32920536635706915
ca0.32642487046632124
es0.32642487046632124
it0.3200836820083682
et0.27616926503340755
fi0.2562929061784897
tl0.2554410080183276
lv0.2215568862275449
hu0.22062350119904073
tr0.19950738916256158
sq0.19053549190535493
sk0.16020671834625322
pl0.15032679738562094
vi0.14361001317523056
cs0.13333333333333333
yo0.12634408602150538
lt0.12280701754385964
pt0.11202185792349727
ms0.10958904109589042
hr0.09090909090909091
reliabletrue
passestrue
10
name"Hunter"
dialogue"A man? Can you describe him?"
detectedLang"en"
heavyLang"en"
scores
en0.8220640569395018
es0.6850393700787402
ca0.6108949416342413
tl0.5525727069351231
pt0.5485327313769752
ro0.5475113122171946
cs0.5121951219512195
da0.5012468827930174
it0.49874686716791977
fr0.4884910485933504
sv0.48717948717948717
de0.47780678851174935
lv0.4708994708994709
lt0.46808510638297873
nl0.4594594594594595
no0.45054945054945056
hu0.43820224719101125
tr0.4350282485875706
az0.42363112391930835
sk0.3939393939393939
yo0.3730407523510972
hr0.358974358974359
pl0.3442622950819672
sl0.3103448275862069
is0.2727272727272727
sq0.2647058823529412
eu0.25925925925925924
vi0.25925925925925924
et0.23954372623574144
fi0.23954372623574144
ms0.23954372623574144
reliabletrue
passestrue
11
name"Melanie"
dialogue"Er trug eine braune Jacke und eine Mütze. Ich habe nicht genau hingesehen."
detectedLang"de"
heavyLang"de"
scores
de0.7941048981361075
is0.4099378881987578
nl0.3766404199475065
no0.3581081081081081
et0.2899850523168909
tl0.2813918305597579
da0.2647058823529412
az0.20833333333333331
sk0.2070116861435726
lt0.19763513513513514
eu0.19491525423728812
pl0.19491525423728812
ms0.18244406196213425
lv0.1810344827586207
cs0.1739130434782609
en0.1739130434782609
tr0.1739130434782609
fi0.15630550621669628
reliabletrue
passestrue
12
name"Hunter"
dialogue"Hold on. Hunter... What? Where? I'll be right there. I have to go. Thank you for your time. I'll need to talk to you again with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8269703058718463
tl0.6293639406982305
da0.5840042941492216
no0.5180348258706468
pl0.4727891156462585
yo0.4669876203576341
hr0.4610570236439499
cs0.42804428044280446
de0.41109422492401215
et0.41019786910197864
pt0.3987587276958883
ca0.3954758190327613
sq0.3873517786561265
sk0.3785084202085004
nl0.37399030694668817
fr0.3683781581092095
ro0.36683006535947715
lt0.3557772236076476
ms0.3393009377664109
sv0.3353344768439108
sl0.33476394849785407
it0.32077125328659073
vi0.32077125328659073
hu0.30493273542600896
lv0.2935278030993619
tr0.25766283524904215
fi0.21558704453441296
es0.21239837398373984
az0.19855222337125128
is0.15115005476451257
eu0.15021929824561403
hi0.09778812572759021
be0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
13
name"Melanie"
dialogue"Auf Wiedersehen. Ich hoffe, Sie finden die vermisste Person."
detectedLang"de"
heavyLang"de"
scores
de0.8263888888888888
nl0.5877788554801164
sv0.5454545454545454
da0.518140589569161
en0.48918269230769235
pl0.48856799037304455
no0.4348404255319149
tr0.40559440559440557
pt0.3988684582743989
it0.36661698956780925
sq0.3491577335375191
tl0.3359375
sk0.30098684210526316
fr0.29401993355481726
az0.2857142857142857
es0.28330522765598654
hu0.28209459459459457
ca0.2796610169491525
fi0.2697594501718213
is0.23971377459749554
et0.2314647377938517
eu0.21296296296296297
ms0.17153996101364524
yo0.17153996101364524
ro0.1650294695481336
lv0.15
lt0.1448692152917505
cs0.121900826446281
hr0.121900826446281
reliabletrue
passestrue