Run: 2026-02-24-01KJ8W9WNA63S5QZ5368RE3654

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
38.5s
Cost:
$0.002827
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
90.91% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
**Voice Sheet - Scene: Café in Alborn** **Characters:** - **Melanie:** 30-year-old German student, speaks only German, visibly shaken. - **Hunter:** 35-year-old detective, speaks only English, no-nonsense tone. **Dialogue:** Melanie: (looking up from her camera, confused) "Entschuldigung? Ich verstehe nicht. Sprechen Sie Deutsch?" Hunter: "Do you speak English? I'm Detective Hunter. I'm investigating the recent disappearances in town. Can I ask you a few questions?" Melanie: (shakes head nervously) "Nein, Englisch... ich kann nicht. Es tut mir leid." Hunter: (points to her camera) "Your camera. Have you been taking pictures around Alborn? Maybe you saw something... unusual." Melanie: (troubled, grips camera tighter) "Meine Kamera? Ja, ich habe viele Fotos gemacht. Aber... gestern im Wald... da war etwas... ich habe etwas Seltsames gesehen. Es macht mir Angst." Hunter: "In the woods? Which woods? Can you show me the pictures on that thing?" (Melanie begins navigating the camera menu, hands slightly trembling. Hunter's phone rings sharply.) Hunter: (answers call) "Hunter. ... Yeah. ... Where? ... On my way." (to Melanie, hurriedly) "I have to go. Stay right here. Do not leave. I'll be back with a translator." Melanie: (perplexed) "Was? Bleiben? Ich verstehe nicht... warten Sie!" Hunter: (already walking away, calls back) "Just stay put!" (End scene)
created_at"2026-02-24T22:28:49.458Z" 2/24/2026, 10:28:49 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1814
moderation_latency(null)
generation_time38485
tokens_prompt319
tokens_completion1724
native_tokens_prompt370
native_tokens_completion1582
native_tokens_completion_images(null)
native_tokens_reasoning1356
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0028272
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"5ad3c9c3-347b-48a3-9baf-53530628dc4e"
is_byokfalse
latency170
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771972129-uUE2Sn6l3rN1bCUzA96z"
upstream_id"5ad3c9c3-347b-48a3-9baf-53530628dc4e"
total_cost0.0028272
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
90.91% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"30-year-old German student, speaks only German, visibly shaken."
detectedLang"en"
heavyLang"en"
scores
en0.806432400238237
tl0.6835443037974683
nl0.5566166439290586
ro0.48083067092651754
sv0.4715447154471545
et0.459234608985025
ca0.43868739205526774
no0.4217081850533808
it0.4186046511627907
fr0.40909090909090906
sq0.39138576779026213
de0.3902439024390244
da0.3725868725868726
es0.32150313152400833
lt0.32150313152400833
lv0.32150313152400833
az0.30851063829787234
hr0.30703624733475476
cs0.30406852248394006
pl0.29653679653679654
sk0.28414096916299564
pt0.20537897310513448
ms0.17721518987341772
tr0.17721518987341772
hu0.15364583333333331
sl0.15364583333333331
reliabletrue
passesfalse
1
name"Hunter"
dialogue"35-year-old detective, speaks only English, no-nonsense tone."
detectedLang"en"
heavyLang"en"
scores
en0.7813411078717201
tl0.6505125815470643
ro0.5335820895522388
ca0.5265151515151516
it0.5167525773195877
es0.5155038759689923
pt0.5110821382007823
no0.4673295454545454
fr0.4292237442922375
de0.39418416801292405
hr0.3902439024390244
da0.3760399334442596
nl0.29906542056074764
et0.2704280155642024
sv0.2704280155642024
lv0.258893280632411
sq0.19871794871794873
sk0.19527896995708155
tr0.19006479481641467
fi0.17218543046357618
pl0.16666666666666666
cs0.1610738255033557
ms0.1610738255033557
sl0.1515837104072398
reliabletrue
passestrue
2
name"Melanie"
dialogue"Entschuldigung? Ich verstehe nicht. Sprechen Sie Deutsch?"
detectedLang"de"
heavyLang"de"
scores
de0.8372271160474913
nl0.5473908413205538
pl0.34815950920245403
sk0.3122977346278317
lt0.28209459459459457
sv0.2796610169491525
ca0.2722602739726028
da0.256993006993007
it0.24911660777385158
no0.247787610619469
is0.24242424242424243
en0.236983842010772
ms0.2085661080074488
sl0.20560747663551404
cs0.1904761904761905
hr0.1533864541832669
hu0.1448692152917505
es0.1290983606557377
fr0.1290983606557377
pt0.1290983606557377
az0.121900826446281
ro0.121900826446281
sq0.121900826446281
reliabletrue
passestrue
3
name"Hunter"
dialogue"Do you speak English? I'm Detective Hunter. I'm investigating the recent disappearances in town. Can I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.8077358063786474
fr0.6358183376178235
tl0.6225577264653641
pt0.5967741935483871
it0.5905587668593449
ro0.5857699805068226
ca0.5789995047052997
nl0.5545073375262054
sv0.5316804407713499
cs0.48328267477203646
hr0.4775660725261217
no0.46941323345817726
da0.46540880503144655
es0.4469746258945999
sl0.44408109875735774
sq0.44115713346482577
de0.4385733157199472
sk0.4225543478260869
ms0.4133885438233264
pl0.38271604938271603
yo0.36042136945071485
az0.3264659270998415
lt0.28209459459459457
tr0.24977934686672548
lv0.24578527062999111
is0.24511545293072823
et0.23076923076923078
vi0.22303473491773307
hu0.20782851817334574
fi0.12551440329218108
be0.07608695652173912
eu0.07608695652173912
uk0.06900328587075576
reliabletrue
passestrue
4
name"Melanie"
dialogue"Nein, Englisch... ich kann nicht. Es tut mir leid."
detectedLang"de"
heavyLang"de"
scores
de0.8288648031945237
nl0.5626822157434402
hr0.3644067796610169
no0.34782608695652173
ca0.3288590604026846
es0.3288590604026846
sk0.29245283018867924
lv0.2857142857142857
pl0.27710843373493976
hu0.2537313432835821
cs0.25
lt0.23273657289002556
en0.22680412371134018
is0.20634920634920634
da0.1935483870967742
ms0.1935483870967742
ro0.1935483870967742
sv0.1935483870967742
reliabletrue
passestrue
5
name"Hunter"
dialogue"Your camera. Have you been taking pictures around Alborn? Maybe you saw something... unusual."
detectedLang"en"
heavyLang"en"
scores
en0.7889133627019089
tl0.5759587020648967
ms0.413265306122449
fr0.37089715536105033
ro0.3502824858757062
et0.32273262661955243
ca0.32113341204250295
es0.30639324487334135
nl0.30303030303030304
pt0.28214731585518105
sv0.28125
de0.28035043804755944
da0.2758186397984887
it0.21555252387448842
no0.21555252387448842
pl0.15565345080763582
tr0.13010590015128592
lv0.12613981762917933
fi0.12213740458015267
cs0.11944869831546708
is0.10990712074303406
sk0.10990712074303406
sl0.10990712074303406
sq0.10990712074303406
reliabletrue
passestrue
6
name"Melanie"
dialogue"Meine Kamera? Ja, ich habe viele Fotos gemacht. Aber... gestern im Wald... da war etwas... ich habe etwas Seltsames gesehen. Es macht mir Angst."
detectedLang"de"
heavyLang"de"
scores
de0.8115429917550059
nl0.5698924731182796
ca0.45054945054945056
no0.4002998500749625
es0.3993993993993994
sk0.39439818319454956
pl0.3925588458618071
pt0.38697318007662834
et0.3803253292021689
hr0.3670886075949367
en0.3635640413683373
fr0.33665008291873966
it0.33554817275747506
fi0.32432432432432434
sv0.3237531699070161
da0.3191489361702128
tl0.31682322801024765
lv0.31565440547476475
ro0.3006993006993007
sl0.2976294995610184
tr0.23076923076923078
eu0.2300288739172281
lt0.2263056092843327
yo0.22178988326848248
ms0.21491658488714427
az0.17098445595854922
is0.1649269311064718
cs0.15254237288135594
sq0.14712153518123666
hu0.1130820399113082
vi0.07300115874855156
reliabletrue
passestrue
7
name"Hunter"
dialogue"In the woods? Which woods? Can you show me the pictures on that thing?"
detectedLang"en"
heavyLang"en"
scores
en0.8374139250191278
tl0.6809309309309309
nl0.5741482965931863
fr0.5251396648044693
et0.44948186528497414
ca0.4487678339818417
ms0.4256756756756757
ro0.4089012517385257
yo0.38848920863309355
no0.37774524158125916
sv0.37683284457478006
sl0.36281859070464767
it0.34815950920245403
sq0.34715821812596004
fi0.34615384615384615
de0.34006211180124224
pl0.28330522765598654
pt0.2796610169491525
az0.2747440273037543
cs0.2647058823529412
da0.2608695652173913
es0.1935483870967742
hr0.17153996101364524
hi0.1650294695481336
lv0.16338582677165356
tr0.1533864541832669
sk0.15
reliabletrue
passestrue
8
name"Hunter"
dialogue"I have to go. Stay right here. Do not leave. I'll be back with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8215560314061384
tl0.642601858470336
pl0.6012759170653907
yo0.5769881556683587
da0.5689655172413793
hr0.54995499549955
sq0.5327102803738317
cs0.5283018867924528
sk0.5140913508260446
no0.5107632093933464
sl0.4742376445846478
pt0.46638207043756674
lt0.46120689655172414
ro0.43820224719101125
ca0.4110718492343934
hu0.40476190476190477
vi0.39903846153846156
lv0.39172749391727496
sv0.3909866017052376
it0.37733499377334995
tr0.3654822335025381
de0.3548387096774194
fr0.3514915693904021
ms0.3429697766097241
et0.3297587131367293
es0.29478138222849076
nl0.2857142857142857
az0.2774566473988439
is0.2163009404388715
eu0.21507064364207218
be0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
9
name"Melanie"
dialogue"Was? Bleiben? Ich verstehe nicht... warten Sie!"
detectedLang"de"
heavyLang"de"
scores
de0.838012958963283
nl0.6
pl0.5238095238095238
en0.4152046783625731
es0.4129158512720157
hu0.3562231759656652
no0.34497816593886466
sv0.33035714285714285
ca0.3006993006993007
sk0.29245283018867924
cs0.25
da0.23469387755102045
yo0.2248062015503876
eu0.21875
fi0.21875
ms0.20634920634920634
lt0.20424403183023873
it0.1935483870967742
tr0.1891891891891892
is0.18256130790190736
fr0.17355371900826447
pt0.17355371900826447
az0.16434540389972147
ro0.16434540389972147
sq0.16434540389972147
reliabletrue
passestrue
10
name"Hunter"
dialogue"Just stay put!"
detectedLang"en"
heavyLang"en"
scores
en0.8179611650485438
hr0.625
et0.576271186440678
sv0.576271186440678
ca0.506578947368421
reliabletrue
passestrue