Run: 2026-09-24-01M39W4RBAV2RFW889M9B7MH7P

Run Details

Model:
Aion 3.5 Mini (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
1m 1s
Cost:
$0.004228
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Melanie: "Ja? Kann ich Ihnen helfen?" Hunter: "Miss. Detective Hunter, Alborn PD. I'm investigating the disappearances. Were you near the old orchard last night?" Melanie: "Der Obstgarten? Nein, aber ich habe Lichter gesehen. Im Wald. Sie sind tief hinein gegangen." Hunter: "Ma'am, I don't speak German. Do you speak English?" Melanie: "Nein, mein Englisch ist sehr schlecht. Die Lichter... sie waren nicht normal. Sie haben gepulst. Es war wie ein Signal." Hunter: "Look, I can't understand a word you're saying. Slow down." Melanie: "Und dann... die Schreie. Sie kamen aus der Richtung der Lichter. Es war schrecklich." Hunter: "I need you to speak English. Do you know anyone who can translate?" Melanie: "Bitte, Detective. Passen Sie auf sich auf. Diese Stadt... sie ist nicht sicher. Die Leute verschwinden." Hunter: "I know they disappear. That's why I'm here. Did you see a vehicle? A person? Anything out of place?" Melanie: "Es war ein Schatten. Er trug eine Tasche. Eine große, dunkle Tasche. Und er hatte eine Schaufel." Hunter: "I have no idea what you're saying, but your camera... did you get any pictures? Show me the camera." Melanie: "Meine Kamera? Ich... ich habe nur die Lichter fotografiert. Hier, sehen Sie? Die Lichter im Wald." Hunter: "Alright, just... stay here. I'll get a translator down here. Don't go anywhere." Melanie: "Ich bleibe hier. Aber beeilen Sie sich, bitte. Es ist nicht viel Zeit." Hunter: (Phone rings) "Hunter. Yeah, I'm on my way." (To Melanie) "Gotta go. We'll finish this later." Melanie: "In Ordnung. Aber seien Sie vorsichtig, Detective."
created_at"2026-09-24T14:12:06.654Z" 9/24/2026, 2:12:06 PM
model"aion-labs/aion-3.5-mini-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1210
moderation_latency(null)
generation_time60497
tokens_prompt306
tokens_completion3043
native_tokens_prompt266
native_tokens_completion2986
native_tokens_completion_images(null)
native_tokens_reasoning2641
native_tokens_cached266
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00422828
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1790259126-FqyaLG7XgocVQERTve83"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1790259126-nUxOE4lgtaRcQe2mcUWR"
upstream_id"c1fea98e5cb14fa7b656c738efca0ba0"
provider_responses
0
endpoint_id"60ac3bdc-90ec-4769-9193-2c00b4d79562"
id"c1fea98e5cb14fa7b656c738efca0ba0"
is_byokfalse
latency1210
model_permaslug"aion-labs/aion-3.5-mini-20260923"
provider_name"AionLabs"
status200
total_cost0.00422828
cache_discount0.00013832
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Ja? Kann ich Ihnen helfen?"
detectedLang"de"
heavyLang"de"
scores
de0.8284313725490196
sk0.5430809399477807
pl0.527027027027027
et0.46808510638297873
fi0.4664634146341463
lv0.396551724137931
nl0.3902439024390244
ca0.38380281690140844
da0.3137254901960784
sl0.3137254901960784
is0.308300395256917
no0.308300395256917
sq0.3
sv0.3
yo0.3
reliabletrue
passestrue
1
name"Hunter"
dialogue"Miss. Detective Hunter, Alborn PD. I'm investigating the disappearances. Were you near the old orchard last night?"
detectedLang"en"
heavyLang"en"
scores
en0.7810329205678043
tl0.6698542805100183
fr0.5847651775486827
ro0.4982698961937716
nl0.4975744975744975
pt0.4887165021156558
it0.47349310094408137
no0.45447705041384495
ca0.42551505546751184
de0.42092651757188504
da0.3798118049615056
sv0.36514886164623467
es0.36459246275197194
ms0.3491921005385996
sq0.32432432432432434
cs0.27860696517412936
hr0.2720883534136546
sl0.2579324462640737
et0.22126745435016112
yo0.1997792494481236
lv0.1657077100115075
is0.15990730011587484
sk0.15990730011587484
lt0.14806110458284372
az0.13997627520759193
fi0.07525510204081631
tr0.07525510204081631
reliabletrue
passestrue
2
name"Melanie"
dialogue"Der Obstgarten? Nein, aber ich habe Lichter gesehen. Im Wald. Sie sind tief hinein gegangen."
detectedLang"de"
heavyLang"de"
scores
de0.7940846125046799
nl0.5676100628930818
da0.45972495088408644
no0.45
pl0.37142857142857144
sv0.36046511627906974
sk0.3552168815943728
ca0.3099121706398996
eu0.26568758344459276
fi0.23822714681440443
en0.22752808988764048
es0.2109038737446198
hr0.15644171779141106
et0.15384615384615385
sl0.14463452566096424
ro0.12420382165605094
fr0.1185897435897436
tr0.11290322580645161
reliabletrue
passestrue
3
name"Hunter"
dialogue"Ma'am, I don't speak German. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7843397478433974
tl0.5554035567715458
hr0.5045731707317073
ro0.4984567901234568
sq0.4969040247678019
cs0.49297971918876754
sv0.4628099173553719
pl0.45286195286195285
no0.411231884057971
ca0.4058500914076782
da0.39365671641791045
sk0.385633270321361
it0.37977099236641226
vi0.3486973947895792
yo0.336734693877551
pt0.32432432432432434
de0.3114406779661017
ms0.30406852248394006
tr0.3010752688172043
az0.2903930131004367
sl0.2696629213483146
nl0.1935483870967742
be0.17721518987341772
es0.17721518987341772
hu0.1709183673469388
et0.16237113402061853
is0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
4
name"Melanie"
dialogue"Nein, mein Englisch ist sehr schlecht. Die Lichter... sie waren nicht normal. Sie haben gepulst. Es war wie ein Signal."
detectedLang"de"
heavyLang"de"
scores
de0.8206170772542453
nl0.6687279151943463
en0.4553376906318083
es0.41360437842064113
no0.37707641196013286
ca0.3644067796610169
tr0.35456110154905335
cs0.30167597765363136
sv0.2951127819548872
ro0.2767598842815815
da0.27395934172313646
pl0.2492492492492493
eu0.23155737704918034
pt0.21465968586387435
ms0.21135646687697163
lv0.19957310565635006
lt0.17035398230088497
fr0.1648106904231626
it0.16201117318435754
az0.1506228765571914
hr0.14869466515323496
tl0.14675767918088736
sk0.14187643020594967
hi0.12383177570093458
hu0.11971830985915494
is0.10501193317422433
yo0.10501193317422433
fi0.07749077490774908
sq0.07749077490774908
et0.07292954264524104
sl0.07292954264524104
reliabletrue
passestrue
5
name"Hunter"
dialogue"Look, I can't understand a word you're saying. Slow down."
detectedLang"en"
heavyLang"en"
scores
en0.8053969901401141
da0.5772266065388951
no0.5772266065388951
sv0.5235069885641677
cs0.46120689655172414
tl0.45809248554913296
pl0.4517543859649123
ro0.4469026548672566
sk0.4369369369369369
ca0.4221879815100154
de0.4094488188976378
hr0.4009584664536741
nl0.3980738362760835
tr0.39710610932475876
it0.3902439024390244
hu0.37290969899665555
is0.36115843270868825
sq0.35456110154905335
yo0.35456110154905335
lt0.27884615384615385
pt0.27184466019417475
az0.2618110236220473
lv0.2618110236220473
vi0.2618110236220473
es0.26035502958579887
et0.251497005988024
fr0.2378048780487805
sl0.1935483870967742
be0.15730337078651685
eu0.15730337078651685
fi0.14383561643835618
ms0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
6
name"Melanie"
dialogue"Und dann... die Schreie. Sie kamen aus der Richtung der Lichter. Es war schrecklich."
detectedLang"de"
heavyLang"de"
scores
de0.845679012345679
nl0.6347699050401753
no0.4646680942184154
en0.3581514762516046
da0.31412894375857336
ca0.3045897079276773
es0.3045897079276773
ms0.2795389048991354
fr0.2223950233281493
sl0.21996879875195008
tr0.21996879875195008
sk0.21875
sv0.21875
lv0.1935483870967742
pl0.1830065359477124
hu0.16943521594684383
it0.1539763113367174
lt0.1539763113367174
tl0.1539763113367174
yo0.14965986394557826
ro0.13494809688581316
cs0.1334488734835355
hr0.1334488734835355
reliabletrue
passestrue
7
name"Hunter"
dialogue"I need you to speak English. Do you know anyone who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.8226950354609929
tl0.5849609375
hr0.5792079207920792
cs0.5435016111707841
no0.5272525027808677
pl0.5272525027808677
sk0.4842233009708738
da0.47073474470734744
ro0.43633952254641906
sq0.4318181818181818
yo0.41540577716643745
sl0.41379310344827586
ca0.40559440559440557
sv0.3876080691642651
vi0.3813682678311499
et0.380466472303207
it0.37315634218289084
lv0.3722304283604136
pt0.35703479576399394
lt0.3550834597875569
tr0.33070866141732286
az0.3189102564102564
de0.24645390070921988
ms0.23561151079136694
fr0.15841584158415842
es0.1533864541832669
be0.1414141414141414
eu0.1361788617886179
hu0.1361788617886179
is0.1290983606557377
nl0.1290983606557377
uk0.1290983606557377
reliabletrue
passestrue
8
name"Melanie"
dialogue"Bitte, Detective. Passen Sie auf sich auf. Diese Stadt... sie ist nicht sicher. Die Leute verschwinden."
detectedLang"de"
heavyLang"de"
scores
de0.8333333333333334
nl0.6285714285714286
it0.49337490257209665
da0.49139280125195617
no0.47197400487408614
sv0.46808510638297873
en0.44961896697713805
fr0.44206008583690987
ca0.40909090909090906
es0.37977099236641226
ro0.37076476282671833
pt0.3414387031408308
tl0.3157894736842105
sq0.31362196409714893
tr0.24855491329479767
pl0.22062350119904073
et0.214975845410628
hu0.21307506053268765
cs0.20924574209245742
hr0.16879795396419436
is0.16879795396419436
sl0.16879795396419436
ms0.16666666666666666
hi0.1402116402116402
yo0.11924119241192413
lt0.10591471801925723
az0.08321579689703808
reliabletrue
passestrue
9
name"Hunter"
dialogue"I know they disappear. That's why I'm here. Did you see a vehicle? A person? Anything out of place?"
detectedLang"en"
heavyLang"en"
scores
en0.8201936376210234
tl0.5578231292517007
sq0.5015337423312883
ca0.48859166011014943
fr0.46369636963696376
ro0.4519392917369309
cs0.44396920444824634
no0.4180841539838854
sv0.40202391904323825
da0.4014732965009208
it0.38967136150234744
nl0.36647173489278756
pl0.3608652900688299
is0.35707220573689413
et0.35323383084577115
pt0.34804413239719156
ms0.33469805527123847
yo0.32920536635706915
hr0.3229166666666667
de0.3128964059196617
es0.3077742279020234
hu0.3055555555555556
sk0.2864983534577387
lt0.2502883506343714
tr0.2476851851851852
lv0.24242424242424243
az0.22802850356294538
vi0.1698595146871009
sl0.12162162162162163
be0.09722222222222222
eu0.09722222222222222
fi0.08835904628330996
uk0.08835904628330996
reliabletrue
passestrue
10
name"Melanie"
dialogue"Es war ein Schatten. Er trug eine Tasche. Eine große, dunkle Tasche. Und er hatte eine Schaufel."
detectedLang"de"
heavyLang"de"
scores
de0.8165810711665443
no0.5833333333333334
nl0.5408631772268135
da0.4753410283315845
sv0.3573264781491003
is0.33774834437086093
ca0.33065595716198126
it0.32157394843962006
en0.2877492877492877
tr0.24242424242424243
es0.22720247295208654
lv0.1935483870967742
fi0.1749174917491749
hu0.16943521594684383
lt0.1539763113367174
fr0.14383561643835618
tl0.13494809688581316
reliabletrue
passestrue
11
name"Hunter"
dialogue"I have no idea what you're saying, but your camera... did you get any pictures? Show me the camera."
detectedLang"en"
heavyLang"en"
scores
en0.8174603174603174
tl0.6151271753681392
ca0.5676691729323309
fr0.4772727272727273
no0.46511627906976744
da0.43125618199802174
it0.4295634920634921
es0.425
ro0.41025641025641024
nl0.4059917355371901
ms0.40352697095435686
sv0.39153439153439157
sq0.3850267379679145
pt0.3451025056947608
lv0.3251173708920188
tr0.3097238895558223
et0.30806257521058966
hr0.29447852760736193
pl0.25902061855670105
yo0.25227568270481143
cs0.2414248021108179
is0.22086720867208673
sk0.22086720867208673
de0.20027816411682894
sl0.13273001508295626
fi0.11538461538461538
be0.10852713178294573
hu0.1043613707165109
az0.0987460815047022
lt0.0987460815047022
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
12
name"Melanie"
dialogue"Meine Kamera? Ich... ich habe nur die Lichter fotografiert. Hier, sehen Sie? Die Lichter im Wald."
detectedLang"de"
heavyLang"de"
scores
de0.8135024244684819
nl0.6019108280254777
no0.47970863683662857
pl0.47201689545934533
sk0.4594594594594595
ca0.39686369119420983
hr0.3872549019607844
ms0.375
ro0.35233160621761656
sv0.3498049414824447
fr0.3234100135317997
es0.3065187239944522
et0.299719887955182
cs0.29676511954992973
sl0.2917847025495751
it0.28366762177650434
tr0.28366762177650434
da0.27219796215429404
en0.22720247295208654
sq0.2125984251968504
lt0.20127795527156547
lv0.19614147909967844
pt0.19614147909967844
eu0.18699186991869918
fi0.14965986394557826
yo0.14965986394557826
is0.13494809688581316
tl0.12587412587412586
az0.10554561717352416
reliabletrue
passestrue
13
name"Hunter"
dialogue"Alright, just... stay here. I'll get a translator down here. Don't go anywhere."
detectedLang"en"
heavyLang"en"
scores
en0.7898178421298458
tl0.5161290322580645
sq0.46871310507674147
de0.4396014943960149
pl0.4375
ro0.39999999999999997
ca0.3902439024390244
et0.3877551020408163
sv0.3877551020408163
pt0.3844049247606019
fr0.37586685159500693
da0.375
yo0.375
no0.3732590529247911
hr0.3440233236151603
sl0.3181818181818182
es0.3171471927162367
nl0.30769230769230765
sk0.3001555209953344
cs0.29797191887675506
it0.29467084639498436
ms0.2890995260663507
is0.27999999999999997
vi0.2598684210526316
hu0.25742574257425743
lt0.24874791318864775
tr0.23728813559322032
eu0.23339011925042585
lv0.23339011925042585
az0.2227979274611399
fi0.12280701754385964
reliabletrue
passestrue
14
name"Melanie"
dialogue"Ich bleibe hier. Aber beeilen Sie sich, bitte. Es ist nicht viel Zeit."
detectedLang"de"
heavyLang"de"
scores
de0.8482684755444484
nl0.542518837459634
pl0.34815950920245403
tr0.33176100628930816
no0.2772108843537415
da0.2697594501718213
ca0.256993006993007
es0.256993006993007
sk0.22586520947176683
lv0.22018348623853207
et0.2100371747211896
hi0.19962335216572505
hu0.1935483870967742
cs0.1904761904761905
lt0.17635658914728683
eu0.17153996101364524
fr0.17153996101364524
sv0.16173570019723865
it0.15
fi0.1448692152917505
reliabletrue
passestrue
15
name"Hunter"
dialogue"Gotta go. We'll finish this later."
detectedLang"en"
heavyLang"en"
scores
en0.732620320855615
it0.5387453874538745
tl0.497991967871486
nl0.4553376906318083
pl0.423963133640553
sv0.3946731234866829
de0.3842364532019704
fr0.3734335839598998
fi0.3093922651933701
hu0.30167597765363136
da0.2732558139534884
no0.2668621700879765
yo0.23547400611620795
hi0.2331288343558282
pt0.22118380062305293
reliabletrue
passestrue
16
name"Melanie"
dialogue"In Ordnung. Aber seien Sie vorsichtig, Detective."
detectedLang"de"
heavyLang"de"
scores
de0.8119212962962964
en0.5854591836734694
nl0.5678191489361702
ro0.5479833101529903
no0.5409604519774012
tl0.4969040247678019
it0.496124031007752
ca0.4415807560137457
sv0.4357638888888889
sl0.40476190476190477
pl0.37619961612284064
fr0.3725868725868726
es0.3538767395626242
ms0.35000000000000003
pt0.34343434343434337
da0.33127572016460904
sq0.22248803827751198
yo0.21307506053268765
az0.20537897310513448
cs0.181360201511335
hr0.1709183673469388
reliabletrue
passestrue