Run: 2026-09-24-01M39WMKNPJMERFN9M26GBGYGG

Run Details

Model:
Aion 3.5 Mini (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
1m 12s
Cost:
$0.003213
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am? Detective Hunter, Alborn PD. I'm canvassing the area regarding the Higgens disappearance. Word is you were out near the old orchard yesterday evening with that camera. Did you see anything unusual?" Marie: "[Shaken, clutching her camera] Je... je ne sais pas de quoi vous parlez. Je prenais juste des photos du paysage... la lumière était parfaite... [Translation: I... I don't know what you are talking about. I was just taking photos of the landscape... the light was perfect...]" Hunter: "Look, lady, I don't speak whatever that is. Did you see someone out there or not? A tall guy, maybe a truck? It's important." Marie: "[Eyes wide, trembling] Non! Vous ne comprenez pas! Les photos... j'ai vu quelque chose dans les photos. Il y avait une silhouette près de la grange... elle n'était pas humaine! [Translation: No! You don't understand! The photos... I saw something in the photos. There was a silhouette near the barn... it wasn't human!]" Hunter: "Great. A tourist who doesn't speak English and thinks she saw a ghost. Ma'am, I'm asking about a missing person. Higgens. Did you see Higgens?" Marie: "[Frantically checking her camera lens, avoiding his gaze] Je ne peux pas vous le montrer. Il m'a regardée. À travers l'objectif. Il sait que je l'ai vu! [Translation: I can't show you. He looked at me. Through the lens. He knows I saw him!]" Hunter: "This is a waste of time. If you aren't going to cooperate, I've got other doors to knock on. You need to learn the local language if you're going to stay here, you know that?" Marie: "[Standing up abruptly, chair scraping] Partez! Laissez-moi tranquille! Vous allez attirer son attention! [Translation: Leave! Leave me alone! You are going to draw his attention!]" Hunter: "[Phone ringing loudly] Hunter. Yeah? ...I'm on my way. Damn it." [Sighs, looking back at Marie] "We aren't done here. Don't leave town." Marie: "[Whispering, sitting back down slowly] Il ne faut pas y aller... s'il vous plaît... ne suivez pas les lumières dans les bois... [Translation: You must not go... please... do not follow the lights into the woods...]"
created_at"2026-09-24T14:20:46.157Z" 9/24/2026, 2:20:46 PM
model"aion-labs/aion-3.5-mini-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency3030
moderation_latency(null)
generation_time72325
tokens_prompt303
tokens_completion2286
native_tokens_prompt266
native_tokens_completion2261
native_tokens_completion_images(null)
native_tokens_reasoning1746
native_tokens_cached266
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00321328
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1790259646-86DSgErIlPdEwfR3BkV5"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1790259646-JjpOoURZuBmyC2mFjAL2"
upstream_id"2c28c917808b4a8984dce34e239072fc"
provider_responses
0
endpoint_id"60ac3bdc-90ec-4769-9193-2c00b4d79562"
id"2c28c917808b4a8984dce34e239072fc"
is_byokfalse
latency3013
model_permaslug"aion-labs/aion-3.5-mini-20260923"
provider_name"AionLabs"
status200
total_cost0.00321328
cache_discount0.00013832
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am? Detective Hunter, Alborn PD. I'm canvassing the area regarding the Higgens disappearance. Word is you were out near the old orchard yesterday evening with that camera. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7614761476147615
tl0.5645744331252054
nl0.5359019264448337
it0.42164993452640764
no0.4147526501766784
fr0.3908045977011494
ms0.3868579361406756
da0.3663318986131038
ro0.3552311435523114
es0.33583959899749377
pt0.32775240994419075
sv0.315599173553719
ca0.29745493107104987
sq0.28839957035445757
de0.284170718530524
et0.2182890855457227
is0.20800956365809922
yo0.17752948479205463
sl0.17290886392009988
cs0.14072632944228275
fi0.11960132890365449
hu0.10412440838404327
sk0.08997252747252747
hr0.08683666436940041
lt0.0555951532430506
tr0.04263005780346821
reliabletrue
passestrue
1
name"Marie"
dialogue"Je... je ne sais pas de quoi vous parlez. Je prenais juste des photos du paysage... la lumière était parfaite..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8240321769733535
ca0.5662949194547707
de0.4971264367816092
nl0.48717948717948717
ro0.4748687171792948
pt0.4740796393688956
es0.47249434815373026
lt0.4299674267100977
sq0.4281045751633987
it0.4077834179357022
tl0.3996569468267582
sl0.3939393939393939
en0.3848857644991213
hr0.37888198757763975
no0.3733213965980305
da0.3427230046948357
sv0.33269780743565297
yo0.33269780743565297
lv0.3210475266731329
tr0.3150684931506849
sk0.2964824120603015
cs0.29435483870967744
eu0.28789420142421157
ms0.2835209825997953
et0.2647058823529412
hu0.26004228329809725
vi0.2072480181200453
fi0.1898148148148148
pl0.18414918414918416
az0.15966386554621848
hi0.0990990990990991
reliabletrue
passestrue
2
name"Hunter"
dialogue"Look, lady, I don't speak whatever that is. Did you see someone out there or not? A tall guy, maybe a truck? It's important."
detectedLang"en"
heavyLang"en"
scores
en0.8180815876515986
tl0.6078897338403042
ca0.4406779661016949
fr0.4073275862068965
ro0.3792325056433409
pt0.3711890243902439
da0.3483412322274882
no0.3483412322274882
it0.34523809523809523
es0.33035714285714285
nl0.31986809563066776
hu0.3136439267886855
sv0.30143945808636746
sq0.298469387755102
de0.2912371134020619
yo0.28323197219808866
cs0.2763157894736842
tr0.26991150442477874
et0.26404995539696696
hr0.23327137546468402
pl0.21875
is0.21800947867298578
lt0.207492795389049
sk0.19668938656280427
az0.13883089770354906
lv0.13883089770354906
vi0.13883089770354906
sl0.09836065573770492
be0.0782122905027933
eu0.0782122905027933
fi0.07094594594594594
ms0.07094594594594594
uk0.07094594594594594
reliabletrue
passestrue
3
name"Marie"
dialogue"Non! Vous ne comprenez pas! Les photos... j'ai vu quelque chose dans les photos. Il y avait une silhouette près de la grange... elle n'était pas humaine!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8277146582231327
ca0.595540008745081
it0.5531400966183575
en0.5529241179313679
es0.5314083080040527
ro0.44677033492822965
nl0.40743113388853297
no0.39104674127715605
da0.38579017264276233
tl0.3728813559322034
de0.365133836650652
pt0.3580846634281749
sq0.354050279329609
lt0.3158284023668639
tr0.2790335151987529
eu0.2436631234668847
hu0.2436631234668847
sl0.2167654530059272
yo0.21477079796264856
hr0.2120954003407155
az0.2107508532423208
vi0.16440831074977416
sv0.16365280289330925
pl0.1590909090909091
lv0.1583257506824386
fi0.14981617647058823
ms0.13712686567164178
cs0.13227016885553472
et0.08956692913385828
hi0.07684630738522955
sk0.059959349593495935
reliabletrue
passestrue
4
name"Hunter"
dialogue"Great. A tourist who doesn't speak English and thinks she saw a ghost. Ma'am, I'm asking about a missing person. Higgens. Did you see Higgens?"
detectedLang"en"
heavyLang"en"
scores
en0.792654028436019
tl0.47384245339747444
de0.45719602977667495
nl0.4520976831559173
no0.4254760341431385
sv0.4254760341431385
da0.40798376184032475
pt0.3695965417867435
is0.36823104693140796
ro0.34701492537313433
et0.33912386706948644
fr0.3376230128690386
ms0.33103975535168195
hr0.26346801346801346
ca0.25404944586530265
it0.24111014744145706
cs0.23513986013986016
es0.2009132420091324
sq0.2009132420091324
hu0.20018281535648996
yo0.19945105215004574
az0.1814780168381665
sk0.17763157894736845
pl0.15784408084696824
sl0.15458937198067632
lt0.14965986394557826
lv0.14215686274509806
tr0.14131501472031402
fi0.13877952755905512
eu0.07407407407407407
vi0.07407407407407407
reliabletrue
passestrue
5
name"Marie"
dialogue"Je ne peux pas vous le montrer. Il m'a regardée. À travers l'objectif. Il sait que je l'ai vu!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8073701842546063
ca0.6156417112299465
it0.5465299684542587
es0.47584320875113945
ro0.46955719557195574
sl0.45856873822975514
yo0.4465832531280077
pt0.43405511811023617
hr0.425
en0.3532058492688414
tr0.3473325766174802
nl0.34210526315789475
sq0.34059633027522934
cs0.2848258706467662
tl0.26658163265306123
sk0.26187419768934533
lt0.25997425997426
da0.2580645161290322
hu0.23841059602649006
fi0.203601108033241
de0.1991643454038997
no0.18555240793201136
az0.16666666666666666
lv0.15191740412979352
pl0.13663663663663664
ms0.1274658573596358
is0.1248097412480974
sv0.09305993690851734
reliabletrue
passestrue
6
name"Hunter"
dialogue"This is a waste of time. If you aren't going to cooperate, I've got other doors to knock on. You need to learn the local language if you're going to stay here, you know that?"
detectedLang"en"
heavyLang"en"
scores
en0.8197960618846694
tl0.5691467002942413
ro0.4675324675324676
nl0.45565586829527355
no0.4235095613048369
yo0.4172825469016486
hr0.39563679245283023
et0.38290186634557494
fr0.3780339805825243
da0.3776563448694596
pt0.35494021397105097
ca0.35044359949302917
sv0.31621080720480316
sq0.30649526387009474
es0.3017711171662125
it0.2998633879781421
sl0.2901662049861496
cs0.28868841082581537
sk0.2847173761339846
lt0.2704626334519573
de0.2636494252873563
is0.24908424908424906
pl0.24017790956263896
hu0.23220973782771534
ms0.21875
lv0.19670846394984326
fi0.17205169628432956
eu0.12617220801364024
hi0.07574391343552751
tr0.06987295825771324
az0.0639269406392694
vi0.0639269406392694
reliabletrue
passestrue
7
name"Marie"
dialogue"Partez! Laissez-moi tranquille! Vous allez attirer son attention!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8035136384650948
en0.6313963573287078
it0.587378640776699
no0.5586708203530634
da0.5535714285714286
tl0.5277777777777778
es0.5114942528735632
de0.51036866359447
nl0.4867149758454107
sv0.4810744810744811
lv0.4720496894409938
et0.46675031367628605
tr0.45161290322580644
fi0.44733420026007803
lt0.4370860927152318
az0.4264507422402159
pt0.4264507422402159
ca0.4162087912087912
sq0.3988684582743989
ro0.3684992570579495
yo0.34006211180124224
hr0.3167202572347267
ms0.3156199677938808
sl0.3122977346278317
eu0.256993006993007
pl0.247787610619469
hu0.24645390070921988
sk0.22867513611615245
cs0.22303473491773307
vi0.17153996101364524
zh0.1533864541832669
reliabletrue
passestrue
8
name"Hunter"
dialogue"We aren't done here. Don't leave town."
detectedLang"en"
heavyLang"en"
scores
en0.8042286609240408
nl0.34210526315789475
pl0.2917847025495751
sq0.2857142857142857
et0.28366762177650434
hr0.22360248447204967
lt0.22360248447204967
no0.22360248447204967
ro0.22360248447204967
sv0.22360248447204967
tl0.22360248447204967
reliabletrue
passestrue
9
name"Marie"
dialogue"Il ne faut pas y aller... s'il vous plaît... ne suivez pas les lumières dans les bois..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8268319358366752
ca0.565018315018315
it0.42143727161997563
da0.4099378881987578
sq0.40550688360450565
no0.3933588761174968
nl0.375
ro0.370026525198939
es0.3675099866844208
tr0.3572395128552098
fi0.3300423131170663
de0.31457431457431456
lt0.2983751846381093
tl0.24722662440570525
en0.24000000000000002
sl0.2122719734660033
sv0.21096345514950168
az0.19491525423728812
hr0.19217687074829934
pl0.1810344827586207
lv0.1782006920415225
vi0.17102966841186737
et0.15026833631484796
ms0.15026833631484796
cs0.14721723518850988
hu0.14721723518850988
reliabletrue
passestrue