Run: 2026-09-24-01M39VQ5Z4DFEQQ2H4FN3JPSAT

Run Details

Model:
Aion 3.5 Mini (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
1m 48s
Cost:
$0.004791
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, miss? I'm Detective Hunter with the Alborn Police. I'm looking into a disappearance near the old mill. Do you mind if I ask you a few questions?" Marie: "Disparition ? Mon Dieu... Je savais que quelque chose n'allait pas dans cette ville. Le vieux moulin ? J'y étais hier soir. Je photographiais le coucher de soleil." Hunter: "Yeah, the mill. Did you see anything? A car, a person, anything out of place?" Marie: "Une voiture ? Peut-être. Mais j'ai surtout vu une silhouette près des arbres. J'ai pensé que c'était un animal, mais il marchait debout..." Hunter: "Ma'am, I'm going to need you to speak English. Do you speak English? This is a police matter." Marie: "Je ne comprends pas 'police matter'... Vous êtes policier ? Oh, grâce au ciel ! Monsieur, il faut que vous voyiez mes photos. J'ai peut-être capturé quelque chose par accident." Hunter: "Photos? Look, lady, this isn't a tourist trap. A local man is missing. *Missing*. Poof. Gone. Do you understand?" Marie: "Disparu ? Non, ce n'est pas possible... Je regardais l'objectif, pas les alentours. Mais si, il y avait quelqu'un ! Je le savais !" Hunter: "You're not making any sense. Do you know the missing man? His name is Dave. Works at the orchard." Marie: "Dave ? Je ne connais pas de Dave. Mais l'homme dans les bois... Il portait quelque chose. C'était lourd, je crois. Il avait du mal à avancer." Hunter: "The woods? Carrying something? Are you talking about the apple festival? Did you see someone stealing apples?" Marie: "Les pommes ? Non ! Pas les pommes ! Une personne ! J'étais là pour le paysage, pas pour les pommes !" Hunter: "Look, if you can't speak English, I can't help you. If you remember anything, come to the station. *The. Station.*" Marie: "La station ? Il n'y a pas de station de train ici. Vous êtes très pressé, Monsieur. Attendez, regardez l'écran de mon appareil—" Hunter: (Phone ringing) "Hold on. Hunter here. ...Yeah? ...I'm on my way." (Turns back to Marie) "I gotta go. Stay in town. Don't leave the cafe." Marie: "Mais... Vous n'avez pas vu les photos ! Monsieur ? Monsieur ! Ah, c'est incroyable, personne n'écoute jamais les touristes..."
created_at"2026-09-24T14:04:41.843Z" 9/24/2026, 2:04:41 PM
model"aion-labs/aion-3.5-mini-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency3557
moderation_latency(null)
generation_time107787
tokens_prompt303
tokens_completion3254
native_tokens_prompt266
native_tokens_completion3388
native_tokens_completion_images(null)
native_tokens_reasoning2697
native_tokens_cached266
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.00479108
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1790258681-bym7XJnWing3tK6au0xK"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1790258681-AiiyoYGhJkKMa6oSAU4z"
upstream_id"370eb95735a34ea4a90de17f9c511beb"
provider_responses
0
endpoint_id"60ac3bdc-90ec-4769-9193-2c00b4d79562"
id"370eb95735a34ea4a90de17f9c511beb"
is_byokfalse
latency3491
model_permaslug"aion-labs/aion-3.5-mini-20260923"
provider_name"AionLabs"
status200
total_cost0.00479108
cache_discount0.00013832
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, miss? I'm Detective Hunter with the Alborn Police. I'm looking into a disappearance near the old mill. Do you mind if I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7897727272727273
tl0.5941202281702501
fr0.5857590685176892
it0.5425321463897131
pt0.517223382045929
sq0.47651386530843237
nl0.47443181818181823
no0.46158323632130377
cs0.4539551357733176
ca0.44007263922518164
ro0.4363193174893357
sv0.4222361024359775
hr0.41823899371069184
sl0.41232528589580686
es0.4036105738233398
da0.39660795825179385
sk0.3728813559322034
ms0.36946148602590323
de0.3330930064888248
pl0.3330930064888248
yo0.32727272727272727
et0.3008314436885865
hu0.29443173150266966
tr0.23108894430590188
vi0.20872540633019673
lt0.20051858254105445
fi0.1935483870967742
lv0.1935483870967742
is0.18430335097001763
az0.18358340688437777
eu0.15059687786960516
be0.07035175879396985
uk0.06376518218623482
reliabletrue
passestrue
1
name"Marie"
dialogue"Disparition ? Mon Dieu... Je savais que quelque chose n'allait pas dans cette ville. Le vieux moulin ? J'y étais hier soir. Je photographiais le coucher de soleil."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7979703063333959
en0.5411865130174989
de0.45264765784114047
da0.447584789311408
nl0.39572793704328274
tl0.38606510565391206
it0.38289322617680827
pt0.37789351851851855
ca0.377533294730747
es0.3654073199527745
lt0.3512371756185878
no0.349273607748184
sv0.33927473878303627
yo0.30510665804783454
fi0.26420260095824777
hu0.25964187327823696
ro0.2503486750348675
sq0.23323823109843084
sl0.21245421245421245
tr0.20546932742054694
cs0.1673121611154144
sk0.16602017067494182
lv0.15949960906958563
hr0.13723916532905298
et0.13166397415185782
hi0.12601626016260162
az0.12244897959183673
ms0.12029459901800327
pl0.07804459691252144
zh0.06684027777777778
eu0.061135371179039305
is0.05536028119507908
reliabletrue
passestrue
2
name"Hunter"
dialogue"Yeah, the mill. Did you see anything? A car, a person, anything out of place?"
detectedLang"en"
heavyLang"en"
scores
en0.8138414367060884
tl0.6664050235478807
fr0.5853658536585366
no0.495249406175772
cs0.4934445768772348
sq0.4835965978128797
sv0.4700748129675811
da0.46874999999999994
ro0.46406052963430017
nl0.4551282051282051
pt0.44948186528497414
yo0.44371727748691103
ms0.4193989071038251
is0.4121715076071923
de0.41054091539528437
ca0.4097222222222222
et0.4072524407252441
es0.40476190476190477
pl0.36186186186186187
hu0.34006211180124224
it0.3338557993730407
sk0.3078175895765472
hr0.2869127516778523
lt0.2659758203799654
lv0.25438596491228066
tr0.2530755711775044
az0.2328519855595668
sl0.17475728155339806
eu0.1414141414141414
vi0.1414141414141414
fi0.1290983606557377
reliabletrue
passestrue
3
name"Marie"
dialogue"Une voiture ? Peut-être. Mais j'ai surtout vu une silhouette près des arbres. J'ai pensé que c'était un animal, mais il marchait debout..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8019571295433364
ca0.6040987424312995
it0.4955489614243323
pt0.46168461051298293
es0.4348404255319149
en0.3694362017804154
ro0.34210526315789475
de0.33800623052959505
az0.22867513611615245
yo0.2251595259799453
lv0.21875
da0.21150278293135436
tl0.20112781954887218
nl0.1920152091254753
no0.18111753371868977
tr0.16338582677165356
hr0.15590863952333664
sl0.14400805639476336
fi0.14228052472250252
sv0.12371134020618556
hu0.12280701754385964
et0.07709011943539631
sq0.07709011943539631
pl0.07608695652173912
lt0.07306434023991276
sk0.07306434023991276
ms0.06695938529088914
reliabletrue
passestrue
4
name"Hunter"
dialogue"Ma'am, I'm going to need you to speak English. Do you speak English? This is a police matter."
detectedLang"en"
heavyLang"en"
scores
en0.8130142109199702
tl0.5741056218057922
cs0.5674740484429065
hr0.5404411764705882
no0.5278564683663833
sk0.5242626070409134
sl0.49647532729103727
pl0.48506694129763134
ro0.48506694129763134
it0.4769874476987448
yo0.47589098532494756
da0.4747899159663866
sv0.45054945054945056
nl0.4487320837927233
de0.43566591422121903
hu0.4350282485875706
pt0.42263279445727486
fr0.4165694282380397
et0.3678887484197219
lv0.3597951344430218
lt0.3531694695989651
sq0.3514915693904021
fi0.3160054719562244
ms0.302649930264993
ca0.2937853107344633
es0.29278642149929274
vi0.26578560939794427
is0.25037481259370314
eu0.24698795180722888
tr0.2295839753466872
az0.2248062015503876
reliabletrue
passestrue
5
name"Marie"
dialogue"Je ne comprends pas 'police matter'... Vous êtes policier ? Oh, grâce au ciel ! Monsieur, il faut que vous voyiez mes photos. J'ai peut-être capturé quelque chose par accident."
detectedLang"fr"
heavyLang"fr"
scores
fr0.795224817009411
en0.5381289308176102
ca0.5142620917734602
ro0.4747429593205185
it0.4728577837595334
nl0.45475638051044076
es0.4460160301744461
de0.36486486486486486
sq0.3607181719260065
pt0.3554580362040592
tl0.3475846751804553
lt0.3454038997214485
cs0.3136682242990654
sl0.30760164997053624
hr0.3030842230130486
sv0.2985074626865672
da0.2934455802766085
sk0.2683686176836862
no0.26516572858036275
lv0.2623979912115505
pl0.21718854097268486
az0.1840277777777778
fi0.17889587700908455
tr0.17543859649122806
et0.1564967695620962
hu0.15528396836808053
ms0.12378821774794929
yo0.1218236173393124
eu0.07407407407407407
hi0.06150159744408946
reliabletrue
passestrue
6
name"Hunter"
dialogue"Photos? Look, lady, this isn't a tourist trap. A local man is missing. Missing. Poof. Gone. Do you understand?"
detectedLang"en"
heavyLang"en"
scores
en0.7813411078717201
tl0.6134020618556701
nl0.5789473684210527
da0.5423340961098398
de0.5260663507109005
pt0.5176848874598071
no0.5057660626029654
fr0.4910941475826972
sv0.48586118251928023
ro0.44547134935304994
is0.43977591036414565
ca0.43396226415094336
cs0.4157740993184031
es0.3939393939393939
sk0.36908517350157727
pl0.35205183585313177
yo0.3456924754634678
hu0.34065934065934067
hr0.3348115299334811
it0.318955732122588
sl0.3181818181818182
lt0.29906542056074764
lv0.29328621908127206
et0.2682926829268293
sq0.23954372623574144
vi0.23175416133162616
ms0.22380336351875807
fi0.1902834008097166
az0.1836734693877551
hi0.1137370753323486
tr0.1137370753323486
eu0.1044776119402985
reliabletrue
passestrue
7
name"Marie"
dialogue"Disparu ? Non, ce n'est pas possible... Je regardais l'objectif, pas les alentours. Mais si, il y avait quelqu'un ! Je le savais !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.796044499381953
it0.5852187028657617
ca0.5703125
en0.494485294117647
es0.48405253283302063
ro0.4418132611637348
lt0.3653846153846154
pt0.359472049689441
yo0.3309002433090025
sl0.3270799347471452
sk0.2900172117039587
cs0.28879310344827586
sq0.27884615384615385
az0.2673179396092362
tl0.25942549371633755
tr0.2506811989100818
no0.23469387755102045
de0.21577946768060838
nl0.20825335892514396
pl0.19196865817825662
hr0.1716867469879518
lv0.11003236245954692
hu0.10617551462621885
vi0.10617551462621885
da0.09638554216867469
eu0.09539473684210525
ms0.0924092409240924
fi0.08637873754152825
reliabletrue
passestrue
8
name"Hunter"
dialogue"You're not making any sense. Do you know the missing man? His name is Dave. Works at the orchard."
detectedLang"en"
heavyLang"en"
scores
en0.8138957816377173
tl0.6523754345307069
nl0.5867768595041323
no0.522673031026253
da0.49622166246851385
de0.4500458295142072
fr0.4355597365945437
pt0.4307400379506641
ca0.4065281899109792
sv0.38271604938271603
is0.3442622950819672
yo0.33701657458563533
sq0.3197278911564626
ms0.3006993006993007
it0.2673992673992674
pl0.26199261992619927
cs0.2601726263871763
tr0.22178988326848248
es0.20424403183023873
hu0.20424403183023873
sk0.18032786885245902
hr0.16666666666666666
sl0.16666666666666666
vi0.15611814345991562
lv0.15254237288135594
lt0.13544668587896252
fi0.11504424778761062
ro0.1044776119402985
az0.09774436090225565
et0.09774436090225565
reliabletrue
passestrue
9
name"Marie"
dialogue"Dave ? Je ne connais pas de Dave. Mais l'homme dans les bois... Il portait quelque chose. C'était lourd, je crois. Il avait du mal à avancer."
detectedLang"fr"
heavyLang"fr"
scores
fr0.828838174273859
ca0.563953488372093
pt0.5421753607103218
it0.45616348055372447
en0.44519166106254204
da0.4202389318341532
ro0.40347071583514105
es0.4017403915881073
sq0.3834080717488789
de0.3773584905660377
tr0.3663594470046083
no0.35697583787996884
lt0.34988179669030733
yo0.34782608695652173
nl0.3441971383147853
sv0.34210526315789475
sl0.3113522537562604
hr0.2960750853242321
sk0.27312775330396477
cs0.25876010781671155
lv0.24242424242424243
hu0.22680412371134018
az0.2231638418079096
eu0.20443587270973965
et0.19980601357904945
ms0.19980601357904945
pl0.1607324516785351
tl0.15036045314109164
vi0.10714285714285714
fi0.09638554216867469
zh0.08435072142064373
reliabletrue
passestrue
10
name"Hunter"
dialogue"The woods? Carrying something? Are you talking about the apple festival? Did you see someone stealing apples?"
detectedLang"en"
heavyLang"en"
scores
en0.806090203964378
tl0.5958083832335329
nl0.5126353790613718
fr0.4962686567164179
pt0.4375
ms0.4294167371090448
es0.4289340101522843
no0.414570685169124
da0.39999999999999997
sv0.3946188340807175
ca0.36679174484052535
ro0.36380772855796417
de0.3626062322946175
et0.3515850144092219
it0.3503368623676612
cs0.28191489361702127
lt0.2516629711751663
sq0.23556058890147225
hr0.22945205479452058
az0.2214532871972318
sl0.21693735498839908
sk0.14880201765447668
yo0.13682864450127877
is0.09517426273458446
hu0.09029649595687331
fi0.08536585365853659
lv0.08536585365853659
pl0.08536585365853659
reliabletrue
passestrue
11
name"Marie"
dialogue"Les pommes ? Non ! Pas les pommes ! Une personne ! J'étais là pour le paysage, pas pour les pommes !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8205994090333474
it0.5298672566371682
ca0.4444444444444444
en0.44078947368421056
es0.4209809264305177
lt0.4014084507042254
de0.375
yo0.33070866141732286
sq0.3210862619808307
ro0.3178170144462279
lv0.29401993355481726
ms0.288107202680067
no0.2869127516778523
nl0.28087986463620984
et0.2784380305602716
hu0.2747440273037543
pt0.2735042735042735
vi0.2697594501718213
da0.2672413793103448
tl0.2530755711775044
sl0.21586715867158673
eu0.169921875
sv0.169921875
tr0.1361788617886179
is0.1290983606557377
az0.121900826446281
cs0.121900826446281
hr0.121900826446281
pl0.121900826446281
sk0.121900826446281
reliabletrue
passestrue
12
name"Hunter"
dialogue"Look, if you can't speak English, I can't help you. If you remember anything, come to the station. The. Station."
detectedLang"en"
heavyLang"en"
scores
en0.826553137811416
tl0.6121297602256699
no0.5801526717557252
da0.5733126454615981
sv0.5665878644602049
yo0.5513866231647635
ms0.4554455445544555
de0.43123061013443637
nl0.43123061013443637
sk0.4155154091392136
fr0.4148936170212766
hr0.4148936170212766
it0.40860215053763443
sq0.40796555435952636
cs0.4066882416396979
pl0.3707093821510297
sl0.36194895591647336
lv0.31077694235588976
hu0.30730478589420657
lt0.3055555555555556
ro0.302915082382763
is0.28292046936114734
et0.26666666666666666
ca0.2005813953488372
tr0.18998527245949925
az0.1863905325443787
fi0.12974683544303797
zh0.12280701754385964
be0.11290322580645161
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
13
name"Marie"
dialogue"La station ? Il n'y a pas de station de train ici. Vous êtes très pressé, Monsieur. Attendez, regardez l'écran de mon appareil—"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8095878136200716
it0.5582120582120582
ca0.5572916666666666
en0.5540398740818467
nl0.5092378752886837
ro0.5029239766081871
es0.4842233009708738
tl0.46641556811048335
no0.42991281019450034
da0.41540577716643745
de0.40014114326040934
yo0.3813682678311499
sv0.37176644493717664
sq0.358974358974359
pt0.3555724033358605
tr0.31062449310624496
az0.30327868852459017
hu0.29343308395677475
eu0.2904841402337229
ms0.288107202680067
lv0.24242424242424243
et0.24039320822162644
sk0.24039320822162644
cs0.23007246376811596
lt0.22586520947176683
hr0.2251595259799453
sl0.21731123388581952
fi0.20187793427230047
pl0.1650294695481336
vi0.1533864541832669
hi0.08405172413793104
zh0.08306364617044228
is0.08108108108108109
reliabletrue
passestrue
14
name"Hunter"
dialogue"I gotta go. Stay in town. Don't leave the cafe."
detectedLang"en"
heavyLang"en"
scores
en0.7890979883192731
it0.5859872611464968
sv0.5517241379310345
yo0.5248538011695907
tl0.5178041543026707
pl0.49455676516329705
nl0.4247787610619469
no0.4247787610619469
ro0.41651705565529623
da0.4003690036900369
sq0.39478584729981375
hu0.35000000000000003
sl0.32150313152400833
ms0.3200836820083682
az0.3114406779661017
de0.3114406779661017
hr0.2995689655172413
ca0.29805615550755943
fi0.2562929061784897
cs0.24418604651162787
fr0.1935483870967742
sk0.181360201511335
be0.17721518987341772
tr0.17721518987341772
et0.16237113402061853
is0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
15
name"Marie"
dialogue"Mais... Vous n'avez pas vu les photos ! Monsieur ? Monsieur ! Ah, c'est incroyable, personne n'écoute jamais les touristes..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8001102839812517
ca0.4944211994421199
en0.4661266568483063
pt0.4444444444444444
es0.42414614773629866
de0.3861134631668078
lv0.3521000893655049
nl0.34802158273381295
lt0.3198874296435272
it0.31214421252371916
tl0.3015414258188825
ms0.2728184553660983
et0.240041928721174
sq0.2170626349892009
no0.19084821428571427
ro0.17986425339366516
cs0.1530373831775701
sv0.10714285714285714
fi0.10161090458488227
da0.09600997506234414
hi0.09600997506234414
tr0.0845959595959596
hu0.0799492385786802
is0.0799492385786802
az0.07525510204081631
hr0.07525510204081631
pl0.07525510204081631
sk0.07525510204081631
reliabletrue
passestrue