Run: 2026-09-24-01M39VNZ6ZRHDDG87PDN4QV3CR

Run Details

Model:
Aion 3.5 Mini (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
51.3s
Cost:
$0.003812
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Hunter: "Ma'am. Detective Hunter, Alborn PD. We're investigating a disappearance near the Miller's Creek Orchard. You were seen there yesterday evening. I need to know exactly what you witnessed." Marie: "Oh, mon Dieu... Le verger... J'y étais pour photographier la lumière du soir. C'était si paisible... et puis, soudain, il y avait cet homme près des vieux chênes. Il avait l'air complètement perdu." Hunter: "Lost? What do you mean, lost? Did he approach you? Did you get a name or a description?" Marie: "Je ne comprends pas ce que vous dites... Il marchait vers la lisière du bois. J'ai pris une photo, juste une seule. Et après... il n'était plus là. Parti. Disparu dans l'air." Hunter: "Ma'am, if you're trying to tell me someone vanished into thin air, this isn't a magic show. This is a potential homicide. Did you see a vehicle? Blood? Anything out of place?" Marie: "Du sang ? Non ! Rien de tout ça. Mais mes photos... Regardez l'écran. Il y a quelque chose dans l'ombre des arbres. Quelque chose de sombre. Je n'ose pas zoomer, c'est terrifiant." Hunter: "I don't know what you're pointing at, and I don't have time for a photography lesson. The whole town is on edge. Three people missing in two months. If you know something, you need to start talking straight." Marie: "Trois ? Il y en a eu trois ? Je pensais que c'était juste monsieur Peterson... C'est affreux. J'ai l'impression que cette chose dans le bois me regardait aussi. J'ai très peur, détective. Très peur." Hunter: (Phone buzzes) "Hunter. Yeah? I'm at the cafe on Main Street. Understood. I'm moving." (To Marie) "Stay right here. Don't leave town. We're going to do this again, and this time, you're going to make some sense." Marie: "Attendez ! Non ! Vous ne pouvez pas partir ! Vous devez regarder l'appareil photo ! S'il vous plaît ! Revenez ici !"
created_at"2026-09-24T14:04:02.155Z" 9/24/2026, 2:04:02 PM
model"aion-labs/aion-3.5-mini-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1796
moderation_latency(null)
generation_time51225
tokens_prompt303
tokens_completion2573
native_tokens_prompt266
native_tokens_completion2590
native_tokens_completion_images(null)
native_tokens_reasoning2103
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0038122
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer(null)
request_id"req-1790258642-gZyDnkke04ZESYJKF5wc"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1790258642-T3zCI2e5f5Jqw90q0Jdy"
upstream_id"992e6017bacf4782a05cf4a15aa9465b"
provider_responses
0
endpoint_id"60ac3bdc-90ec-4769-9193-2c00b4d79562"
id"992e6017bacf4782a05cf4a15aa9465b"
is_byokfalse
latency1796
model_permaslug"aion-labs/aion-3.5-mini-20260923"
provider_name"AionLabs"
status200
total_cost0.0038122
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Ma'am. Detective Hunter, Alborn PD. We're investigating a disappearance near the Miller's Creek Orchard. You were seen there yesterday evening. I need to know exactly what you witnessed."
detectedLang"en"
heavyLang"en"
scores
en0.782192019515595
tl0.5370370370370371
nl0.49124949124949124
no0.486863711001642
it0.48368442792234617
ro0.4712351945854484
fr0.46626814688300594
da0.4510320597277119
de0.421831637372803
es0.4117647058823529
sv0.397009165460685
pt0.3964268469338484
ca0.3759360958562157
cs0.36386768447837153
hr0.35798664612223935
sq0.35600206079340546
sk0.2981471083660865
sl0.2961711711711712
yo0.2893689596361569
et0.2824339839265212
is0.27494199535962877
ms0.26556991774383076
lt0.23076923076923078
pl0.2264851485148515
az0.21383647798742136
lv0.20634920634920634
hu0.1997439180537772
tr0.18725617685305593
fi0.18513689700130379
vi0.09616775126536516
ja0.07407407407407407
be0.05303030303030303
eu0.05303030303030303
uk0.04798172124904798
reliabletrue
passestrue
1
name"Marie"
dialogue"Oh, mon Dieu... Le verger... J'y étais pour photographier la lumière du soir. C'était si paisible... et puis, soudain, il y avait cet homme près des vieux chênes. Il avait l'air complètement perdu."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8075805983154226
ca0.5311394196744516
en0.413716814159292
es0.4012652507907818
it0.400181077410593
ro0.3708452041785375
tl0.3256997455470738
no0.3253564154786151
da0.315599173553719
nl0.3055555555555556
de0.283008658008658
sq0.24458380843785632
et0.2389431361286617
yo0.2318840579710145
lt0.21921037124337067
cs0.1930572472594397
pt0.1881127450980392
vi0.17496886674968867
az0.16086130462317924
sv0.15979708306911858
fi0.14900449582530506
sl0.1468126207340631
sk0.12309728656518862
pl0.11489645958583836
tr0.1137123745819398
hu0.10834454912516824
hi0.10472972972972973
eu0.09679618268575323
lv0.07147862648913805
ms0.07147862648913805
hr0.045389048991354465
reliabletrue
passestrue
2
name"Hunter"
dialogue"Lost? What do you mean, lost? Did he approach you? Did you get a name or a description?"
detectedLang"en"
heavyLang"en"
scores
en0.8263888888888888
fr0.6066433566433567
tl0.5389344262295082
ca0.47368421052631576
pt0.469964664310954
es0.46808510638297873
yo0.4655581947743468
cs0.4325346784363178
nl0.402390438247012
it0.4015957446808511
de0.3679775280898876
sk0.3679775280898876
pl0.3553008595988539
ro0.34971098265895956
fi0.3440233236151603
hr0.3401759530791789
sl0.3181818181818182
sq0.29577464788732394
da0.2890995260663507
vi0.2868462757527734
is0.27999999999999997
sv0.2730210016155089
hu0.25742574257425743
no0.24623115577889448
lt0.15413533834586465
tr0.14611005692599618
zh0.14611005692599618
az0.1346153846153846
eu0.1346153846153846
lv0.1346153846153846
et0.12280701754385964
ms0.12280701754385964
reliabletrue
passestrue
3
name"Marie"
dialogue"Je ne comprends pas ce que vous dites... Il marchait vers la lisière du bois. J'ai pris une photo, juste une seule. Et après... il n'était plus là. Parti. Disparu dans l'air."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8187549251379038
ca0.5658739146847868
ro0.4856887298747764
it0.4753649635036496
es0.459332393041843
da0.4147582697201017
pt0.4093477144324602
en0.40135346173867775
de0.3451025056947608
nl0.34472934472934474
no0.343607305936073
lt0.34285714285714286
et0.3263034563561804
tl0.3191237418590882
sv0.3166963755199049
sq0.31384248210023863
yo0.2909987669543773
ms0.2848258706467662
cs0.28080050031269543
sk0.2730720606826802
sl0.27261227071473754
hr0.23384410393071284
vi0.22818791946308725
tr0.2144808743169399
eu0.20304920304920307
pl0.167270094134685
az0.1449814126394052
lv0.1320754716981132
hu0.11196911196911197
fi0.07108239095315023
is0.07108239095315023
hi0.06275468622656886
reliabletrue
passestrue
4
name"Hunter"
dialogue"Ma'am, if you're trying to tell me someone vanished into thin air, this isn't a magic show. This is a potential homicide. Did you see a vehicle? Blood? Anything out of place?"
detectedLang"en"
heavyLang"en"
scores
en0.7927927927927928
tl0.5713753261274692
fr0.42842942345924456
pt0.42355889724310775
es0.4059917355371901
ro0.3837084673097535
nl0.36004451864218145
cs0.3488108720271801
yo0.32590855803048063
ca0.3076459963877182
it0.30639324487334135
no0.2953431372549019
da0.2923076923076923
ms0.28615766604593423
sl0.28125
sq0.27944862155388467
sk0.2542153047989624
et0.2517891997397528
pl0.25032594524119944
hr0.2374005305039788
hu0.21232876712328766
lv0.21232876712328766
sv0.2041522491349481
de0.19127988748241914
is0.18207681365576103
lt0.1779842744817727
fi0.14877868245743894
az0.14561664190193166
tr0.06275468622656886
eu0.05737704918032788
vi0.05737704918032788
reliabletrue
passestrue
5
name"Marie"
dialogue"Du sang ? Non ! Rien de tout ça. Mais mes photos... Regardez l'écran. Il y a quelque chose dans l'ombre des arbres. Quelque chose de sombre. Je n'ose pas zoomer, c'est terrifiant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.787363304981774
ca0.5684340320591862
en0.5111731843575419
es0.4845360824742268
it0.46126218573627503
nl0.42560175054704596
pt0.39620471535365154
de0.39095127610208813
da0.34660858742999384
lt0.34497816593886466
ro0.33586337760910817
sq0.29006085192697767
no0.28716904276985744
tl0.27083333333333337
yo0.2636746143057504
eu0.26004228329809725
vi0.26004228329809725
pl0.25531914893617025
sv0.2526690391459075
hu0.23133235724743775
az0.22850844966936076
hr0.21230307576894225
cs0.20993227990970656
sk0.20754716981132076
sl0.2003046458492003
tr0.19786096256684493
ms0.16666666666666666
lv0.11838790931989925
et0.10714285714285714
fi0.10409556313993173
hi0.06832298136645963
is0.06666666666666668
reliabletrue
passestrue
6
name"Hunter"
dialogue"I don't know what you're pointing at, and I don't have time for a photography lesson. The whole town is on edge. Three people missing in two months. If you know something, you need to start talking straight."
detectedLang"en"
heavyLang"en"
scores
en0.8277878866649337
tl0.6472310969116081
da0.5329573493126543
no0.5319675026492405
fr0.47731755424063116
sv0.4646464646464647
nl0.45066334991708124
yo0.42139737991266374
hr0.3848653667595172
de0.3799719232569022
it0.3785178236397749
is0.37822618488972315
pl0.3711438063597532
ro0.3504901960784314
cs0.34046789447486314
pt0.3318204740292486
sk0.3232890704800817
et0.31240269849507
ms0.2963356346255975
sl0.2860991379310345
ca0.27871529667936856
lt0.2581187010078388
lv0.2332175925925926
sq0.23277359583092067
hu0.22150411280846063
fi0.208955223880597
az0.20468187274909963
es0.17290886392009988
tr0.16666666666666666
hi0.10834454912516824
vi0.09122085048010975
be0.05017921146953405
eu0.05017921146953405
uk0.045389048991354465
reliabletrue
passestrue
7
name"Marie"
dialogue"Trois ? Il y en a eu trois ? Je pensais que c'était juste monsieur Peterson... C'est affreux. J'ai l'impression que cette chose dans le bois me regardait aussi. J'ai très peur, détective. Très peur."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8135997614076946
it0.514751552795031
en0.5130502532138683
ca0.5
es0.48111249481112495
pt0.45367132867132864
da0.4515138218516893
no0.4437027147307522
nl0.42502299908003677
de0.3996157540826129
sv0.397009165460685
ro0.3896484375
sl0.3784186971655893
et0.281196089706728
sq0.2732558139534884
tl0.2724097788125727
tr0.26340601060695346
fi0.26122931442080377
hu0.26035502958579887
hr0.2537313432835821
az0.24969987995198079
sk0.24969987995198079
yo0.24425634824667475
cs0.21875
pl0.1940683430045132
is0.1830065359477124
ms0.18032786885245902
lt0.16611074049366245
eu0.14733969986357437
vi0.11847672778561354
lv0.10136592379583033
reliabletrue
passestrue
8
name"Hunter"
dialogue"Stay right here. Don't leave town. We're going to do this again, and this time, you're going to make some sense."
detectedLang"en"
heavyLang"en"
scores
en0.8319979322822434
tl0.5041952707856598
pt0.3821292775665399
yo0.3737957610789981
pl0.3486973947895792
no0.33537832310838445
da0.3319630010277493
hr0.3298969072164949
nl0.2995689655172413
cs0.28884026258205686
sk0.28884026258205686
fr0.27048260381593714
sl0.27048260381593714
sq0.2502883506343714
ca0.24065420560747666
es0.19154228855721395
it0.19154228855721395
de0.181360201511335
lv0.15803108808290156
vi0.14586070959264125
lt0.13793103448275862
ms0.09722222222222222
ro0.09722222222222222
reliabletrue
passestrue
9
name"Marie"
dialogue"Attendez ! Non ! Vous ne pouvez pas partir ! Vous devez regarder l'appareil photo ! S'il vous plaît ! Revenez ici !"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8000592417061612
en0.5730550284629982
ca0.5625405055087491
it0.5
es0.46471054718477395
pt0.4453574363188167
nl0.4026548672566372
tl0.4015957446808511
ro0.39946619217081847
no0.3522072936660269
sq0.3147208121827411
eu0.3133265513733469
sl0.291710388247639
lt0.29096638655462187
hr0.28038379530916846
lv0.2710583153347732
sv0.25742574257425743
cs0.2566079295154185
da0.2524916943521595
tr0.25083240843507215
fi0.21784472769409038
de0.20118343195266272
ms0.18576598311218334
hu0.17682926829268292
et0.16666666666666666
az0.10596026490066225
hi0.10239361702127658
is0.10119840213049268
pl0.09395973154362416
sk0.08536585365853659
yo0.08038147138964578
reliabletrue
passestrue