Run: 2026-02-24-01KJ8VTDAF4RA4ASA3ESNWJE6J

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
30.3s
Cost:
$0.002058
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: (Sitting at a cafe table, scrolling through photos on her camera. She looks up as Hunter approaches.) Hunter: Excuse me, are you Marie? The French student? Marie: (Nods, looking wary) Oui, c'est moi. Pourquoi? Hunter: I'm Detective Hunter. I'm investigating the disappearance of Liam Cooper. I understand you were in the area near the old mill yesterday afternoon, taking photographs. Is that correct? Marie: (Her face pales. She clutches her camera.) Le vieux moulin? Oui, j'y étais. Pour la lumière du soir. Mais... il est disparu? Liam? Mon Dieu... (She shakes her head, distressed.) Hunter: I'm sorry, I don't speak French. Do you understand English? Did you see anything unusual? Marie: (Speaking rapidly in French, growing more agitated) Je n'ai rien vu de spécial! Juste les arbres, la rivière. J'ai pris des photos. Attendez... (She turns her camera around, showing him the display.) Sur cette photo... il y a une silhouette. Là, près des buissons. Je ne l'avais pas remarquée avant. Hunter: (Leans in, squinting at the small screen.) A silhouette? I see it. That could be something. Can you send me that photo? (He pulls out a notepad, scribbling his email.) Here's my contact. Marie: (Takes the paper, looking confused.) Envoyer? Par email? D'accord, je vais essayer. Mais monsieur le détective... j'ai peur. C'est la deuxième personne cette année, non? Hunter: (Frowns, not understanding the question.) Look, just email me the picture, okay? It's important. (Marie continues speaking in French, her voice trembling. Hunter's phone rings sharply.) Hunter: (Holds up a finger, answering.) Hunter. ... Yeah. Where? I'm on my way. (He hangs up, turning back to Marie.) I have to go. Email that photo. And stay in town, please. We'll need to talk again, with a translator. Marie: (Nods, looking even more shaken.) Je resterai. Faites attention. Hunter: (Gives a curt nod and hurries off.)
created_at"2026-02-24T22:20:22.233Z" 2/24/2026, 10:20:22 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2712
moderation_latency(null)
generation_time30261
tokens_prompt316
tokens_completion1234
native_tokens_prompt366
native_tokens_completion1103
native_tokens_completion_images(null)
native_tokens_reasoning727
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0020576
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"ab603859-283f-4248-9f97-5a3e9d8f99f7"
is_byokfalse
latency162
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971622-sM9HRSXgbb3MykxQiPf8"
upstream_id"ab603859-283f-4248-9f97-5a3e9d8f99f7"
total_cost0.0020576
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, are you Marie? The French student?"
detectedLang"en"
heavyLang"en"
scores
en0.7711670480549199
tl0.6192893401015229
no0.6103896103896105
ro0.6088657105606258
fr0.6026490066225165
sq0.5879120879120879
it0.5652173913043478
nl0.5529061102831594
sv0.5405819295558958
da0.5356037151702787
cs0.48186528497409326
es0.4708994708994709
pt0.45750452079566006
et0.4318181818181818
ms0.42857142857142855
sl0.42196531791907516
pl0.40476190476190477
de0.3951612903225807
sk0.3902439024390244
yo0.3617021276595745
ca0.336283185840708
hr0.336283185840708
lt0.3135011441647597
fi0.3087557603686636
lv0.3006993006993007
az0.2
eu0.17355371900826447
hu0.16434540389972147
reliabletrue
passestrue
1
name"Marie"
dialogue"Oui, c'est moi. Pourquoi?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8419150858175248
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm Detective Hunter. I'm investigating the disappearance of Liam Cooper. I understand you were in the area near the old mill yesterday afternoon, taking photographs. Is that correct?"
detectedLang"en"
heavyLang"en"
scores
en0.7912127814088599
tl0.6482104619149588
nl0.5980426424327159
fr0.5383380168606985
no0.5153813737884535
it0.4909251881363435
ro0.48591864103710325
da0.4578029231494578
de0.4508118433619866
sv0.4508118433619866
pt0.44336882865440463
ca0.40135346173867775
es0.358974358974359
sl0.35284186831738884
sq0.3473325766174802
yo0.3329466357308584
cs0.3179122182680902
is0.31425163983303517
sk0.3051359516616314
hr0.2896849907350216
ms0.2874845105328377
pl0.2551813471502591
az0.18727915194346292
et0.18612880396319886
hu0.1611962071480671
tr0.1575091575091575
lt0.14115011202389843
fi0.1078355314197052
lv0.10366328916601715
hi0.06275468622656886
be0.05737704918032788
uk0.05193734542456719
vi0.05193734542456719
reliabletrue
passestrue
3
name"Marie"
dialogue"Le vieux moulin? Oui, j'y étais. Pour la lumière du soir. Mais... il est disparu? Liam? Mon Dieu..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8163452708907254
ro0.5184590690208668
it0.4863013698630137
es0.39271255060728744
pt0.3775933609958506
ca0.36575052854122625
tl0.3142857142857143
sq0.2797118847539016
lt0.2665036674816626
yo0.2628992628992629
da0.2537313432835821
no0.23857868020304565
vi0.23371647509578544
de0.2277992277992278
eu0.19137466307277629
sl0.16317991631799164
az0.16083916083916083
sv0.16083916083916083
lv0.1452991452991453
nl0.14285714285714285
hu0.14040114613180515
tr0.12280701754385964
en0.12023460410557184
hi0.11504424778761062
fi0.11242603550295857
cs0.1031390134529148
sk0.1031390134529148
reliabletrue
passestrue
4
name"Hunter"
dialogue"I'm sorry, I don't speak French. Do you understand English? Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.798590130916415
tl0.5069843878389483
no0.46619217081850534
da0.460431654676259
pt0.4152046783625731
sv0.41234084231145934
cs0.39999999999999997
sq0.36908517350157727
pl0.36642027455121434
et0.3603411513859275
hr0.35553168635875404
sk0.3281075027995521
it0.3273542600896861
de0.3063583815028902
ro0.2822966507177033
ms0.27448609431680776
nl0.22879177377892032
es0.22580645161290325
vi0.2248062015503876
yo0.21568627450980393
ca0.18699186991869918
is0.18588873812754408
sl0.16666666666666666
be0.1044776119402985
tr0.1044776119402985
hu0.10044977511244377
az0.09502262443438914
lt0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
5
name"Marie"
dialogue"Je n'ai rien vu de spécial! Juste les arbres, la rivière. J'ai pris des photos. Attendez... Sur cette photo... il y a une silhouette. Là, près des buissons. Je ne l'avais pas remarquée avant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8052656176974606
ca0.6441787645886707
es0.5449581361485257
it0.49433656957928807
en0.45462478184991273
ro0.4503078276165347
pt0.4310423304506145
nl0.41833410888785477
no0.4013409961685824
de0.3690055527511358
tl0.33083511777301927
sv0.3297587131367293
da0.32505399568034554
sq0.31991294885745375
tr0.3131868131868132
yo0.3078626799557032
lt0.2707117852975496
hu0.2664319248826291
cs0.2642731018246027
vi0.24653405666063893
lv0.24104432301153617
hr0.24058323207776428
sl0.23826934795856186
et0.23640806353084912
ms0.22408441961514589
pl0.1940683430045132
sk0.18032786885245902
az0.16555407209612816
eu0.14442162902121833
is0.1090520313613685
fi0.10778015703069237
hi0.058025621703089676
reliabletrue
passestrue
6
name"Hunter"
dialogue"A silhouette? I see it. That could be something. Can you send me that photo? Here's my contact."
detectedLang"en"
heavyLang"en"
scores
en0.8079287031346035
fr0.5736698499317872
tl0.5394252026529108
cs0.4743481917577796
it0.46717817561807334
es0.44982394366197187
nl0.436429215509468
ca0.4307832422586521
hu0.42343173431734316
sq0.4131455399061033
pt0.41148775894538603
no0.40926275992438566
da0.38665358194308147
yo0.3854473942969518
et0.38484251968503935
sk0.37311935807422264
ro0.35765673175745116
pl0.3407172995780591
tr0.32867883995703545
ms0.3265086206896552
lt0.2913832199546485
hr0.2865296803652968
lv0.259478672985782
az0.251497005988024
sv0.2433414043583535
sl0.22166874221668745
de0.19871794871794873
fi0.18086500655307994
is0.18086500655307994
vi0.17546174142480211
hi0.10968660968660969
be0.10071942446043164
eu0.10071942446043164
uk0.09156976744186046
reliabletrue
passestrue
7
name"Marie"
dialogue"Envoyer? Par email? D'accord, je vais essayer. Mais monsieur le détective... j'ai peur. C'est la deuxième personne cette année, non?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8236677115987461
it0.5447647951441578
en0.43467336683417085
ro0.4019933554817276
de0.3482983345401882
pt0.3430656934306569
es0.3343195266272189
sl0.3298585256887565
ca0.3293591654247392
tl0.30394431554524365
yo0.29522317932654657
no0.2907801418439716
da0.2868462757527734
cs0.2857142857142857
nl0.2828685258964143
sq0.2647058823529412
hr0.24812030075187969
hu0.23728813559322032
sv0.2153443766346992
lv0.20353982300884957
tr0.2
sk0.1847826086956522
eu0.1712707182320442
ms0.16201117318435754
pl0.14285714285714285
vi0.08536585365853659
lt0.07407407407407407
is0.06542056074766354
az0.06152241918665276
et0.06152241918665276
reliabletrue
passestrue
8
name"Hunter"
dialogue"Look, just email me the picture, okay? It's important."
detectedLang"en"
heavyLang"en"
scores
en0.7973815461346634
tl0.6494066882416397
fr0.6412803532008831
sq0.5751633986928104
ca0.5357142857142857
it0.5262390670553936
ro0.5206489675516224
no0.4992295839753467
es0.4791666666666667
pt0.4672131147540984
ms0.4328097731239092
sv0.4318181818181818
nl0.4237588652482269
da0.3992606284658041
et0.37739463601532564
yo0.3538767395626242
sl0.34077079107505076
tr0.32432432432432434
cs0.32150313152400833
eu0.23349056603773585
hr0.20924574209245742
fi0.1875
de0.1792929292929293
lt0.1792929292929293
reliabletrue
passestrue
9
name"Hunter"
dialogue"Hunter. ... Yeah. Where? I'm on my way. I have to go. Email that photo. And stay in town, please. We'll need to talk again, with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.8135520988706584
tl0.6028143440762597
pl0.4988545246277205
cs0.4868035190615836
ro0.4412515964240102
yo0.4380218368657675
da0.4329228775113415
nl0.41432396251673365
hr0.39821182943603856
fr0.3936243936243936
sq0.3927827897293546
sk0.38939288206559663
sl0.383368569415081
et0.3811881188118812
no0.3754461099214847
de0.37005039596832257
it0.3695965417867435
ca0.3668596237337192
sv0.36270939548434084
ms0.3547197640117994
tr0.2827868852459016
pt0.28219852337981954
lv0.2690058479532163
lt0.2653232577665827
az0.23979148566463945
eu0.21242124212421243
hu0.20309653916211293
vi0.20164233576642335
fi0.1957720588235294
es0.19280442804428044
hi0.15540540540540537
is0.1362290227048371
be0.07407407407407407
uk0.06716417910447761
reliabletrue
passestrue
10
name"Marie"
dialogue"Je resterai. Faites attention."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7989276139410187
en0.7208436724565757
nl0.6467817896389325
it0.63884430176565
de0.6347402597402597
no0.6134020618556701
sv0.5945945945945946
yo0.5894160583941606
da0.5802238805970149
sl0.5706106870229007
hr0.5689655172413793
es0.560546875
lt0.560546875
ca0.5570866141732284
ms0.5481927710843374
tl0.5263157894736842
cs0.4827586206896552
pt0.47674418604651164
lv0.4630071599045346
et0.4578313253012048
fi0.39189189189189183
sk0.39189189189189183
ro0.3784530386740331
az0.358974358974359
sq0.358974358974359
pl0.2879746835443038
eu0.27184466019417475
zh0.2549668874172185
tr0.2077464788732394
reliabletrue
passestrue