Run: 2026-02-24-01KJ8X4SPWH74AE5P66B0AYYFC

Run Details

Model:
Aion 2.0
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
48.1s
Cost:
$0.003275
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: (Looking up from her camera, startled) "Pardon? Je ne parle pas anglais." (Pardon? I don't speak English.) Hunter: "Excuse me, miss? I'm Detective Hunter with the Alborn PD. Mind if I ask you a few questions? About the missing student?" Marie: (Her expression darkens) "Un étudiant disparu? Mon Dieu... J'ai peut-être vu quelque chose." (A missing student? My God... I might have seen something.) Hunter: (Leaning in, frustrated) "I don't understand. Do you speak English? Anything about last night? The old mill?" Marie: (She clutches her camera, hands trembling) "Hier soir, près du vieux moulin... J'étais là pour prendre des photos. J'ai vu une voiture noire. Et un homme. Il traînait quelque chose... quelque chose de lourd." (Last night, near the old mill... I was there to take photos. I saw a black car. And a man. He was dragging something... something heavy.) Hunter: "A car? A man? Can you show me? The photos?" (He points to her camera.) Marie: (Nods, scrolling through the camera's display) "Oui, voici." (Yes, here.) Hunter: (Examining the image) "That's it? That blur? This could be something. I need to take this in." Marie: "Prendre mon appareil? Non, s'il vous plaît, c'est important pour moi!" (Take my camera? No, please, it's important to me!) Hunter: (His phone rings) "Hold on." (He answers) "Hunter. Yeah. Right now? Okay." (He hangs up) "I have to go. Stay here. I'll be back with someone who can understand you. Don't leave." Marie: (Worried) "D'accord. Je vais attendre." (Okay. I will wait.) Hunter: (Already walking away) "Good. Stay put."
created_at"2026-02-24T22:43:31.173Z" 2/24/2026, 10:43:31 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2196
moderation_latency(null)
generation_time48006
tokens_prompt316
tokens_completion2054
native_tokens_prompt366
native_tokens_completion1864
native_tokens_completion_images(null)
native_tokens_reasoning1635
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0032752
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"81180542-6069-4528-a046-79ccbf52a6d8"
is_byokfalse
latency248
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771973011-lcJRE57kOfy4JkgKAml9"
upstream_id"81180542-6069-4528-a046-79ccbf52a6d8"
total_cost0.0032752
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Pardon? Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7575431034482759
lt0.7107969151670951
sl0.6983914209115282
cs0.6771879483500717
sq0.6299342105263158
hr0.6066433566433567
ca0.5825602968460111
sk0.5596868884540117
nl0.5544554455445544
lv0.5322245322245323
it0.5192307692307693
ro0.5192307692307693
yo0.4201030927835051
pl0.412532637075718
tr0.40476190476190477
hu0.39839572192513373
ms0.3951612903225807
es0.3935309973045822
de0.3885869565217392
en0.3732590529247911
tl0.3181818181818182
fi0.281150159744409
az0.23728813559322032
et0.21875
pt0.21875
da0.2077464788732394
no0.2077464788732394
sv0.2077464788732394
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? I'm Detective Hunter with the Alborn PD. Mind if I ask you a few questions? About the missing student?"
detectedLang"en"
heavyLang"en"
scores
en0.7916666666666666
tl0.5946652719665272
fr0.5892951775304717
it0.5711123408965135
ca0.5107323232323233
nl0.5076238881829733
no0.5019280205655527
ro0.5016077170418006
sv0.4901315789473684
sq0.4826435246995994
da0.4816053511705686
pt0.47457627118644075
cs0.4056748466257669
es0.386381631037213
ms0.3785084202085004
de0.3642329778506973
et0.3642329778506973
hr0.33760683760683763
hu0.3231441048034934
pl0.32195975503062113
sl0.3189806678383128
sk0.29927667269439423
yo0.2876838235294118
is0.27230046948356806
az0.2604961832061069
fi0.21796165489404642
lt0.21717171717171715
tr0.20998980632008157
lv0.20756646216768918
vi0.14647577092511013
be0.08284023668639054
eu0.08284023668639054
uk0.07517899761336516
reliabletrue
passestrue
2
name"Marie"
dialogue"Un étudiant disparu? Mon Dieu... J'ai peut-être vu quelque chose."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8179871520342612
en0.4835965978128797
ca0.48296836982968366
it0.46808510638297873
es0.44152431011826543
ro0.36281859070464767
lv0.28209459459459457
de0.256993006993007
yo0.19962335216572505
pt0.1904761904761905
lt0.18738049713193117
ms0.17953667953667954
da0.1550695825049702
hi0.1550695825049702
cs0.13967611336032387
sk0.13967611336032387
sq0.13967611336032387
reliabletrue
passestrue
3
name"Hunter"
dialogue"I don't understand. Do you speak English? Anything about last night? The old mill?"
detectedLang"en"
heavyLang"en"
scores
en0.8191255111670337
tl0.612533692722372
no0.5465299684542587
da0.5359160613397902
sv0.46461824953445063
sq0.4272908366533864
cs0.41025641025641024
pl0.37635574837310193
yo0.3756786102062975
de0.37089715536105033
nl0.37089715536105033
hr0.3653421633554084
sk0.33755760368663595
ro0.2909987669543773
ms0.28393524283935245
vi0.23230974632843793
pt0.213406292749658
fr0.20907840440165062
et0.1958041958041958
ca0.1935483870967742
is0.19241573033707865
sl0.1726618705035971
it0.16666666666666666
be0.10852713178294573
tr0.10852713178294573
hu0.1043613707165109
az0.0987460815047022
lt0.0987460815047022
lv0.0987460815047022
uk0.0987460815047022
reliabletrue
passestrue
4
name"Marie"
dialogue"Hier soir, près du vieux moulin... J'étais là pour prendre des photos. J'ai vu une voiture noire. Et un homme. Il traînait quelque chose... quelque chose de lourd."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8175182481751825
ca0.5109732824427481
it0.4026806526806527
de0.3880597014925373
da0.37953995157384984
pt0.36845348120764015
en0.3621655258245177
no0.35817157169693176
es0.3157543391188251
ro0.2735648476257973
yo0.25939306358381503
lv0.24908424908424906
tl0.24743024963289278
et0.24242424242424243
nl0.24186390532544377
sv0.2384843982169391
lt0.22524565381708242
vi0.19984387197501954
tr0.19796557120500782
fi0.1760450160771704
eu0.1713823767178658
az0.1479634247714048
sl0.14297658862876253
hr0.13937867338371118
sq0.11561691113028472
hu0.08645276292335115
sk0.07239819004524886
hi0.06987295825771324
ms0.057904411764705885
reliabletrue
passestrue
5
name"Hunter"
dialogue"A car? A man? Can you show me? The photos?"
detectedLang"en"
heavyLang"en"
scores
en0.8183139534883721
fr0.7034400948991696
tl0.6794871794871795
nl0.6603260869565218
pt0.6062992125984252
no0.5833333333333334
es0.5567375886524822
sq0.5437956204379563
ca0.5318352059925093
da0.5274102079395085
sv0.5173745173745175
lt0.5059288537549407
de0.503968253968254
lv0.49899799599198397
yo0.4747899159663866
ms0.47368421052631576
cs0.45652173913043476
it0.45054945054945056
sl0.41588785046728977
et0.3872549019607844
hu0.3842364532019704
tr0.3811881188118812
az0.37027707808564225
ro0.3573264781491003
fi0.3556701030927836
sk0.34210526315789475
hr0.3093922651933701
pl0.29577464788732394
hi0.23547400611620795
is0.23076923076923078
eu0.21875
vi0.21875
reliabletrue
passestrue
6
name"Marie"
dialogue"Oui, voici."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7933884297520661
en0.5098039215686274
ja0.5098039215686274
reliabletrue
passestrue
7
name"Hunter"
dialogue"That's it? That blur? This could be something. I need to take this in."
detectedLang"en"
heavyLang"en"
scores
en0.8391370174110522
tl0.6235606731620904
yo0.5395449620801733
sl0.4537275064267352
pl0.448051948051948
sq0.42953020134228187
lt0.3963068181818182
lv0.38936781609195403
it0.3813682678311499
hr0.375
no0.37407952871870404
sv0.3656716417910448
da0.36377245508982037
cs0.35703479576399394
ro0.3531202435312024
sk0.32432432432432434
et0.32216905901116427
hu0.30213464696223313
nl0.2685025817555938
ms0.2647058823529412
az0.256993006993007
de0.256993006993007
ca0.24511545293072823
fr0.2085661080074488
es0.1550695825049702
pt0.1550695825049702
be0.1414141414141414
tr0.1414141414141414
is0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
8
name"Marie"
dialogue"Prendre mon appareil? Non, s'il vous plaît, c'est important pour moi!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8122653316645806
ca0.5742667928098392
it0.5436105476673428
en0.503858875413451
da0.43109987357774965
es0.3860845839017735
ro0.37931034482758624
no0.37413073713490963
pt0.3732590529247911
tl0.3430656934306569
sv0.26108374384236455
tr0.25124792013311154
nl0.2474916387959866
sl0.16820702402957485
eu0.16201117318435754
hr0.15094339622641512
sk0.15094339622641512
hi0.14772727272727273
lt0.1362763915547025
sq0.12959381044487428
reliabletrue
passestrue
9
name"Hunter"
dialogue"I have to go. Stay here. I'll be back with someone who can understand you. Don't leave."
detectedLang"en"
heavyLang"en"
scores
en0.8230942425217112
da0.556809024979855
tl0.507168458781362
no0.5004541326067212
pl0.448345035105316
yo0.42767950052029136
cs0.41983122362869196
sv0.38820912124582874
sk0.3475682087781732
lt0.3365500603136309
hr0.3167701863354037
sq0.298469387755102
ca0.28104575163398693
de0.2597577388963661
lv0.25170068027210885
hu0.2506811989100818
nl0.2445054945054945
ro0.22969187675070027
tr0.2109038737446198
az0.20289855072463767
is0.19941775836972345
sl0.18032786885245902
it0.1729323308270677
es0.12420382165605094
ms0.12420382165605094
pt0.12420382165605094
be0.11290322580645161
et0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
10
name"Marie"
dialogue"D'accord. Je vais attendre."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8071359691417551
ca0.6742671009771987
it0.6389891696750902
no0.5085995085995086
nl0.49748743718592964
en0.47643979057591623
sl0.46380697050938335
hr0.4609164420485175
yo0.4490358126721763
cs0.42363112391930835
sk0.42028985507246375
da0.38461538461538464
sv0.3150684931506849
pl0.3127147766323024
ro0.2907801418439716
tl0.2907801418439716
de0.2857142857142857
lv0.2753623188405797
es0.2647058823529412
reliabletrue
passestrue
11
name"Hunter"
dialogue"Good. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8267898383371826
hr0.625
tl0.5714285714285714
reliabletrue
passestrue