Run: 2026-07-07-01KWZ3CV4CG43WCEN959KNKDTH

Run Details

Model:
Aion 3.0 Mini
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
27.1s
Cost:
$0.001676
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
**Voice Sheet** --- **Marie:** *(Troubled, staring at her camera screen)* "Je ne comprends pas... ces photos... quelque chose ne va pas. Il y avait un homme, près du chapiteau. Il me regardait toujours." **Hunter:** "Excuse me, miss? I'm Detective Hunter. I need to ask you about the disappearance at the apple festival. Did you see anything unusual?" **Marie:** *(Startled, voice shaking)* "Le festival... oui, j'étais là. Mais cet homme, il était partout. Je l'ai photographié sans le savoir, et maintenant..." *(She turns the camera toward him, speaking rapidly)* "Regardez! Son visage est flou sur toutes les images, sauf une. C'est comme s'il voulait qu'on le voie." **Hunter:** *(Frowning, leaning in)* "I'm sorry, I didn't catch that. Do you speak English? *English?*" **Marie:** *(Frantic now, in French)* "Non, non, vous devez comprendre! La femme qui a disparu—elle parlait avec lui sous les lumières. J'ai la preuve!" **Hunter:** *(Sighs, rubs his forehead)* "Look, ma'am, I really need to—" *(His phone buzzes loudly. He glances at it.)* "Hold on. One second." **Marie:** "Ne partez pas! Je sais à quoi il ressemble! Il portait un chapeau noir, et ses yeux..." **Hunter:** *(Into phone)* "Hunter here. Yeah? Where? The old grain silo? I'm on my way." *(He hangs up, turning back to Marie, speaking slowly)* "I have to go. Stay here. I'll find someone who speaks—" *(He gestures vaguely)* "—your language. Don't leave town." **Marie:** *(Desperate, reaching out)* "Attendez! Son nom—je l'ai entendu dire 'Call me Felix.' Felix! Vous comprenez?" **Hunter:** *(Already walking away, not looking back)* "I'll be back. Just... stay put." **Marie:** *(To herself, in a whisper)* "Felix... je dois trouver Felix." ---
created_at"2026-07-07T20:13:02.007Z" 7/7/2026, 8:13:02 PM
model"aion-labs/aion-3.0-mini-20260707"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency700
moderation_latency(null)
generation_time27031
tokens_prompt316
tokens_completion1089
native_tokens_prompt262
native_tokens_completion1066
native_tokens_completion_images(null)
native_tokens_reasoning626
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0016758
router(null)
provider_responses
0
endpoint_id"0ad7ab68-a351-4a96-b2ef-fa8fe13adae3"
id"fadd98cb78f74a86a1833f057b35b4f8"
is_byokfalse
latency663
model_permaslug"aion-labs/aion-3.0-mini-20260707"
provider_name"AionLabs"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1783455182-qA6BGcPu3jdGIrYZ6uk5"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1783455182-uYBsfkQ7NGXORlbbWBis"
upstream_id"fadd98cb78f74a86a1833f057b35b4f8"
total_cost0.0016758
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Je ne comprends pas... ces photos... quelque chose ne va pas. Il y avait un homme, près du chapiteau. Il me regardait toujours."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8186473223810539
ca0.5672097759674134
en0.5656617271333674
it0.5382944052145573
es0.5114942528735632
ro0.47270471464019853
lt0.3531202435312024
nl0.3526275704493526
pt0.3441358024691358
de0.3275316455696203
sl0.31396287328490724
sq0.3122977346278317
lv0.2863140218303946
tl0.2728828058169376
no0.2530755711775044
hr0.2504409171075838
tr0.24242424242424243
yo0.24039320822162644
et0.23835125448028674
fi0.22089825847846015
da0.21731123388581952
cs0.21223354958294718
az0.20112781954887218
vi0.18815663801337154
pl0.18738049713193117
ms0.1650294695481336
sk0.1457286432160804
eu0.1431451612903226
sv0.11917098445595854
hu0.08798283261802575
hi0.08306364617044228
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss? I'm Detective Hunter. I need to ask you about the disappearance at the apple festival. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.79111959894963
tl0.5888157894736842
no0.5328350240256273
fr0.5221190606226106
da0.51035254616676
it0.4950952106174264
sq0.4779236276849642
es0.4631901840490798
nl0.45685909373060213
et0.44231994901210964
pt0.4292237442922375
ms0.4273560209424084
cs0.42244224422442245
sl0.4006849315068493
ca0.3998628257887517
hr0.39945092656142756
sv0.38380281690140844
ro0.37230989956958394
de0.3430930930930931
yo0.308300395256917
sk0.303343949044586
pl0.2702251876563803
lt0.2508561643835616
lv0.22083704363312553
az0.17140151515151517
fi0.1362290227048371
hu0.13280475718533202
tr0.12848605577689243
be0.07407407407407407
is0.06716417910447761
uk0.06716417910447761
vi0.06716417910447761
reliabletrue
passestrue
2
name"Marie"
dialogue"Regardez! Son visage est flou sur toutes les images, sauf une. C'est comme s'il voulait qu'on le voie."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8249027237354085
es0.46428571428571425
en0.458700882117081
ro0.4503257328990228
ca0.4026548672566372
tl0.37615526802218113
it0.3283582089552239
de0.32432432432432434
nl0.28646934460887946
et0.25331858407079644
da0.22235023041474655
no0.21602787456445993
yo0.15307402760351316
sl0.14772727272727273
az0.14012738853503184
lt0.13903061224489796
tr0.13793103448275862
sv0.1357234314980794
lv0.13350449293966624
hu0.12677878395860284
pt0.11533420707732633
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I didn't catch that. Do you speak English? English?"
detectedLang"en"
heavyLang"en"
scores
en0.808282208588957
tl0.584717607973422
hr0.4688385269121813
cs0.4573082489146165
sv0.44526627218934917
it0.4360902255639098
pl0.41770186335403725
pt0.40570522979397783
sq0.4009584664536741
no0.37707641196013286
da0.36006825938566556
sk0.35233160621761656
vi0.3169398907103825
yo0.3055555555555556
ro0.30167597765363136
de0.2816091954022989
ca0.2690058479532163
sl0.24242424242424243
fr0.19527896995708155
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
4
name"Marie"
dialogue"Non, non, vous devez comprendre! La femme qui a disparu—elle parlait avec lui sous les lumières. J'ai la preuve!"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8272773797338792
ca0.625
it0.6222719641857861
ro0.5656370656370656
es0.5325484764542936
en0.4734789391575663
pt0.43890274314214467
no0.43703085904920774
tl0.37615526802218113
sq0.3503368623676612
da0.3465634075508229
hr0.34146341463414637
sk0.3382352941176471
sl0.3161094224924012
cs0.281150159744409
fi0.2557883131201764
lt0.2549668874172185
nl0.24916573971078973
hu0.24832962138084633
sv0.2407199100112486
yo0.23814898419864558
de0.2276887871853547
pl0.20306965761511217
eu0.18870192307692307
vi0.18576598311218334
az0.17177914110429449
tr0.16769420468557336
lv0.16044776119402984
et0.15730337078651685
ms0.15730337078651685
is0.09999999999999999
reliabletrue
passestrue
5
name"Hunter"
dialogue"Hold on. One second."
detectedLang"en"
heavyLang"en"
scores
en0.819364161849711
tl0.7329059829059829
fr0.6898263027295286
hr0.5833333333333334
pl0.5777027027027027
et0.5519713261648745
fi0.5454545454545454
it0.4791666666666667
da0.47257383966244726
ca0.44196428571428575
hi0.40191387559808617
cs0.375
nl0.375
ro0.375
sk0.375
yo0.375
reliabletrue
passestrue
6
name"Marie"
dialogue"Ne partez pas! Je sais à quoi il ressemble! Il portait un chapeau noir, et ses yeux..."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8116929698708751
ca0.5849802371541503
it0.5610367892976589
yo0.49324324324324326
ro0.4883040935672514
pt0.4791666666666667
sl0.45595854922279794
da0.45426195426195426
hr0.44089456869009586
lv0.43548387096774194
tr0.42052980132450335
sq0.4198895027624309
et0.41536748329621387
nl0.40476190476190477
cs0.4006849315068493
no0.3937644341801385
lt0.3902439024390244
en0.38953488372093026
es0.37648456057007124
ms0.36363636363636365
de0.362089914945322
sk0.34045226130653267
az0.32605905006418484
pl0.3027888446215139
sv0.2866847826086956
hu0.2837653478854025
fi0.1435562805872757
eu0.13223140495867766
tl0.13223140495867766
reliabletrue
passestrue
7
name"Hunter"
dialogue"—your language. Don't leave town."
detectedLang"en"
heavyLang"en"
scores
en0.8169243287225387
ro0.4538834951456311
ms0.4230769230769231
tl0.38524590163934425
no0.2902208201892744
da0.27884615384615385
de0.27884615384615385
nl0.27884615384615385
is0.27184466019417475
et0.25742574257425743
eu0.25742574257425743
fr0.23728813559322032
lt0.21875
yo0.21875
reliabletrue
passestrue
8
name"Marie"
dialogue"Attendez! Son nom—je l'ai entendu dire 'Call me Felix.' Felix! Vous comprenez?"
detectedLang"fr"
heavyLang"en"
scores
fr0.7564102564102564
es0.6160064672594988
it0.5826010544815465
ca0.5701357466063348
en0.5020964360587002
pt0.4946808510638298
nl0.44379391100702575
no0.3886743886743887
cs0.3823146944083225
sl0.3546195652173913
sk0.3475274725274725
eu0.34392265193370164
tr0.3384401114206128
tl0.3338008415147265
ro0.2835595776772248
hr0.2647058823529412
de0.26356589147286824
yo0.2554858934169279
et0.25196850393700787
da0.24242424242424243
sq0.2375601926163724
az0.18803418803418803
pl0.1607773851590106
lt0.1532976827094474
ms0.15026833631484796
lv0.13793103448275862
fi0.13636363636363635
sv0.12037037037037036
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'll be back. Just... stay put."
detectedLang"en"
heavyLang"en"
scores
en0.8031496062992126
hr0.4545454545454546
hu0.43820224719101125
lt0.42748091603053434
yo0.4230769230769231
et0.40476190476190477
sv0.40476190476190477
tl0.39999999999999997
ca0.33920704845814975
reliabletrue
passestrue
10
name"Marie"
dialogue"Felix... je dois trouver Felix."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7064579256360078
pt0.6021220159151194
nl0.576271186440678
sl0.5356037151702787
hr0.5327102803738317
yo0.5207667731629393
cs0.494949494949495
sk0.4915254237288135
pl0.3775933609958506
ca0.3644067796610169
es0.3644067796610169
de0.34782608695652173
en0.34210526315789475
it0.336283185840708
ro0.336283185840708
reliabletrue
passestrue