Run: 2026-02-24-01KJ8VMCYTM15JYAGP5W6FXP75

Run Details

Model:
Aion 2.0
Duration:
49.5s
Cost:
$0.003398
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
50.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Scene: The Daily Grind Cafe, Alborn, MN** The cozy aroma of fresh coffee and baked apples fills the air. Selvi sits alone at a corner table, her camera’s display glowing as she reviews yesterday’s landscape shots. Detective Hunter enters, his sharp eyes scanning the room before settling on her. He approaches with measured steps. **Voice Sheet:** **Selvi:** (Softly, to herself in Hindi) "Yeh chashma… kitna shaant hai. Par kal… woh jagah bilkul shaant nahi thi." (This landscape… so peaceful. But yesterday… that place was not peaceful at all.) **Hunter:** "Miss? I’m Detective Hunter. Mind if I sit?" He doesn’t wait for an answer, pulling out the chair. "You were photographing near the old mill path yesterday around four. That’s around the time we believe another person went missing. Did you see anything unusual?" **Selvi:** (Startled, she looks up. Understanding he is authority, but not his words, her face pales.) "Mujhe maaf kijiye… main English nahi bolti. Kuch buri baat hui hai? Mainne… mainne kuch dekha." (I’m sorry… I don’t speak English. Something bad has happened? I saw… I saw something.) **Hunter:** (Leans forward, voice low and insistent.) "What did you see? A person? A vehicle? Anything." **Selvi:** (Shakes her head, frustrated. She picks up her camera, her hands trembling slightly. She finds a photo and turns the screen to him.) "Yeh lo! Yeh aadmi… pehle tha, phir gayab. Maine socha shayad meri nazar ka dhoka hai, lebin yeh camera mein bhi hai." (Here! This man… he was there, then gone. I thought maybe a trick of my eyes, but it is in the camera too.) **Hunter:** (Stares at the image—a clear shot of the mill’s foundation, a blur of dark clothing near the water’s edge. In the next photo in the sequence, the spot is empty. He points at the screen.) "This. Here. What is this?" **Selvi:** (Following his finger, she nods urgently.) "Haan! Woh! Wo aadmi ek second mein nahi raha. Aisa kaise ho sakta hai?" (Yes! That! That man was gone in a second. How is that possible?) **Hunter:** (Rubs his temple, the language barrier clearly grating on him.) "I need to get these pictures. And I need to understand what you’re saying." Before he can continue, his phone vibrates loudly on the table. He snatches it up. **Hunter:** "Hunter. … You’re sure? I’ll be right there." He stands abruptly, chair scraping the floor. "Stay. Right. Here." He enunciates each word slowly, pointing at her, then at the table. "Do not leave. I will be back with a translator." **Selvi:** (Watches him stride out the door. She slumps back in her chair, pulling her camera close to her chest. Her whisper is barely audible.) "Wo mujhse pooch raha tha uss aadmi ke baare mein. Main usse bata nahi paayi. Ab wo chala gaya… aur main phans gayi hoon." (He was asking me about that man. I couldn’t tell him. Now he is gone… and I am trapped here.)
created_at"2026-02-24T22:17:05.254Z" 2/24/2026, 10:17:05 PM
model"aion-labs/aion-2.0-20260223"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2052
moderation_latency(null)
generation_time49378
tokens_prompt315
tokens_completion2028
native_tokens_prompt371
native_tokens_completion1938
native_tokens_completion_images(null)
native_tokens_reasoning1272
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.0033976
router(null)
provider_responses
0
endpoint_id"1e93b0bb-eb0f-49bc-8fda-947105413b86"
id"fbdccca2-b850-4bdd-9097-2f5fc268f05c"
is_byokfalse
latency121
model_permaslug"aion-labs/aion-2.0-20260223"
provider_name"AionLabs"
status200
api_type"completions"
id"gen-1771971425-oULdHL4c93rTyVcqP88L"
upstream_id"fbdccca2-b850-4bdd-9097-2f5fc268f05c"
total_cost0.0033976
cache_discount(null)
upstream_inference_cost0
provider_name"AionLabs"

Evaluation details

Result Evaluator Details Meta Data
50.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Yeh chashma… kitna shaant hai. Par kal… woh jagah bilkul shaant nahi thi."
detectedLang"vi"
heavyLang"de"
scores
vi0.42333785617367703
fr0.36472346786248133
sv0.3122977346278317
eu0.2796610169491525
lv0.2672413793103448
et0.2085661080074488
tl0.19811320754716982
bg0.1904761904761905
it0.1904761904761905
da0.17953667953667954
reliablefalse
passesfalse
1
name"Hunter"
dialogue"You were photographing near the old mill path yesterday around four. That’s around the time we believe another person went missing. Did you see anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8130179907014352
tl0.5673526660430308
nl0.46438911407064276
ms0.3771043771043771
fr0.3668720054757016
da0.358974358974359
sq0.35269419174247724
no0.30763473053892215
et0.3013595166163142
pt0.2823894491854151
sv0.2693522906793049
is0.23616845582163504
es0.22268907563025211
it0.21477079796264856
de0.19072615923009625
tr0.17114695340501793
ca0.14903403863845444
pl0.14903403863845444
hr0.13389513108614234
cs0.1290018832391714
az0.11820781696854146
yo0.10368217054263566
ro0.08325074331020813
fi0.0777666999002991
hi0.07684630738522955
lv0.075
lt0.07221664994984955
hu0.06376518218623482
sk0.059959349593495935
reliabletrue
passestrue
2
name"Selvi"
dialogue"Mujhe maaf kijiye… main English nahi bolti. Kuch buri baat hui hai? Mainne… mainne kuch dekha."
detectedLang"en"
heavyLang"id"
scores
en0.4444444444444444
de0.37421777221526903
fr0.3630573248407643
it0.3103448275862069
is0.2907801418439716
no0.27219796215429404
fi0.25925925925925924
eu0.24812030075187969
vi0.2389649923896499
sv0.2295839753466872
ro0.22360248447204967
lv0.14965986394557826
tl0.14089347079037798
da0.12587412587412586
et0.12587412587412586
hr0.12587412587412586
ms0.12587412587412586
reliablefalse
passesfalse
3
name"Hunter"
dialogue"What did you see? A person? A vehicle? Anything."
detectedLang"en"
heavyLang"en"
scores
en0.8208955223880597
ca0.5798319327731093
tl0.560117302052786
sq0.5161290322580645
ro0.5008319467554077
et0.49324324324324326
fr0.4906621392190153
pt0.4809688581314879
cs0.4727592267135325
sv0.43396226415094336
ms0.43289224952741023
no0.4318181818181818
da0.4230769230769231
es0.4230769230769231
hu0.42196531791907516
de0.4152046783625731
it0.4152046783625731
is0.4106090373280943
sk0.38650306748466257
hr0.3630573248407643
pl0.35344827586206895
lt0.33920704845814975
lv0.3258426966292135
nl0.3258426966292135
tr0.32432432432432434
az0.3006993006993007
yo0.2840095465393795
sl0.23076923076923078
eu0.1891891891891892
vi0.1891891891891892
fi0.17355371900826447
reliabletrue
passestrue
4
name"Selvi"
dialogue"Yeh lo! Yeh aadmi… pehle tha, phir gayab. Maine socha shayad meri nazar ka dhoka hai, lebin yeh camera mein bhi hai."
detectedLang"et"
heavyLang"ber"
scores
et0.36179577464788737
tl0.3462578899909829
it0.34566787003610105
de0.3217960710944809
es0.30422264875239924
ro0.2961165048543689
fr0.2814667988107037
sq0.2639593908629441
vi0.25488180883864336
yo0.2518059855521156
lv0.250258531540848
en0.2479253112033195
ms0.2479253112033195
ca0.210239651416122
pt0.20678336980306347
fi0.18355855855855857
sl0.13895486935866982
tr0.1082410824108241
pl0.103831891223733
sv0.10161090458488227
az0.09713574097135741
nl0.09488139825218476
reliablefalse
passesfalse
5
name"Hunter"
dialogue"This. Here. What is this?"
detectedLang"en"
heavyLang"en"
scores
en0.8605299860529986
nl0.6138996138996139
hu0.6062992125984252
yo0.5454545454545454
sq0.5
tl0.5
is0.4791666666666667
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan! Woh! Wo aadmi ek second mein nahi raha. Aisa kaise ho sakta hai?"
detectedLang"it"
heavyLang"de"
scores
it0.4163424124513619
en0.3860845839017735
fr0.3818681318681319
de0.3571428571428572
et0.3273542600896861
tr0.3171471927162367
no0.293563579277865
sq0.2868462757527734
nl0.27999999999999997
tl0.27652733118971057
yo0.2730210016155089
eu0.2682926829268293
vi0.25864909390444807
ca0.21052631578947367
sk0.19786096256684493
cs0.1906474820143885
fi0.1891891891891892
is0.14448669201520914
sv0.14448669201520914
ro0.14285714285714285
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I need to get these pictures. And I need to understand what you’re saying."
detectedLang"en"
heavyLang"en"
scores
en0.8289521065898452
no0.5673952641165756
da0.5646196150320807
tl0.5564892623716153
sv0.4698660714285714
pl0.4164619164619165
yo0.40476190476190477
cs0.4025157232704403
ro0.3994943109987357
ca0.3933588761174968
et0.3870967741935484
sk0.3815104166666667
lv0.3606998654104979
de0.3581081081081081
hr0.3493150684931507
nl0.3448275862068966
is0.33286516853932585
sq0.3300423131170663
it0.3115942028985507
fr0.28785607196401797
tr0.26356589147286824
lt0.2601246105919003
sl0.2030201342281879
be0.12844036697247707
hu0.12361623616236161
az0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
8
name"Hunter"
dialogue"Do not leave. I will be back with a translator."
detectedLang"en"
heavyLang"en"
scores
en0.823943661971831
tl0.6527777777777778
pl0.6112440191387559
hr0.6036585365853658
sq0.5911949685534591
pt0.5734908136482939
cs0.5689655172413793
sk0.5498614958448753
yo0.5479833101529903
ro0.5454545454545454
ca0.5178041543026707
hu0.5112781954887218
no0.5105421686746987
da0.5075757575757576
vi0.5053272450532724
sl0.5038167938931297
lt0.4992295839753467
sv0.4969040247678019
de0.4857594936708861
it0.482484076433121
tr0.4698205546492659
ms0.44539249146757676
et0.43082311733800355
es0.39138576779026213
lv0.38095238095238093
nl0.38095238095238093
fr0.37739463601532564
az0.37137330754352027
is0.29805615550755943
eu0.29653679653679654
be0.17721518987341772
fi0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
9
name"Selvi"
dialogue"Wo mujhse pooch raha tha uss aadmi ke baare mein. Main usse bata nahi paayi. Ab wo chala gaya… aur main phans gayi hoon."
detectedLang"de"
heavyLang"de"
scores
de0.43092621664050235
tl0.31279620853080564
et0.2684157416750757
yo0.2617107942973524
eu0.2579324462640737
ms0.24870466321243526
en0.23199152542372883
fr0.2059145673603505
sv0.20154185022026433
cs0.19889502762430938
sq0.13895486935866982
ro0.12650602409638553
tr0.09713574097135741
sk0.09600997506234414
reliablefalse
passesfalse