Run: 2026-09-23-01M37Q3435BKTHHCESD58PQ478

Run Details

Model:
Aion 3.5 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
26.1s
Cost:
$0.005308
Provider:
AionLabs

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "…" Hunter: "Excuse me, miss. Sorry to bother you. I'm Detective Hunter, Alborn PD. Mind if I ask you a few questions about last Saturday? The apple festival." Maria: "¿Perdón? Lo siento… no entiendo. No hablo inglés." Hunter: "The festival. Saturday. You were there, right? Someone went missing. A woman. Dark hair, green coat." Maria: "¿El festival? Sí, sí… yo estaba allí. Tomaba fotos del huerto. Pero… pero vi algo. Fue horrible." Hunter: "Photos? You—photographs?" (gestures at the camera) "Did you see anything? Anyone suspicious?" Maria: "No… no le entiendo. Por favor… Escuché un grito, cerca de los árboles, al final del día. Y vi a un hombre arrastrando a una mujer. Ella llevaba un abrigo verde. Intenté tomar una foto, pero… temblaba tanto que salió borrosa." Hunter: "Okay, okay—slow down. I don't understand a word of that. English? Do you speak any English?" Maria: "¡No! No sé inglés. ¡Necesito hablar con alguien que entienda español! Hay una mujer desaparecida, ¿no es eso lo que busca? ¡Yo la vi! ¡La vi! Hunter: "Ma'am, I'm sorry. I wish I—hold on." (phone rings) "Detective Hunter. …When? …No, don't touch anything. I'm on my way." Maria: "¿Qué pasa? ¿Adónde va? ¡Espere! ¡Tengo que decirle lo que vi!" Hunter: "Stay. Here. Don't leave town." (gestures firmly, then heads for the door) "I'll find someone who speaks Spanish. Don't go anywhere." Maria: "No entiendo… ¡Por favor! ¡La mujer del abrigo verde! ¡En las fotos! ¡Mire mis fotos! …Se fue. Dios mío, se fue…" Hunter: "…"
created_at"2026-09-23T18:05:21.4Z" 9/23/2026, 6:05:21 PM
model"aion-labs/aion-3.5-20260923"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1335
moderation_latency(null)
generation_time26089
tokens_prompt304
tokens_completion803
native_tokens_prompt262
native_tokens_completion852
native_tokens_completion_images(null)
native_tokens_reasoning396
native_tokens_cached262
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.0053085
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.20.0; linux; x64))"
http_referer(null)
request_id"req-1790186721-H8tTlz8siEh6QNqSb8k3"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1790186721-7wV9yangq8CVfZqcy67p"
upstream_id"b2ef4d0521424622832d755895204c7e"
provider_responses
0
endpoint_id"09b1fc56-3888-42bd-b7a0-926851c7f9d6"
id"b2ef4d0521424622832d755895204c7e"
is_byokfalse
latency1320
model_permaslug"aion-labs/aion-3.5-20260923"
provider_name"AionLabs"
status200
total_cost0.0053085
cache_discount0.0005895
upstream_inference_cost0
provider_name"AionLabs"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"…"
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Excuse me, miss. Sorry to bother you. I'm Detective Hunter, Alborn PD. Mind if I ask you a few questions about last Saturday? The apple festival."
detectedLang"en"
heavyLang"en"
scores
en0.7796386073159982
tl0.5801847187237615
it0.5610184372256365
fr0.5545657015590201
pt0.4834710743801653
ca0.4626544868350349
no0.4609164420485175
ro0.4550408719346049
da0.4517543859649123
es0.4514536478332419
nl0.4502473886750962
sq0.4165694282380397
sv0.414519906323185
cs0.41348973607038125
hr0.38837920489296635
sl0.3796526054590571
ms0.35064935064935066
et0.3368700265251989
de0.3155373032169747
sk0.3112947658402204
yo0.3103448275862069
pl0.3002099370188943
lv0.2831541218637993
hu0.274310595065312
lt0.2727272727272727
az0.2006394884092726
tr0.17081260364842457
fi0.16736053288925898
is0.12126537785588754
vi0.11738746690203002
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passestrue
2
name"Maria"
dialogue"¿Perdón? Lo siento… no entiendo. No hablo inglés."
detectedLang"es"
heavyLang"es"
scores
es0.8128957973517559
pt0.6956928838951311
it0.6578947368421053
ca0.5962732919254659
fr0.5045731707317073
lt0.473257698541329
en0.375
sk0.3737957610789981
tl0.36399217221135033
tr0.3380855397148676
et0.32150313152400833
yo0.29653679653679654
lv0.2872807017543859
hu0.24065420560747666
ms0.2388758782201405
hr0.23708920187793428
no0.22985781990521328
cs0.2243436754176611
fi0.21875
vi0.21875
nl0.19154228855721395
pl0.1875
sq0.181360201511335
reliabletrue
passestrue
3
name"Hunter"
dialogue"The festival. Saturday. You were there, right? Someone went missing. A woman. Dark hair, green coat."
detectedLang"en"
heavyLang"en"
scores
en0.8036253776435045
tl0.5960223741454319
nl0.5386799148332151
no0.5019157088122606
da0.4583333333333333
fr0.4444444444444444
ms0.43820224719101125
pt0.4268077601410935
cs0.4186046511627907
es0.4186046511627907
de0.41494149414941495
sq0.39759036144578314
ca0.3890977443609023
ro0.3890977443609023
it0.3737957610789981
hr0.37137330754352027
fi0.36149312377210213
sv0.35323383084577115
yo0.3157894736842105
sl0.2988133764832794
az0.28017718715393136
et0.2777777777777778
sk0.27616926503340755
is0.2588369441277081
hu0.2554410080183276
lv0.24418604651162787
lt0.24242424242424243
pl0.20537897310513448
tr0.10591471801925723
eu0.09722222222222222
vi0.09722222222222222
reliabletrue
passestrue
4
name"Maria"
dialogue"¿El festival? Sí, sí… yo estaba allí. Tomaba fotos del huerto. Pero… pero vi algo. Fue horrible."
detectedLang"es"
heavyLang"es"
scores
es0.7774480712166172
ca0.6631106120157214
pt0.564902102973169
tl0.5562130177514794
it0.5057660626029654
sv0.4510521500457456
da0.4490358126721763
no0.4408201304753029
en0.4323557237464522
fr0.42473633748801537
sl0.3697478991596639
nl0.34711643090315564
eu0.3288590604026846
ro0.3281075027995521
lt0.3095512082853855
hr0.3087557603686636
cs0.297423887587822
yo0.28741092636579574
pl0.2628992628992629
de0.2537313432835821
lv0.24717691342534504
sq0.24337957124842372
hu0.24242424242424243
et0.23566878980891717
sk0.23566878980891717
ms0.22978177150192552
az0.2277992277992278
vi0.14285714285714285
tr0.1044776119402985
fi0.09502262443438914
reliabletrue
passestrue
5
name"Hunter"
dialogue"Did you see anything? Anyone suspicious?"
detectedLang"en"
heavyLang"en"
scores
en0.8062015503875969
tl0.6338215712383488
et0.3820224719101124
ms0.3529411764705882
sq0.26666666666666666
hu0.24242424242424243
pt0.24242424242424243
ro0.24242424242424243
cs0.22096317280453256
ca0.207492795389049
es0.207492795389049
fr0.207492795389049
reliabletrue
passestrue
6
name"Maria"
dialogue"No… no le entiendo. Por favor… Escuché un grito, cerca de los árboles, al final del día. Y vi a un hombre arrastrando a una mujer. Ella llevaba un abrigo verde. Intenté tomar una foto, pero… temblaba tanto que salió borrosa."
detectedLang"es"
heavyLang"es"
scores
es0.7920579554601556
pt0.6670962199312714
it0.6555555555555556
ca0.6407046824292999
fr0.5482366656951326
ro0.4969165855241805
tl0.4673539518900343
no0.42293373045420696
sv0.4179496808111153
da0.4166353029732781
nl0.3737373737373737
en0.35764608371322004
sq0.3448858833474218
de0.32491289198606277
lv0.32491289198606277
pl0.32461873638344224
ms0.31294326241134746
sk0.3111111111111111
sl0.3027440395861448
cs0.2999096657633243
tr0.2973708068902992
hu0.2935278030993619
eu0.26260704091341575
hr0.2405683488486036
et0.23832923832923833
yo0.22149673530889002
lt0.1952232606438214
fi0.18890633176347463
az0.18506834910620398
vi0.17597022860180755
is0.10040626813697041
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay, okay—slow down. I don't understand a word of that. English? Do you speak any English?"
detectedLang"en"
heavyLang"en"
scores
en0.8127340823970037
tl0.5894909688013136
no0.5791245791245792
da0.5387453874538745
cs0.5155038759689923
sv0.49186991869918695
pl0.4747899159663866
hr0.46977730646871685
sk0.4582881906825569
de0.453551912568306
ca0.4487320837927233
yo0.44258639910813824
ro0.42857142857142855
nl0.4279176201372997
sq0.3924665856622114
is0.3757802746566792
pt0.3718592964824121
vi0.32795698924731176
it0.32432432432432434
hu0.3084370677731674
sl0.29577464788732394
tr0.22720247295208654
lt0.2248062015503876
ms0.2125984251968504
az0.21011058451816747
lv0.21011058451816747
es0.20886075949367086
et0.20127795527156547
fr0.18962722852512154
be0.12280701754385964
eu0.12280701754385964
fi0.11190053285968028
uk0.11190053285968028
reliabletrue
passestrue
8
name"Maria"
dialogue"\"¡No! No sé inglés. ¡Necesito hablar con alguien que entienda español! Hay una mujer desaparecida, ¿no es eso lo que busca? ¡Yo la vi! ¡La vi!"
detectedLang"es"
heavyLang"es"
scores
es0.8202916409940441
ca0.6603260869565218
pt0.6470350947962888
it0.5702357563850687
fr0.42847811887655124
vi0.38466947960618847
ro0.36823104693140796
yo0.36777456647398843
en0.3238021638330757
tl0.3148003132341425
et0.2714404662781016
no0.2597292724196278
lv0.22291296625222026
is0.19503219871205152
eu0.19429097605893186
hu0.1898148148148148
sk0.1682509505703422
tr0.15865384615384615
hr0.15784408084696824
sq0.15130940834141612
ms0.14800389483933787
de0.1404715127701375
da0.13962635201573254
nl0.13793103448275862
sv0.13708086785009863
az0.13194444444444445
fi0.09420289855072464
lt0.09420289855072464
pl0.07894736842105263
sl0.06716417910447761
reliabletrue
passestrue
9
name"Hunter"
dialogue"Detective Hunter. …When? …No, don't touch anything. I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.8168498168498168
tl0.5829471733086191
fr0.5192307692307693
ca0.5124593716143012
pt0.45188794153471373
it0.412532637075718
es0.4117647058823529
ro0.40867279894875164
hr0.3626062322946175
no0.3617021276595745
sk0.358974358974359
sq0.358974358974359
pl0.3580599144079886
cs0.34114202049780384
de0.27652733118971057
da0.2694805194805195
et0.2549668874172185
fi0.25
tr0.24623115577889448
nl0.24369747899159663
ms0.23339011925042585
sv0.23339011925042585
lv0.225473321858864
sl0.21875
hi0.15730337078651685
yo0.14285714285714285
reliabletrue
passestrue
10
name"Maria"
dialogue"¿Qué pasa? ¿Adónde va? ¡Espere! ¡Tengo que decirle lo que vi!"
detectedLang"es"
heavyLang"es"
scores
es0.7698882314266929
it0.6568627450980391
ca0.6446700507614213
pt0.5716034271725826
eu0.4890510948905109
ro0.4760479041916168
fr0.4195688225538972
yo0.39130434782608703
hu0.37275985663082434
no0.3613138686131387
vi0.35304990757855825
en0.33962264150943394
tl0.29435483870967744
da0.2886178861788618
sv0.2842535787321063
is0.2391304347826087
ms0.22566371681415928
reliabletrue
passestrue
11
name"Hunter"
dialogue"I'll find someone who speaks Spanish. Don't go anywhere."
detectedLang"en"
heavyLang"en"
scores
en0.7948577680525164
tl0.4248466257668711
da0.3131868131868132
de0.3042671614100185
sq0.2964352720450282
et0.2704280155642024
pl0.22360248447204967
nl0.1758241758241758
no0.1758241758241758
ro0.1758241758241758
sv0.1758241758241758
es0.17218543046357618
pt0.17218543046357618
yo0.17035398230088497
hu0.1591928251121076
reliabletrue
passestrue
12
name"Maria"
dialogue"No entiendo… ¡Por favor! ¡La mujer del abrigo verde! ¡En las fotos! ¡Mire mis fotos! …Se fue. Dios mío, se fue…"
detectedLang"es"
heavyLang"es"
scores
es0.8024027821688271
pt0.6698362387744321
ca0.6614301191765981
it0.6132425742574258
fr0.5695592286501377
no0.558303886925795
nl0.5377218934911242
da0.5015948963317385
sq0.497991967871486
ro0.46717817561807334
tr0.42660550458715596
sv0.42343173431734316
sl0.41148775894538603
en0.3509865005192108
tl0.33862433862433866
hr0.32505399568034554
de0.32432432432432434
fi0.30709534368070956
et0.3024553571428571
lv0.29775280898876405
cs0.24516908212560387
yo0.24150485436893204
sk0.20178799489144317
az0.1935483870967742
lt0.18619791666666666
is0.17654808959156787
pl0.17654808959156787
vi0.11847672778561354
eu0.10714285714285714
reliabletrue
passestrue
13
name"Hunter"
dialogue"…"
detectedLang""
heavyLang""
scores
reliablefalse
passestrue