Run: 2026-02-17-01KHNF2NNQ53M8TR59MGWEJ83R

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
13.9s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
61.54% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."

Model response

AI
Maria: "¡Ay Dios mío! ¿Has oído lo que pasó en el festival de manzanas? Fue terrible." Hunter: "Excuse me, I'm sorry, I don't speak Spanish. Can you please repeat that in English?" Maria: "Oh, I'm sorry. I just got so excited. Did you hear about what happened at the apple festival? It was terrible." Hunter: "No, I haven't heard anything about it. What happened?" Maria: "Well, I was taking pictures of the festival when suddenly I heard a loud scream. I turned around and saw a man running away from the scene. It was so scary." Hunter: "Did you get a good look at the man? Can you describe him to me?" Maria: "I'm sorry, it all happened so fast. I didn't get a good look at his face. But he was wearing a black hoodie and jeans." Hunter: "Thank you for your help. I'll look into it." Maria: "Of course. I hope you catch the person responsible." Hunter: "Me too. I have to go now, but if you remember anything else, please let me know." Maria: "I will. Be careful out there." Hunter: "Thank you. Take care." Maria: "You too."
created_at"2026-02-17T09:32:21.663205+00:00" 2/17/2026, 9:32:21 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency352
moderation_latency(null)
generation_time13836
tokens_prompt317
tokens_completion282
native_tokens_prompt268
native_tokens_completion270
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"chatcmpl-be042972364bc65e"
status200
is_byokfalse
latency101
endpoint_id"b9d81865-ce9a-432a-9cd5-0d9be55e7cb5"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771320727-SsBVWnQcMF0i8Z1ixOMZ"
upstream_id"chatcmpl-be042972364bc65e"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
61.54% Parse dialogue n/a
dialogue
0
name"Maria"
dialogue"¡Ay Dios mío! ¿Has oído lo que pasó en el festival de manzanas? Fue terrible."
detectedLang"es"
heavyLang"es"
scores
es0.7620033112582781
ca0.6819690265486726
pt0.6029005524861879
fr0.5833333333333334
en0.5055889939810835
tl0.49561403508771934
nl0.49249779346866723
da0.4734432234432235
no0.4641192917054986
it0.44870565675934804
sv0.4351669941060904
ro0.3997912317327766
hu0.37971952535059333
az0.3702081051478641
ms0.3653421633554084
hr0.3480725623582766
tr0.3443557582668187
sq0.31384248210023863
sl0.31302270011947436
yo0.2866004962779156
lt0.2767295597484277
fi0.26376440460947503
de0.2580645161290322
lv0.2493472584856397
cs0.24540682414698162
et0.24342105263157895
eu0.20138888888888887
is0.18899858956276447
pl0.17503586800573886
sk0.17027417027417027
vi0.13663663663663664
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, I'm sorry, I don't speak Spanish. Can you please repeat that in English?"
detectedLang"en"
heavyLang"en"
scores
en0.7912885662431942
tl0.5290745290745291
ro0.49781659388646293
it0.4346116027531956
no0.40904419321685515
sv0.40843621399176955
sq0.3863393810032017
nl0.3575418994413408
de0.34659090909090906
ca0.343607305936073
da0.3290548424737456
pt0.3146603098927294
sl0.2962056303549572
ms0.2866004962779156
az0.28035043804755944
hr0.2684478371501272
pl0.267515923566879
cs0.2414248021108179
es0.23638778220451526
yo0.23333333333333334
et0.21555252387448842
tr0.203601108033241
hu0.1935483870967742
fr0.13663663663663664
fi0.11538461538461538
sk0.11128284389489954
be0.10852713178294573
is0.0987460815047022
lt0.0987460815047022
lv0.0987460815047022
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
2
name"Maria"
dialogue"Oh, I'm sorry. I just got so excited. Did you hear about what happened at the apple festival? It was terrible."
detectedLang"en"
heavyLang"en"
scores
en0.8015873015873016
tl0.6095717884130982
no0.5104232469993684
fr0.46844993141289437
nl0.46329639889196683
da0.45306986591390264
ca0.4375907111756169
it0.42550037064492213
sv0.4250741839762611
yo0.42336309523809523
de0.404304381245196
es0.396417445482866
sq0.3912018853102907
pt0.32491289198606277
cs0.3231441048034934
et0.3111111111111111
ms0.3067978533094812
hr0.30493273542600896
sl0.30368373764600176
sk0.27637721755368816
pl0.24242424242424243
az0.23945044160942097
lv0.21479229989868287
ro0.2115971515768057
hu0.20267489711934156
lt0.19605809128630705
vi0.17289220917822837
fi0.13600891861761427
be0.08284023668639054
tr0.08284023668639054
is0.07517899761336516
uk0.07517899761336516
reliabletrue
passesfalse
3
name"Hunter"
dialogue"No, I haven't heard anything about it. What happened?"
detectedLang"en"
heavyLang"en"
scores
en0.8194945848375451
tl0.5731056563500534
ca0.48119325551232167
sq0.4444444444444444
no0.441340782122905
lv0.4117647058823529
hr0.375
da0.35691318327974275
pt0.355877616747182
sv0.3464052287581699
pl0.33444259567387685
it0.3277310924369748
sk0.2895204262877442
yo0.2895204262877442
tr0.2831541218637993
es0.25512104283054005
cs0.2079207920792079
ro0.1836734693877551
ms0.16317991631799164
nl0.15611814345991562
be0.14893617021276595
hu0.14346895074946467
az0.13606911447084233
et0.13606911447084233
is0.13606911447084233
lt0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
4
name"Maria"
dialogue"Well, I was taking pictures of the festival when suddenly I heard a loud scream. I turned around and saw a man running away from the scene. It was so scary."
detectedLang"en"
heavyLang"en"
scores
en0.8042669798394989
tl0.6928746928746928
no0.5419147961520843
nl0.4959677419354839
da0.485331960885229
sv0.4815966822187662
yo0.4487320837927233
de0.44071588366890374
ro0.41690962099125367
it0.3993993993993994
ca0.3939393939393939
fr0.38912645082467934
sq0.38650306748466257
sl0.3861264579496623
sk0.38385705483672206
hr0.3710691823899371
pl0.3498049414824447
lt0.3346640053226879
cs0.3256911665542818
lv0.32111337406653084
pt0.3201903467029232
ms0.29577464788732394
et0.29428369795342274
is0.28977272727272724
es0.27219796215429404
hu0.2248062015503876
fi0.20948616600790515
az0.2006394884092726
tr0.18896999188969993
vi0.1883116883116883
be0.06542056074766354
eu0.06542056074766354
uk0.059266227657572904
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Did you get a good look at the man? Can you describe him to me?"
detectedLang"en"
heavyLang"en"
scores
en0.8351195383347073
tl0.6393146979260595
no0.6051332675222113
da0.5824634655532359
es0.5731056563500534
yo0.47575360419397117
fr0.47368421052631576
cs0.4601889338731444
nl0.45799457994579945
pt0.4528043775649795
ca0.43977591036414565
lv0.42857142857142855
sl0.42775393419170243
sq0.4269340974212034
lt0.4117647058823529
it0.4108983799705449
sv0.40119760479041916
sk0.3957703927492447
ro0.37694704049844235
pl0.375
hr0.3630573248407643
ms0.36
de0.313893653516295
is0.30434782608695654
et0.2831541218637993
hu0.2805755395683453
tr0.2779783393501805
az0.2687385740402194
fi0.25650557620817843
eu0.14893617021276595
vi0.14893617021276595
reliabletrue
passestrue
6
name"Maria"
dialogue"I'm sorry, it all happened so fast. I didn't get a good look at his face. But he was wearing a black hoodie and jeans."
detectedLang"en"
heavyLang"en"
scores
en0.8044487900268883
tl0.6342021033379058
da0.49174078780177893
no0.48220064724919093
yo0.46524064171123
de0.4405594405594406
sv0.3745113369820172
fr0.3685872138910813
it0.33993399339933994
ca0.3133047210300429
sq0.3127147766323024
ro0.2988606485539001
nl0.28698752228163993
pt0.2837958818263205
sk0.2779783393501805
hr0.23882017126546146
sl0.23150816522574447
is0.22928709055876687
cs0.22854387656702024
vi0.2248062015503876
pl0.22405431619786614
hu0.2179863147605083
lv0.21491658488714427
es0.2125984251968504
et0.21104536489151873
ms0.16230366492146597
fi0.16142557651991615
tr0.15522703273495247
lt0.15343915343915343
az0.14255091103965703
be0.08045977011494253
eu0.08045977011494253
uk0.07300115874855156
reliabletrue
passesfalse
7
name"Hunter"
dialogue"Thank you for your help. I'll look into it."
detectedLang"en"
heavyLang"en"
scores
en0.8255408234473133
tl0.5682210708117443
da0.38875305623471884
no0.3872549019607844
vi0.3670886075949367
lv0.25595238095238093
pt0.25595238095238093
sq0.25595238095238093
cs0.2378048780487805
ms0.2378048780487805
yo0.2331288343558282
reliabletrue
passestrue
8
name"Maria"
dialogue"Of course. I hope you catch the person responsible."
detectedLang"en"
heavyLang"en"
scores
en0.8139880952380952
tl0.7197309417040358
fr0.6869782971619365
ca0.6138002059732235
no0.5950323974082073
sv0.5870044052863436
sq0.5791245791245792
it0.5376078914919853
da0.5306633291614518
ro0.5294855708908407
es0.49664429530201337
nl0.47844228094575797
pt0.4549418604651163
cs0.4541484716157206
yo0.45014662756598234
de0.4477172312223858
is0.43267776096822996
hr0.34554973821989526
lt0.34554973821989526
az0.33862433862433866
sk0.336283185840708
pl0.33035714285714285
ms0.30683918669131244
lv0.2690058479532163
tr0.267578125
hu0.25742574257425743
et0.2454728370221328
be0.15730337078651685
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passesfalse
9
name"Hunter"
dialogue"Me too. I have to go now, but if you remember anything else, please let me know."
detectedLang"en"
heavyLang"en"
scores
en0.8272458045409673
tl0.5816733067729083
da0.5442708333333333
no0.4961612284069098
yo0.4827586206896552
sl0.4570837642192347
cs0.4479495268138801
sv0.42497261774370204
sq0.4211686879823594
pl0.41275167785234906
ms0.38953488372093026
sk0.38739789964994165
fr0.34701492537313433
nl0.33962264150943394
hr0.3269230769230769
hu0.31729518855656696
et0.3101182654402102
is0.29245283018867924
it0.27083333333333337
ro0.26573426573426573
lv0.2605633802816902
lt0.24132947976878616
de0.2290748898678414
ca0.2081447963800905
es0.16267942583732056
pt0.1435562805872757
fi0.125
be0.11764705882352942
tr0.11764705882352942
az0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
10
name"Maria"
dialogue"I will. Be careful out there."
detectedLang"en"
heavyLang"en"
scores
en0.8360655737704918
tl0.6289424860853432
de0.5867768595041323
ro0.5815899581589958
sq0.5145631067961165
yo0.49622166246851385
hu0.4791666666666667
lt0.4666666666666667
no0.42028985507246375
da0.41002949852507375
hr0.41002949852507375
ca0.40828402366863903
sv0.40828402366863903
pl0.38650306748466257
it0.36507936507936506
cs0.3442622950819672
es0.2753623188405797
fr0.2753623188405797
sk0.2647058823529412
be0.25925925925925924
tr0.25925925925925924
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lv0.23954372623574144
uk0.23954372623574144
vi0.23954372623574144
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Thank you. Take care."
detectedLang"en"
heavyLang"en"
scores
en0.8204022988505748
ro0.5993589743589743
tl0.5551601423487544
vi0.5370370370370371
cs0.3842364532019704
sl0.3842364532019704
reliabletrue
passestrue
12
name"Maria"
dialogue"You too."
detectedLang"en"
heavyLang"en"
scores
en0.8422712933753943
cs0.609375
tl0.609375
reliablefalse
passestrue