Run: 2026-02-17-01KHNEZJ3T7G6PKVGA3Q26SWFZ

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
14.0s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: "Mi dispiace, non capisco l'inglese. Può ripetere in italiano?" Hunter: "Uh, I'm sorry, I don't speak Italian. I was just wondering if you saw anything unusual around town recently?" Isabella: "Non ho visto niente di strano. Ma perché mi chiede questo?" Hunter: "There have been a few disappearances in town lately. I'm trying to gather information from anyone who might have seen something." Isabella: "Oh mio Dio, è terribile. Spero che trovino presto le persone scomparse." Hunter: "Yeah, me too. It's a real mystery. Do you mind if I ask you a few more questions?" Isabella: "Certo, sono felice di aiutare in qualsiasi modo possibile." [Hunter's phone rings] Hunter: "I'm sorry, I have to take this call. But I'll be back to ask you more questions later, okay?" Isabella: "Va bene, a dopo." [Hunter walks away to take the call]
created_at"2026-02-17T09:30:39.803744+00:00" 2/17/2026, 9:30:39 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency522
moderation_latency(null)
generation_time13907
tokens_prompt321
tokens_completion230
native_tokens_prompt268
native_tokens_completion221
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"chatcmpl-999e478942ab4bb7"
status200
is_byokfalse
latency21
endpoint_id"b9d81865-ce9a-432a-9cd5-0d9be55e7cb5"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771320625-M3yVj5Ej60Rv0NdR3UI8"
upstream_id"chatcmpl-999e478942ab4bb7"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Mi dispiace, non capisco l'inglese. Può ripetere in italiano?"
detectedLang"it"
heavyLang"it"
scores
it0.7851002865329513
es0.5685522531160115
en0.5609756097560975
ro0.560117302052786
fr0.5408163265306122
pt0.5297805642633229
yo0.4955156950672646
ca0.47976878612716767
sl0.471830985915493
de0.45520581113801456
tl0.412532637075718
nl0.39919893190921224
sv0.3715083798882682
sk0.3580599144079886
pl0.34497816593886466
sq0.336283185840708
cs0.3181818181818182
tr0.3098159509202454
eu0.2706645056726094
da0.26108374384236455
no0.2549668874172185
az0.24114671163575044
hr0.23339011925042585
ms0.22945205479452058
hu0.15887850467289721
lt0.12280701754385964
fi0.11591355599214145
reliabletrue
passestrue
1
name"Hunter"
dialogue"Uh, I'm sorry, I don't speak Italian. I was just wondering if you saw anything unusual around town recently?"
detectedLang"en"
heavyLang"en"
scores
en0.7994116073816528
tl0.503968253968254
sv0.46808510638297873
nl0.43267776096822996
da0.4075829383886255
ms0.3985565356856456
no0.3980738362760835
sq0.3368700265251989
it0.33095450490633366
de0.3237150586113616
pt0.30619796484736356
ro0.293119698397738
cs0.2890995260663507
ca0.2753623188405797
et0.2647058823529412
hr0.258160237388724
yo0.2454728370221328
es0.21301154249737672
az0.20802534318901794
lt0.20127795527156547
sk0.15254237288135594
fi0.1515837104072398
fr0.1506228765571914
sl0.1506228765571914
tr0.14675767918088736
pl0.14383561643835618
be0.08536585365853659
hu0.08200734394124846
is0.07749077490774908
lv0.07749077490774908
uk0.07749077490774908
vi0.07749077490774908
reliabletrue
passestrue
2
name"Isabella"
dialogue"Non ho visto niente di strano. Ma perché mi chiede questo?"
detectedLang"it"
heavyLang"it"
scores
it0.8253185367858611
fr0.6428571428571429
sk0.6228926353149956
es0.602803738317757
tl0.5865758754863813
pt0.5707070707070707
sl0.5153933865450399
cs0.5023419203747073
en0.4982290436835891
ro0.4867149758454107
ms0.4713930348258706
hr0.4572158365261813
no0.4537275064267352
ca0.44152431011826543
lt0.42953020134228187
yo0.4121715076071923
sq0.39544807965860596
pl0.38226744186046513
hu0.3694362017804154
da0.3410852713178295
vi0.2916666666666667
nl0.28451178451178455
eu0.2796610169491525
et0.2722602739726028
de0.2672413793103448
lv0.2504409171075838
is0.24645390070921988
tr0.23561151079136694
fi0.17153996101364524
sv0.1448692152917505
az0.121900826446281
reliabletrue
passestrue
3
name"Hunter"
dialogue"There have been a few disappearances in town lately. I'm trying to gather information from anyone who might have seen something."
detectedLang"en"
heavyLang"en"
scores
en0.8272116903633492
tl0.5943439962911451
fr0.5111731843575419
de0.5092540661805945
nl0.48710433763188743
da0.48589894242068155
yo0.40232240437158473
pl0.3889664804469274
pt0.3820621468926554
sv0.3691420331651046
it0.36317321688500726
sl0.3613138686131387
sk0.3537666174298375
no0.3425995492111195
es0.34161023325808876
ca0.3315508021390375
ro0.3269230769230769
cs0.3180046765393608
lv0.3180046765393608
ms0.3011182108626198
hr0.29605792437650846
sq0.2857142857142857
lt0.27566225165562913
az0.24242424242424243
fi0.20309653916211293
hu0.20018281535648996
eu0.18906394810009267
et0.17452830188679244
tr0.14383561643835618
zh0.08088235294117647
hi0.07991587802313353
is0.07894736842105263
vi0.07407407407407407
reliabletrue
passestrue
4
name"Isabella"
dialogue"Oh mio Dio, è terribile. Spero che trovino presto le persone scomparse."
detectedLang"it"
heavyLang"it"
scores
it0.7870528109028961
es0.6405463695183321
ro0.5305164319248826
fr0.5251661918328585
sl0.48506694129763134
de0.46236559139784944
hr0.451152579582876
pt0.4337485843714609
ca0.40688018979833923
nl0.40617577197149646
yo0.3924665856622114
en0.38042131350681535
da0.3796526054590571
ms0.34469200524246396
tl0.3297587131367293
sk0.3206521739130435
sv0.3150684931506849
hu0.3093922651933701
no0.3065187239944522
sq0.3045897079276773
et0.28977272727272724
cs0.28366762177650434
eu0.28366762177650434
az0.26578560939794427
lt0.25595238095238093
lv0.2163009404388715
fi0.20508744038155804
pl0.19093851132686085
tr0.11816578483245149
is0.11190053285968028
reliabletrue
passestrue
5
name"Hunter"
dialogue"Yeah, me too. It's a real mystery. Do you mind if I ask you a few more questions?"
detectedLang"en"
heavyLang"en"
scores
en0.8029863127333057
pt0.5701357466063348
fr0.539282250242483
it0.5361328125
ca0.5148110316649642
pl0.5057232049947971
sq0.49788583509513745
sl0.4908896034297963
hr0.4859307359307359
cs0.485373781148429
es0.4521337946943483
no0.4431418522860493
sk0.4128553770086526
tl0.4099378881987578
hu0.39567430025445294
et0.39413265306122447
ro0.38788659793814434
sv0.38788659793814434
yo0.3741765480895916
nl0.3484224965706447
vi0.33936022253129344
da0.30758017492711365
az0.3014705882352941
ms0.23633440514469453
tr0.23633440514469453
lt0.23387096774193547
fi0.22512234910277326
is0.22512234910277326
lv0.21875
be0.12844036697247707
eu0.12844036697247707
de0.12361623616236161
uk0.1171003717472119
reliabletrue
passestrue
6
name"Isabella"
dialogue"Certo, sono felice di aiutare in qualsiasi modo possibile."
detectedLang"it"
heavyLang"it"
scores
it0.8256320836965998
en0.6289424860853432
pt0.6251171508903468
ro0.5951417004048583
fr0.5731056563500534
ca0.5721925133689839
tl0.5618838992332968
sl0.4838709677419355
es0.4609164420485175
de0.4326241134751773
ms0.37402190923317685
yo0.3548387096774194
sv0.3453355155482815
nl0.2805755395683453
hr0.2779783393501805
lt0.24953095684803
sq0.24670433145009416
vi0.19517102615694165
cs0.18533604887983707
az0.17355371900826447
pl0.17355371900826447
sk0.15074309978768577
reliabletrue
passestrue
7
name"Hunter"
dialogue"I'm sorry, I have to take this call. But I'll be back to ask you more questions later, okay?"
detectedLang"en"
heavyLang"en"
scores
en0.8111263736263735
tl0.6400523560209423
fr0.4796594134342479
da0.46808510638297873
it0.44668008048289737
no0.38547486033519557
pt0.38547486033519557
pl0.3799323562570462
yo0.3778280542986425
hr0.377123442808607
cs0.36342592592592593
sl0.3428912783751493
ca0.3373493975903614
lt0.3365500603136309
sv0.289405684754522
nl0.2753623188405797
sk0.27055702917771884
lv0.25170068027210885
hu0.2506811989100818
de0.22096317280453256
sq0.19590643274853803
ro0.140625
es0.12140575079872205
hi0.12140575079872205
be0.11290322580645161
tr0.11290322580645161
az0.10277324632952692
et0.10277324632952692
is0.10277324632952692
uk0.10277324632952692
vi0.10277324632952692
reliabletrue
passestrue
8
name"Isabella"
dialogue"Va bene, a dopo."
detectedLang"it"
heavyLang"it"
scores
it0.8355263157894737
ca0.7442455242966752
ro0.7340425531914894
es0.6987951807228916
fr0.6884735202492211
hu0.609375
pt0.5833333333333334
en0.5726495726495726
cs0.5689655172413793
sk0.5652173913043478
yo0.54337899543379
hr0.5283018867924528
pl0.5121951219512195
sl0.47368421052631576
lt0.45054945054945056
tr0.4350282485875706
is0.42857142857142855
da0.4186046511627907
sq0.4186046511627907
tl0.4186046511627907
az0.4117647058823529
eu0.4117647058823529
lv0.4117647058823529
nl0.4117647058823529
no0.4117647058823529
vi0.4117647058823529
de0.40119760479041916
et0.38650306748466257
fi0.38650306748466257
ms0.38650306748466257
sv0.38650306748466257
reliabletrue
passestrue