Run: 2026-02-17-01KHNFHTCWA6BM8X2A0CYVAXZA

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
16.5s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
72.73% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: *sighs and looks up from her camera* Ciao... Can I help you? Hunter: *confused* Excuse me, do you speak English? Isabella: *shakes her head* Mi dispiace, non parlo inglese. Parlo solo italiano. *I'm sorry, I don't speak English. I only speak Italian.* Hunter: *looks frustrated* Ah, well, I'm Detective Hunter and I'm investigating a recent event in town. Did you happen to witness anything unusual? Isabella: *looks troubled and shaken* Sì, ho visto qualcosa di strano. *Yes, I saw something strange.* Hunter: *confused* I'm sorry, I don't understand. Can you try to explain in English? Isabella: *shakes her head and looks frustrated* Non posso. *I can't.* Hunter: *sighs* Okay, well, if you remember anything or see anything else, please let me know. Isabella: *nods* Sì, certo. *Yes, of course.* *Hunter gets a call and has to leave* Hunter: *waves goodbye* Ciao, signorina. *Goodbye, miss.* Isabella: *waves back* Ciao, detective. *Goodbye, detective.*
created_at"2026-02-17T09:40:40.890945+00:00" 2/17/2026, 9:40:40 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency80
moderation_latency(null)
generation_time16419
tokens_prompt321
tokens_completion263
native_tokens_prompt268
native_tokens_completion256
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"chatcmpl-90c783845c51e3f5"
status200
is_byokfalse
latency21
endpoint_id"b9d81865-ce9a-432a-9cd5-0d9be55e7cb5"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321223-OFGH7LKGiL7ZwPdAf8n8"
upstream_id"chatcmpl-90c783845c51e3f5"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
72.73% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Ciao... Can I help you?"
detectedLang"en"
heavyLang"en"
scores
en0.7990353697749196
ca0.6323529411764706
cs0.5941558441558442
tl0.5503597122302158
tr0.5404411764705882
no0.5370370370370371
az0.5283018867924528
da0.5265151515151516
hr0.5265151515151516
sv0.5247148288973384
sq0.5173745173745175
pl0.50199203187251
it0.4791666666666667
ro0.4186046511627907
yo0.410377358490566
sk0.3654822335025381
be0.358974358974359
hu0.34895833333333337
et0.33510638297872336
is0.33510638297872336
lt0.33510638297872336
lv0.33510638297872336
uk0.33510638297872336
vi0.33510638297872336
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7715736040609137
sq0.5408163265306122
pt0.5202558635394456
cs0.48394495412844035
sl0.4803695150115473
hr0.460431654676259
tl0.44168734491315137
no0.43467336683417085
ms0.4094488188976378
pl0.3885869565217392
sk0.3697478991596639
vi0.33035714285714285
es0.3119266055045872
et0.296875
fr0.2879746835443038
nl0.27184466019417475
it0.26229508196721313
yo0.25742574257425743
fi0.25
da0.24242424242424243
de0.24242424242424243
ro0.24242424242424243
sv0.24242424242424243
reliabletrue
passestrue
2
name"Isabella"
dialogue"Mi dispiace, non parlo inglese. Parlo solo italiano."
detectedLang"it"
heavyLang"it"
scores
it0.798636926889715
es0.7113676731793961
pt0.5896464646464646
fr0.5554035567715458
sk0.4969040247678019
ro0.49455676516329705
ca0.4881889763779528
en0.48083067092651754
sq0.468954248366013
yo0.4610281923714759
cs0.45652173913043476
sl0.40909090909090906
pl0.4036697247706422
hr0.38095238095238093
de0.375
tr0.36893203883495146
hu0.3186582809224318
et0.3010752688172043
az0.28414096916299564
lt0.2793791574279379
nl0.2793791574279379
ms0.27293064876957496
no0.27293064876957496
da0.26636568848758463
sv0.26636568848758463
eu0.2111650485436893
tl0.1875
fi0.15364583333333331
lv0.15364583333333331
reliabletrue
passestrue
3
name"Hunter"
dialogue"Ah, well, I'm Detective Hunter and I'm investigating a recent event in town. Did you happen to witness anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.8001998001998002
tl0.6767676767676768
ro0.5848469122989102
nl0.5446784291405805
pt0.538638985005767
it0.5229576624925462
fr0.517781796262809
sv0.5142683667273831
de0.5076923076923077
da0.49622166246851385
cs0.48816378758797185
ca0.4798439531859558
no0.46879150066401065
sl0.4594594594594595
es0.45799457994579945
hr0.41262848751835535
sk0.4074074074074074
ms0.3874425727411945
yo0.3563958165728077
sq0.355877616747182
pl0.3294216261525566
lt0.3191489361702128
lv0.2963940193491645
et0.2707383773928897
az0.2537313432835821
hu0.23809523809523808
is0.2102665350444225
tr0.1452991452991453
fi0.13232104121475055
eu0.08045977011494253
vi0.08045977011494253
reliabletrue
passestrue
4
name"Isabella"
dialogue"Sì, ho visto qualcosa di strano."
detectedLang"it"
heavyLang"it"
scores
it0.8207885304659498
ca0.552772808586762
yo0.5454545454545454
pt0.5327102803738317
sk0.5201535508637236
no0.5145631067961165
sl0.5126705653021443
es0.5069033530571991
tl0.48665297741273095
ms0.47589098532494756
cs0.43052391799544415
hr0.4131455399061033
en0.3946731234866829
fr0.39320388349514557
de0.39172749391727496
lt0.38271604938271603
da0.36224489795918363
lv0.36224489795918363
is0.3573264781491003
vi0.2795389048991354
fi0.26035502958579887
pl0.2378048780487805
nl0.23547400611620795
ro0.23076923076923078
sv0.22360248447204967
az0.19093851132686085
et0.19093851132686085
sq0.19093851132686085
tr0.19093851132686085
reliabletrue
passestrue
5
name"Hunter"
dialogue"I'm sorry, I don't understand. Can you try to explain in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8070325900514581
no0.5844875346260388
da0.5778611632270169
sv0.5710200190657769
tl0.5631067961165048
nl0.5287958115183247
de0.5176848874598071
ro0.5103373231773667
pl0.4845360824742268
cs0.4693396226415094
it0.44581280788177335
hr0.42084942084942084
ca0.4163424124513619
yo0.4094488188976378
sk0.3943472409152086
sl0.37931034482758624
ms0.36619718309859156
az0.33234421364985167
pt0.30124223602484473
lv0.2913385826771654
fr0.2741935483870968
lt0.2706645056726094
tr0.24623115577889448
is0.23339011925042585
sq0.22945205479452058
es0.1818181818181818
fi0.14448669201520914
be0.1346153846153846
hu0.12959381044487428
et0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
6
name"Isabella"
dialogue"Non posso."
detectedLang"it"
heavyLang"it"
scores
it0.8387096774193549
pt0.7648902821316614
fr0.7321428571428571
en0.7201492537313433
ca0.5714285714285714
eu0.5370370370370371
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay, well, if you remember anything or see anything else, please let me know."
detectedLang"en"
heavyLang"en"
scores
en0.815422477440525
tl0.6103896103896105
et0.4325346784363178
ms0.42675159235668786
sl0.4163424124513619
nl0.375
fr0.37413073713490963
no0.36886395511921455
sv0.3571428571428572
sq0.3553008595988539
da0.34497816593886466
cs0.296875
yo0.29577464788732394
hu0.2822966507177033
de0.25742574257425743
is0.2549668874172185
sk0.2214532871972318
es0.1847826086956522
ro0.1818181818181818
pt0.16356877323420074
it0.15094339622641512
fi0.14285714285714285
reliabletrue
passestrue
8
name"Isabella"
dialogue"Sì, certo."
detectedLang"it"
heavyLang"it"
scores
it0.808673469387755
pt0.7232472324723247
es0.7035573122529644
yo0.691358024691358
ca0.6781115879828327
tl0.663677130044843
fr0.5810055865921787
en0.5398773006134969
ro0.4897959183673469
reliabletrue
passestrue
9
name"Hunter"
dialogue"Ciao, signorina."
detectedLang"it"
heavyLang"eo"
scores
it0.5850622406639004
ca0.5670995670995671
es0.5670995670995671
pt0.5670995670995671
da0.5535714285714286
sv0.5535714285714286
en0.4594594594594595
fr0.4594594594594595
cs0.3939393939393939
de0.3939393939393939
nl0.3939393939393939
no0.3939393939393939
sk0.3939393939393939
hr0.38650306748466257
tl0.38650306748466257
et0.3710691823899371
fi0.3710691823899371
lt0.3710691823899371
lv0.3710691823899371
ro0.3710691823899371
sl0.3710691823899371
sq0.3710691823899371
tr0.3710691823899371
reliablefalse
passesfalse
10
name"Isabella"
dialogue"Ciao, detective."
detectedLang"en"
heavyLang"eo"
scores
en0.7524752475247525
ro0.7159090909090909
tl0.6951219512195121
fr0.658703071672355
ca0.6428571428571429
es0.6402877697841727
it0.6336996336996337
pt0.6296296296296297
sq0.48186528497409326
da0.45652173913043476
de0.45652173913043476
nl0.45054945054945056
no0.4444444444444444
cs0.4186046511627907
hr0.40119760479041916
sl0.40119760479041916
sv0.40119760479041916
reliabletrue
passesfalse