Run: 2026-02-17-01KHNFHTCWA6BM8X2A0CYVAXZA

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
16.5s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
63.64% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: *sighs and looks up from her camera* Ciao... Can I help you? Hunter: *confused* Excuse me, do you speak English? Isabella: *shakes her head* Mi dispiace, non parlo inglese. Parlo solo italiano. *I'm sorry, I don't speak English. I only speak Italian.* Hunter: *looks frustrated* Ah, well, I'm Detective Hunter and I'm investigating a recent event in town. Did you happen to witness anything unusual? Isabella: *looks troubled and shaken* Sì, ho visto qualcosa di strano. *Yes, I saw something strange.* Hunter: *confused* I'm sorry, I don't understand. Can you try to explain in English? Isabella: *shakes her head and looks frustrated* Non posso. *I can't.* Hunter: *sighs* Okay, well, if you remember anything or see anything else, please let me know. Isabella: *nods* Sì, certo. *Yes, of course.* *Hunter gets a call and has to leave* Hunter: *waves goodbye* Ciao, signorina. *Goodbye, miss.* Isabella: *waves back* Ciao, detective. *Goodbye, detective.*
created_at"2026-02-17T09:40:40.890945+00:00" 2/17/2026, 9:40:40 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency80
moderation_latency(null)
generation_time16419
tokens_prompt321
tokens_completion263
native_tokens_prompt268
native_tokens_completion256
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"chatcmpl-90c783845c51e3f5"
status200
is_byokfalse
latency21
endpoint_id"b9d81865-ce9a-432a-9cd5-0d9be55e7cb5"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321223-OFGH7LKGiL7ZwPdAf8n8"
upstream_id"chatcmpl-90c783845c51e3f5"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
63.64% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"sighs and looks up from her camera Ciao... Can I help you?"
detectedLang"en"
heavyLang"en"
scores
en0.7889701744513224
tl0.5856353591160222
ca0.45809248554913296
it0.4212962962962963
tr0.4204018547140649
da0.410377358490566
no0.4085173501577287
ro0.3980738362760835
sv0.3697478991596639
yo0.3315508021390375
cs0.32795698924731176
nl0.29111531190926276
az0.27184466019417475
hr0.2704280155642024
sq0.2632612966601179
pl0.251497005988024
es0.20886075949367086
fr0.16851441241685144
de0.1610738255033557
ms0.1610738255033557
sk0.1610738255033557
be0.15730337078651685
hu0.1515837104072398
et0.14383561643835618
is0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passesfalse
1
name"Hunter"
dialogue"confused Excuse me, do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.765625
pt0.5398773006134969
sq0.4690265486725664
tl0.46808510638297873
et0.45054945054945056
cs0.4129158512720157
sl0.4094488188976378
es0.40711462450592883
fr0.3963782696177062
hr0.3902439024390244
it0.38650306748466257
ro0.3697478991596639
no0.36575052854122625
ms0.34210526315789475
nl0.34065934065934067
pl0.3227990970654628
sk0.3055555555555556
vi0.27007299270072993
ca0.25
yo0.20634920634920634
fi0.2
da0.1935483870967742
de0.1935483870967742
sv0.1935483870967742
reliabletrue
passestrue
2
name"Isabella"
dialogue"shakes her head Mi dispiace, non parlo inglese. Parlo solo italiano. I'm sorry, I don't speak English. I only speak Italian."
detectedLang"en"
heavyLang"en"
scores
en0.7273411056788266
it0.6747420367877972
es0.5249017038007864
tl0.49547668754349344
pt0.43885448916408676
ro0.43754848719937933
sq0.40622440622440625
no0.3897306397306397
da0.3835034013605442
ca0.38192668371696503
hr0.36179577464788737
fr0.358974358974359
sk0.35152057245080504
tr0.34684684684684686
cs0.34270172257479603
yo0.3348623853211009
pl0.323062558356676
sv0.3114909781576448
et0.28641732283464566
ms0.28217821782178215
de0.2691532258064516
sl0.23684210526315788
hu0.23199152542372883
az0.2093784078516903
lt0.20678336980306347
fi0.1559953434225844
nl0.14806110458284372
lv0.14403778040141677
eu0.10714285714285714
be0.0880503144654088
is0.0799492385786802
uk0.0799492385786802
vi0.0799492385786802
reliabletrue
passesfalse
3
name"Hunter"
dialogue"looks frustrated Ah, well, I'm Detective Hunter and I'm investigating a recent event in town. Did you happen to witness anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7976815398075241
tl0.6531683539557556
ro0.5651151857075694
nl0.5244215938303343
pt0.520973588814086
it0.5050829320492242
fr0.4991878722252301
sv0.4948115783724741
de0.48866777224986185
da0.4779909706546276
cs0.471730439748715
ca0.4640787949015064
no0.4539551357733176
es0.44710101613867304
sl0.4441105769230769
hr0.40322580645161293
sk0.39856957087126144
ms0.35359888190076866
sq0.3531468531468532
pl0.33019551049963797
yo0.32383040935672514
lt0.32333577176298467
lv0.30188679245283023
et0.28846153846153844
az0.2635350318471338
is0.227234753550543
hu0.2127659574468085
tr0.1281809613572102
eu0.12570888468809074
fi0.11652340019102196
hi0.10019455252918288
vi0.07035175879396985
reliabletrue
passestrue
4
name"Isabella"
dialogue"looks troubled and shaken Sì, ho visto qualcosa di strano. Yes, I saw something strange."
detectedLang"en"
heavyLang"it"
scores
en0.7332479726845924
it0.6684350132625994
tl0.5250759878419453
no0.5003996802557954
yo0.4374437443744375
ca0.41697761194029853
da0.39437984496124034
ms0.39320388349514557
nl0.3699596774193548
pt0.36740890688259115
fr0.36289500509684
sk0.3543388429752066
es0.34895833333333337
hr0.33510638297872336
sv0.32212581344902386
cs0.31991294885745375
sl0.2961711711711712
de0.28977272727272724
lt0.2586002372479241
lv0.24698795180722888
pl0.2460796139927624
is0.24425634824667475
sq0.23594132029339854
ro0.20886075949367086
vi0.20382165605095542
tr0.1710875331564987
az0.16331994645247658
et0.16331994645247658
fi0.12342215988779803
be0.10071942446043164
hu0.09682080924855492
uk0.09156976744186046
reliabletrue
passestrue
5
name"Hunter"
dialogue"confused I'm sorry, I don't understand. Can you try to explain in English?"
detectedLang"en"
heavyLang"en"
scores
en0.8001522649409973
tl0.5591939546599496
no0.5466321243523317
da0.5398773006134969
sv0.5329181494661922
nl0.5231607629427792
ro0.5218579234972678
de0.4791666666666667
it0.4728915662650602
pl0.44620253164556967
ca0.4450317124735729
cs0.4312026002166848
hr0.38380281690140844
yo0.37275985663082434
pt0.3651753325272068
sk0.3581907090464548
fr0.3445692883895131
sl0.34375
ms0.3312101910828026
az0.29906542056074764
et0.2895805142083897
es0.279835390946502
lv0.2605633802816902
lt0.24132947976878616
tr0.21875
is0.20694864048338368
sq0.2033383915022762
fi0.1264559068219634
be0.11764705882352942
hu0.11317567567567569
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
6
name"Isabella"
dialogue"shakes her head and looks frustrated Non posso. I can't."
detectedLang"en"
heavyLang"en"
scores
en0.7953964194373402
it0.588477366255144
tl0.5703544575725027
no0.44598337950138506
da0.4444444444444444
pt0.441340782122905
ca0.42938659058487877
fr0.40119760479041916
et0.3640699523052464
hr0.33554817275747506
sq0.32998324958123953
sv0.32998324958123953
tr0.3277310924369748
pl0.32088285229202035
yo0.3174061433447099
cs0.29577464788732394
ro0.2920353982300885
eu0.2727272727272727
sk0.2523364485981308
lt0.24528301886792453
lv0.23954372623574144
az0.23371647509578544
is0.23371647509578544
hi0.2047713717693837
es0.15254237288135594
be0.14893617021276595
hu0.14346895074946467
nl0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
de0.12854030501089325
sl0.12854030501089325
reliabletrue
passesfalse
7
name"Hunter"
dialogue"sighs Okay, well, if you remember anything or see anything else, please let me know."
detectedLang"en"
heavyLang"en"
scores
en0.7990353697749196
tl0.5850622406639004
et0.40688018979833923
ms0.40119760479041916
sl0.3909866017052376
nl0.35064935064935066
fr0.3498049414824447
no0.34469200524246396
sv0.3333333333333333
sq0.3315508021390375
da0.32157394843962006
cs0.2753623188405797
yo0.274310595065312
hu0.26144756277695713
de0.2378048780487805
is0.23547400611620795
sk0.20382165605095542
es0.16943521594684383
ro0.16666666666666666
pt0.14965986394557826
it0.13793103448275862
fi0.13043478260869565
reliabletrue
passestrue
8
name"Isabella"
dialogue"nods Sì, certo. Yes, of course."
detectedLang"en"
heavyLang"it"
scores
en0.7395833333333334
tl0.6825396825396826
it0.6131528046421664
fr0.6023856858846919
yo0.5841995841995842
pt0.494949494949495
es0.4708994708994709
ca0.441340782122905
ro0.441340782122905
nl0.38650306748466257
sq0.3265993265993266
no0.3197278911564626
is0.3079584775086505
de0.29328621908127206
reliabletrue
passestrue
9
name"Hunter"
dialogue"waves goodbye Ciao, signorina. Goodbye, miss."
detectedLang"en"
heavyLang"en"
scores
en0.6767241379310345
es0.4791666666666667
pt0.4791666666666667
da0.47058823529411764
tl0.4201030927835051
fr0.41709844559585496
it0.38524590163934425
ca0.3679775280898876
sv0.3553008595988539
cs0.22413793103448276
de0.22413793103448276
nl0.22413793103448276
no0.22413793103448276
sk0.22413793103448276
hr0.21875
et0.2077464788732394
fi0.2077464788732394
lt0.2077464788732394
lv0.2077464788732394
ro0.2077464788732394
sl0.2077464788732394
sq0.2077464788732394
tr0.2077464788732394
reliabletrue
passestrue
10
name"Isabella"
dialogue"waves back Ciao, detective. Goodbye, detective."
detectedLang"en"
heavyLang"en"
scores
en0.7619047619047619
tl0.593128390596745
fr0.5445344129554657
es0.5302713987473904
ro0.5283018867924528
pt0.5222929936305732
ca0.4444444444444444
it0.43467336683417085
da0.4155844155844156
sq0.29245283018867924
de0.27184466019417475
nl0.267100977198697
no0.26229508196721313
cs0.24242424242424243
hr0.22945205479452058
sl0.22945205479452058
sv0.22945205479452058
reliabletrue
passesfalse