Run: 2026-02-17-01KHNFSYRGG2D39DFAWACMQH7Z

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
4.8s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
71.43% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."

Model response

AI
Isabella: *looks up from her camera, startled* "Oh, ciao! How can I help you?" Hunter: "Excuse me, ma'am. I'm Detective Hunter, and I'm investigating a recent event in town. Can you tell me what you saw?" Isabella: *speaks rapidly in Italian, her voice shaking* "Ho visto qualcosa di terribile! C'era una luce brillante e poi... e poi è scomparso!" Hunter: *looks confused* "I'm sorry, I don't understand Italian. Can you speak English?" Isabella: *takes a deep breath and tries to compose herself* "I... I saw something terrible. There was a bright light and then... then it disappeared." Hunter: *nods slowly* "Okay, I think I understand. Can you tell me more about what you saw?" Isabella: *starts to explain, but her words are jumbled and unclear* Hunter: *listens patiently, trying to make sense of her words* Isabella: *finishes her story, looking exhausted* Hunter: *nods* "Thank you for your help, ma'am. I have to go now, but I'll be in touch if I have any more questions." Isabella: *nods, still looking shaken* Hunter: *turns and walks away, pulling out his phone to make a call*
created_at"2026-02-17T09:44:55.319388+00:00" 2/17/2026, 9:44:55 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency265
moderation_latency(null)
generation_time4700
tokens_prompt321
tokens_completion293
native_tokens_prompt268
native_tokens_completion278
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf45931e3b9c997-IAD"
status200
is_byokfalse
latency162
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321490-4NEaSau3bLUA7mlm4T2e"
upstream_id"9cf45931e3b9c997-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
71.43% Parse dialogue n/a
dialogue
0
name"Isabella"
dialogue"Oh, ciao! How can I help you?"
detectedLang"en"
heavyLang"en"
scores
en0.7860635696821516
ca0.5512820512820513
cs0.5111731843575419
tl0.4664634146341463
tr0.45652173913043476
no0.453125
az0.4444444444444444
da0.44267515923566875
hr0.44267515923566875
sv0.44089456869009586
sq0.4336569579288026
pl0.4186046511627907
nl0.41666666666666663
it0.396551724137931
ro0.33962264150943394
yo0.3320610687022901
sk0.29149797570850206
be0.2857142857142857
hu0.2768595041322314
et0.2647058823529412
is0.2647058823529412
lt0.2647058823529412
lv0.2647058823529412
uk0.2647058823529412
vi0.2647058823529412
reliabletrue
passesfalse
1
name"Hunter"
dialogue"Excuse me, ma'am. I'm Detective Hunter, and I'm investigating a recent event in town. Can you tell me what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.7889022919179735
tl0.6333158721843898
ro0.6168582375478927
it0.5775497887748944
fr0.5757575757575758
pt0.574468085106383
nl0.573170731707317
ca0.5379537953795379
sv0.5159059474412172
es0.5003568879371877
de0.4856722997795738
sl0.4803266518188567
no0.45736434108527135
cs0.4431185361972952
ms0.4331983805668016
da0.42622950819672134
sq0.4117647058823529
hr0.38917975567190227
sk0.3738819320214669
az0.33269780743565297
yo0.30417495029821073
et0.2907801418439716
lt0.2790937178166838
pl0.2693110647181628
is0.23329682365826945
tr0.23329682365826945
fi0.21962095875139354
hu0.1822429906542056
lv0.16666666666666666
eu0.09090909090909091
vi0.09090909090909091
reliabletrue
passestrue
2
name"Isabella"
dialogue"Ho visto qualcosa di terribile! C'era una luce brillante e poi... e poi è scomparso!"
detectedLang"it"
heavyLang"it"
scores
it0.8032169746748802
pt0.5563271604938271
es0.5465299684542587
ca0.5184254606365158
tl0.5184254606365158
fr0.4656133828996283
no0.4041450777202072
yo0.4004171011470281
ro0.39537329127234494
de0.39217758985200846
sq0.35101580135440186
en0.3443557582668187
da0.33526011560693636
sl0.2848258706467662
fi0.267515923566879
sv0.25997425997426
sk0.2414248021108179
ms0.2219215155615697
lt0.21232876712328766
pl0.19692737430167598
hu0.1958041958041958
is0.19467787114845939
hr0.19241573033707865
lv0.19014084507042253
nl0.1843971631205674
az0.1797432239657632
et0.1797432239657632
cs0.15565345080763582
vi0.14434523809523808
tr0.10852713178294573
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't understand Italian. Can you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7966507177033493
no0.5800395256916996
da0.5732931726907631
tl0.5439914163090128
sv0.5303867403314917
ro0.4766009852216749
de0.43559096945551123
cs0.43408788282290284
it0.41460055096418735
sq0.39801699716713884
hr0.38848920863309355
nl0.36186186186186187
ms0.3431221020092735
ca0.3359375
tr0.3264659270998415
pl0.32432432432432434
az0.3189102564102564
sk0.2747440273037543
pt0.2722602739726028
yo0.2697594501718213
is0.24377224199288253
fi0.23971377459749554
lt0.22867513611615245
be0.1414141414141414
sl0.1414141414141414
hu0.1361788617886179
es0.1290983606557377
et0.1290983606557377
fr0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
4
name"Isabella"
dialogue"I... I saw something terrible. There was a bright light and then... then it disappeared."
detectedLang"en"
heavyLang"en"
scores
en0.8141263940520446
tl0.5617529880478088
yo0.4963369963369963
sq0.4845360824742268
de0.47668886774500474
ca0.4532803180914513
fr0.4494494494494495
it0.4240837696335079
es0.41113490364025695
nl0.40604751619870405
pt0.40021810250817885
no0.3902439024390244
da0.38752783964365256
ms0.3813273340832396
hr0.3735763097949886
pl0.34523809523809523
hu0.34210526315789475
sv0.32432432432432434
cs0.301143583227446
ro0.2939666238767651
lv0.28478543563068925
eu0.2753623188405797
sk0.26861702127659576
az0.26273458445040215
et0.2557510148849797
tr0.2109038737446198
lt0.20863309352517986
is0.2005813953488372
vi0.19472913616398244
fi0.18154761904761904
sl0.140625
be0.11290322580645161
uk0.10277324632952692
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Okay, I think I understand. Can you tell me more about what you saw?"
detectedLang"en"
heavyLang"en"
scores
en0.8193315266485999
no0.5712754555198285
da0.5238095238095238
nl0.47506561679790027
sv0.465954606141522
tl0.45054945054945056
sq0.41348973607038125
cs0.4002998500749625
hr0.35170178282009723
ca0.34959349593495936
pl0.33774834437086093
it0.3277310924369748
de0.3254637436762226
ms0.3150684931506849
sl0.3055555555555556
ro0.2907801418439716
sk0.28698752228163993
et0.2831541218637993
tr0.2687385740402194
az0.25925925925925924
is0.25512104283054005
es0.20318725099601595
fr0.18533604887983707
pt0.18032786885245902
yo0.17864476386036962
fi0.15789473684210525
be0.14893617021276595
hu0.14346895074946467
lt0.13606911447084233
lv0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
6
name"Hunter"
dialogue"Thank you for your help, ma'am. I have to go now, but I'll be in touch if I have any more questions."
detectedLang"en"
heavyLang"en"
scores
en0.8186829126776908
tl0.5516499282639885
da0.46763202725724023
fr0.46717817561807334
yo0.44395017793594305
it0.4399641577060932
pl0.4202226345083488
ca0.3978805394990366
no0.39729990356798456
sl0.36740890688259115
sv0.3556701030927836
hr0.3475991649269311
cs0.3343982960596379
lt0.3086283185840708
pt0.2937853107344633
ro0.2707117852975496
vi0.24969987995198079
sk0.2460796139927624
lv0.22839506172839508
hu0.22744128553770088
nl0.1997439180537772
ms0.19665809768637532
az0.19041450777202074
de0.19041450777202074
sq0.17654808959156787
es0.10841654778887304
be0.10071942446043164
tr0.10071942446043164
et0.09156976744186046
is0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue