Run: 2026-02-17-01KHNFG92BPK3YHQ7AWYRDHW5Z

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
5.8s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
[INT. CAFE - DAY] [Marie is sitting at a table, looking at her camera. Hunter approaches her.] HUNTER: Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearances in town. Do you have a moment to talk? MARIE: (in French) Oui, bien sûr. Qu'est-ce qui se passe? [Hunter looks confused.] HUNTER: I'm sorry, I don't speak French. Do you speak English? MARIE: (in French) Je ne parle pas anglais. Je suis désolée. [Marie looks troubled and shaken. She starts to explain in French, but Hunter can't understand her.] HUNTER: (confused) I'm sorry, I don't understand. Can you try to speak more slowly? MARIE: (in French) Je suis désolée. Je ne peux pas expliquer en anglais. [Hunter looks frustrated. He takes out his phone and starts typing something.] HUNTER: (to himself) I need to find someone who can translate for me. [Marie looks at Hunter's phone and realizes he's trying to find a translator. She nods and smiles, understanding his frustration.] MARIE: (in French) Je comprends. C'est difficile de communiquer. HUNTER: (confused) What did you say? MARIE: (in French) Rien. Je comprends que c'est difficile de communiquer. [Hunter's phone rings. He answers it and listens for a moment.] HUNTER: (to Marie) I'm sorry, I have to go. Can we continue this conversation later? MARIE: (in French) Oui, bien sûr. Je serai ici. [Hunter nods and leaves the cafe. Marie looks at her camera and starts to cry.]
created_at"2026-02-17T09:39:39.244939+00:00" 2/17/2026, 9:39:39 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency281
moderation_latency(null)
generation_time5704
tokens_prompt316
tokens_completion394
native_tokens_prompt268
native_tokens_completion365
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf45173d786d6af-IAD"
status200
is_byokfalse
latency181
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321173-OrwVOGiND0IENzynH19l"
upstream_id"9cf45173d786d6af-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"HUNTER"
dialogue"Excuse me, miss. I'm Detective Hunter. I'm investigating the recent disappearances in town. Do you have a moment to talk?"
detectedLang"en"
heavyLang"en"
scores
en0.7965929316043733
tl0.651719634305616
fr0.6414164051994621
pt0.6110841030627127
ro0.6019900497512438
nl0.6007984031936128
it0.5668651867893882
ca0.5604395604395604
cs0.5425957690108634
sl0.5260663507109005
da0.5142683667273831
sq0.5073891625615764
sv0.5055624227441285
sk0.505256648113791
es0.5003123048094941
no0.49748743718592964
hr0.48220064724919093
de0.47780678851174935
pl0.4576271186440678
ms0.43302622253720763
yo0.42528735632183906
lt0.3191489361702128
lv0.29577464788732394
az0.29515418502202645
et0.2640294388224471
hu0.21491658488714427
is0.2102665350444225
fi0.19759277833500502
vi0.18450560652395515
tr0.1452991452991453
eu0.08045977011494253
reliabletrue
passestrue
1
name"MARIE"
dialogue"Oui, bien sûr. Qu'est-ce qui se passe?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.8328877005347594
it0.648876404494382
ca0.6050552922590837
pt0.5511669658886894
da0.5155038759689923
es0.5126705653021443
ro0.5107632093933464
sv0.4834710743801653
no0.4802494802494803
de0.4033412887828162
et0.3902439024390244
nl0.36224489795918363
cs0.35233160621761656
hr0.34725848563968675
sl0.34554973821989526
sq0.3093922651933701
yo0.299719887955182
fi0.28977272727272724
en0.24698795180722888
is0.20634920634920634
ms0.20634920634920634
reliabletrue
passestrue
2
name"HUNTER"
dialogue"I'm sorry, I don't speak French. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8012492901760363
tl0.5641344956413449
pt0.4992846924177396
hr0.48604992657856094
cs0.47447447447447455
it0.45482866043613707
pl0.4345718901453958
sq0.4176372712146422
no0.3934142114384749
da0.3761140819964349
sv0.375
sk0.36823104693140796
vi0.3320610687022901
yo0.32038834951456313
ro0.31640625
ca0.2827868852459016
sl0.25531914893617025
es0.21875
de0.17061611374407584
ms0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
et0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
reliabletrue
passestrue
3
name"MARIE"
dialogue"Je ne parle pas anglais. Je suis désolée."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8010130246020261
sl0.6545226130653266
lt0.6060171919770774
sq0.5820668693009119
cs0.5749613601236476
hr0.5578778135048231
ca0.533106960950764
sk0.5098039215686274
nl0.5045045045045045
lv0.4821092278719397
it0.46911196911196906
ro0.46911196911196906
yo0.3721461187214612
pl0.3648960739030023
tr0.3574766355140187
hu0.3514150943396226
ms0.3483412322274882
es0.34679334916864607
de0.34210526315789475
en0.3276283618581907
fi0.24242424242424243
az0.20289855072463767
et0.1863905325443787
pt0.1863905325443787
da0.17664670658682635
no0.17664670658682635
sv0.17664670658682635
reliabletrue
passestrue
4
name"HUNTER"
dialogue"I'm sorry, I don't understand. Can you try to speak more slowly?"
detectedLang"en"
heavyLang"en"
scores
en0.7997329773030708
no0.5504495504495505
da0.5472837022132797
tl0.5317377731529657
cs0.4693396226415094
sv0.4367959949937422
pl0.4296577946768061
hr0.42528735632183906
sk0.3943472409152086
nl0.3818681318681319
yo0.33234421364985167
ca0.32330827067669177
it0.32330827067669177
sl0.3171471927162367
de0.3001555209953344
lv0.2913385826771654
lt0.2706645056726094
ro0.267100977198697
tr0.24623115577889448
az0.23728813559322032
is0.23339011925042585
sq0.22945205479452058
pt0.1818181818181818
be0.1346153846153846
hu0.12959381044487428
et0.12280701754385964
uk0.12280701754385964
vi0.12280701754385964
reliabletrue
passestrue
5
name"MARIE"
dialogue"Je suis désolée. Je ne peux pas expliquer en anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8171368861024032
ca0.6268656716417911
sl0.56575682382134
nl0.5575221238938053
lt0.5070422535211268
sq0.4807121661721069
cs0.4688922610015175
hr0.4479495268138801
ro0.4299674267100977
es0.42622950819672134
pt0.3902439024390244
sv0.3848857644991213
sk0.38162544169611307
tr0.36823104693140796
lv0.360146252285192
fi0.32950191570881227
yo0.317738791423002
en0.31640625
de0.3013972055888224
da0.29718875502008035
no0.2842535787321063
is0.2768595041322314
pl0.20634920634920634
it0.2009132420091324
ms0.1935483870967742
hu0.1898148148148148
eu0.1764705882352941
reliabletrue
passestrue
6
name"HUNTER"
dialogue"I need to find someone who can translate for me."
detectedLang"en"
heavyLang"en"
scores
en0.8241341991341992
no0.6635610766045549
da0.6348314606741574
tl0.5504840940525588
hr0.5473537604456825
et0.5227606461086637
sq0.5213549337260678
it0.5060790273556232
pt0.5053272450532724
pl0.5045731707317073
cs0.47580645161290325
ca0.4715447154471545
sl0.4519392917369309
sk0.45101351351351354
es0.4415807560137457
ro0.4415807560137457
lv0.436741767764298
lt0.4186046511627907
yo0.4080145719489982
tr0.3925233644859813
az0.37977099236641226
sv0.37739463601532564
fr0.344758064516129
vi0.3172268907563025
nl0.3114406779661017
ms0.3055555555555556
fi0.1875
be0.17721518987341772
de0.1709183673469388
eu0.1709183673469388
hu0.1709183673469388
is0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
7
name"MARIE"
dialogue"Je comprends. C'est difficile de communiquer."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8256103637269556
en0.6666666666666666
it0.6611810261374638
ca0.6132596685082874
nl0.6049661399548533
es0.5608531994981178
tl0.5442708333333333
pt0.5339547270306259
ro0.4992846924177396
de0.46236559139784944
yo0.4233937397034596
sk0.3794326241134752
da0.34944237918215615
no0.34701492537313433
sv0.3433395872420263
sl0.33078393881453155
hr0.328214971209213
cs0.29577464788732394
az0.2738589211618257
tr0.21875
hu0.21700223713646533
pl0.20634920634920634
lt0.19724770642201836
eu0.16666666666666666
et0.16467780429594273
ms0.15254237288135594
sq0.15254237288135594
reliabletrue
passestrue
8
name"HUNTER"
dialogue"What did you say?"
detectedLang"en"
heavyLang"en"
scores
en0.8444790046656299
tl0.6402877697841727
cs0.43820224719101125
reliabletrue
passestrue
9
name"MARIE"
dialogue"Rien. Je comprends que c'est difficile de communiquer."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8283998283998284
ca0.646954986760812
en0.6363636363636364
it0.6306555863342567
es0.6105160662122687
pt0.5889003083247688
nl0.5726495726495726
tl0.511002444987775
ro0.465954606141522
de0.42938659058487877
yo0.3911719939117199
sk0.3485342019543974
da0.3197278911564626
no0.3174061433447099
sv0.313893653516295
sl0.3019197207678883
hr0.29947460595446584
cs0.2687385740402194
az0.24812030075187969
tr0.19678714859437751
hu0.19517102615694165
pl0.18533604887983707
lt0.17695473251028807
eu0.14893617021276595
et0.14712153518123666
ms0.13606911447084233
sq0.13606911447084233
reliabletrue
passestrue
10
name"HUNTER"
dialogue"I'm sorry, I have to go. Can we continue this conversation later?"
detectedLang"en"
heavyLang"en"
scores
en0.8173779315647828
tl0.6412386706948641
fr0.6242088607594937
da0.6096959737058341
nl0.5862369337979094
ca0.5609981515711645
it0.5577281191806331
pt0.5484790874524715
pl0.5356793743890519
no0.5087900723888314
sv0.5010504201680672
ro0.49788583509513745
yo0.490343347639485
de0.4662921348314607
es0.4457409568261376
hr0.3493150684931507
lv0.343015214384509
lt0.33473389355742295
cs0.3319268635724332
sq0.302496328928047
sk0.3004418262150221
az0.2994100294985251
ms0.2375601926163724
tr0.23633440514469453
et0.22131147540983606
is0.20435510887772196
sl0.2030201342281879
fi0.14721723518850988
zh0.1394927536231884
hi0.13793103448275862
be0.12844036697247707
hu0.12361623616236161
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
11
name"MARIE"
dialogue"Oui, bien sûr. Je serai ici."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8159831756046267
ms0.5111731843575419
sl0.4971264367816092
hr0.4942196531791907
it0.48224852071005914
yo0.48224852071005914
cs0.45652173913043476
sk0.453125
es0.4318181818181818
nl0.4186046511627907
lt0.34701492537313433
pl0.34210526315789475
de0.3137254901960784
ca0.3027888446215139
tr0.3027888446215139
reliabletrue
passestrue