Run: 2026-02-17-01KHNF39AKXSGVGQ09XHNN04Z0

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
9.4s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
90.91% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: "Qu'est-ce que vous voulez? Je ne parle pas anglais." (What do you want? I don't speak English.) Hunter: "Sorry, I don't understand. Do you speak English?" Marie: "Non, je ne parle pas anglais. Je suis française." (No, I don't speak English. I'm French.) Hunter: "Oh, I see. Well, I'm Detective Hunter and I'm investigating some recent disappearances in town. Have you seen or heard anything unusual lately?" Marie: "Je ne comprends pas. Je ne parle pas anglais." (I don't understand. I don't speak English.) Hunter: "Okay, let me try this. Avez-vous vu quelque chose d'inhabituel récemment?" (Have you seen anything unusual recently?) Marie: "Non, je n'ai rien vu d'inhabituel. Je suis ici pour étudier la photographie de paysage." (No, I haven't seen anything unusual. I'm here to study landscape photography.) Hunter: "I see. Well, if you do see anything out of the ordinary, please let me know. Here's my card." Marie: "Merci, mais je ne comprends pas." (Thank you, but I don't understand.) Hunter's phone rings. He answers it and listens for a moment before hanging up. Hunter: "I'm sorry, I have to go. If you remember anything, please call me." Marie: "Au revoir." (Goodbye.)
created_at"2026-02-17T09:32:37.440421+00:00" 2/17/2026, 9:32:37 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency374
moderation_latency(null)
generation_time9180
tokens_prompt316
tokens_completion319
native_tokens_prompt268
native_tokens_completion311
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"chatcmpl-8edd17fa8e69d9d8"
status200
is_byokfalse
latency69
endpoint_id"b9d81865-ce9a-432a-9cd5-0d9be55e7cb5"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771320747-MLBl10FlsQMNLovqNc2z"
upstream_id"chatcmpl-8edd17fa8e69d9d8"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
90.91% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Qu'est-ce que vous voulez? Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8184647302904563
sl0.5981630309988519
ca0.5843230403800476
lt0.5472186287192755
ro0.5231607629427792
sq0.5225102319236016
cs0.515235457063712
hr0.49784791965566716
es0.48224852071005914
it0.47839046199701935
sk0.4496855345911949
nl0.4444444444444444
lv0.42244224422442245
pt0.40170940170940167
yo0.317738791423002
pl0.3110236220472441
tr0.30417495029821073
hu0.2985971943887776
ms0.29577464788732394
de0.29006085192697767
en0.2768595041322314
fi0.2009132420091324
az0.16666666666666666
et0.15254237288135594
da0.14425427872860636
no0.14425427872860636
sv0.14425427872860636
reliabletrue
passestrue
1
name"Hunter"
dialogue"Sorry, I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7988505747126436
no0.5995423340961099
da0.5939675174013921
tl0.5472186287192755
sv0.5460440985732815
cs0.5333333333333334
pl0.49784791965566716
hr0.48604992657856094
sk0.45567651632970446
de0.4308943089430894
pt0.42244224422442245
sq0.4176372712146422
ro0.40273037542662116
it0.3805309734513274
nl0.3371212121212121
vi0.3320610687022901
yo0.32038834951456313
ca0.2827868852459016
is0.2813141683778234
sl0.25531914893617025
ms0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
et0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
reliabletrue
passestrue
2
name"Marie"
dialogue"Non, je ne parle pas anglais. Je suis française."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8075689544579858
sl0.6651785714285715
ca0.6277915632754343
it0.6129032258064515
sq0.604221635883905
cs0.5956873315363882
hr0.5856353591160222
lt0.5850622406639004
en0.5535714285714286
sk0.5440729483282675
nl0.5419847328244275
lv0.5121951219512195
ro0.5106035889070147
yo0.44751381215469616
pl0.4318181818181818
de0.42418426103646834
pt0.42418426103646834
hu0.42196531791907516
es0.42084942084942084
tr0.4186046511627907
ms0.40711462450592883
eu0.3576017130620985
et0.3197278911564626
no0.3087557603686636
az0.3071593533487298
da0.29577464788732394
sv0.29577464788732394
fi0.22680412371134018
tl0.18256130790190736
is0.16434540389972147
reliabletrue
passestrue
3
name"Hunter"
dialogue"Oh, I see. Well, I'm Detective Hunter and I'm investigating some recent disappearances in town. Have you seen or heard anything unusual lately?"
detectedLang"en"
heavyLang"en"
scores
en0.8041237113402062
tl0.6163166397415185
nl0.5221327967806841
fr0.5175215845606908
ro0.5105615662029881
it0.47859495060373214
pt0.4765840220385675
ca0.46145124716553293
sv0.4418331374853114
da0.4117647058823529
de0.38749194068343
es0.36918990703851257
ms0.3628437290409121
cs0.3581081081081081
no0.3470790378006873
sq0.3466299862448418
hr0.33239634574841886
sl0.33051444679351655
et0.32956951305575155
sk0.3155619596541787
pl0.2720306513409962
yo0.2238562091503268
az0.21810699588477367
lt0.2096505823627288
lv0.17891097666378566
is0.1746307558644657
fi0.12603495860165592
tr0.1195551436515292
hi0.07407407407407407
be0.06862745098039216
hu0.06588003933136675
uk0.06219151036525173
vi0.06219151036525173
reliabletrue
passestrue
4
name"Marie"
dialogue"Je ne comprends pas. Je ne parle pas anglais."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7990353697749196
sl0.6757457846952011
ca0.6736292428198434
lt0.6706192358366271
it0.6418338108882521
sq0.6050552922590837
cs0.5980707395498392
nl0.5974235104669887
ro0.5867768595041323
es0.5854063018242123
en0.584717607973422
hr0.5812395309882747
sk0.5335820895522388
lv0.5059288537549407
de0.46808510638297873
pt0.42528735632183906
tl0.40191387559808617
yo0.3946731234866829
pl0.3872549019607844
tr0.3796526054590571
hu0.3734335839598998
ms0.37027707808564225
fi0.26035502958579887
az0.21875
et0.20127795527156547
da0.19093851132686085
no0.19093851132686085
sv0.19093851132686085
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay, let me try this. Avez-vous vu quelque chose d'inhabituel récemment?"
detectedLang"fr"
heavyLang"fr"
scores
fr0.7602221100454316
en0.6233148295003965
tl0.3807040417209909
it0.37335092348284965
nl0.3572395128552098
sq0.3115942028985507
ca0.30858806404657935
sl0.28892215568862273
cs0.2692307692307693
no0.24960505529225907
de0.24363057324840762
da0.23263327948303714
es0.17677642980935876
et0.16666666666666666
pt0.15630550621669628
ms0.15026833631484796
ro0.14721723518850988
fi0.13636363636363635
pl0.12361623616236161
az0.1171003717472119
hr0.1171003717472119
hu0.1171003717472119
sk0.1171003717472119
sv0.1171003717472119
yo0.1171003717472119
reliabletrue
passesfalse
6
name"Marie"
dialogue"Non, je n'ai rien vu d'inhabituel. Je suis ici pour étudier la photographie de paysage."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7975352112676056
en0.4824482448244825
it0.44174757281553406
ca0.4209466263846928
yo0.3777056277056277
es0.36252771618625274
tl0.35247747747747743
ro0.3488108720271801
nl0.32669789227166274
no0.31952662721893493
de0.3021844660194175
da0.26937738246505716
sv0.2493472584856397
sl0.23128342245989306
hr0.2292225201072386
eu0.2144808743169399
pt0.2058011049723757
cs0.203601108033241
sk0.20138888888888887
sq0.19692737430167598
tr0.14561664190193166
hu0.14434523809523808
pl0.13663663663663664
vi0.1274658573596358
hi0.11809815950920245
az0.0987460815047022
ms0.0987460815047022
reliabletrue
passestrue
7
name"Hunter"
dialogue"I see. Well, if you do see anything out of the ordinary, please let me know. Here's my card."
detectedLang"en"
heavyLang"en"
scores
en0.8242015821857605
tl0.6445497630331753
cs0.5222929936305732
sq0.49022939677145283
no0.41463414634146345
sl0.3957703927492447
yo0.39086294416243655
sv0.3896236012207528
sk0.3839835728952772
da0.38080495356037153
nl0.38080495356037153
pl0.3756503642039542
it0.3723849372384937
ro0.3637327677624602
hr0.3610223642172524
et0.35344827586206895
fr0.28994082840236685
es0.2890995260663507
pt0.2890995260663507
ms0.2857142857142857
is0.2673992673992674
vi0.2248062015503876
ca0.18699186991869918
lt0.1780821917808219
de0.12152269399707175
eu0.11764705882352942
fi0.1111111111111111
be0.1044776119402985
tr0.1044776119402985
hu0.10044977511244377
az0.09502262443438914
lv0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
8
name"Marie"
dialogue"Merci, mais je ne comprends pas."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8149671052631579
it0.6729651162790697
ca0.6651785714285715
pt0.6280991735537189
sl0.6218487394957983
nl0.5778611632270169
cs0.576271186440678
es0.5664739884393063
lt0.5614035087719298
en0.560546875
hr0.5579567779960707
sq0.5140388768898488
tl0.512987012987013
de0.5011086474501109
ro0.4874715261958998
pl0.44168734491315137
tr0.4201030927835051
yo0.4201030927835051
ms0.40476190476190477
sk0.39189189189189183
lv0.31402439024390244
fi0.281150159744409
hu0.267100977198697
reliabletrue
passestrue
9
name"Hunter"
dialogue"I'm sorry, I have to go. If you remember anything, please call me."
detectedLang"en"
heavyLang"en"
scores
en0.8167438271604938
tl0.612876935615322
da0.5365853658536586
no0.5211693548387096
yo0.5077720207253886
sv0.44959443800695253
sq0.4457409568261376
pl0.43720379146919436
sl0.41502463054187194
ms0.4135802469135802
sk0.4114002478314746
cs0.39797211660329534
it0.38311688311688313
nl0.36241610738255037
hr0.3493150684931507
hu0.33936022253129344
et0.3319268635724332
is0.31358381502890176
fr0.28678678678678676
ro0.2857142857142857
pt0.2835595776772248
lv0.2803030303030303
lt0.2601246105919003
de0.24722662440570525
ca0.22512234910277326
es0.17677642980935876
fi0.13636363636363635
be0.12844036697247707
tr0.12844036697247707
az0.1171003717472119
uk0.1171003717472119
vi0.1171003717472119
reliabletrue
passestrue
10
name"Marie"
dialogue"Au revoir."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8166259168704157
ro0.7699386503067485
ca0.46428571428571425
cs0.46428571428571425
da0.46428571428571425
en0.46428571428571425
es0.46428571428571425
hr0.46428571428571425
nl0.46428571428571425
no0.46428571428571425
pt0.46428571428571425
sk0.46428571428571425
sl0.46428571428571425
sq0.46428571428571425
reliabletrue
passestrue