Run: 2026-02-17-01KHNEVSZ16H4S9C6T9K3VSV5A

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
3.6s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."

Model response

AI
Marie: (looking troubled and shaken) "Je ne comprends pas ce qui se passe. Je n'ai jamais rien vu de tel auparavant." Hunter: (confused) "I'm sorry, I don't understand. Can you speak English?" Marie: (nervously) "Je suis désolée, je ne parle pas anglais. Je viens de France et je ne connais pas encore la langue." Hunter: (frustrated) "Okay, let me try to find someone who can translate for us." (They continue to try to communicate, with Hunter using hand gestures and Marie responding in French. Eventually, Hunter's phone rings and he has to leave.) Hunter: "I'm sorry, I have to go. But I'll be back later to talk more. Can we meet here again tomorrow?" Marie: (nodding) "Oui, je serai ici demain." Hunter: (smiling) "Great. See you then."
created_at"2026-02-17T09:28:26.13318+00:00" 2/17/2026, 9:28:26 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency383
moderation_latency(null)
generation_time3555
tokens_prompt316
tokens_completion200
native_tokens_prompt268
native_tokens_completion191
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf4411351b62265-IAD"
status200
is_byokfalse
latency278
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771320502-oSslR9GZmlYahqx3PXmV"
upstream_id"9cf4411351b62265-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Marie"
dialogue"Je ne comprends pas ce qui se passe. Je n'ai jamais rien vu de tel auparavant."
detectedLang"fr"
heavyLang"fr"
scores
fr0.7978436657681941
ca0.6577574967405476
it0.6102449888641426
ro0.5714285714285714
pt0.5610367892976589
nl0.5345744680851064
es0.48326771653543305
en0.4553941908713693
sl0.4519832985386221
hr0.44267515923566875
no0.44208289054197664
sq0.44029850746268656
de0.4281045751633987
lt0.42371020856201974
da0.4230769230769231
cs0.4101123595505618
yo0.4094488188976378
sv0.3986254295532647
ms0.37275985663082434
tr0.3566176470588235
tl0.31640625
lv0.27184466019417475
fi0.26573426573426573
hu0.25426136363636365
et0.2335766423357664
sk0.2164179104477612
is0.21407185628742514
pl0.14772727272727273
eu0.11764705882352942
az0.10714285714285714
reliabletrue
passestrue
1
name"Hunter"
dialogue"I'm sorry, I don't understand. Can you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.8019017432646592
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.41588785046728977
de0.4140625
ro0.3862520458265139
ca0.3644067796610169
it0.3644067796610169
hr0.36006825938566556
pl0.35233160621761656
nl0.3218806509945751
sk0.30037313432835816
tr0.2816091954022989
az0.27184466019417475
is0.267578125
sq0.2632612966601179
pt0.21052631578947367
yo0.1883116883116883
ms0.1610738255033557
be0.15730337078651685
hu0.1515837104072398
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
vi0.14383561643835618
reliabletrue
passestrue
2
name"Marie"
dialogue"Je suis désolée, je ne parle pas anglais. Je viens de France et je ne connais pas encore la langue."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8100664767331434
ca0.5932203389830508
it0.588477366255144
es0.5708154506437768
sq0.5542347696879644
nl0.5481927710843374
lt0.5405819295558958
ro0.5370370370370371
en0.5356037151702787
no0.5337995337995338
lv0.5249406175771971
sl0.5234312946783162
pt0.51651893634166
da0.506578947368421
yo0.4787141615986099
de0.460431654676259
cs0.45897204688908927
hr0.44598337950138506
sk0.41002949852507375
tl0.3743482794577685
ms0.3723849372384937
hu0.34497816593886466
sv0.3435448577680525
tr0.3435448577680525
et0.33184855233853006
eu0.2753623188405797
pl0.2753623188405797
az0.24623115577889448
is0.19246298788694483
fi0.12790697674418602
vi0.12280701754385964
zh0.11242603550295857
reliabletrue
passestrue
3
name"Hunter"
dialogue"Okay, let me try to find someone who can translate for us."
detectedLang"en"
heavyLang"en"
scores
en0.8072970195272353
tl0.5772266065388951
da0.5728929384965832
no0.5694603903559128
pt0.520460358056266
sl0.49866310160427807
es0.4695898161244696
cs0.4460856720827179
hr0.4038155802861685
nl0.39710610932475876
ca0.37707641196013286
sq0.3697478991596639
it0.3676222596964587
pl0.35344827586206895
sk0.34210526315789475
lv0.33510638297872336
fr0.3131868131868132
lt0.3131868131868132
ro0.3081180811808118
de0.2964352720450282
et0.29111531190926276
ms0.27606177606177607
tr0.27184466019417475
yo0.267578125
az0.2661448140900196
vi0.19006479481641467
fi0.16666666666666666
eu0.1515837104072398
sv0.1359447004608295
reliabletrue
passestrue
4
name"Hunter"
dialogue"I'm sorry, I have to go. But I'll be back later to talk more. Can we meet here again tomorrow?"
detectedLang"en"
heavyLang"en"
scores
en0.8021760633036598
tl0.534522885958107
pl0.47735191637630664
nl0.47322212467076386
da0.44649446494464945
yo0.4065281899109792
no0.36507936507936506
hr0.35691318327974275
lt0.3174061433447099
cs0.2822966507177033
sq0.2805755395683453
sv0.27184466019417475
ca0.26380368098159507
it0.26380368098159507
sl0.2583436341161928
sk0.2537313432835821
lv0.23566878980891717
hu0.23469387755102045
pt0.22178988326848248
fr0.20948616600790515
de0.20634920634920634
tr0.19678714859437751
az0.1891891891891892
ro0.13043478260869565
hi0.11242603550295857
be0.1044776119402985
et0.09502262443438914
is0.09502262443438914
uk0.09502262443438914
vi0.09502262443438914
reliabletrue
passestrue
5
name"Marie"
dialogue"Oui, je serai ici demain."
detectedLang"fr"
heavyLang"fr"
scores
fr0.8024830699774267
ms0.626068376068376
ca0.5098039215686274
sl0.4971264367816092
hr0.4942196531791907
en0.49275362318840576
it0.48224852071005914
yo0.48224852071005914
cs0.45652173913043476
sk0.453125
nl0.4186046511627907
lt0.34701492537313433
pl0.34210526315789475
es0.3371212121212121
pt0.3371212121212121
de0.3137254901960784
tl0.3055555555555556
tr0.3027888446215139
fi0.29718875502008035
ro0.29718875502008035
reliabletrue
passestrue
6
name"Hunter"
dialogue"Great. See you then."
detectedLang"en"
heavyLang"en"
scores
en0.8454882571075402
et0.576271186440678
ro0.4444444444444444
cs0.3842364532019704
tl0.3842364532019704
reliabletrue
passestrue