Run: 2026-02-17-01KHNFGSWRKXK99KZEC96D5X5C

Run Details

Model:
Arcee AI: Trinity Large (Preview)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
7.2s
Cost:
$0.000000
Provider:
Arcee AI

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."

Model response

AI
Melanie: (Looking at her camera, troubled) "Ich kann nicht glauben, was passiert ist. Es war so schrecklich." Hunter: (Approaching her) "Excuse me, ma'am. I'm Detective Hunter. I'm investigating the recent disappearances in town. Can you tell me what happened?" Melanie: (Shaken) "Ich... ich habe es nicht gesehen. Aber ich habe gehört, dass es schrecklich war. Ich weiß nicht, was ich tun soll." Hunter: (Confused) "I'm sorry, I don't understand. Do you speak English?" Melanie: (Nervously) "Nein, ich spreche kein Englisch. Ich bin Austauschstudentin aus Deutschland." Hunter: (Trying to communicate) "Okay, okay. Can you tell me what you saw in German?" Melanie: (Reluctantly) "Ich habe nichts gesehen. Aber ich habe gehört, dass jemand verschwunden ist. Es war so plötzlich." Hunter: (Nodding) "Okay, thank you for your help. I have to go now. If you remember anything else, please let me know." Melanie: (Nodding) "Ja, natürlich. Ich werde es tun." Hunter: (Leaving) "Thank you, ma'am. Have a good day." Melanie: (Watching him leave, still troubled) "Ich hoffe, er findet die Wahrheit."
created_at"2026-02-17T09:39:58.528407+00:00" 2/17/2026, 9:39:58 AM
model"arcee-ai/trinity-large-preview:free"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency401
moderation_latency(null)
generation_time7160
tokens_prompt319
tokens_completion294
native_tokens_prompt268
native_tokens_completion290
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0
router(null)
provider_responses
0
id"9cf451df966ad6af-IAD"
status200
is_byokfalse
latency293
endpoint_id"239c00d5-c404-4d17-b243-6a645212dc95"
provider_name"Arcee AI"
model_permaslug"arcee-ai/trinity-large-preview"
api_type"completions"
id"gen-1771321190-785ZS8XFv8ZXBBkBsgfX"
upstream_id"9cf451df966ad6af-IAD"
total_cost0
cache_discount(null)
upstream_inference_cost0
provider_name"Arcee AI"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Melanie"
dialogue"Ich kann nicht glauben, was passiert ist. Es war so schrecklich."
detectedLang"de"
heavyLang"de"
scores
de0.8452012383900929
nl0.5197438633938101
en0.5081967213114754
no0.43324937027707805
ca0.3644067796610169
sk0.3382352941176471
yo0.3212669683257918
it0.3066255778120185
sl0.25124792013311154
es0.24623115577889448
is0.24114671163575044
lv0.21052631578947367
pl0.20353982300884957
hi0.1906474820143885
pt0.18772563176895307
hu0.1847826086956522
cs0.1818181818181818
vi0.18032786885245902
fr0.17883211678832117
tr0.17279411764705882
lt0.16820702402957485
tl0.16356877323420074
da0.15413533834586465
sv0.14772727272727273
et0.1262135922330097
ms0.1262135922330097
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, ma'am. I'm Detective Hunter. I'm investigating the recent disappearances in town. Can you tell me what happened?"
detectedLang"en"
heavyLang"en"
scores
en0.7858672376873662
tl0.5897435897435898
fr0.581151832460733
nl0.5485327313769752
ro0.5296884185773074
pt0.522673031026253
it0.5113011606597434
ca0.48486799742434
sv0.46380697050938335
es0.4207096307023896
sl0.41046425939572584
ms0.4065281899109792
no0.40564635958395245
de0.39622641509433965
sq0.38271604938271603
da0.3635640413683373
cs0.3469387755102041
hr0.2945326278659612
sk0.2647058823529412
az0.25857275254865614
et0.21875
yo0.19597989949748743
lt0.1911021233569262
pl0.16054564533053514
lv0.15254237288135594
is0.14712153518123666
tr0.1452991452991453
fi0.14346895074946467
reliabletrue
passestrue
2
name"Melanie"
dialogue"Ich... ich habe es nicht gesehen. Aber ich habe gehört, dass es schrecklich war. Ich weiß nicht, was ich tun soll."
detectedLang"de"
heavyLang"de"
scores
de0.8469387755102041
nl0.4414893617021277
en0.33962264150943394
yo0.27586206896551724
ca0.21875
es0.21875
sk0.19106317411402157
lv0.18604651162790697
eu0.1796875
pl0.1796875
sv0.1640127388535032
hu0.16267942583732056
cs0.16
lt0.14772727272727273
fi0.1435562805872757
ms0.1435562805872757
tr0.1435562805872757
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't understand. Do you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7994652406417112
no0.5828698553948832
da0.5772266065388951
tl0.5300751879699248
sv0.5288944723618091
cs0.5161290322580645
pl0.4806094182825485
hr0.4688385269121813
sk0.438622754491018
de0.4140625
pt0.40570522979397783
sq0.4009584664536741
ro0.3862520458265139
it0.3644067796610169
nl0.3218806509945751
vi0.3169398907103825
yo0.3055555555555556
ca0.2690058479532163
is0.267578125
sl0.24242424242424243
ms0.1610738255033557
be0.15730337078651685
tr0.15730337078651685
hu0.1515837104072398
az0.14383561643835618
et0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
4
name"Melanie"
dialogue"Nein, ich spreche kein Englisch. Ich bin Austauschstudentin aus Deutschland."
detectedLang"de"
heavyLang"de"
scores
de0.7938144329896907
nl0.5693367786391041
no0.43883277216610556
ro0.4350282485875706
en0.4318181818181818
sk0.4292237442922375
da0.4152046783625731
is0.39759036144578314
ms0.37888198757763975
sv0.3734335839598998
sq0.3581514762516046
hr0.3548387096774194
ca0.34469200524246396
it0.34469200524246396
lt0.30167597765363136
fi0.2774566473988439
pl0.258160237388724
yo0.24471299093655588
tl0.21507064364207218
cs0.20127795527156547
lv0.20127795527156547
es0.19614147909967844
sl0.18032786885245902
tr0.14965986394557826
az0.14675767918088736
pt0.11816578483245149
fr0.11190053285968028
et0.10554561717352416
reliabletrue
passestrue
5
name"Hunter"
dialogue"Okay, okay. Can you tell me what you saw in German?"
detectedLang"en"
heavyLang"en"
scores
en0.8062015503875969
tl0.6318114874815906
ms0.5682210708117443
nl0.5598591549295775
it0.5543672014260249
ro0.5479204339963833
sl0.49186991869918695
az0.4802494802494803
de0.4703389830508474
sq0.4658119658119659
sv0.414519906323185
es0.4075829383886255
ca0.39172749391727496
tr0.37027707808564225
et0.2753623188405797
fr0.2668621700879765
no0.2668621700879765
pt0.26035502958579887
yo0.26035502958579887
pl0.251497005988024
cs0.2378048780487805
fi0.23076923076923078
reliabletrue
passestrue
6
name"Melanie"
dialogue"Ich habe nichts gesehen. Aber ich habe gehört, dass jemand verschwunden ist. Es war so plötzlich."
detectedLang"de"
heavyLang"de"
scores
de0.8322637106184364
nl0.4272908366533864
en0.39790575916230364
sv0.37295528898582336
tr0.3451025056947608
es0.33526011560693636
hu0.32590855803048063
no0.2962056303549572
sk0.2857142857142857
da0.27854454203262236
yo0.27122940430925224
ca0.26376440460947503
lt0.22611036339165547
sl0.20798898071625344
is0.20138888888888887
sq0.19467787114845939
fr0.1935483870967742
ro0.18899858956276447
lv0.1726618705035971
eu0.16666666666666666
pl0.16666666666666666
hi0.15565345080763582
cs0.14814814814814814
vi0.14688427299703263
fi0.13273001508295626
ms0.13273001508295626
tl0.13273001508295626
it0.11128284389489954
pt0.0987460815047022
az0.09305993690851734
reliabletrue
passestrue
7
name"Hunter"
dialogue"Okay, thank you for your help. I have to go now. If you remember anything else, please let me know."
detectedLang"en"
heavyLang"en"
scores
en0.8213264722698684
tl0.5985870263326911
da0.5570517363571935
no0.5192307692307693
yo0.43946188340807174
sl0.41424554826616683
cs0.40532825880114176
ms0.3978805394990366
sv0.3830207305034551
sq0.37934458788480635
pl0.37122736418511065
sk0.3469174503657262
nl0.30167597765363136
hr0.28977272727272724
hu0.2807825086306099
et0.27409988385598144
is0.2577197149643705
vi0.24969987995198079
it0.2378048780487805
fr0.23406862745098037
ro0.2331288343558282
lv0.22839506172839508
pt0.21777221526908636
lt0.21085858585858586
de0.1997439180537772
ca0.18086500655307994
es0.14030261348005504
fi0.10714285714285714
be0.10071942446043164
tr0.10071942446043164
az0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
8
name"Melanie"
dialogue"Ja, natürlich. Ich werde es tun."
detectedLang"de"
heavyLang"de"
scores
de0.830954169797145
ca0.5322245322245323
nl0.5212765957446809
lv0.5108695652173912
es0.49209932279909707
tr0.4863013698630137
sk0.4803695150115473
pl0.46428571428571425
yo0.45520581113801456
et0.4063324538258575
fi0.40476190476190477
sq0.40476190476190477
da0.4015957446808511
hu0.3119266055045872
lt0.2879746835443038
ms0.281150159744409
pt0.26229508196721313
sl0.26229508196721313
cs0.25742574257425743
sv0.25
it0.2398648648648649
no0.2398648648648649
ro0.2398648648648649
reliabletrue
passestrue
9
name"Hunter"
dialogue"Thank you, ma'am. Have a good day."
detectedLang"en"
heavyLang"en"
scores
en0.8036649214659686
tl0.6166950596252129
da0.49324324324324326
vi0.4886363636363637
cs0.4827586206896552
hu0.4094488188976378
pt0.3835616438356164
ro0.3818681318681319
ca0.3767313019390581
es0.3697478991596639
sk0.36619718309859156
it0.3571428571428572
yo0.34593023255813954
fr0.34210526315789475
hr0.33234421364985167
pl0.3181818181818182
sl0.2857142857142857
lt0.267100977198697
tr0.2549668874172185
is0.25
sq0.24242424242424243
az0.23728813559322032
eu0.23728813559322032
lv0.23728813559322032
nl0.23728813559322032
no0.23728813559322032
de0.22945205479452058
et0.21875
fi0.21875
ms0.21875
sv0.21875
reliabletrue
passestrue
10
name"Melanie"
dialogue"Ich hoffe, er findet die Wahrheit."
detectedLang"de"
heavyLang"de"
scores
de0.830163043478261
no0.6463932107496464
da0.6234939759036143
nl0.6111975116640747
is0.4004796163069544
sk0.3315508021390375
pl0.3150684931506849
sv0.3131868131868132
sq0.2937853107344633
yo0.26035502958579887
en0.2378048780487805
reliabletrue
passestrue