NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-08-01KGYXESP0AXPN3BF11TF3V0ER
Run Details
Model:
Writer: Palmyra X5
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
12.4s
Cost:
$0.005251
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet – Café Encounter in Alborn, MN** *(The scene opens at a quiet corner of a rustic café in Alborn, MN. Maria sits near the window, reviewing photos on her camera. She looks pale, her fingers trembling slightly. Hunter enters, badge subtly visible, eyes scanning before landing on her. He approaches with measured steps.)* **Hunter:** Ma’am? Excuse me. You were at the old Miller place last night, weren’t you? Near the woods? **Maria:** *(Looking up, startled. She shakes her head slightly, then speaks quickly, voice strained.)* No sé qué pasó... Había una luz... una sombra entre los árboles. No era persona. No era nada que haya visto antes. Mi cámara... las fotos están borrosas, pero en una... en una hay algo. Algo que no debería estar ahí. **Hunter:** *(Frowning, tilting his head slightly. He doesn’t understand.)* I’m sorry—can you repeat that in English? I didn’t catch any of that. **Maria:** *(Frantically, switching to gestures, pointing at her camera, then toward the woods.)* ¡No hablo inglés! ¡Español! ¿Comprende? ¡Ví algo! Anoche, en el bosque... algo malo. La luz roja... y silencio. Mucho silencio. **Hunter:** *(Eyes narrowing, trying to read her tone and gestures. He pulls out a small notebook.)* You saw something? Last night? In the woods? **Maria:** *(Nodding rapidly, tapping her temple, then her heart.)* Sí, sí... en la cabeza... en el pecho. Miedo. Miedo grande. Y la cámara... *(She opens the gallery, shows him a blurred image of a red glow between trees.)* Esto. No estaba allí cuando miré. Apareció después. **Hunter:** *(Leans in, studying the photo. His jaw tightens.)* That’s the third time someone’s reported red lights near the forest. You didn’t go inside the old house, did you? **Maria:** *(Shakes her head violently.)* ¡No! Solo tomé fotos. Del cielo. Del bosque. Todo normal... hasta que el reloj marcó las 2:13. Entonces... silencio. Como si el mundo se detuviera. **Hunter:** 2:13? That’s... *(pauses, scribbles in notepad)* That’s exact. You remember the time? *(Before Maria can respond, Hunter’s phone rings—sharp, urgent. He pulls it out, checks the ID. His expression turns hard.)* **Hunter:** I’ve got to take this. Stay here for a second. Or— *(he hesitates, realizing she won’t understand)* —just... don’t leave yet. I may need to talk to you again. *(He turns away, answers the phone, voice low but tense.)* **Hunter (on phone):** Hunter here... What? Another one gone? Where? ...The orchard? Dammit. On my way. *(He hangs up, stuffs the phone in his pocket, and turns back to Maria with regret in his eyes.)* **Hunter:** I’ve got to go. Stay safe. And if you remember anything else... *(he points to his badge, then taps it twice)* Hunter. Detective. If you see me—tell me. *(Maria watches him leave, clutching her camera. She whispers softly to herself, shivering.)* **Maria:** Ojalá no esté sola esta noche... Porque *eso* sabe que estuve allí. *(The café door closes behind Hunter. The wind outside rustles autumn leaves, and in the reflection of the window, Maria’s camera screen flickers—briefly showing a new photo that wasn’t there before: a pair of glowing red eyes in the dark.)*
created_at
"2026-02-08T15:21:05.544427+00:00"
2/8/2026, 3:21:05 PM
model
"writer/palmyra-x5-20250428"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1930
moderation_latency
155
generation_time
12082
tokens_prompt
257
tokens_completion
804
native_tokens_prompt
271
native_tokens_completion
848
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0052506
router
(null)
provider_responses
0
status
200
is_byok
false
latency
1930
endpoint_id
"c684c4e7-1b77-4ca5-9516-7ecc66e2c455"
provider_name
"Amazon Bedrock"
model_permaslug
"writer/palmyra-x5-20250428"
api_type
"completions"
id
"gen-1770564052-Enrgrkod6yIV276Ajbzx"
upstream_id
(null)
total_cost
0.0052506
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Ma’am? Excuse me. You were at the old Miller place last night, weren’t you? Near the woods?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7867210682492581
tl
0.6928418803418803
no
0.5196324143692566
fr
0.5192307692307693
da
0.5164003364171572
nl
0.4492337164750958
sv
0.32273262661955243
et
0.31952662721893493
de
0.3097238895558223
es
0.3088942307692307
ca
0.30133657351154314
sq
0.28214731585518105
cs
0.27944862155388467
yo
0.23941798941798942
tr
0.22611036339165547
ms
0.21981004070556312
pt
0.2144808743169399
fi
0.20689655172413793
ro
0.20138888888888887
it
0.19692737430167598
az
0.13403614457831325
hu
0.13403614457831325
is
0.13273001508295626
sl
0.13273001508295626
pl
0.11809815950920245
reliable
true
passes
true
1
name
"Hunter"
dialogue
"2:13? That’s... That’s exact. You remember the time?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8140635564570656
tl
0.6536523929471032
nl
0.5729813664596274
no
0.5542949756888168
da
0.532312925170068
yo
0.5183887915936953
ms
0.47718631178707227
sv
0.4532803180914513
ro
0.39956331877729256
fr
0.39293598233995586
sq
0.39293598233995586
hu
0.39159292035398224
de
0.36194895591647336
is
0.358974358974359
sk
0.3176178660049628
sl
0.3176178660049628
it
0.26666666666666666
hr
0.233983286908078
pt
0.233983286908078
cs
0.22096317280453256
es
0.22096317280453256
et
0.22096317280453256
reliable
true
passes
true
2
name
"Hunter"
dialogue
"I’ve got to take this. Stay here for a second. Or— —just... don’t leave yet. I may need to talk to you again."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8323013415892672
tl
0.6735308890005023
no
0.4257950530035336
da
0.4217081850533808
cs
0.40693430656934304
yo
0.4042163153070577
et
0.3608652900688299
hr
0.3608652900688299
pl
0.3602362204724409
fr
0.358974358974359
it
0.35323383084577115
ca
0.35064935064935066
nl
0.34673366834170855
sk
0.3394308943089431
sq
0.3200836820083682
ro
0.3186582809224318
sv
0.3179433368310598
sl
0.3077742279020234
lv
0.281767955801105
lt
0.27697441601779754
pt
0.25799086757990863
vi
0.25799086757990863
hu
0.2554410080183276
tr
0.18444165621079048
is
0.1751269035532995
az
0.1698595146871009
es
0.16879795396419436
be
0.09722222222222222
eu
0.09722222222222222
de
0.09344490934449094
fi
0.08835904628330996
ms
0.08835904628330996
uk
0.08835904628330996
reliable
true
passes
true
3
name
"Hunter"
dialogue
"I’ve got to go. Stay safe. And if you remember anything else... Hunter. Detective. If you see me—tell me."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8196248196248196
tl
0.6113184079601991
no
0.4588744588744588
yo
0.44543034605146403
sl
0.42555147058823534
fr
0.421831637372803
da
0.4075829383886255
nl
0.39903846153846156
sq
0.3902439024390244
ms
0.38665358194308147
sv
0.38241106719367585
et
0.3543388429752066
de
0.3441762854144806
pt
0.33932346723044393
it
0.33581296493092455
ro
0.33226495726495725
cs
0.31015452538631344
es
0.3093922651933701
sk
0.2937853107344633
pl
0.2799539170506913
ca
0.27662037037037035
hr
0.2264851485148515
hu
0.2206982543640898
is
0.19768934531450577
lv
0.16331994645247658
lt
0.14266117969821673
fi
0.10714285714285714
tr
0.08625730994152046
reliable
true
passes
true