NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9ACGMR4N8JVB8T4JAH5JP
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
17.2s
Cost:
$0.013300
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: The Alborn Café, mid-afternoon. Maria sits at a small table near the window, scrolling through photos on her camera. The bell above the door jingles as Hunter walks in, scanning the room before making his way toward her.** Hunter: "Excuse me, miss. Detective Hunter, Alborn PD. Mind if I ask you a few questions about yesterday evening?" **Maria looks up, her eyes wide. Her hands tighten around the camera strap.** Maria: "¿Ayer? Sí... sí, estaba allí. Fue horrible. No podía dejar de temblar cuando volví a casa." **Hunter's brow furrows. He glances around, half-expecting someone to translate.** Hunter: "Uh... I'm sorry, I don't— do you speak English?" Maria: "No, lo siento, no hablo inglés. Solo español." **Hunter exhales slowly, rubbing the back of his neck.** Hunter: "Okay. Okay, that's fine. Let's try this slow." *(He points to his own eyes, then toward the street.)* "Did you... see anything? Last night?" **Maria nods vigorously, her expression darkening. She lifts her camera, flipping through the screen with shaking fingers.** Maria: "Tomé fotos. Muchas fotos. Había una luz extraña cerca del bosque, y luego... escuché un grito. No vi a nadie, pero el sonido... todavía lo escucho." **Hunter leans in, trying to catch any recognizable words. He points at the camera.** Hunter: "Photos? You have photos?" **Maria pauses, then seems to understand the word "photos." She nods and turns the camera toward him, showing a blurry image of trees and a strange glow in the distance.** Maria: "Sí. Fotos. Esto es lo que vi. No sé qué es, pero me dio miedo." **Hunter studies the image, his jaw tightening.** Hunter: "That's... huh. That's near the old orchard road." *(He looks back at her, frustrated at the language gap.)* "I need someone who can translate this. Can you stay here? Don't go anywhere, alright?" **Maria tilts her head, clearly not understanding but sensing the urgency in his tone.** Maria: "No entiendo, pero... está bien. Me quedo aquí." **Hunter's phone buzzes sharply in his pocket. He pulls it out, glances at the screen, and his expression shifts to alarm.** Hunter: "Damn it— I have to take this." *(He looks at Maria, holding up a finger.)* "Stay. Right here. I'll send someone who speaks Spanish, okay?" **Maria watches him, confused but nodding slowly as he backs away, already lifting the phone to his ear.** Hunter: "Hunter. Yeah, go ahead—" *(His face pales as he listens.)* "Another one? When?" **He turns and hurries out the door, the bell jingling wildly behind him. Maria sits alone again, staring down at the strange, glowing photo on her camera screen, her hands still trembling.**
created_at
"2026-07-01T07:29:27.583Z"
7/1/2026, 7:29:27 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3771
moderation_latency
(null)
generation_time
17175
tokens_prompt
317
tokens_completion
790
native_tokens_prompt
420
native_tokens_completion
1246
native_tokens_completion_images
(null)
native_tokens_reasoning
74
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0133
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_0172efW2254aphDAy2zvKFbm"
is_byok
false
latency
1796
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890967-JwNnBpXDXJtkYyDwDBwE"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890967-i7Wdf5VeLVcpKxMS7dh7"
upstream_id
"msg_0172efW2254aphDAy2zvKFbm"
total_cost
0.0133
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, miss. Detective Hunter, Alborn PD. Mind if I ask you a few questions about yesterday evening?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7809667673716012
it
0.5745305164319249
tl
0.5538461538461539
fr
0.5310478654592496
nl
0.5037645448323067
ro
0.5006887052341598
pt
0.5
ca
0.4746376811594203
no
0.4746376811594203
sv
0.4700292397660819
da
0.44359171143514964
es
0.43798449612403106
sq
0.41104792851340366
cs
0.34802158273381295
hr
0.30488974113135187
hu
0.30019305019305015
et
0.2988394584139265
de
0.29816069699903197
sl
0.29543245869776485
is
0.25488180883864336
pl
0.24163179916317992
ms
0.22126745435016112
tr
0.22126745435016112
yo
0.22126745435016112
sk
0.21790722761596548
lt
0.16666666666666666
fi
0.15990730011587484
az
0.15501165501165504
lv
0.15501165501165504
vi
0.15501165501165504
be
0.0880503144654088
eu
0.0880503144654088
uk
0.0799492385786802
reliable
true
passes
true
1
name
"Maria"
dialogue
"¿Ayer? Sí... sí, estaba allí. Fue horrible. No podía dejar de temblar cuando volví a casa."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8036006546644845
ca
0.6341463414634145
pt
0.5747696669029058
it
0.45799457994579945
en
0.455535390199637
fr
0.4291151284490961
eu
0.41972920696324956
tl
0.3939393939393939
ro
0.3839835728952772
yo
0.3756503642039542
ms
0.33993399339933994
sv
0.31584948688711517
no
0.3150684931506849
az
0.3071593533487298
tr
0.3047508690614137
cs
0.30394431554524365
hu
0.2966002344665885
sl
0.2831541218637993
nl
0.2709599027946537
sk
0.269183922046285
hr
0.26199261992619927
lv
0.250936329588015
da
0.24146649810366622
pl
0.23076923076923078
sq
0.1836734693877551
de
0.18256130790190736
lt
0.12023460410557184
is
0.1111111111111111
vi
0.1044776119402985
et
0.09502262443438914
fi
0.09502262443438914
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Uh... I'm sorry, I don't— do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7885491216655823
tl
0.5206489675516224
hr
0.5045731707317073
cs
0.49297971918876754
pl
0.45286195286195285
pt
0.4406196213425129
sq
0.4357638888888889
no
0.411231884057971
it
0.3981481481481482
da
0.39365671641791045
sv
0.3925233644859813
sk
0.385633270321361
vi
0.3486973947895792
yo
0.336734693877551
ro
0.33264887063655035
ca
0.29805615550755943
sl
0.2696629213483146
de
0.181360201511335
ms
0.181360201511335
be
0.17721518987341772
tr
0.17721518987341772
hu
0.1709183673469388
az
0.16237113402061853
et
0.16237113402061853
is
0.16237113402061853
lt
0.16237113402061853
lv
0.16237113402061853
uk
0.16237113402061853
reliable
true
passes
true
3
name
"Maria"
dialogue
"No, lo siento, no hablo inglés. Solo español."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8212157330154947
it
0.6543778801843317
pt
0.6453900709219859
ca
0.5844875346260388
lt
0.4117647058823529
sk
0.39271255060728744
tl
0.38271604938271603
fr
0.375
tr
0.3562231759656652
yo
0.3135011441647597
lv
0.30394431554524365
eu
0.2840095465393795
en
0.25742574257425743
hu
0.2555831265508685
hr
0.2518703241895262
no
0.24433249370277077
cs
0.23857868020304565
vi
0.23273657289002556
et
0.20424403183023873
pl
0.2
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Did you... see anything? Last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8290273556231003
tl
0.6715328467153285
et
0.5233050847457626
sq
0.30769230769230765
cs
0.25742574257425743
ms
0.25742574257425743
nl
0.2549668874172185
da
0.2474916387959866
de
0.2474916387959866
fr
0.2474916387959866
no
0.2474916387959866
yo
0.2474916387959866
reliable
true
passes
true
5
name
"Maria"
dialogue
"Tomé fotos. Muchas fotos. Había una luz extraña cerca del bosque, y luego... escuché un grito. No vi a nadie, pero el sonido... todavía lo escucho."
detectedLang
"es"
heavyLang
"es"
scores
es
0.802960399846213
ca
0.5845156059991893
it
0.5676929565584141
pt
0.5498462889767238
fr
0.4602422327540811
ro
0.4405021834061135
tl
0.3887895050685748
sk
0.3854916067146283
cs
0.3425272610647851
lv
0.32874918140144077
en
0.32074221338634856
no
0.30649526387009474
yo
0.3046132971506106
sv
0.3022464261402315
da
0.26733380986418864
vi
0.25939306358381503
pl
0.2512783053323594
lt
0.22699849170437406
nl
0.21815408085430968
hu
0.21516079632465546
hr
0.21455938697318008
de
0.2133537989255564
sl
0.19921875
tr
0.1865079365079365
az
0.16801948051948054
sq
0.11637931034482758
et
0.10947002606429192
is
0.06818181818181819
eu
0.0639269406392694
fi
0.057904411764705885
ms
0.057904411764705885
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Photos? You have photos?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.823943661971831
fr
0.6453900709219859
tl
0.6078431372549019
da
0.5951417004048583
es
0.4444444444444444
lt
0.4444444444444444
pt
0.4444444444444444
cs
0.43820224719101125
hi
0.4350282485875706
ca
0.4152046783625731
de
0.4152046783625731
lv
0.4152046783625731
nl
0.4152046783625731
reliable
true
passes
true
7
name
"Maria"
dialogue
"photos."
detectedLang
"fr"
heavyLang
"ga"
scores
fr
0.7844827586206896
en
0.7663551401869159
es
0.6153846153846154
lt
0.6153846153846154
pt
0.6153846153846154
hi
0.6062992125984252
tl
0.6062992125984252
ca
0.5867768595041323
de
0.5867768595041323
lv
0.5867768595041323
nl
0.5867768595041323
reliable
false
passes
true
8
name
"Maria"
dialogue
"Sí. Fotos. Esto es lo que vi. No sé qué es, pero me dio miedo."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8147290412227883
ca
0.6825396825396826
pt
0.6097560975609756
it
0.5971802618328298
lv
0.49044585987261147
no
0.48253557567917205
yo
0.48119325551232167
fr
0.4444444444444444
de
0.4091580502215657
hr
0.40298507462686567
en
0.39668174962292607
tl
0.37694704049844235
lt
0.36908517350157727
nl
0.35275080906148865
sq
0.3453355155482815
da
0.33444259567387685
sv
0.3311036789297659
vi
0.32318104906937395
et
0.2831541218637993
sk
0.2831541218637993
tr
0.2831541218637993
sl
0.27927927927927926
pl
0.250936329588015
is
0.23518164435946462
eu
0.21875
hu
0.20318725099601595
ms
0.17355371900826447
fi
0.15789473684210525
cs
0.14346895074946467
az
0.12854030501089325
ro
0.12854030501089325
reliable
true
passes
true
9
name
"Hunter"
dialogue
"I need someone who can translate this. Can you stay here? Don't go anywhere, alright?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.809713664371149
tl
0.5603015075376884
sq
0.42244224422442245
no
0.40476190476190477
pl
0.3667068757539204
ca
0.3558282208588957
hr
0.3453865336658354
da
0.3445692883895131
et
0.3320610687022901
ro
0.3286445012787723
it
0.3251928020565552
cs
0.3155149934810952
yo
0.3119266055045872
de
0.29435483870967744
tr
0.2857142857142857
az
0.27486187845303867
sv
0.27285318559556787
pt
0.23133235724743775
es
0.22794117647058826
fr
0.22680412371134018
vi
0.22337278106508876
sk
0.20454545454545453
lt
0.1984732824427481
lv
0.1984732824427481
be
0.11764705882352942
eu
0.11317567567567569
hu
0.11317567567567569
is
0.10714285714285714
nl
0.10714285714285714
uk
0.10714285714285714
ms
0.10102739726027396
sl
0.10102739726027396
reliable
true
passes
true
10
name
"Maria"
dialogue
"No entiendo, pero... está bien. Me quedo aquí."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8266666666666667
pt
0.7026532479414456
ca
0.6782178217821783
fr
0.5517241379310345
en
0.46546052631578944
it
0.46013289036544847
tl
0.4268077601410935
no
0.36647173489278756
et
0.3460764587525151
sk
0.34077079107505076
fi
0.3380855397148676
nl
0.33127572016460904
sq
0.3128964059196617
lv
0.2872807017543859
hr
0.23708920187793428
sl
0.21307506053268765
tr
0.21307506053268765
cs
0.2111650485436893
ms
0.20537897310513448
pl
0.1875
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Stay. Right here. I'll send someone who speaks Spanish, okay?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.796037296037296
tl
0.5370370370370371
sq
0.33962264150943394
de
0.3137254901960784
no
0.3055555555555556
da
0.29292929292929293
et
0.2842535787321063
nl
0.18604651162790697
ro
0.18604651162790697
sv
0.18604651162790697
es
0.1822429906542056
pt
0.1822429906542056
fr
0.17452830188679244
yo
0.17452830188679244
hu
0.16864608076009502
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Another one? When?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8466257668711656
tl
0.6503496503496503
es
0.5
hr
0.46524064171123
pl
0.46524064171123
da
0.43820224719101125
reliable
true
passes
true