NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE8RCQQWCN5FZZ608TP852S
Run Details
Model:
Claude Sonnet 5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
20.3s
Cost:
$0.016152
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: A Cafe in Alborn, MN** *Melanie sits at a small table outside the cafe, scrolling through photos on her camera. The autumn light catches the frost on her coffee cup. Hunter approaches, badge clipped to his belt, notepad in hand.* Hunter: "Afternoon. Detective Hunter, Alborn PD. Mind if I ask you a few questions?" Melanie: *(looking up, startled)* "Oh—entschuldigen Sie, ich—" *(She pauses, realizing he's speaking English)* "Es tut mir leid, ich verstehe nicht." Hunter: *(frowning slightly)* "Sorry, come again?" Melanie: *(flustered, gesturing toward her camera as if it might help)* "Ich spreche kein Englisch. Nur Deutsch." Hunter: *(sighing, rubbing his temple)* "Great. Okay—German. Got it." *(He pulls out his notepad anyway, more out of habit than hope.)* "Were you here last night? Down by the orchard?" Melanie: *(shaking her head, clearly not understanding the words but sensing the seriousness)* "Was ist passiert? Ich habe gestern Abend Schreie gehört—in der Nähe des Obstgartens. Es war fürchterlich." Hunter: *(leaning in, catching the tone if not the words)* "Screams? Did you say something about screaming?" Melanie: *(nodding vigorously, her hands trembling slightly as she mimics covering her ears)* "Ja, ja—Schreie! Ich hatte solche Angst. Ich bin sofort zurück ins Hotel gerannt." Hunter: *(exhaling, frustrated but patient)* "Okay. Okay, screaming, orchard, scared—I'm getting pieces here." *(He gestures for her to wait, pulling out his phone to search for a translation app.)* "Hang on a second." Melanie: *(watching him fumble with his phone, she lifts her camera)* "Ich habe Fotos gemacht. Vielleicht helfen sie?" *(She turns the camera toward him, flipping through images of the orchard at dusk.)* Hunter: *(squinting at the screen, unable to read the German captions but recognizing the location)* "That's the Hendersons' orchard. You were out there last night?" Melanie: *(pointing at the timestamp on one photo, insistent)* "Ja—hier, um acht Uhr. Aber danach war es... anders. Dunkel. Ich hörte etwas im Gebüsch." Hunter: *(nodding slowly, piecing together fragments)* "Eight o'clock. Something in the bushes. Alright, this might actually be useful—" *His phone buzzes sharply. He glances at the screen, jaw tightening.* Hunter: "Damn it—not now." *(He looks back at Melanie, torn.)* "Listen, I need you to stay right here. Don't go anywhere. I'll get someone who speaks German, alright?" Melanie: *(confused but nodding, sensing urgency)* "Ich... ich verstehe nicht, aber—okay?" Hunter: *(already standing, phone pressed to his ear)* "Hunter. Yeah. Where?" *(His expression darkens.)* "I'm on my way." *He gives Melanie one last glance—apologetic, hurried—before jogging toward his truck. Melanie watches him go, clutching her camera tighter, the photographs of the orchard glowing faintly on the screen in the fading light.*
created_at
"2026-07-01T07:19:37.986Z"
7/1/2026, 7:19:37 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4565
moderation_latency
(null)
generation_time
20280
tokens_prompt
319
tokens_completion
861
native_tokens_prompt
416
native_tokens_completion
1532
native_tokens_completion_images
(null)
native_tokens_reasoning
97
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.016152
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01PsSfTENsxNkQnjmBaiTopc"
is_byok
false
latency
2006
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890377-8SpHUwsEsgbuRI7smBN2"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890377-XyTvh7Y3tpX7OSFAq3Vn"
upstream_id
"msg_01PsSfTENsxNkQnjmBaiTopc"
total_cost
0.016152
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Afternoon. Detective Hunter, Alborn PD. Mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7774480712166172
tl
0.6302816901408451
it
0.6087928464977646
fr
0.5816733067729083
ca
0.5550847457627118
ro
0.5493562231759657
pt
0.5426829268292682
da
0.47500000000000003
es
0.46808510638297873
no
0.467005076142132
sv
0.45482866043613707
cs
0.42434210526315785
sq
0.40543601359003395
hr
0.37722419928825623
nl
0.375
hu
0.37200956937799046
sk
0.3462017434620174
de
0.31282722513089006
pl
0.3055555555555556
sl
0.29149797570850206
et
0.2895805142083897
tr
0.2818057455540356
yo
0.2818057455540356
lt
0.2164179104477612
is
0.2081447963800905
az
0.20212765957446807
lv
0.20212765957446807
vi
0.20212765957446807
ms
0.18856259659969088
be
0.11764705882352942
eu
0.11764705882352942
fi
0.10714285714285714
uk
0.10714285714285714
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Es tut mir leid, ich verstehe nicht."
detectedLang
"de"
heavyLang
"de"
scores
de
0.828060522696011
nl
0.4813278008298755
es
0.45652173913043476
ca
0.4517543859649123
hu
0.410377358490566
lt
0.40191387559808617
sk
0.3315508021390375
lv
0.32432432432432434
pl
0.3150684931506849
cs
0.2857142857142857
hr
0.2857142857142857
it
0.22360248447204967
is
0.21135646687697163
en
0.20127795527156547
fr
0.20127795527156547
no
0.20127795527156547
pt
0.20127795527156547
az
0.19093851132686085
ro
0.19093851132686085
sq
0.19093851132686085
sv
0.19093851132686085
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Sorry, come again?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7920133111480865
it
0.6770025839793281
nl
0.6153846153846154
pt
0.4444444444444444
tl
0.4444444444444444
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ich spreche kein Englisch. Nur Deutsch."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8165810711665443
nl
0.5598591549295775
sk
0.43566591422121903
ro
0.414519906323185
ms
0.4075829383886255
no
0.38875305623471884
en
0.3857493857493857
hr
0.3734335839598998
da
0.36061381074168797
pl
0.3150684931506849
sl
0.3055555555555556
ca
0.2857142857142857
lt
0.2647058823529412
sv
0.22360248447204967
is
0.2163009404388715
it
0.2163009404388715
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Were you here last night? Down by the orchard?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8267170762444865
tl
0.6726190476190476
no
0.4701348747591522
da
0.46393762183235865
nl
0.461839530332681
fr
0.45219123505976094
cs
0.4318181818181818
yo
0.39692982456140347
sq
0.39293598233995586
de
0.3514150943396226
sk
0.3309002433090025
pl
0.3002544529262086
ms
0.22096317280453256
sv
0.22096317280453256
et
0.21875
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Was ist passiert? Ich habe gestern Abend Schreie gehört—in der Nähe des Obstgartens. Es war fürchterlich."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8112732762959235
nl
0.5291902071563088
en
0.4444444444444444
no
0.42878903274942876
ca
0.4230769230769231
sv
0.39172749391727496
it
0.3654822335025381
fr
0.31444241316270566
da
0.3081180811808118
es
0.28842504743833014
et
0.2774566473988439
tr
0.2566897918731417
sl
0.24774322968906717
ro
0.22118380062305293
sk
0.21135646687697163
pl
0.20969441517386725
pt
0.20634920634920634
yo
0.1891891891891892
tl
0.1847826086956522
is
0.16201117318435754
ms
0.15730337078651685
lv
0.13793103448275862
hi
0.12383177570093458
fi
0.12075029308323564
hu
0.11971830985915494
lt
0.10820451843043996
az
0.10071942446043164
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Screams? Did you say something about screaming?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8177399756986633
tl
0.6539792387543253
fr
0.39999999999999997
de
0.336283185840708
nl
0.23857868020304565
da
0.21671018276762402
cs
0.20634920634920634
es
0.20634920634920634
ms
0.20634920634920634
pt
0.20634920634920634
no
0.19786096256684493
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Ja, ja—Schreie! Ich hatte solche Angst. Ich bin sofort zurück ins Hotel gerannt."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8155662117299889
nl
0.51171875
da
0.4324631101021567
no
0.40119760479041916
ms
0.37421777221526903
tl
0.3581514762516046
sk
0.3514915693904021
it
0.35064935064935066
pt
0.3160054719562244
sv
0.30747922437673125
sl
0.302649930264993
et
0.29873772791023845
fi
0.29775280898876405
en
0.29278642149929274
pl
0.2805755395683453
tr
0.26035502958579887
ca
0.251497005988024
fr
0.24471299093655588
es
0.20508744038155804
lv
0.18699186991869918
eu
0.1610738255033557
lt
0.15540540540540537
sq
0.13043478260869565
yo
0.13043478260869565
is
0.12587412587412586
hr
0.11190053285968028
cs
0.10554561717352416
ro
0.10554561717352416
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Hang on a second."
detectedLang
"en"
heavyLang
"nl"
scores
en
0.7913188647746243
fr
0.7596153846153846
tl
0.7240618101545254
it
0.6575342465753424
ca
0.6527777777777778
et
0.6345029239766081
ro
0.6312684365781711
fi
0.6301775147928995
cs
0.6234939759036143
sk
0.6212121212121212
hr
0.6153846153846154
yo
0.6081504702194357
pl
0.6019108280254777
hu
0.5551601423487544
nl
0.5370370370370371
pt
0.5283018867924528
es
0.5136186770428015
sl
0.4186046511627907
hi
0.40191387559808617
lt
0.3961352657004831
tr
0.3811881188118812
is
0.375
da
0.3654822335025381
sq
0.3654822335025381
az
0.358974358974359
eu
0.358974358974359
lv
0.358974358974359
no
0.358974358974359
vi
0.358974358974359
de
0.34895833333333337
ms
0.33510638297872336
sv
0.33510638297872336
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Ich habe Fotos gemacht. Vielleicht helfen sie?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8329621380846325
nl
0.6838777660695469
pl
0.48805460750853247
fi
0.44751381215469616
sk
0.3890020366598778
es
0.3227990970654628
lt
0.3227990970654628
pt
0.3227990970654628
ca
0.3087557603686636
lv
0.3087557603686636
fr
0.21052631578947367
ms
0.20634920634920634
en
0.19137466307277629
tr
0.1891891891891892
cs
0.18256130790190736
hr
0.18256130790190736
sl
0.18256130790190736
et
0.17355371900826447
it
0.17355371900826447
sq
0.17355371900826447
az
0.16434540389972147
da
0.16434540389972147
no
0.16434540389972147
ro
0.16434540389972147
sv
0.16434540389972147
reliable
true
passes
true
10
name
"Hunter"
dialogue
"That's the Hendersons' orchard. You were out there last night?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.815242494226328
tl
0.6244131455399061
de
0.5079950799507995
nl
0.49238578680203043
no
0.45652173913043476
fr
0.4482758620689655
da
0.394856278366112
sq
0.3902439024390244
sv
0.38556067588325654
yo
0.31153184165232356
ms
0.30434782608695654
is
0.17695473251028807
cs
0.16317991631799164
et
0.16142557651991615
lv
0.16142557651991615
it
0.15966386554621848
reliable
true
passes
true
11
name
"Melanie"
dialogue
"Ja—hier, um acht Uhr. Aber danach war es... anders. Dunkel. Ich hörte etwas im Gebüsch."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8054803788903924
nl
0.4838420107719928
pl
0.4209466263846928
da
0.39153439153439157
sv
0.3837084673097535
ca
0.36252771618625274
sk
0.3502824858757062
no
0.3021844660194175
lv
0.29012345679012347
is
0.28836633663366334
en
0.27398989898989895
hr
0.27398989898989895
sl
0.22611036339165547
fr
0.21662125340599456
et
0.21124828532235942
pt
0.21124828532235942
fi
0.2101648351648352
es
0.203601108033241
hu
0.15066469719350073
lt
0.13663663663663664
az
0.1314199395770393
sq
0.11538461538461538
yo
0.11538461538461538
tl
0.10990712074303406
reliable
true
passes
true
12
name
"Hunter"
dialogue
"Eight o'clock. Something in the bushes. Alright, this might actually be useful—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8118178396687994
tl
0.584717607973422
yo
0.43117178612059154
ro
0.410377358490566
nl
0.3857493857493857
fr
0.32523616734143057
ms
0.3160054719562244
de
0.3065187239944522
sv
0.27007299270072993
es
0.2636229749631811
no
0.25261584454409564
pt
0.24357034795764
sl
0.23547400611620795
da
0.2331288343558282
it
0.22720247295208654
hu
0.18962722852512154
lt
0.1830065359477124
ca
0.18166939443535188
az
0.14383561643835618
pl
0.14383561643835618
sq
0.13494809688581316
reliable
true
passes
true
13
name
"Hunter"
dialogue
"Listen, I need you to stay right here. Don't go anywhere. I'll get someone who speaks German, alright?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7963020996552804
tl
0.5888678051865908
no
0.43771626297577854
da
0.4293239683933275
sq
0.406392694063927
pl
0.4014732965009208
de
0.3885230479774224
cs
0.3670886075949367
yo
0.3658536585365854
sv
0.364613880742913
et
0.3440968718466196
hr
0.336734693877551
ro
0.3257261410788381
lv
0.2942453854505972
sk
0.28806133625410735
it
0.28414096916299564
is
0.2638731596828992
ca
0.2545871559633027
es
0.2450638792102207
tr
0.2415402567094516
nl
0.22985781990521328
fi
0.2243436754176611
sl
0.21686746987951808
lt
0.20440636474908203
hu
0.18444165621079048
pt
0.17825537294563845
fr
0.17407878017789072
az
0.1698595146871009
eu
0.15254237288135594
be
0.09722222222222222
ms
0.09722222222222222
uk
0.08835904628330996
vi
0.08835904628330996
reliable
true
passes
true
14
name
"Melanie"
dialogue
"Ich... ich verstehe nicht, aber—okay?"
detectedLang
"de"
heavyLang
"de"
scores
de
0.8307952622673435
nl
0.5370370370370371
sk
0.38271604938271603
pl
0.36507936507936506
tl
0.3442622950819672
cs
0.3333333333333333
lt
0.2779783393501805
hu
0.2647058823529412
it
0.2647058823529412
is
0.250936329588015
en
0.23954372623574144
es
0.23954372623574144
fr
0.23954372623574144
no
0.23954372623574144
pt
0.23954372623574144
az
0.2277992277992278
ca
0.2277992277992278
ro
0.2277992277992278
sq
0.2277992277992278
sv
0.2277992277992278
reliable
true
passes
true
15
name
"Hunter"
dialogue
"I'm on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.830220713073005
pl
0.6376811594202898
cs
0.6168582375478927
sk
0.6168582375478927
tl
0.6153846153846154
et
0.6062992125984252
fi
0.6
fr
0.5215311004784688
ca
0.49748743718592964
hr
0.46808510638297873
hi
0.45652173913043476
yo
0.42857142857142855
reliable
true
passes
true