NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE8VMNETS8A62GJWY12WD4D
Run Details
Model:
Claude Sonnet 5 (Reasoning)
Test:
Language Writing
Scenario:
Character dialogue (French) in a story
Duration:
17.1s
Cost:
$0.014018
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Marie"> Marie is a 30-year old college student on a study abroad program. Born in France, she is fluent in French and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of French, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Marie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in French, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Marie and Hunter as a voice sheet: Marie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: The Copper Kettle Café, Alborn, MN — mid-morning** *Marie sits at a small table near the window, scrolling through photos on her camera's screen. Her coffee has gone lukewarm beside her. The bell above the door chimes as Hunter steps inside, scanning the room before his eyes land on her. He approaches, pulling out a small notepad.* **Hunter:** "Morning. Sorry to interrupt — you were at the festival grounds yesterday evening, weren't you? Taking pictures?" *Marie looks up, startled. Her hands tighten slightly around the camera.* **Marie:** "Je... je ne comprends pas. Qu'est-ce qui s'est passé ?" *(I... I don't understand. What happened?)* **Hunter:** *(pausing, brow furrowing)* "Uh — English? Do you speak English?" **Marie:** *(shaking her head, voice trembling)* "Non, non — je suis désolée. Je ne parle pas anglais." *(No, no — I'm sorry. I don't speak English.)* **Hunter:** *(sighing, rubbing the back of his neck)* "Great. Okay. Um — pictures?" *(He mimes holding a camera, pointing at hers.)* "Last night? Near the orchard?" *Marie's eyes widen with recognition, and she nods quickly, though her expression grows more troubled.* **Marie:** "Oui, oui — j'étais là-bas. J'ai vu quelque chose... une lumière, très étrange, près des arbres. Et puis j'ai entendu un cri. Un cri terrible." *(Yes, yes — I was there. I saw something... a light, very strange, near the trees. And then I heard a scream. A terrible scream.)* **Hunter:** *(leaning in, trying to catch any familiar word)* "A scream? Did you say — scream?" *(He mimics covering his ears, alarmed.)* **Marie:** *(nodding vigorously, pointing toward her camera)* "Oui ! J'ai pris une photo, juste avant. Peut-être qu'il y a quelque chose là-dedans." *(Yes! I took a photo, just before. Maybe there's something in it.)* *She turns the camera toward him, flipping through images with shaking fingers. Hunter squints at the screen, clearly frustrated by the language barrier but intrigued by her urgency.* **Hunter:** "Okay — okay, hold on. I need someone who can translate this. Can you—" *(he gestures for her to wait)* "—stay here? Don't go anywhere. I'll get someone." *Marie tilts her head, not understanding, but sensing the seriousness in his tone. She nods slowly, clutching the camera to her chest.* **Marie:** "D'accord... je reste ici." *(Okay... I'll stay here.)* *Hunter's phone buzzes sharply in his pocket. He glances at the screen, jaw tightening.* **Hunter:** "Damn it — that's dispatch." *(to Marie, holding up a hand)* "Stay. Right here. I mean it." *Marie watches him, confused but nodding again. Hunter hesitates a beat, frustrated by the unfinished conversation, then turns and strides quickly out of the café, phone pressed to his ear. The bell chimes behind him as the door swings shut.* *Marie looks back down at her camera, scrolling once more to the photo from the orchard, her expression darkening.*
created_at
"2026-07-01T07:21:24.412Z"
7/1/2026, 7:21:24 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4301
moderation_latency
(null)
generation_time
17088
tokens_prompt
316
tokens_completion
833
native_tokens_prompt
409
native_tokens_completion
1320
native_tokens_completion_images
(null)
native_tokens_reasoning
51
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.014018
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_0133mnhLzJo39GWfDiAvLxgs"
is_byok
false
latency
2100
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890484-WmH7jrfIrx2TgeF0ZJVS"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890484-eaA1hVdK55SShgtfa4zq"
upstream_id
"msg_0133mnhLzJo39GWfDiAvLxgs"
total_cost
0.014018
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Morning. Sorry to interrupt — you were at the festival grounds yesterday evening, weren't you? Taking pictures?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7733894464227905
tl
0.6790463090325539
nl
0.58968347010551
no
0.5818399044205496
da
0.5627732667083073
fr
0.5066948555320648
sv
0.5
pt
0.44400317712470216
it
0.40476190476190477
cs
0.40323955669224215
ca
0.40119760479041916
sl
0.39603106125970666
ro
0.3939393939393939
hr
0.36363636363636365
sk
0.3613138686131387
pl
0.3554327808471455
de
0.35125115848007415
et
0.34024505183788883
sq
0.34024505183788883
es
0.33774834437086093
lv
0.33586337760910817
ms
0.31640625
lt
0.3048659384309831
yo
0.2584745762711864
az
0.20903954802259886
is
0.2054483541430193
tr
0.18414918414918416
fi
0.16963226571767495
hu
0.16367980884109917
eu
0.10485933503836317
vi
0.08256880733944955
reliable
true
passes
true
1
name
"Marie"
dialogue
"Je... je ne comprends pas. Qu'est-ce qui s'est passé ?"
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8317805383022774
ca
0.6810598626104024
it
0.6364653243847874
nl
0.5390070921985816
ro
0.5220588235294118
sl
0.48083067092651754
en
0.48
lt
0.4698205546492659
hr
0.4663382594417077
de
0.4268077601410935
sq
0.4227353463587922
cs
0.4133574007220217
pt
0.41016333938294003
es
0.3890977443609023
hu
0.358974358974359
tl
0.34077079107505076
yo
0.3340163934426229
ms
0.3143459915611814
sk
0.30851063829787234
lv
0.24065420560747666
tr
0.2243436754176611
pl
0.21875
fi
0.21307506053268765
da
0.20147420147420148
no
0.1935483870967742
sv
0.1935483870967742
et
0.16666666666666666
is
0.16666666666666666
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Uh — English? Do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7933884297520661
cs
0.5466321243523317
hr
0.5231607629427792
tl
0.5042492917847025
pt
0.4712990936555891
pl
0.4496855345911949
sk
0.4299674267100977
sl
0.4067796610169492
sq
0.4006849315068493
vi
0.38811188811188807
no
0.31906614785992216
yo
0.308300395256917
da
0.29149797570850206
de
0.29149797570850206
ms
0.29149797570850206
ro
0.29149797570850206
sv
0.29149797570850206
reliable
true
passes
true
3
name
"Marie"
dialogue
"Non, non — je suis désolée. Je ne parle pas anglais."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8015873015873016
sl
0.6345919610231425
lt
0.5850622406639004
it
0.5683453237410072
sq
0.5607613469985359
cs
0.5535714285714286
hr
0.5363214837712519
ca
0.511400651465798
sk
0.48805460750853247
nl
0.4827586206896552
lv
0.460431654676259
ro
0.44751381215469616
en
0.4307400379506641
yo
0.35205183585313177
pl
0.34497816593886466
tr
0.33774834437086093
hu
0.33184855233853006
ms
0.3288590604026846
es
0.3273542600896861
de
0.3227990970654628
fi
0.22680412371134018
eu
0.2248062015503876
az
0.1891891891891892
et
0.17355371900826447
pt
0.17355371900826447
da
0.16434540389972147
no
0.16434540389972147
sv
0.16434540389972147
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Last night? Near the orchard?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8051224944320714
tl
0.7356495468277946
no
0.5823389021479713
nl
0.5742092457420924
fr
0.5646766169154229
yo
0.5084269662921348
da
0.4648318042813456
de
0.45987654320987653
ms
0.308300395256917
sq
0.308300395256917
sv
0.308300395256917
et
0.3055555555555556
reliable
true
passes
true
5
name
"Marie"
dialogue
"Oui, oui — j'étais là-bas. J'ai vu quelque chose... une lumière, très étrange, près des arbres. Et puis j'ai entendu un cri. Un cri terrible."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8084291187739464
ca
0.5707070707070707
en
0.415807560137457
es
0.3694362017804154
da
0.32324840764331214
pt
0.3216280925778133
no
0.3122977346278317
de
0.30612244897959184
it
0.2951907131011609
tl
0.2647058823529412
lv
0.24039320822162644
nl
0.2314647377938517
ro
0.2144177449168207
et
0.20560747663551404
yo
0.18582375478927202
vi
0.15590863952333664
sq
0.1550695825049702
cs
0.1474423269809428
sv
0.1414141414141414
fi
0.1370558375634518
lt
0.12551440329218108
eu
0.1127348643006263
sk
0.1127348643006263
ms
0.10526315789473685
tr
0.07608695652173912
az
0.06900328587075576
hu
0.06900328587075576
pl
0.06490649064906491
reliable
true
passes
true
6
name
"Hunter"
dialogue
"A scream? Did you say — scream?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8295454545454545
tl
0.7
cs
0.5833333333333334
hu
0.5098039215686274
pt
0.4827586206896552
ro
0.4809688581314879
ca
0.4755244755244755
es
0.46808510638297873
sk
0.46428571428571425
it
0.4545454545454546
yo
0.44237918215613387
fr
0.43820224719101125
hr
0.42748091603053434
pl
0.4117647058823529
sl
0.375
lt
0.35344827586206895
tr
0.33920704845814975
is
0.3333333333333333
da
0.32432432432432434
sq
0.32432432432432434
az
0.3181818181818182
eu
0.3181818181818182
lv
0.3181818181818182
nl
0.3181818181818182
no
0.3181818181818182
vi
0.3181818181818182
de
0.3087557603686636
et
0.29577464788732394
fi
0.29577464788732394
ms
0.29577464788732394
sv
0.29577464788732394
reliable
true
passes
true
7
name
"Marie"
dialogue
"Oui ! J'ai pris une photo, juste avant. Peut-être qu'il y a quelque chose là-dedans."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.8131423232637807
en
0.531615925058548
ca
0.46476360392506694
es
0.43342776203966005
pt
0.3839835728952772
ro
0.375
it
0.3576017130620985
vi
0.35135135135135137
et
0.3492407809110629
no
0.3212669683257918
sv
0.3111366245694604
da
0.2736077481840194
cs
0.2682926829268293
tl
0.2647058823529412
pl
0.25925925925925924
yo
0.25650557620817843
de
0.2555831265508685
hu
0.20634920634920634
tr
0.19678714859437751
sq
0.19137466307277629
eu
0.1902834008097166
nl
0.1792065663474692
ms
0.1780821917808219
sk
0.1780821917808219
hr
0.15730337078651685
sl
0.13043478260869565
lt
0.12023460410557184
hi
0.1137370753323486
is
0.1111111111111111
az
0.1044776119402985
lv
0.1044776119402985
fi
0.09502262443438914
reliable
true
passes
true
8
name
"Hunter"
dialogue
"—stay here? Don't go anywhere. I'll get someone."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7926744989633725
sq
0.3723849372384937
tl
0.3710691823899371
pl
0.2647058823529412
is
0.25
de
0.20634920634920634
es
0.20634920634920634
pt
0.20634920634920634
yo
0.20424403183023873
reliable
true
passes
true
9
name
"Marie"
dialogue
"D'accord... je reste ici."
detectedLang
"fr"
heavyLang
"fr"
scores
fr
0.7943595769682726
it
0.6982758620689654
nl
0.6548323471400395
sl
0.630801687763713
hr
0.6244635193133047
ca
0.5901639344262295
ro
0.5892018779342723
sk
0.5603015075376884
cs
0.5454545454545454
de
0.5406824146981627
es
0.5370370370370371
no
0.48224852071005914
yo
0.48224852071005914
pt
0.4791666666666667
da
0.4760479041916168
en
0.45987654320987653
tl
0.44620253164556967
et
0.44267515923566875
lt
0.4186046511627907
eu
0.37722419928825623
pl
0.34210526315789475
sv
0.2647058823529412
az
0.25213675213675213
lv
0.25213675213675213
ms
0.25213675213675213
sq
0.25213675213675213
tr
0.25213675213675213
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Stay. Right here. I mean it."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8285994123408423
tl
0.6679316888045541
sq
0.6464646464646464
yo
0.5752427184466019
no
0.5558375634517766
da
0.5489690721649484
lv
0.45987654320987653
hr
0.44267515923566875
ca
0.44089456869009586
sv
0.44089456869009586
pl
0.4186046511627907
it
0.396551724137931
cs
0.375
ro
0.33962264150943394
de
0.29718875502008035
fr
0.29718875502008035
sk
0.29149797570850206
be
0.2857142857142857
tr
0.2857142857142857
hu
0.2768595041322314
az
0.2647058823529412
et
0.2647058823529412
is
0.2647058823529412
lt
0.2647058823529412
uk
0.2647058823529412
vi
0.2647058823529412
reliable
true
passes
true