NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9X63KY3NAA3YFG6ZV0V3Y
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
29.9s
Cost:
$0.018356
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
56.25%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
The late afternoon sun slanted through the front window of the Alborn Café, catching the dust motes above Selvi's table. She turned her camera over in her hands, scrolling through the last photos she'd taken — rows of apple trees, a red barn, the water tower at the edge of town — but her eyes kept drifting to the window, to the street outside where, only two nights ago, she'd heard something she couldn't explain. The bell above the door jingled. Hunter stepped in, scanning the room with the practiced ease of a man who'd spent years noticing exits before anything else. His eyes landed on Selvi, the only stranger in a town where everyone else had lived their whole lives within shouting distance of each other. He crossed over, pulling out the chair across from her without asking. --- **Hunter:** "Afternoon. I'm Detective Hunter, Alborn PD. You mind if I ask you a few questions?" **Selvi:** *(startled, gripping her camera tighter)* "Kya? Mujhe... mujhe samajh nahi aaya." *(What? I... I don't understand.)* **Hunter:** *(pausing, brow furrowing)* "...Come again?" **Selvi:** *(leaning forward, voice trembling)* "Woh raat... maine kuch dekha tha. Bahut darawna tha." *(That night... I saw something. It was terrifying.)* **Hunter:** "I — okay, I'm gonna be honest, I have no idea what you just said." *(He rubs the back of his neck, glancing around as if someone might materialize to translate.)* **Selvi:** *(pointing toward the window, hands shaking slightly)* "Wahaan... us gully mein... koi tha. Lekin woh insaan jaisa nahi tha." *(There... in that alley... someone was there. But it didn't look human.)* **Hunter:** "You're pointing at the alley. Okay. Something happened in the alley?" *(He pulls out a small notepad, more out of habit than hope.)* "Did you see someone? A person?" **Selvi:** *(shaking her head quickly, eyes wide)* "Nahi, nahi — main sirf itna keh sakti hoon ki main bahut dari hui thi. Please, koi meri baat samjhe." *(No, no — all I can say is that I was very scared. Please, someone understand what I'm saying.)* **Hunter:** *(sighing, setting the notepad down)* "Look — I can see you're shaken up about something. I just wish I knew what." *(He studies her face, softer now.)* "You were here that night, weren't you? Near where the Petersons' barn is?" **Selvi:** *(catching the word "Petersons," nodding slowly, though clearly unsure what else he's asking)* "Peterson... haan, haan, wahi jagah thi." *(Peterson... yes, yes, that was the place.)* **Hunter:** "Okay — okay, that's something. That's a start." *(He leans back, exhaling.)* "I don't suppose you've got any photos from that night? You've got that camera glued to your hands." **Selvi:** *(looking down at her camera, then back up, uncertain but sensing his intent)* "Camera? Haan, maine kuch photos li thi. Lekin—" *(Camera? Yes, I took some photos. But—)* *(She hesitates, scrolling through the gallery with trembling fingers, angling the screen toward him.)* **Hunter:** *(leaning in, squinting at the small screen)* "Hang on — is that—" His phone rang sharply, cutting through the quiet café. He glanced at the screen, jaw tightening. **Hunter:** "Hunter." *(a pause, his expression darkening)* "When?" *(another pause)* "I'm on my way." He shoved the phone back into his pocket and stood abruptly, chair scraping against the floor. **Hunter:** "I have to go. Stay put — actually, no, don't stay put, go somewhere with people. I'll find someone who speaks—" *(he gestures vaguely, frustrated)* "—whatever it is you speak. Just don't delete those photos." **Selvi:** *(watching him hurry toward the door, calling after him, voice small)* "Ruko! Kya hua? Kahaan ja rahe ho?" *(Wait! What happened? Where are you going?)* But the bell above the door was already jingling again, and Hunter was gone, leaving Selvi alone with her camera and the photographs no one in Alborn could yet understand.
created_at
"2026-07-01T07:39:43.615Z"
7/1/2026, 7:39:43 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
4654
moderation_latency
(null)
generation_time
29518
tokens_prompt
315
tokens_completion
1088
native_tokens_prompt
423
native_tokens_completion
1751
native_tokens_completion_images
(null)
native_tokens_reasoning
64
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.018356
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_013Zkq7Kc37VTqPGrBcT8c1m"
is_byok
false
latency
1899
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891583-XfU2FOk65fmV71h4KlBn"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891583-nQJErOSG1wnRLQaBYOdr"
upstream_id
"msg_013Zkq7Kc37VTqPGrBcT8c1m"
total_cost
0.018356
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
56.25%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Afternoon. I'm Detective Hunter, Alborn PD. You mind if I ask you a few questions?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7790277219766975
tl
0.6193771626297577
it
0.5976591075347476
fr
0.5703125
ca
0.5435684647302904
ro
0.5378151260504201
pt
0.5311167945439046
da
0.46341463414634143
es
0.45652173913043476
no
0.4554455445544555
sv
0.4433198380566802
cs
0.4130202774813233
sq
0.394273127753304
hr
0.3663594470046083
nl
0.36416184971098264
hu
0.3612078977932636
sk
0.3357487922705314
de
0.302915082382763
pl
0.29577464788732394
sl
0.2819843342036553
et
0.2801047120418848
tr
0.2724867724867725
yo
0.2724867724867725
lt
0.20863309352517986
is
0.2005813953488372
az
0.19472913616398244
lv
0.19472913616398244
vi
0.19472913616398244
ms
0.18154761904761904
be
0.11290322580645161
eu
0.11290322580645161
fi
0.10277324632952692
uk
0.10277324632952692
reliable
true
passes
true
1
name
"Selvi"
dialogue
"Kya? Mujhe... mujhe samajh nahi aaya."
detectedLang
"eu"
heavyLang
"tl"
scores
eu
0.4852941176470589
et
0.37275985663082434
fi
0.37275985663082434
is
0.36823104693140796
no
0.36363636363636365
lv
0.3566176470588235
tl
0.3566176470588235
da
0.32950191570881227
sv
0.3137254901960784
ms
0.2886178861788618
reliable
false
passes
false
2
name
"Hunter"
dialogue
"...Come again?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8337028824833703
nl
0.7272727272727273
it
0.6835443037974683
reliable
true
passes
true
3
name
"Selvi"
dialogue
"Woh raat... maine kuch dekha tha. Bahut darawna tha."
detectedLang
"de"
heavyLang
"vi"
scores
de
0.45155393053016457
sq
0.42528735632183906
fr
0.4094488188976378
tl
0.358974358974359
en
0.35205183585313177
et
0.35205183585313177
fi
0.35205183585313177
ro
0.3288590604026846
pl
0.25925925925925924
lv
0.22680412371134018
eu
0.2227979274611399
ms
0.2227979274611399
yo
0.20212765957446807
reliable
false
passes
false
4
name
"Hunter"
dialogue
"I — okay, I'm gonna be honest, I have no idea what you just said."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7844827586206896
et
0.5588235294117647
ca
0.5324189526184538
da
0.4925575101488498
tl
0.47405329593267886
no
0.460431654676259
it
0.43524096385542166
hr
0.3902439024390244
sv
0.3902439024390244
es
0.37395659432387307
pl
0.34895833333333337
yo
0.3444055944055944
lv
0.3409490333919156
hu
0.32915921288014316
cs
0.32795698924731176
lt
0.3181818181818182
sk
0.3029739776951673
tr
0.2964352720450282
eu
0.29111531190926276
pt
0.2690058479532163
sq
0.2632612966601179
fi
0.23469387755102045
ro
0.1935483870967742
ms
0.17035398230088497
be
0.15730337078651685
az
0.14383561643835618
is
0.14383561643835618
uk
0.14383561643835618
vi
0.14383561643835618
reliable
true
passes
true
5
name
"Selvi"
dialogue
"Wahaan... us gully mein... koi tha. Lekin woh insaan jaisa nahi tha."
detectedLang
"eu"
heavyLang
"de"
scores
eu
0.43820224719101125
fi
0.43661971830985913
ms
0.4244604316546763
tl
0.3957703927492447
en
0.35170178282009723
de
0.35064935064935066
is
0.3197278911564626
az
0.23371647509578544
sq
0.2263056092843327
tr
0.2263056092843327
lv
0.2
no
0.2
ro
0.2
sv
0.16142557651991615
ca
0.15789473684210525
es
0.15789473684210525
pt
0.15789473684210525
reliable
false
passes
false
6
name
"Hunter"
dialogue
"Did you see someone? A person?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8201438848920863
pt
0.6402877697841727
es
0.5983935742971888
et
0.5934959349593496
tl
0.5901639344262295
cs
0.5735607675906184
sv
0.5348837209302325
no
0.5327102803738317
ca
0.5305164319248826
ro
0.5271867612293144
da
0.5238095238095238
sq
0.5238095238095238
hu
0.522673031026253
de
0.5157384987893463
it
0.5157384987893463
is
0.511002444987775
fr
0.5012468827930174
sk
0.48586118251928023
hr
0.4609164420485175
pl
0.45054945054945056
lt
0.4350282485875706
ms
0.4301994301994302
lv
0.42028985507246375
nl
0.42028985507246375
tr
0.4186046511627907
az
0.39209726443769
yo
0.3730407523510972
sl
0.3103448275862069
eu
0.25925925925925924
vi
0.25925925925925924
fi
0.23954372623574144
reliable
true
passes
true
7
name
"Selvi"
dialogue
"Nahi, nahi — main sirf itna keh sakti hoon ki main bahut dari hui thi. Please, koi meri baat samjhe."
detectedLang
"en"
heavyLang
"tl"
scores
en
0.40136830102622584
sq
0.375
fr
0.26880222841225626
ms
0.24132947976878616
eu
0.2391304347826087
az
0.2290748898678414
vi
0.22794117647058826
sl
0.22566371681415928
hu
0.1873065015479876
yo
0.17711598746081506
et
0.16666666666666666
tr
0.16534181240063595
ro
0.16
tl
0.16
de
0.12935323383084577
reliable
false
passes
false
8
name
"Hunter"
dialogue
"You were here that night, weren't you? Near where the Petersons' barn is?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.811195024433585
nl
0.5591286307053942
tl
0.5319383259911894
sv
0.5137299771167049
no
0.49404761904761907
da
0.48609431680773885
yo
0.41460055096418735
sq
0.37591776798825255
fr
0.37037037037037035
de
0.3441358024691358
is
0.28451178451178455
hu
0.2659758203799654
ca
0.16173570019723865
pt
0.16173570019723865
sk
0.15841584158415842
sl
0.15841584158415842
cs
0.1550695825049702
ms
0.1550695825049702
lv
0.1533864541832669
es
0.1448692152917505
et
0.1431451612903226
reliable
true
passes
true
9
name
"Selvi"
dialogue
"Peterson... haan, haan, wahi jagah thi."
detectedLang
"sv"
heavyLang
"id"
scores
sv
0.6441281138790036
da
0.5391705069124424
no
0.5381062355658198
en
0.5337995337995338
et
0.47780678851174935
vi
0.43661971830985913
pt
0.43342776203966005
nl
0.4318181818181818
de
0.4152046783625731
ca
0.2907801418439716
sk
0.2857142857142857
sl
0.2857142857142857
es
0.2647058823529412
is
0.26199261992619927
sq
0.26199261992619927
tl
0.26199261992619927
reliable
true
passes
false
10
name
"Hunter"
dialogue
"I don't suppose you've got any photos from that night? You've got that camera glued to your hands."
detectedLang
"en"
heavyLang
"en"
scores
en
0.794201861130995
tl
0.6236910994764397
fr
0.5450949367088607
no
0.49912891986062713
da
0.49781659388646293
sv
0.45133587786259544
ca
0.435721295387635
nl
0.40904419321685515
de
0.4053774560496381
it
0.375
pl
0.36882546652030734
ro
0.3539325842696629
yo
0.3413516609392898
lv
0.30806257521058966
hr
0.3072289156626506
is
0.3004866180048662
lt
0.3004866180048662
cs
0.2909987669543773
sk
0.26187419768934533
es
0.2374005305039788
ms
0.20689655172413793
sq
0.18899858956276447
sl
0.1738505747126437
eu
0.16424418604651161
pt
0.12213740458015267
hi
0.11809815950920245
be
0.10852713178294573
tr
0.10852713178294573
hu
0.1043613707165109
az
0.0987460815047022
et
0.0987460815047022
uk
0.0987460815047022
vi
0.0987460815047022
reliable
true
passes
true
11
name
"Selvi"
dialogue
"Camera? Haan, maine kuch photos li thi. Lekin—"
detectedLang
"fr"
heavyLang
"vi"
scores
fr
0.608355091383812
en
0.5732574679943101
ro
0.5581737849779087
de
0.4915254237288135
ca
0.4863013698630137
fi
0.4614003590664273
it
0.44547134935304994
tl
0.4350282485875706
es
0.3736951983298539
et
0.35205183585313177
lv
0.3464052287581699
vi
0.34065934065934067
lt
0.33920704845814975
eu
0.3288590604026846
nl
0.3288590604026846
hr
0.2518703241895262
is
0.22680412371134018
cs
0.21671018276762402
sv
0.21465968586387435
pt
0.21052631578947367
hi
0.20424403183023873
pl
0.19786096256684493
ms
0.1935483870967742
reliable
true
passes
false
12
name
"Hunter"
dialogue
"Hang on — is that—"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8272884283246977
yo
0.6610169491525424
tl
0.647887323943662
nl
0.6138996138996139
et
0.6062992125984252
hu
0.6062992125984252
fi
0.6
fr
0.5215311004784688
ca
0.49748743718592964
is
0.4791666666666667
hr
0.46808510638297873
hi
0.45652173913043476
pl
0.45652173913043476
cs
0.42857142857142855
sk
0.42857142857142855
reliable
true
passes
true
13
name
"Hunter"
dialogue
"I'm on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.830220713073005
pl
0.6376811594202898
cs
0.6168582375478927
sk
0.6168582375478927
tl
0.6153846153846154
et
0.6062992125984252
fi
0.6
fr
0.5215311004784688
ca
0.49748743718592964
hr
0.46808510638297873
hi
0.45652173913043476
yo
0.42857142857142855
reliable
true
passes
true
14
name
"Hunter"
dialogue
"—whatever it is you speak. Just don't delete those photos."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8191489361702127
tl
0.4867149758454107
nl
0.47530864197530864
fr
0.4627054361567636
sv
0.37683284457478006
sq
0.37315634218289084
no
0.3675595238095238
hu
0.358974358974359
pt
0.3531202435312024
ca
0.3359375
yo
0.3156199677938808
et
0.29401993355481726
da
0.2722602739726028
lv
0.2697594501718213
es
0.256993006993007
ro
0.2504409171075838
is
0.17794970986460348
lt
0.15841584158415842
cs
0.1550695825049702
hi
0.1533864541832669
sl
0.15
tr
0.15
de
0.1431451612903226
it
0.1361788617886179
reliable
true
passes
true
15
name
"Selvi"
dialogue
"Ruko! Kya hua? Kahaan ja rahe ho?"
detectedLang
"fi"
heavyLang
"tl"
scores
fi
0.5633187772925764
ca
0.5337995337995338
sk
0.4936708860759494
et
0.4350282485875706
tl
0.42196531791907516
lv
0.36507936507936506
no
0.35691318327974275
cs
0.3464052287581699
it
0.3464052287581699
de
0.3055555555555556
da
0.2857142857142857
pl
0.2857142857142857
sl
0.2857142857142857
sq
0.2727272727272727
sv
0.2727272727272727
yo
0.2727272727272727
reliable
false
passes
false