NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-05-31-01KSYXHC914674JWQAR4G10EBY
Run Details
Model:
Claude Opus 4.8 (Reasoning, High)
Test:
Language Writing
Scenario:
Character dialogue (Spanish) in a story
Duration:
17.5s
Cost:
$0.028150
Provider:
Anthropic
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Maria"> Maria is a 30-year old college student on a study abroad program. Born in Spain, she is fluent in Spanish and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Spanish, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Maria is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Spanish, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Maria and Hunter as a voice sheet: Maria: "..." Hunter: "..."
Model response
Messages
Meta
AI
Maria: *(scrolling through her camera, murmuring to herself)* "No puede ser... yo estaba justo ahí. Lo vi todo, pero nadie me va a creer..." Hunter: "Excuse me, miss? Mind if I sit for a second?" *(pulls out a chair without waiting)* "I'm Detective Hunter. You were near the old mill last night, weren't you? A couple folks said they saw a woman with a camera." Maria: *(looking up, startled)* "¿Qué? Perdón, yo... yo no hablo inglés." *(clutching her camera tighter)* "Pero sí, estuve allí. Tomé fotos del atardecer y entonces... entonces escuché algo." Hunter: "Whoa, okay. Spanish. Great." *(rubs the back of his neck)* "Look, I'm trying to figure out what happened to Tom Brennan. He vanished, just like the others. Did you see anything? A car? A person?" Maria: *(voice shaking, gesturing toward the camera)* "Había un hombre. Lo capturé sin querer, en esta foto. Mire, mire..." *(turns the screen toward him, hands trembling)* "Estaba arrastrando algo hacia el bosque. Tengo miedo. No sé qué hacer con esto." Hunter: *(squinting at the screen)* "I can't— slow down. I don't understand a word you're saying." *(leans in, studying the image)* "Wait. Is that... is that a figure by the tree line? Can you send me this photo? Email? Phone?" Maria: *(frustrated, on the verge of tears)* "¡No me entiende! Esto es importante. Hay alguien peligroso en este pueblo, ¿entiende? ¡Peligroso!" *(taps the camera screen urgently)* "Por favor, alguien tiene que escucharme." Hunter: "Hey, hey, easy. You're shaking." *(softens his tone)* "Whatever you saw, it's got you scared. I get that much." *(slides a business card across the table)* "I'm gonna find someone who can translate. We'll figure this out, okay? You're safe." Maria: *(taking the card, staring at it)* "Detective..." *(quietly)* "Quiero ayudar. De verdad. Pero tengo tanto miedo de lo que vi." Hunter: *(his phone buzzes loudly; he glances at it, jaw tightening)* "Dispatch. Of course." *(answers)* "Hunter. ...What? Where? ...I'm on my way." *(stands abruptly, pockets the phone)* "I have to go. There's been another one." *(points firmly at the card, then at her)* "Don't go anywhere. Stay right here. I'll be back." Maria: *(watching him rush out)* "¿Otro? ¿Otra persona?" *(whispers, gripping the card)* "Dios mío... está pasando otra vez."
created_at
"2026-05-31T11:43:33.677Z"
5/31/2026, 11:43:33 AM
model
"anthropic/claude-4.8-opus-20260528"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3198
moderation_latency
(null)
generation_time
17485
tokens_prompt
317
tokens_completion
653
native_tokens_prompt
420
native_tokens_completion
1042
native_tokens_completion_images
(null)
native_tokens_reasoning
44
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.02815
router
(null)
provider_responses
0
endpoint_id
"b0d3beaa-5ff7-4666-a749-b1bb2b14c916"
id
"msg_01K1kwdV2xeFKsrKFXbBPiPy"
is_byok
false
latency
1542
model_permaslug
"anthropic/claude-4.8-opus-20260528"
provider_name
"Anthropic"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.16.0; linux; x64))"
http_referer
(null)
request_id
"req-1780227813-mA6nqvFKMuEJbfbRmKsl"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1780227813-AS3vjRNeF735OHUe0J27"
upstream_id
"msg_01K1kwdV2xeFKsrKFXbBPiPy"
total_cost
0.02815
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Anthropic"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Maria"
dialogue
"No puede ser... yo estaba justo ahí. Lo vi todo, pero nadie me va a creer..."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8122317596566524
pt
0.6518567639257294
ca
0.6167883211678832
tl
0.6148202494497432
it
0.5661157024793388
en
0.563953488372093
no
0.5070422535211268
fr
0.4827586206896552
da
0.4160177975528365
sv
0.4081172491544532
yo
0.39999999999999997
ro
0.3951612903225807
vi
0.3320610687022901
eu
0.32605905006418484
et
0.3
sk
0.29624664879356566
sq
0.2953020134228188
nl
0.2905405405405405
fi
0.2895805142083897
ms
0.2895805142083897
hr
0.2886178861788618
lv
0.2768595041322314
pl
0.25531914893617025
sl
0.2532005689900427
tr
0.2391304347826087
hu
0.2290748898678414
az
0.21991084695393756
cs
0.2009132420091324
de
0.19601837672281774
lt
0.13509060955518945
is
0.125
reliable
true
passes
true
1
name
"Hunter"
dialogue
"I'm Detective Hunter. You were near the old mill last night, weren't you? A couple folks said they saw a woman with a camera."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7907366071428571
tl
0.6069182389937107
fr
0.5373226403454658
ro
0.47844228094575797
nl
0.47071277346506707
no
0.4331065759637188
it
0.40898345153664306
da
0.39903846153846156
ca
0.38875305623471884
sv
0.37913907284768217
ms
0.375
sq
0.375
es
0.3528904227782571
de
0.33920704845814975
pt
0.3321460373998219
cs
0.32003626473254765
yo
0.2857142857142857
et
0.251497005988024
hr
0.25
sl
0.22360248447204967
hu
0.17218543046357618
fi
0.1601343784994401
tr
0.15349887133182843
sk
0.14772727272727273
pl
0.12280701754385964
lt
0.0985576923076923
is
0.09090909090909091
az
0.08536585365853659
eu
0.08536585365853659
lv
0.08536585365853659
vi
0.08536585365853659
reliable
true
passes
true
2
name
"Maria"
dialogue
"Pero sí, estuve allí. Tomé fotos del atardecer y entonces... entonces escuché algo."
detectedLang
"es"
heavyLang
"es"
scores
es
0.7613882863340564
ca
0.5943952802359882
fr
0.5465787304204451
pt
0.5393634840871022
tl
0.4148936170212766
it
0.3778280542986425
cs
0.377123442808607
da
0.31077694235588976
sk
0.3081761006289308
lv
0.2744063324538259
en
0.2403314917127072
sl
0.23076923076923078
pl
0.22969187675070027
no
0.22535211267605632
sv
0.22535211267605632
yo
0.21203438395415475
lt
0.20634920634920634
de
0.19590643274853803
nl
0.19590643274853803
vi
0.15123456790123457
tr
0.11290322580645161
hr
0.1085899513776337
et
0.10277324632952692
sq
0.10277324632952692
az
0.09688013136288999
ro
0.09688013136288999
reliable
true
passes
true
3
name
"Hunter"
dialogue
"Look, I'm trying to figure out what happened to Tom Brennan. He vanished, just like the others. Did you see anything? A car? A person?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8140857392825896
tl
0.5523959978936283
no
0.5035046728971962
sq
0.4337108594270486
da
0.431438127090301
sv
0.4129834254143646
fr
0.39329050678087085
cs
0.3708364174685418
ca
0.35654806964420893
yo
0.35361216730038025
hr
0.3491577335375191
sk
0.3343774471417384
et
0.3167202572347267
is
0.3167202572347267
es
0.30498773507767785
ro
0.30327868852459017
de
0.29577464788732394
pt
0.28989139515455303
nl
0.2735042735042735
ms
0.26534140017286084
pl
0.26022628372497825
it
0.24911660777385158
fi
0.24309884238646481
lv
0.23903312444046554
lt
0.2328519855595668
hu
0.2048643592142189
sl
0.19886899151743637
tr
0.1448692152917505
az
0.1317671092951992
eu
0.07608695652173912
vi
0.07608695652173912
reliable
true
passes
true
4
name
"Maria"
dialogue
"Estaba arrastrando algo hacia el bosque. Tengo miedo. No sé qué hacer con esto."
detectedLang
"es"
heavyLang
"es"
scores
es
0.81233681462141
pt
0.5904558404558404
it
0.5340356564019448
ca
0.5077054794520548
eu
0.36674008810572684
is
0.3653421633554084
fr
0.3480725623582766
en
0.31710213776722085
no
0.3162901307966707
ro
0.31302270011947436
sv
0.30303030303030304
sk
0.3004866180048662
hu
0.25997425997426
tl
0.22506738544474394
pl
0.20027816411682894
sq
0.1958041958041958
lv
0.18555240793201136
vi
0.18555240793201136
ms
0.15066469719350073
hr
0.14940828402366865
tr
0.13273001508295626
yo
0.13010590015128592
da
0.12213740458015267
et
0.11402157164869028
cs
0.10714285714285714
sl
0.10714285714285714
reliable
true
passes
true
5
name
"Hunter"
dialogue
"Wait. Is that... is that a figure by the tree line? Can you send me this photo? Email? Phone?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8209413369713506
fr
0.5738636363636364
tl
0.56575682382134
cs
0.5573355817875211
nl
0.473420260782347
sq
0.4620901639344262
da
0.4198895027624309
yo
0.39724454649827784
no
0.3823529411764706
ms
0.37200956937799046
hu
0.37125748502994016
es
0.36594202898550726
pt
0.3613138686131387
ca
0.3558282208588957
ro
0.3526510480887793
it
0.3429286608260325
sk
0.336283185840708
tr
0.30463576158940403
pl
0.2981283422459893
de
0.2866847826086956
vi
0.27884615384615385
sl
0.2532005689900427
eu
0.2435158501440922
is
0.24132947976878616
et
0.23133235724743775
az
0.21875
sv
0.21171171171171171
fi
0.2081447963800905
hr
0.1758241758241758
lt
0.13509060955518945
hi
0.12790697674418602
lv
0.11764705882352942
reliable
true
passes
true
6
name
"Maria"
dialogue
"Por favor, alguien tiene que escucharme."
detectedLang
"es"
heavyLang
"es"
scores
es
0.819435325016415
pt
0.7061965811965812
ca
0.6527777777777778
fr
0.576271186440678
it
0.5521172638436482
sq
0.4148936170212766
no
0.3559718969555035
nl
0.3544600938967136
ro
0.3514150943396226
da
0.3405275779376499
et
0.27055702917771884
cs
0.22096317280453256
pl
0.22096317280453256
tl
0.21875
fi
0.21652421652421652
en
0.207492795389049
sl
0.19117647058823528
sv
0.19117647058823528
reliable
true
passes
true
7
name
"Hunter"
dialogue
"I'm gonna find someone who can translate. We'll figure this out, okay? You're safe."
detectedLang
"en"
heavyLang
"en"
scores
en
0.772628843655262
tl
0.45764462809917356
ro
0.37425506555423127
it
0.3644067796610169
da
0.3064729194187582
ca
0.3037135278514589
fr
0.3018617021276596
pt
0.3018617021276596
es
0.29906542056074764
no
0.2827868852459016
et
0.25426136363636365
sq
0.22106824925816024
tr
0.21052631578947367
hr
0.2081447963800905
az
0.20574886535552195
de
0.20574886535552195
fi
0.1796875
vi
0.1435562805872757
pl
0.11764705882352942
eu
0.11317567567567569
lt
0.11317567567567569
lv
0.11317567567567569
nl
0.10714285714285714
sk
0.10714285714285714
cs
0.10102739726027396
ms
0.10102739726027396
sl
0.10102739726027396
sv
0.10102739726027396
reliable
true
passes
true
8
name
"Maria"
dialogue
"Quiero ayudar. De verdad. Pero tengo tanto miedo de lo que vi."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8163353500432152
pt
0.6507806080525883
it
0.6379897785349233
ca
0.6013133208255159
da
0.4544287548138639
no
0.44005270092226617
tl
0.42411924119241196
fr
0.4129834254143646
nl
0.3786549707602339
sv
0.37315634218289084
de
0.35213414634146345
yo
0.35213414634146345
ro
0.3369734789391576
vi
0.31006493506493504
tr
0.29983525535420097
eu
0.29867986798679863
hu
0.2904841402337229
ms
0.2796610169491525
az
0.2659758203799654
sq
0.23423423423423423
is
0.20560747663551404
pl
0.169921875
sl
0.1533864541832669
lv
0.15169660678642716
et
0.15
en
0.1290983606557377
reliable
true
passes
true
9
name
"Hunter"
dialogue
"Don't go anywhere. Stay right here. I'll be back."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8039806996381182
tl
0.5952677459526774
yo
0.44539249146757676
sq
0.3538767395626242
de
0.3186582809224318
hu
0.2647058823529412
lt
0.2562929061784897
pl
0.2494226327944573
da
0.18546365914786966
fr
0.18546365914786966
no
0.18546365914786966
reliable
true
passes
true
10
name
"Maria"
dialogue
"Dios mío... está pasando otra vez."
detectedLang
"es"
heavyLang
"es"
scores
es
0.8116760828625236
pt
0.7256515775034293
lv
0.5024875621890548
tl
0.46380697050938335
it
0.3957703927492447
lt
0.37694704049844235
ca
0.36507936507936506
ms
0.3265993265993266
eu
0.3197278911564626
cs
0.30313588850174217
sk
0.2779783393501805
pl
0.26199261992619927
ro
0.26199261992619927
sq
0.26199261992619927
reliable
true
passes
true