NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-08-01M4DA2AHCVGHQCAER65A1HGSK
Run Details
Model:
Claude Haiku 5.5 (Adaptive)
Test:
Language Writing
Scenario:
Character dialogue (German) in a story
Duration:
12.7s
Cost:
$0.001205
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Melanie"> Melanie is a 30-year old college student on a study abroad program. Born in Germany, she is fluent in German and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of German, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Melanie is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in German, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Melanie and Hunter as a voice sheet: Melanie: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Scene: Café on Main Street, Alborn, MN. Late morning. Melanie sits alone at a corner table, camera in her lap, scrolling through photos. Hunter walks in, scans the room, and approaches her.** **Hunter:** "Excuse me. Are you Melanie? I'm Detective Hunter. I'd like to ask you about the orchard on Saturday night, the night Clara Dunmore disappeared." *(Melanie looks up, startled. She glances at the camera screen, then at him.)* **Melanie:** "Ich habe es gesehen. Auf dem Bild. Es war dort, zwischen den Bäumen, direkt neben ihr. Und dann war es einfach weg." *[I saw it. In the picture. It was there, between the trees, right next to her. And then it was just gone.]* *(Hunter frowns, leaning closer to the screen.)* **Hunter:** "Okay, slow down. Did you see Clara? Was anyone with her?" *(Melanie's voice wavers. She holds the camera tighter.)* **Melanie:** "Ich weiß nicht. Ich habe erst später bemerkt, dass ich nicht allein war. Bitte, glauben Sie mir. Ich habe es nicht erfunden." *[I don't know. I only noticed later that I wasn't alone. Please, believe me. I didn't make it up.]* *(Hunter shakes his head slowly, his brow creased in confusion.)* **Hunter:** "I'm sorry, I'm not following. I need you to tell me what you saw. Anything." **Melanie:** "Sie verstehen mich nicht, oder? Ich kann nicht... ich weiß nicht, wie ich es Ihnen sagen soll." *[You don't understand me, do you? I can't... I don't know how to tell you.]* *(Hunter exhales through his nose, pulls out a chair, and sits. He points to the camera, then to his chest, then to hers.)* **Hunter:** "Can I see the photo? Maybe the picture can help us understand." *(Melanie hesitates, then slides the camera across the table. Hunter studies the screen. Melanie watches his face, her hands trembling. She speaks again, softer.)* **Melanie:** "Das Gesicht... es hat mich angesehen. Ich habe das Foto dreimal angeschaut, und es sieht immer noch so aus." *[The face... it was looking at me. I've looked at the photo three times, and it still looks like that.]* **Hunter:** "Hey, it's okay. You're safe here. Can you tell me your last name? Where are you staying?" *(Melanie shakes her head, frustrated, and repeats one word.)* **Melanie:** "Nein. Nein, nein." *[No. No, no.]* *(Hunter's phone buzzes. He glances at the screen, then stands.)* **Hunter:** "Hunter. ...Yeah. Where? ...Got it. I'm ten minutes out." *(He hangs up and turns back to Melanie, hesitating. He slides his business card across the table and taps it.)* **Hunter:** "I have to go. This is my number. If you remember anything else, call me. Okay? Call me." *(Melanie picks up the card, reads his name, and looks up at him with uncertainty.)* **Melanie:** "Ich verstehe Sie nicht. Aber ich... ich rufe an. Versprochen." *[I don't understand you. But I... I'll call. I promise.]* *(Hunter nods, though he clearly has no idea what she said. He heads for the door. Melanie watches him go, then looks back down at the photo on her camera. The figure between the trees is still there.)* **END OF SCENE**
created_at
"2026-10-08T08:28:52.151Z"
10/8/2026, 8:28:52 AM
model
"anthropic/claude-haiku-5.5-20261007"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
12672
moderation_latency
(null)
generation_time
12672
tokens_prompt
306
tokens_completion
781
native_tokens_prompt
418
native_tokens_completion
2326
native_tokens_completion_images
(null)
native_tokens_reasoning
1047
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.0012048
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1791448132-3A6NSsHh4GMTRX0PnXzf"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1791448132-2nG0HFnkcU7VXFRcjhv5"
upstream_id
"msg_011CfpTMDHoyXmrArJmYHYBV"
provider_responses
0
endpoint_id
"b6cdf493-3a61-441f-a134-e7944fddb980"
id
"msg_011CfpTMDHoyXmrArJmYHYBV"
is_byok
false
latency
709
model_permaslug
"anthropic/claude-haiku-5.5-20261007"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.0012048
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me. Are you Melanie? I'm Detective Hunter. I'd like to ask you about the orchard on Saturday night, the night Clara Dunmore disappeared."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7769516728624535
tl
0.5535714285714286
fr
0.48394495412844035
ro
0.46107784431137727
no
0.44683466502765823
ms
0.38524590163934425
ca
0.3539124192390524
nl
0.3539124192390524
it
0.3529834651329979
pt
0.3492407809110629
sq
0.3464052287581699
es
0.33135215453194655
da
0.31921331316187596
yo
0.30394431554524365
pl
0.2862807295796987
cs
0.2834394904458599
hr
0.2805755395683453
sk
0.2747784045124899
sl
0.27125506072874495
de
0.2628992628992629
sv
0.24686192468619247
et
0.21671018276762402
fi
0.2
lv
0.18107370336669698
tr
0.16201117318435754
eu
0.13378248315688163
az
0.1141732283464567
lt
0.10358565737051792
hi
0.08536585365853659
reliable
true
passes
true
1
name
"Melanie"
dialogue
"Ich habe es gesehen. Auf dem Bild. Es war dort, zwischen den Bäumen, direkt neben ihr. Und dann war es einfach weg."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8384290330599056
sv
0.5195861049519587
nl
0.41912421805183203
da
0.38967136150234744
es
0.375
eu
0.3394308943089431
no
0.3222106360792492
lt
0.28492849284928495
ca
0.2562929061784897
sk
0.236192714453584
en
0.23258559622195982
lv
0.22341696535244923
cs
0.21780986762936222
ms
0.18444165621079048
sl
0.18238993710691823
sq
0.17302798982188297
is
0.15584415584415584
pl
0.15032679738562094
hu
0.1356382978723404
fi
0.11924119241192413
pt
0.11684782608695651
ro
0.10958904109589042
it
0.10714285714285714
fr
0.10591471801925723
tl
0.09972299168975068
et
0.08835904628330996
hr
0.08835904628330996
tr
0.08835904628330996
az
0.08321579689703808
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Okay, slow down. Did you see Clara? Was anyone with her?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.792861695347355
tl
0.5817245817245817
tr
0.4247787610619469
et
0.34343434343434337
es
0.3380855397148676
pt
0.33264887063655035
ca
0.3229166666666667
ro
0.30997876857749473
nl
0.2919389978213508
da
0.27293064876957496
de
0.268018018018018
az
0.2630385487528345
no
0.25968109339407747
yo
0.2111650485436893
hr
0.19753086419753088
sv
0.19753086419753088
cs
0.1935483870967742
ms
0.1935483870967742
fr
0.1875
reliable
true
passes
true
3
name
"Melanie"
dialogue
"Ich weiß nicht. Ich habe erst später bemerkt, dass ich nicht allein war. Bitte, glauben Sie mir. Ich habe es nicht erfunden."
detectedLang
"de"
heavyLang
"de"
scores
de
0.832977017637627
nl
0.5261561789234268
no
0.41424554826616683
da
0.37996031746031744
sv
0.37624750499001997
es
0.2664319248826291
pl
0.2664319248826291
hu
0.24789410348977134
sk
0.24425634824667475
et
0.23965936739659366
en
0.2331288343558282
fr
0.21383647798742136
it
0.20785804816223066
ca
0.19041450777202074
tr
0.16219839142091153
lv
0.1610738255033557
cs
0.13793103448275862
hr
0.13793103448275862
lt
0.1270949720670391
sq
0.11347517730496455
fi
0.10071942446043164
tl
0.10071942446043164
reliable
true
passes
true
4
name
"Hunter"
dialogue
"I'm sorry, I'm not following. I need you to tell me what you saw. Anything."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8161764705882353
tl
0.6052631578947368
sq
0.45913461538461536
it
0.4532199270959903
no
0.43396226415094336
cs
0.4109947643979057
et
0.39759036144578314
ms
0.3679775280898876
pl
0.3670886075949367
hr
0.3617021276595745
da
0.35064935064935066
yo
0.33234421364985167
sl
0.3171471927162367
sk
0.3119266055045872
pt
0.29467084639498436
lv
0.2913385826771654
lt
0.2706645056726094
nl
0.2647058823529412
tr
0.2474916387959866
ca
0.23469387755102045
sv
0.23469387755102045
es
0.1847826086956522
fr
0.16820702402957485
ro
0.16666666666666666
fi
0.14285714285714285
be
0.1346153846153846
hu
0.12959381044487428
az
0.12280701754385964
is
0.12280701754385964
uk
0.12280701754385964
vi
0.12280701754385964
reliable
true
passes
true
5
name
"Melanie"
dialogue
"Sie verstehen mich nicht, oder? Ich kann nicht... ich weiß nicht, wie ich es Ihnen sagen soll."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8454782042940794
nl
0.488697524219591
pl
0.391025641025641
es
0.3823146944083225
no
0.3356643356643356
ca
0.302496328928047
da
0.2973372781065089
sv
0.27811550151975684
hu
0.26810477657935283
lt
0.26127527216174184
is
0.23387096774193547
sk
0.2070116861435726
lv
0.20168067226890754
eu
0.19491525423728812
cs
0.1739130434782609
fi
0.15630550621669628
et
0.1410488245931284
it
0.1316270566727605
en
0.1171003717472119
fr
0.1171003717472119
pt
0.1171003717472119
az
0.11048689138576778
ro
0.11048689138576778
sq
0.11048689138576778
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Can I see the photo? Maybe the picture can help us understand."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8139880952380952
tl
0.6023329798515377
no
0.5888157894736842
da
0.58006718924972
sv
0.5324189526184538
fr
0.5033112582781457
de
0.4863013698630137
ca
0.4360902255639098
sq
0.43009118541033436
cs
0.4248466257668711
yo
0.4140625
nl
0.4113029827315541
ro
0.39222042139384117
et
0.3832236842105263
hr
0.375
pl
0.35233160621761656
it
0.34895833333333337
sk
0.30037313432835816
tr
0.2816091954022989
az
0.27184466019417475
is
0.267578125
sl
0.1758241758241758
ms
0.17218543046357618
hi
0.17035398230088497
es
0.16666666666666666
pt
0.16666666666666666
be
0.15730337078651685
hu
0.1515837104072398
lt
0.14383561643835618
lv
0.14383561643835618
uk
0.14383561643835618
vi
0.14383561643835618
reliable
true
passes
true
7
name
"Melanie"
dialogue
"Das Gesicht... es hat mich angesehen. Ich habe das Foto dreimal angeschaut, und es sieht immer noch so aus."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8329621380846325
nl
0.5041322314049587
no
0.4163424124513619
en
0.4129158512720157
sk
0.3814432989690722
pt
0.3340732519422864
sl
0.3281075027995521
ca
0.318955732122588
it
0.318955732122588
es
0.3111366245694604
fr
0.2647058823529412
da
0.24433249370277077
sv
0.24242424242424243
hu
0.24050632911392408
lv
0.23371647509578544
pl
0.22879177377892032
tl
0.22077922077922074
ro
0.1758241758241758
yo
0.17355371900826447
hr
0.1712707182320442
eu
0.16083916083916083
vi
0.14163090128755365
lt
0.13169319826338638
fi
0.12790697674418602
tr
0.11504424778761062
is
0.1137370753323486
az
0.11242603550295857
cs
0.08952959028831564
et
0.08952959028831564
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Hey, it's okay. You're safe here. Can you tell me your last name? Where are you staying?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8124012638230649
tl
0.485373781148429
sq
0.4069912609238452
nl
0.33473389355742295
et
0.2658423493044822
ms
0.2543171114599686
de
0.24722662440570525
ro
0.2375601926163724
es
0.17677642980935876
fr
0.1607773851590106
no
0.1607773851590106
pt
0.15630550621669628
sl
0.15630550621669628
it
0.14414414414414414
cs
0.1410488245931284
az
0.1394927536231884
ca
0.1394927536231884
tr
0.1394927536231884
fi
0.13636363636363635
reliable
true
passes
true
9
name
"Melanie"
dialogue
"Nein. Nein, nein."
detectedLang
"de"
heavyLang
""
scores
de
0.8076923076923077
reliable
false
passes
true
10
name
"Hunter"
dialogue
"Hunter. ...Yeah. Where? ...Got it. I'm ten minutes out."
detectedLang
"en"
heavyLang
"en"
scores
en
0.800266311584554
de
0.5073891625615764
tl
0.504950495049505
sq
0.48805460750853247
fr
0.44547134935304994
nl
0.41972920696324956
ca
0.40828402366863903
cs
0.3670886075949367
sk
0.3670886075949367
pl
0.3644067796610169
lt
0.34497816593886466
da
0.33184855233853006
no
0.3258426966292135
et
0.3227990970654628
sv
0.3181818181818182
sl
0.30394431554524365
it
0.3023255813953488
ro
0.3006993006993007
pt
0.29577464788732394
ms
0.2822966507177033
lv
0.2227979274611399
yo
0.20212765957446807
fi
0.1935483870967742
es
0.18256130790190736
hr
0.18256130790190736
tr
0.16434540389972147
reliable
true
passes
true
11
name
"Hunter"
dialogue
"I have to go. This is my number. If you remember anything else, call me. Okay? Call me."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8226321390564031
tl
0.6456413890857547
yo
0.5495495495495496
da
0.5238095238095238
no
0.5083579154375615
pl
0.47970863683662857
nl
0.4617868675995694
sk
0.4553376906318083
cs
0.4444444444444444
hu
0.44320712694877507
sv
0.4369369369369369
sq
0.4331065759637188
sl
0.4026284348864994
ms
0.40119760479041916
et
0.3857493857493857
is
0.38195302843016066
hr
0.33774834437086093
it
0.2805755395683453
fr
0.27641099855282203
lv
0.27007299270072993
lt
0.25037481259370314
de
0.2378048780487805
ca
0.2163009404388715
es
0.16943521594684383
ro
0.15254237288135594
pt
0.14965986394557826
fi
0.13043478260869565
be
0.12280701754385964
tr
0.12280701754385964
az
0.11190053285968028
uk
0.11190053285968028
vi
0.11190053285968028
reliable
true
passes
true
12
name
"Melanie"
dialogue
"Ich verstehe Sie nicht. Aber ich... ich rufe an. Versprochen."
detectedLang
"de"
heavyLang
"de"
scores
de
0.8336745138178095
nl
0.48657187993680884
sv
0.4257950530035336
pl
0.411231884057971
en
0.37137330754352027
ro
0.32432432432432434
da
0.32150313152400833
fr
0.3055555555555556
no
0.2995689655172413
sk
0.27616926503340755
vi
0.2511520737327189
eu
0.24242424242424243
cs
0.23529411764705882
yo
0.2243436754176611
ms
0.19753086419753088
lt
0.19154228855721395
hu
0.181360201511335
it
0.181360201511335
tr
0.1792929292929293
is
0.1709183673469388
es
0.16237113402061853
pt
0.16237113402061853
az
0.15364583333333331
ca
0.15364583333333331
sq
0.15364583333333331
reliable
true
passes
true