Run: 2026-02-08-01KGZ069TP1NQN79FRB7VBE4QC

Run Details

Model:
Claude Haiku 4.5
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
12.2s
Cost:
$0.004372
Provider:
Anthropic

Evaluation summary

Score Evaluator
Details Link
52.63% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
# Voice Sheet: Cafe Encounter **SETTING: Alborn Cafe, late afternoon. SELVI sits at a corner table, reviewing photos on her camera. HUNTER approaches, his detective's notebook in hand.** --- Selvi: *(looking up, startled)* "Haan? Kya... kya aap mujhe dhundh rahe the?" Hunter: "Miss, I'm Detective Hunter. I'm investigating some incidents that happened around town. Were you here last Tuesday evening?" Selvi: *(voice trembling, clutching her camera)* "Main... main samajh nahi rahi. English... main English nahi bolti." Hunter: *(pausing, frustrated)* "Do you... speak English at all?" Selvi: *(shaking her head, speaking slowly)* "No. No English. Hindi. Sirf Hindi." Hunter: *(sighing, pulling out his notebook anyway)* "Okay. Look, there were some disappearances. Two people missing. You see anything unusual? Anything at all?" Selvi: *(distressed, hands shaking)* "Aapne kaha... gum? Kya matlab gum? Bhagwan! Yeh shahar bahut khatra hai! Meine kal raat kuch ajeeb avaaz suni." Hunter: "I have no idea what you're saying, ma'am. Do you have anyone who speaks Hindi? Anyone who can translate?" Selvi: *(looking around frantically, then back at her camera)* "Mere... mere hostel mein. Ek ladka hai. Voh English bolte hain. Lekin main aapko batana chahti hoon—yeh bahut important hai!" Hunter: *(leaning against the table)* "Can you show me your camera? These photos—did you take them here in town?" Selvi: *(nodding urgently, turning the camera screen toward him)* "Haan, haan! Landscape photography. Magar ek photo... ek photo mein kuch ajeeb dikhta hai. Behind the old mill. Main nahi samajh paayi pehle." Hunter: *(studying the screen intently)* "This is the old mill location. When was this taken?" Selvi: "Tuesday. Tuesday ko. Subah nahin, raat ko." Hunter: "Night? You were out at the mill at—" *Hunter's phone BUZZES. He checks it, his expression hardening.* Hunter: "Damn it. I have to go. There's been another—" *(stops himself)* "I need that translation. Get someone from your hostel to call me. Today. You understand? Phone. Now." Selvi: *(frantically)* "Haan! Haan, main karta hoon! Lekin detective sahab, main dar gayi hoon. Yeh mill... kuch bura hai vahan." Hunter: *(already backing away)* "Just call me. And don't go back to that mill. Understood?" Selvi: *(whispering)* "Understood. Lekin phir se kaha—main samajh nahin rahi jab aapne kaha 'disappearances.'" Hunter: *(into his phone as he walks away)* "Yeah, I'm heading there now..." *SELVI sits alone at the table, clutching her camera, deeply troubled.* ---
created_at"2026-02-08T16:08:52.647554+00:00" 2/8/2026, 4:08:52 PM
model"anthropic/claude-4.5-haiku-20251001"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2507
moderation_latency(null)
generation_time11867
tokens_prompt262
tokens_completion684
native_tokens_prompt307
native_tokens_completion813
native_tokens_completion_images(null)
native_tokens_reasoning0
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.004372
router(null)
provider_responses
0
id"msg_01VpVUk1eTrTNE4hmTmW277C"
status200
is_byokfalse
latency2507
endpoint_id"41d2915a-92e6-4993-b537-210b4e10cba8"
provider_name"Anthropic"
model_permaslug"anthropic/claude-4.5-haiku-20251001"
api_type"completions"
id"gen-1770566920-I3xcwl8mUROYlB6sr7hD"
upstream_id"msg_01VpVUk1eTrTNE4hmTmW277C"
total_cost0.004372
cache_discount(null)
upstream_inference_cost0
provider_name"Anthropic"

Evaluation details

Result Evaluator Details Meta Data
52.63% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Haan? Kya... kya aap mujhe dhundh rahe the?"
detectedLang"en"
heavyLang"ga"
scores
en0.4498777506112469
sq0.4485294117647059
yo0.32228915662650603
tl0.3161094224924012
no0.296875
nl0.27184466019417475
da0.25742574257425743
fr0.25742574257425743
ms0.25742574257425743
sv0.25742574257425743
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Miss, I'm Detective Hunter. I'm investigating some incidents that happened around town. Were you here last Tuesday evening?"
detectedLang"en"
heavyLang"en"
scores
en0.8194511314395763
tl0.6893123446561723
ro0.5341614906832298
nl0.5101241018941869
pt0.5003331112591606
fr0.4969818913480885
it0.4755244755244755
ca0.46504992867332384
no0.4485294117647059
da0.423963133640553
es0.4204018547140649
sv0.4204018547140649
de0.4028662420382166
sq0.36386768447837153
sl0.3368700265251989
cs0.3112947658402204
hr0.3055555555555556
et0.26108374384236455
is0.24849699398797598
ms0.22118380062305293
sk0.20802534318901794
az0.20042643923240938
lt0.19786096256684493
lv0.18211559432933477
fi0.07292954264524104
tr0.07292954264524104
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main... main samajh nahi rahi. English... main English nahi bolti."
detectedLang"en"
heavyLang"tl"
scores
en0.5810055865921787
is0.5770676691729324
no0.44717444717444715
eu0.4230769230769231
da0.412532637075718
sv0.40318302387267907
de0.39999999999999997
ms0.3885869565217392
it0.3571428571428572
et0.3161094224924012
fi0.3161094224924012
lv0.30124223602484473
tl0.30124223602484473
fr0.281150159744409
hr0.24242424242424243
ro0.24242424242424243
reliablefalse
passesfalse
3
name"Hunter"
dialogue"Do you... speak English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8242530755711776
tl0.6825396825396826
no0.6138996138996139
da0.5525727069351231
cs0.51338199513382
hr0.4897959183673469
sq0.48586118251928023
pt0.43820224719101125
de0.4186046511627907
sv0.4186046511627907
pl0.41690962099125367
sk0.39759036144578314
sl0.375
vi0.35691318327974275
et0.3055555555555556
yo0.2805755395683453
it0.2647058823529412
ms0.2647058823529412
ro0.2647058823529412
reliabletrue
passestrue
4
name"Selvi"
dialogue"No. No English. Hindi. Sirf Hindi."
detectedLang"tl"
heavyLang"tl"
scores
tl0.722735674676525
en0.6788008565310492
it0.5481927710843374
no0.5440729483282675
hr0.5356037151702787
pt0.4791666666666667
es0.47735191637630664
ca0.47368421052631576
lv0.46619217081850534
is0.3951612903225807
et0.38524590163934425
sk0.3775933609958506
tr0.3697478991596639
sq0.3670886075949367
hi0.34210526315789475
pl0.3333333333333333
da0.32432432432432434
de0.32432432432432434
ms0.32432432432432434
ro0.32432432432432434
sv0.32432432432432434
reliabletrue
passesfalse
5
name"Hunter"
dialogue"Okay. Look, there were some disappearances. Two people missing. You see anything unusual? Anything at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8131539611360238
tl0.5912361020274689
et0.4064577397910731
fr0.3811881188118812
ms0.36740890688259115
de0.3400211193241816
no0.3379237288135593
da0.3343982960596379
pt0.3265086206896552
nl0.31015452538631344
sq0.2857142857142857
it0.2638398115429918
ca0.26297169811320753
sv0.21185372005044137
es0.20986093552465232
is0.19562419562419564
cs0.11095305832147938
fi0.11095305832147938
lv0.10586552217453504
az0.09420289855072464
reliabletrue
passestrue
6
name"Selvi"
dialogue"Aapne kaha... gum? Kya matlab gum? Bhagwan! Yeh shahar bahut khatra hai! Meine kal raat kuch ajeeb avaaz suni."
detectedLang"de"
heavyLang"et"
scores
de0.2686890574214518
ms0.23728813559322032
sq0.21236872812135354
no0.20118343195266272
vi0.18870192307692307
tr0.1346153846153846
it0.12903225806451613
et0.11994784876140809
fr0.11994784876140809
hr0.1141732283464567
nl0.11300919842312747
is0.10358565737051792
lv0.10239361702127658
ro0.10239361702127658
reliablefalse
passesfalse
7
name"Hunter"
dialogue"I have no idea what you're saying, ma'am. Do you have anyone who speaks Hindi? Anyone who can translate?"
detectedLang"en"
heavyLang"en"
scores
en0.7923156801661475
tl0.6254681647940075
ca0.455535390199637
hr0.453551912568306
it0.42028985507246375
pl0.40828402366863903
sq0.40594059405940597
tr0.39879759519038077
no0.3877551020408163
cs0.38461538461538464
pt0.3839835728952772
sk0.3736951983298539
et0.3717277486910995
da0.3677555321390938
es0.3340732519422864
vi0.30394431554524365
lv0.30313588850174217
ro0.2998833138856476
az0.2490613266583229
sv0.24717691342534504
sl0.22978177150192552
yo0.21568627450980393
is0.21156373193166886
ms0.1847826086956522
lt0.1780821917808219
fr0.11764705882352942
hi0.11504424778761062
be0.1044776119402985
de0.10044977511244377
eu0.10044977511244377
hu0.10044977511244377
nl0.09502262443438914
uk0.09502262443438914
reliabletrue
passestrue
8
name"Selvi"
dialogue"Mere... mere hostel mein. Ek ladka hai. Voh English bolte hain. Lekin main aapko batana chahti hoon—yeh bahut important hai!"
detectedLang"en"
heavyLang"ber"
scores
en0.47405329593267886
it0.3985565356856456
fr0.38016528925619836
ca0.37027707808564225
ro0.35842600513259193
tl0.3567753001715266
eu0.3345164152617569
da0.32915921288014316
es0.3119266055045872
pt0.3119266055045872
nl0.2795389048991354
fi0.27606177606177607
de0.2682926829268293
et0.25224327018943166
no0.22680412371134018
ms0.2227979274611399
is0.2046659597030753
tr0.20382165605095542
sq0.18655097613882862
vi0.1730981256890849
hr0.1601343784994401
sv0.156355455568054
cs0.1039426523297491
az0.09638554216867469
sk0.09310761789600969
lt0.08647990255785627
sl0.08647990255785627
reliablefalse
passesfalse
9
name"Hunter"
dialogue"Can you show me your camera? These photos—did you take them here in town?"
detectedLang"en"
heavyLang"en"
scores
en0.8168892718655751
tl0.576271186440678
it0.532967032967033
nl0.5219347581552306
fr0.4509043927648579
sq0.4501940491591203
sl0.42953020134228187
ms0.4209809264305177
ro0.41379310344827586
de0.40559440559440557
es0.39801699716713884
ca0.37037037037037035
pt0.3656716417910448
sv0.3078175895765472
az0.2747440273037543
et0.18269230769230768
no0.17635658914728683
yo0.17153996101364524
pl0.1650294695481336
lt0.15841584158415842
cs0.1550695825049702
hi0.1533864541832669
tr0.1533864541832669
fi0.15
lv0.1431451612903226
reliabletrue
passestrue
10
name"Selvi"
dialogue"Haan, haan! Landscape photography. Magar ek photo... ek photo mein kuch ajeeb dikhta hai. Behind the old mill. Main nahi samajh paayi pehle."
detectedLang"en"
heavyLang"et"
scores
en0.6309963099630996
fr0.43977591036414565
tl0.41219691403379866
eu0.3277310924369748
no0.3265993265993266
de0.3144815766923736
sv0.30855661192739847
is0.26672777268560954
nl0.25857275254865614
da0.2530345471521942
ms0.21491658488714427
et0.18032786885245902
it0.17695473251028807
vi0.16405433646812956
tr0.12280701754385964
yo0.11797133406835722
fi0.11504424778761062
lv0.10813823857302118
hu0.10714285714285714
cs0.0990990990990991
ca0.09502262443438914
pt0.09502262443438914
sq0.0888382687927107
hi0.08779931584948689
es0.08571428571428572
ro0.08256880733944955
reliabletrue
passesfalse
11
name"Hunter"
dialogue"This is the old mill location. When was this taken?"
detectedLang"en"
heavyLang"en"
scores
en0.8357064622124862
nl0.7093023255813954
tl0.6677740863787376
yo0.6178343949044587
fr0.6057818659658344
sv0.5542347696879644
de0.5334370139968896
da0.49409780775716694
no0.47368421052631576
hu0.33920704845814975
sq0.33035714285714285
ro0.2647058823529412
pt0.25742574257425743
ca0.24433249370277077
es0.23857868020304565
is0.23469387755102045
it0.23273657289002556
fi0.21465968586387435
ms0.20634920634920634
sk0.20634920634920634
sl0.20634920634920634
zh0.20424403183023873
tr0.1891891891891892
reliabletrue
passestrue
12
name"Selvi"
dialogue"Tuesday. Tuesday ko. Subah nahin, raat ko."
detectedLang"tl"
heavyLang"en"
scores
tl0.7487437185929648
eu0.5575221238938053
en0.5348837209302325
yo0.3957703927492447
sl0.38650306748466257
lv0.38080495356037153
ms0.36908517350157727
lt0.3220338983050847
reliabletrue
passesfalse
13
name"Hunter"
dialogue"Night? You were out at the mill at—"
detectedLang"en"
heavyLang"en"
scores
en0.8356614626129828
tl0.7655334114888629
da0.6204933586337761
no0.6175908221797323
yo0.47506561679790027
fr0.4318181818181818
nl0.29577464788732394
cs0.2805755395683453
ms0.2805755395683453
sq0.2805755395683453
sv0.2805755395683453
de0.27007299270072993
reliabletrue
passestrue
14
name"Hunter"
dialogue"I need that translation. Get someone from your hostel to call me. Today. You understand? Phone. Now."
detectedLang"en"
heavyLang"en"
scores
en0.8190423162583519
tl0.6114763897190676
da0.5798319327731093
no0.5460893854748603
nl0.5116453794139745
sv0.48657187993680884
de0.46236559139784944
cs0.45561139028475717
fr0.4500846023688663
et0.4333042720139495
yo0.4257950530035336
sk0.39981532779316714
sq0.39478584729981375
pl0.3862134088762984
es0.35770750988142297
pt0.3486973947895792
hr0.3285123966942149
vi0.30406852248394006
sl0.2919389978213508
it0.28414096916299564
lv0.2793791574279379
ro0.2753623188405797
is0.26719278466741825
lt0.2647058823529412
ms0.2537313432835821
ca0.24681344148319811
tr0.23798358733880423
fi0.19454770755885997
az0.15803108808290156
zh0.10591471801925723
be0.09722222222222222
eu0.09344490934449094
hu0.09344490934449094
uk0.08835904628330996
reliabletrue
passestrue
15
name"Selvi"
dialogue"Haan! Haan, main karta hoon! Lekin detective sahab, main dar gayi hoon. Yeh mill... kuch bura hai vahan."
detectedLang"ro"
heavyLang"et"
scores
ro0.4615384615384615
en0.43426724137931033
tl0.4061085972850679
ms0.4006849315068493
it0.3951612903225807
es0.3937644341801385
pt0.39165701042873696
fr0.34863523573200994
lt0.34782608695652173
ca0.3225806451612903
fi0.31462140992167104
sq0.3018617021276596
de0.3
eu0.2895805142083897
no0.284741144414169
sv0.27184466019417475
cs0.2698191933240611
et0.2510699001426534
tr0.24132947976878616
az0.23802612481857763
vi0.23020527859237538
is0.22337278106508876
da0.21407185628742514
hr0.1935483870967742
lv0.1935483870967742
sl0.1935483870967742
pl0.18856259659969088
nl0.13509060955518945
sk0.10102739726027396
reliablefalse
passesfalse
16
name"Hunter"
dialogue"Just call me. And don't go back to that mill. Understood?"
detectedLang"en"
heavyLang"en"
scores
en0.821882951653944
tl0.609375
no0.5382585751978892
pl0.47839046199701935
sv0.4720965309200603
yo0.4720965309200603
da0.4672754946727549
sk0.38704028021015763
cs0.3805309734513274
sl0.3738819320214669
et0.360146252285192
nl0.32432432432432434
sq0.29718875502008035
lv0.2584745762711864
hr0.24892703862660948
lt0.2290748898678414
es0.22566371681415928
de0.21348314606741572
fr0.20634920634920634
pt0.2009132420091324
ms0.1935483870967742
it0.18604651162790697
ca0.18032786885245902
fi0.1764705882352941
reliabletrue
passestrue
17
name"Selvi"
dialogue"Understood. Lekin phir se kaha—main samajh nahin rahi jab aapne kaha 'disappearances.'"
detectedLang"en"
heavyLang"tl"
scores
en0.5043103448275862
tl0.4508118433619866
fr0.40843621399176955
no0.3997912317327766
da0.3985355648535565
sv0.3960084033613445
fi0.34285714285714286
eu0.33831990794016115
cs0.2767295597484277
es0.2758186397984887
pt0.25130208333333337
is0.2483660130718954
de0.23128342245989306
lv0.2292225201072386
ca0.22818791946308725
sk0.22506738544474394
hr0.18785310734463279
sl0.18670438472418668
ro0.1726618705035971
sq0.16302765647743814
yo0.15689149560117305
et0.1531664212076583
it0.14434523809523808
nl0.1274658573596358
pl0.11944869831546708
ms0.10990712074303406
reliablefalse
passesfalse
18
name"Hunter"
dialogue"Yeah, I'm heading there now..."
detectedLang"en"
heavyLang"en"
scores
en0.8184647302904563
de0.5042492917847025
nl0.39236111111111116
tl0.37275985663082434
ms0.36823104693140796
no0.3346007604562738
da0.31906614785992216
sq0.308300395256917
is0.29149797570850206
sk0.29149797570850206
reliabletrue
passestrue