NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-25-01KQ2EPY8Z20BQFD0E3JZH6R89
Run Details
Model:
DeepSeek V4 Pro
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
52.3s
Cost:
$0.004360
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
60.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Selvi:** (Staring at the digital screen, her brow furrowed in concentration and a faint tremor in her hands. She whispers to herself in Hindi) *Yeh… yeh kaise ho sakta hai? Woh toh bas ped ke paas gaya tha…* (How… how is this possible? He only went near the tree…) **Hunter:** (Approaching the table, his posture is straight, notepad in hand but not open.) Excuse me, miss. Mind if I sit? You were out by the old Patterson orchard this morning, correct? We’re asking around about an incident out there. **Selvi:** (Jumps slightly, clutching the camera protectively to her chest. Looks up at Hunter with wide, shaken eyes.) *Main… main us aadmi ke baare mein nahin jaanti. Main sirf tasveerein le rahi thi. Phir woh dhund mein… kho gaya. Bilkul kho gaya.* (I… I don't know about that man. I was only taking pictures. Then he, in the mist… got lost. Completely lost.) **Hunter:** (Frowns, turning his ear slightly towards her as if trying to catch a familiar word. He gestures vaguely at her camera.) I’m sorry, I don’t… your camera. Photos. Did you take photos there? Of the trees, the fog? Anything… strange? **Selvi:** (Nodding rapidly, a desperate look in her eyes. She thrusts the camera towards him, pointing at the screen.) *Aap dekhiye! Yeh dekhiye! Koi nishan nahin. Jaise dhund ne use… nigal liya.* (You look! Look at this! No trace. As if the mist… swallowed him.) *Woh aadmi. Woh lamba aadmi. Kuch hi second mein gayab.* (That man. That tall man. Disappeared in just a few seconds.) **Hunter:** (Leaning over, squinting at the screen which shows a picture of the orchard’s edge, fog swirling unnaturally thick around a gnarled apple tree. He looks from the picture to heruncing, trying to bridge the gap.) That’s a weird fog, alright. The man… was he here? (Points to the picture, then makes a walking motion with his fingers off the edge of the table.) Walk away? **Selvi:** (Shakes her head violently, her long black hair swishing.) *Nahin! Nahin gaya. Gayab! Woh jaadu tha? Koi bhoot tha?* (No! Didn’t walk away. Vanished! Was it magic? Was it a ghost?) (Her voice catches, and she begins to tremble again, covering her mouth with her hand.) *Main ghar jaana chahti hoon. Yeh sheher…* (I want to go home. This town…) **Hunter:** (Scratches the back of his neck, a mixture of frustration and concern on his face. He speaks slowly, deliberately.) Okay. Okay. You’re scared. I get it. Magic? No. No magic. Just… a bad situation. (A distinct, insistent ringtone chimes from Hunter’s coat. He holds up a finger to Selvi, his expression hardening.) **Hunter:** Just a second. (Answers the phone) Dawson. … Yeah. … You’re kidding. Right now? Secure the area; I’m on my way. (He ends the call, his jaw tight. He gives Selvi one last, long, helpless look.) **Hunter:** I’m sorry. I have to go. Stay here. Don’t go anywhere. I’ll find someone to… (He stops, realizing the futility of his words. He points firmly at her, then at the bench, then at the cafe interior.) Here. Stay. Understand? (He doesn't wait for a response, turning and striding quickly away, leaving Selvi alone, shaking and clutching her camera in the silent, sunny cafe.)
created_at
"2026-04-25T13:54:25.359Z"
4/25/2026, 1:54:25 PM
model
"deepseek/deepseek-v4-pro-20260423"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1587
moderation_latency
(null)
generation_time
46119
tokens_prompt
315
tokens_completion
832
native_tokens_prompt
268
native_tokens_completion
863
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00436
router
(null)
provider_responses
0
endpoint_id
"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
is_byok
false
latency
273
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"DeepSeek"
status
429
1
endpoint_id
"13bda129-f8a6-4a60-b1db-98082e5f7ccd"
id
"ogZUWPd-6z2FuN-9f1dd6ee63e92710"
is_byok
false
latency
1587
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"Together"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777125265-IZbmRNRzCKWj7h3b6Agb"
session_id
(null)
api_type
"completions"
id
"gen-1777125265-GOT1b7lCw0EwCY9xc2ZB"
upstream_id
"ogZUWPd-6z2FuN-9f1dd6ee63e92710"
total_cost
0.00436
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
60.00%
Parse dialogue
n/a
dialogue
0
name
"Selvi"
dialogue
"Yeh… yeh kaise ho sakta hai? Woh toh bas ped ke paas gaya tha…"
detectedLang
"ms"
heavyLang
"de"
scores
ms
0.4755244755244755
sq
0.4427934621099554
fr
0.37080536912751677
cs
0.3578767123287671
it
0.35456110154905335
no
0.33274021352313166
vi
0.2951127819548872
ca
0.24242424242424243
tl
0.2299794661190965
sk
0.22839506172839508
fi
0.21875
tr
0.20550847457627117
yo
0.19006479481641467
en
0.17218543046357618
et
0.17218543046357618
is
0.16851441241685144
sv
0.16851441241685144
reliable
false
passes
false
1
name
"Hunter"
dialogue
"Excuse me, miss. Mind if I sit? You were out by the old Patterson orchard this morning, correct? We’re asking around about an incident out there."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8026179098275504
tl
0.5912220309810671
no
0.5155532891381948
nl
0.4850948509485095
da
0.4671901289960741
fr
0.44735311227457825
sv
0.4411764705882353
de
0.4341870160810006
sq
0.39759036144578314
it
0.3914157591287636
ro
0.34346924671734624
pt
0.32767162066525124
ca
0.3209435310936383
cs
0.31654676258992803
et
0.28301886792452835
es
0.2669753086419753
sk
0.2618492618492619
is
0.24901185770750986
pl
0.24841772151898736
yo
0.23263327948303714
ms
0.2030201342281879
sl
0.18594687232219365
hu
0.18384879725085912
az
0.17962003454231434
hr
0.17247386759581881
vi
0.1532976827094474
tr
0.12923923006416133
lt
0.11380597014925374
eu
0.09867172675521822
fi
0.07317073170731707
be
0.06862745098039216
lv
0.06219151036525173
uk
0.06219151036525173
reliable
true
passes
true
2
name
"Selvi"
dialogue
"Main… main us aadmi ke baare mein nahin jaanti. Main sirf tasveerein le rahi thi. Phir woh dhund mein… kho gaya. Bilkul kho gaya."
detectedLang
"tl"
heavyLang
"tl"
scores
tl
0.4701726844583987
de
0.41760138050043144
ms
0.32160804020100503
et
0.2749731471535983
fr
0.2749731471535983
it
0.27341227125941875
yo
0.23728813559322032
en
0.23208191126279862
es
0.2232451093210587
sl
0.21420256111757857
ro
0.2114485981308411
sq
0.20306965761511217
cs
0.20118343195266272
vi
0.18674698795180722
eu
0.17883211678832117
hu
0.12677878395860284
is
0.1222366710013004
lt
0.11533420707732633
nl
0.11533420707732633
ca
0.09999999999999999
lv
0.09999999999999999
pt
0.09999999999999999
hr
0.09029649595687331
sk
0.09029649595687331
tr
0.09029649595687331
reliable
false
passes
false
3
name
"Hunter"
dialogue
"I’m sorry, I don’t… your camera. Photos. Did you take photos there? Of the trees, the fog? Anything… strange?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8059229442208166
tl
0.6679783571077226
de
0.46
no
0.43703085904920774
nl
0.43656093489148584
fr
0.4186046511627907
it
0.40318302387267907
sq
0.39946619217081847
da
0.3795955882352941
ca
0.3784530386740331
sv
0.35406698564593303
ms
0.35344827586206895
ro
0.3236472945891784
yo
0.31262729124236255
cs
0.2826780021253985
hr
0.2524916943521595
et
0.2474916387959866
is
0.24496644295302009
lt
0.23728813559322032
lv
0.23208191126279862
pl
0.23208191126279862
hu
0.21420256111757857
pt
0.21052631578947367
es
0.20960187353629978
sl
0.19738406658739593
sk
0.19161676646706588
tr
0.16044776119402984
az
0.15307402760351316
hi
0.10239361702127658
be
0.09395973154362416
uk
0.08536585365853659
vi
0.08536585365853659
reliable
true
passes
true
4
name
"Selvi"
dialogue
"Aap dekhiye! Yeh dekhiye! Koi nishan nahin. Jaise dhund ne use… nigal liya. Woh aadmi. Woh lamba aadmi. Kuch hi second mein gayab."
detectedLang
"tl"
heavyLang
"et"
scores
tl
0.48735475051264526
en
0.36278674596431604
fr
0.34497816593886466
ca
0.2401215805471125
sq
0.2260061919504644
it
0.21301154249737672
ro
0.19093851132686085
eu
0.1638795986622074
sl
0.14578587699316628
de
0.14285714285714285
hr
0.13093858632676708
lt
0.1289198606271777
ms
0.12280701754385964
lv
0.12075029308323564
tr
0.11137440758293839
fi
0.10501193317422433
cs
0.0985576923076923
hu
0.0985576923076923
et
0.09420289855072464
nl
0.09090909090909091
reliable
false
passes
false
5
name
"Hunter"
dialogue
"That’s a weird fog, alright. The man… was he here? Walk away?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7948717948717948
tl
0.6208530805687204
yo
0.5500562429696289
nl
0.5490417136414881
de
0.4845360824742268
da
0.46879150066401065
sq
0.4666666666666667
no
0.4542974079126876
hu
0.40564635958395245
fr
0.4020926756352765
sv
0.40119760479041916
ca
0.3620414673046252
it
0.36
es
0.35064935064935066
lv
0.3079584775086505
lt
0.3055555555555556
fi
0.2779783393501805
ms
0.26062846580406657
pt
0.25925925925925924
ro
0.25788497217068646
cs
0.24812030075187969
sk
0.24528301886792453
hr
0.21875
pl
0.2079207920792079
sl
0.1836734693877551
tr
0.16142557651991615
is
0.15789473684210525
az
0.14893617021276595
eu
0.14893617021276595
vi
0.14893617021276595
et
0.13606911447084233
reliable
true
passes
true
6
name
"Selvi"
dialogue
"Nahin! Nahin gaya. Gayab! Woh jaadu tha? Koi bhoot tha? Main ghar jaana chahti hoon. Yeh sheher…"
detectedLang
"tl"
heavyLang
"tlh"
scores
tl
0.3840985442329227
et
0.3064312736443884
fi
0.2939666238767651
de
0.24965893587994542
eu
0.2109038737446198
sq
0.17541229385307347
nl
0.16030534351145037
ms
0.15384615384615385
en
0.15254237288135594
fr
0.13793103448275862
reliable
false
passes
false
7
name
"Hunter"
dialogue
"Okay. Okay. You’re scared. I get it. Magic? No. No magic. Just… a bad situation."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7961033076574535
tl
0.6231155778894472
ca
0.5557749259624877
it
0.5535714285714286
sv
0.5522388059701493
ro
0.5436105476673428
fr
0.5243128964059197
da
0.5098039215686274
no
0.5011086474501109
sk
0.49095022624434387
lv
0.48571428571428565
pt
0.48335246842709534
de
0.4809688581314879
hr
0.47976878612716767
es
0.47674418604651164
cs
0.4545454545454546
yo
0.4545454545454546
sq
0.43820224719101125
pl
0.40476190476190477
nl
0.3943472409152086
is
0.34593023255813954
tr
0.3430656934306569
et
0.336283185840708
hu
0.33135215453194655
lt
0.3202416918429003
sl
0.24874791318864775
fi
0.24369747899159663
az
0.22813036020583194
vi
0.22813036020583194
ms
0.21328671328671328
zh
0.14611005692599618
be
0.1346153846153846
eu
0.1346153846153846
uk
0.12280701754385964
reliable
true
passes
true
8
name
"Hunter"
dialogue
"Just a second. Dawson. … Yeah. … You’re kidding. Right now? Secure the area; I’m on my way."
detectedLang
"en"
heavyLang
"en"
scores
en
0.8021760633036598
tl
0.660633484162896
fr
0.47689625108979944
yo
0.38461538461538464
sk
0.37694704049844235
nl
0.3630573248407643
no
0.35275080906148865
et
0.34711643090315564
it
0.3464052287581699
ca
0.34210526315789475
ro
0.33847850055126794
da
0.33774834437086093
cs
0.3281075027995521
pl
0.318955732122588
ms
0.28825622775800713
sv
0.28825622775800713
es
0.2673992673992674
fi
0.26199261992619927
hr
0.25
hu
0.20634920634920634
sq
0.2
is
0.19678714859437751
de
0.1902834008097166
pt
0.1891891891891892
sl
0.13043478260869565
hi
0.12280701754385964
lt
0.12023460410557184
tr
0.1137370753323486
az
0.1044776119402985
eu
0.1044776119402985
lv
0.1044776119402985
vi
0.1044776119402985
reliable
true
passes
true
9
name
"Hunter"
dialogue
"I’m sorry. I have to go. Stay here. Don’t go anywhere. I’ll find someone to… Here. Stay. Understand?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8077595246417336
tl
0.6102055279943304
da
0.5898583146905294
no
0.5004541326067212
pl
0.448345035105316
sv
0.38820912124582874
cs
0.367816091954023
sq
0.36194895591647336
yo
0.35370152761457113
sk
0.3475682087781732
de
0.33008526187576126
hr
0.3167701863354037
it
0.28104575163398693
lv
0.25170068027210885
nl
0.2445054945054945
pt
0.2445054945054945
lt
0.2329149232914923
ro
0.22969187675070027
ca
0.2005813953488372
is
0.19941775836972345
sl
0.18032786885245902
es
0.12420382165605094
be
0.11290322580645161
tr
0.11290322580645161
hu
0.1085899513776337
az
0.10277324632952692
et
0.10277324632952692
uk
0.10277324632952692
vi
0.10277324632952692
reliable
true
passes
true