Run: 2024-08-09-01J4W2AXH9FDPC7CZK5DHNHVBG

Run Details

Model:
DeepSeek-V2 Chat
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
22.6s
Cost:
$0.000173
Provider:
DeepSeek

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "यहाँ पर हाल ही में हुआ वह घटना बहुत ही भयानक थी। मैं इसके बारे में बहुत परेशान हूँ।" Hunter: "Excuse me, miss, I'm Detective Hunter. I'm investigating some recent events in town. Can you tell me if you've seen anything unusual?" Selvi: "मैंने देखा कि कुछ लोग गायब हो गए हैं। यह बहुत ही डरावना है।" Hunter: "I'm sorry, I don't understand Hindi. Can you speak English?" Selvi: "मैं अंग्रेजी नहीं बोल सकती। मैं वाकई में घबरा गई हूँ।" Hunter: "I see. Well, if you remember anything or if you learn English, please contact me. Here's my card." Selvi: "धन्यवाद। मैं आपकी मदद करने की कोशिश करूँगी।" Hunter: "Thank you. I have to take this call. Stay safe."
id"gen-2IswgSb2n3zHB6x8KtiGAJ3ckqOi"
total_cost0.00017262
upstream_id"d11d15bd20443025bdc1ebd75408da48"
created_at"2024-08-09T17:18:07.666707+00:00" 8/9/2024, 5:18:07 PM
model"deepseek/deepseek-chat"
app_id182717
streamedfalse
cancelledfalse
provider_name"DeepSeek"
latency22174
moderation_latency(null)
generation_time0
finish_reason"stop"
tokens_prompt273
tokens_completion365
native_tokens_prompt297
native_tokens_completion468
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00017262

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"यहाँ पर हाल ही में हुआ वह घटना बहुत ही भयानक थी। मैं इसके बारे में बहुत परेशान हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8808916113663434
mr0.8745744490234725
reliabletrue
passestrue
1
name"Hunter"
dialogue"Excuse me, miss, I'm Detective Hunter. I'm investigating some recent events in town. Can you tell me if you've seen anything unusual?"
detectedLang"en"
heavyLang"en"
scores
en0.7910863509749304
tl0.5995145631067961
ro0.5449531163816878
pt0.5166959578207382
nl0.5132743362831859
fr0.5062836624775583
it0.5021122510561256
sv0.4869402985074627
ca0.47115384615384615
es0.4391570360299116
de0.4186046511627907
sl0.4030390738060782
ms0.389792899408284
no0.38661710037174724
sq0.3857036485480268
da0.3519245875883739
cs0.34
hr0.2881794650560828
et0.2850953206239168
sk0.25876010781671155
az0.25271739130434784
lt0.1863905325443787
lv0.16834677419354838
pl0.15644171779141106
is0.14330218068535827
tr0.14151925078043703
fi0.1397288842544317
yo0.09638554216867469
reliabletrue
passestrue
2
name"Selvi"
dialogue"मैंने देखा कि कुछ लोग गायब हो गए हैं। यह बहुत ही डरावना है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8815700428603654
mr0.8722938457796157
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, I don't understand Hindi. Can you speak English?"
detectedLang"en"
heavyLang"en"
scores
en0.7812660833762224
tl0.6333045729076789
no0.5521601685985247
da0.5464247598719317
sv0.49763593380614657
it0.4272237196765499
cs0.38583815028901736
de0.38405797101449274
ro0.35703479576399394
is0.356060606060606
sq0.34210526315789475
ca0.3359375
hr0.33176100628930816
pl0.32432432432432434
nl0.2951907131011609
sk0.2747440273037543
et0.2697594501718213
tr0.256993006993007
az0.247787610619469
pt0.1904761904761905
yo0.169921875
hi0.1550695825049702
ms0.1448692152917505
be0.1414141414141414
hu0.1361788617886179
lt0.1290983606557377
lv0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
4
name"Selvi"
dialogue"मैं अंग्रेजी नहीं बोल सकती। मैं वाकई में घबरा गई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8830213903743316
mr0.8710707269155207
reliabletrue
passestrue
5
name"Hunter"
dialogue"I see. Well, if you remember anything or if you learn English, please contact me. Here's my card."
detectedLang"en"
heavyLang"en"
scores
en0.8183139534883721
tl0.5993589743589743
nl0.4531933508311461
no0.43946188340807174
ms0.4369369369369369
fr0.4292237442922375
sv0.423963133640553
da0.4164332399626517
et0.39379243452958296
sq0.37934458788480635
ro0.378727634194831
sk0.3718592964824121
cs0.35500515995872034
it0.34141201264488935
es0.32505399568034554
yo0.30632630410654826
ca0.2937853107344633
hu0.2807825086306099
de0.2672919109026964
pt0.259478672985782
pl0.2586002372479241
is0.2577197149643705
sl0.2568370986920333
hr0.25239234449760767
fi0.10714285714285714
be0.10071942446043164
tr0.10071942446043164
az0.09156976744186046
lt0.09156976744186046
lv0.09156976744186046
uk0.09156976744186046
vi0.09156976744186046
reliabletrue
passestrue
6
name"Selvi"
dialogue"धन्यवाद। मैं आपकी मदद करने की कोशिश करूँगी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8791348600508906
mr0.8739049641624635
reliabletrue
passestrue
7
name"Hunter"
dialogue"Thank you. I have to take this call. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8356246264196056
tl0.6037463976945245
da0.5864661654135338
cs0.533106960950764
pl0.4869402985074627
hr0.4811320754716981
no0.48015122873345933
yo0.44889779559118237
vi0.43064182194616984
sk0.4258872651356994
sl0.41983122362869196
lv0.40217391304347827
lt0.3778280542986425
ca0.3341404358353511
sv0.3341404358353511
sq0.3276283618581907
it0.2948717948717949
ro0.24657534246575344
be0.20289855072463767
tr0.20289855072463767
hu0.19590643274853803
az0.1863905325443787
et0.1863905325443787
is0.1863905325443787
uk0.1863905325443787
reliabletrue
passestrue