NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-09-20-01J881B127ZG6DDTVFTQEY684E
Run Details
Model:
Qwen 2.5 72B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
38.2s
Cost:
$0.000527
Provider:
Hyperbolic
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Dialogue between Selvi and Hunter** **[Setting: A cozy cafe in Alborn, MN. The aroma of coffee and baked goods fills the air. Selvi is sitting at a table near the window, her camera in front of her. Hunter approaches and sits down opposite her.]** **Hunter:** "Excuse me, are you Selvi?" **Selvi:** [Looking up, visibly troubled] "हाँ, मैं सेल्वि हूँ। मुझे लगता है कि आप मुझसे कुछ पूछना चाहते हैं।" [Hindi: "Yes, I am Selvi. I think you want to ask me something."] **Hunter:** [Confused, scratching his head] "Uh, I'm Detective Hunter. I'm investigating a recent event in town, and I was hoping you could help me. Do you speak English?" **Selvi:** [Shaken, shaking her head] "नहीं, मुझे अंग्रेजी नहीं आती। मैं हिंदी में बोलूँगी।" [Hindi: "No, I don't speak English. I will speak in Hindi."] **Hunter:** [Frustrated but trying to stay calm] "Okay, I'll try my best. What happened, Selvi? Did you see anything unusual?" **Selvi:** [Her voice trembling] "मैंने आज सुबह अजीब चीज़ें देखी। जंगल के किनारे एक अनजान आदमी था, वह किसी की तलाश कर रहा था। फिर वह अचानक गायब हो गया।" [Hindi: "I saw strange things this morning. There was an unknown man at the edge of the forest, he was looking for someone. Then he suddenly disappeared."] **Hunter:** [Leaning in, trying to understand] "Can you describe the man? Did you see his face?" **Selvi:** [Tears welling up in her eyes] "नहीं, उसका चेहरा छिपा हुआ था। मुझे लगता है कि वह किसी की तलाश में था, लेकिन वह गायब हो गया।" [Hindi: "No, his face was hidden. I think he was looking for someone, but he disappeared."] **Hunter:** [Nodding, trying to piece it together] "I see. Did anyone else see this man? Do you know where he might have gone?" **Selvi:** [Shaking her head] "मुझे नहीं पता। मैं उस स्थान से दूर चली गई क्योंकि मुझे भयभीत था।" [Hindi: "I don't know. I left that place because I was scared."] **Hunter:** [Thinking, then his phone rings] "Excuse me, I need to take this." [Answers the phone] "Hunter here. What do you have?" **Selvi:** [Watching him, still troubled] **Hunter:** [On the phone] "I see. I'll be right there." [Hangs up, looking apologetic] "Selvi, I have to go. But I'll need to speak with you again. Can I find you here?" **Selvi:** [Nodding slowly] "हाँ, मैं यहाँ ही रहूँगी। लेकिन कृपया जल्दी आइए, मुझे इस कार्य के बारे में और बताएं।" [Hindi: "Yes, I'll stay here. But please come back soon and tell me more about this matter."] **Hunter:** [Nodding] "I will. Stay safe, Selvi." [Stands up and leaves the cafe] **[Selvi watches him go, still visibly shaken, and picks up her camera again, her hands trembling.]**
id
"gen-VOYAlRJEvjeQTINwbKBubM5c8qE8"
total_cost
0.0005272
upstream_id
"chat-a7d0e9398cfa4667a84e386117347270"
created_at
"2024-09-20T15:38:57.530586+00:00"
9/20/2024, 3:38:57 PM
model
"qwen/qwen-2.5-72b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Hyperbolic"
latency
355
moderation_latency
(null)
generation_time
36855
finish_reason
"stop"
tokens_prompt
273
tokens_completion
1085
native_tokens_prompt
279
native_tokens_completion
1039
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0005272
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Excuse me, are you Selvi?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.6967071057192374
fi
0.5138888888888888
no
0.5125348189415042
ro
0.4582043343653251
sq
0.4582043343653251
da
0.3902439024390244
es
0.36823104693140796
et
0.35185185185185186
fr
0.34210526315789475
pt
0.3346007604562738
sl
0.3346007604562738
ms
0.32432432432432434
nl
0.32432432432432434
it
0.3137254901960784
cs
0.308300395256917
tl
0.308300395256917
ca
0.3055555555555556
reliable
true
passes
true
1
name
"Selvi"
dialogue
"हाँ, मैं सेल्वि हूँ। मुझे लगता है कि आप मुझसे कुछ पूछना चाहते हैं।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8698239523927597
mr
0.8688483637272046
reliable
true
passes
true
2
name
"Hunter"
dialogue
"Uh, I'm Detective Hunter. I'm investigating a recent event in town, and I was hoping you could help me. Do you speak English?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8069723912026205
tl
0.6409921671018277
ro
0.6097445600756859
pt
0.5866733466933868
nl
0.5810055865921787
fr
0.5784363822176801
it
0.5651027938850817
sv
0.5562130177514794
no
0.518107476635514
ca
0.5149911816578483
de
0.5080500894454383
da
0.492619926199262
cs
0.4907407407407407
hr
0.4850187265917603
sl
0.48178391959798994
sq
0.4731800766283525
es
0.45937090432503275
sk
0.42985487214927437
ms
0.4148936170212766
yo
0.40347071583514105
pl
0.389792899408284
et
0.3373493975903614
az
0.28879310344827586
lt
0.2881794650560828
is
0.2506811989100818
vi
0.2282507015902713
hu
0.21278625954198474
tr
0.19980601357904945
lv
0.19747081712062256
fi
0.19275929549902154
be
0.0782122905027933
eu
0.0782122905027933
uk
0.07094594594594594
reliable
true
passes
true
3
name
"Selvi"
dialogue
"नहीं, मुझे अंग्रेजी नहीं आती। मैं हिंदी में बोलूँगी।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8869509043927648
mr
0.8855461085676913
reliable
true
passes
true
4
name
"Hunter"
dialogue
"Okay, I'll try my best. What happened, Selvi? Did you see anything unusual?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.7749881572714353
tl
0.5315581854043393
et
0.36666666666666664
nl
0.2813918305597579
no
0.26242236024844723
cs
0.2566510172143975
ms
0.24603174603174602
da
0.1908006814310051
fi
0.18803418803418803
sq
0.1739130434782609
pl
0.16225749559082892
is
0.1532976827094474
sk
0.1532976827094474
ca
0.1394927536231884
es
0.1394927536231884
pt
0.1394927536231884
reliable
true
passes
true
5
name
"Selvi"
dialogue
"मैंने आज सुबह अजीब चीज़ें देखी। जंगल के किनारे एक अनजान आदमी था, वह किसी की तलाश कर रहा था। फिर वह अचानक गायब हो गया।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8792134831460674
mr
0.8739594325243287
reliable
true
passes
true
6
name
"Hunter"
dialogue
"Can you describe the man? Did you see his face?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8318042813455658
es
0.5242214532871973
tl
0.5036101083032491
fr
0.47619047619047616
ro
0.4387755102040817
da
0.4294605809128631
sv
0.4270833333333333
no
0.4073275862068965
nl
0.4008714596949891
pt
0.39560439560439564
ca
0.39293598233995586
et
0.3820224719101124
de
0.2966751918158568
lv
0.2819843342036553
yo
0.2801047120418848
lt
0.25474254742547425
cs
0.22096317280453256
ms
0.22096317280453256
sq
0.22096317280453256
az
0.21875
tr
0.21875
it
0.21203438395415475
reliable
true
passes
true
7
name
"Selvi"
dialogue
"नहीं, उसका चेहरा छिपा हुआ था। मुझे लगता है कि वह किसी की तलाश में था, लेकिन वह गायब हो गया।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8810232004759072
mr
0.8755251283647114
reliable
true
passes
true
8
name
"Hunter"
dialogue
"I see. Did anyone else see this man? Do you know where he might have gone?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8340707964601769
tl
0.5894160583941606
da
0.5207667731629393
yo
0.43109987357774965
sq
0.42233632862644416
cs
0.412532637075718
no
0.4102228047182176
pl
0.37413073713490963
de
0.3732590529247911
sv
0.3706293706293706
hr
0.3653032440056418
et
0.34114202049780384
ca
0.337260677466863
sk
0.3119266055045872
vi
0.27884615384615385
lv
0.2753623188405797
lt
0.25864909390444807
pt
0.25742574257425743
sl
0.21052631578947367
it
0.20353982300884957
nl
0.1818181818181818
fi
0.16820702402957485
ro
0.16666666666666666
es
0.15730337078651685
fr
0.1412213740458015
be
0.1346153846153846
tr
0.1346153846153846
hu
0.12959381044487428
az
0.12280701754385964
is
0.12280701754385964
uk
0.12280701754385964
reliable
true
passes
true
9
name
"Selvi"
dialogue
"मुझे नहीं पता। मैं उस स्थान से दूर चली गई क्योंकि मुझे भयभीत था।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.8790237744582369
mr
0.871393424289868
reliable
true
passes
true
10
name
"Hunter"
dialogue
"Hunter here. What do you have?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8323754789272031
sq
0.6119733924611973
da
0.5668316831683169
pt
0.5558375634517766
cs
0.5466321243523317
sl
0.5056497175141244
tl
0.453125
pl
0.4496855345911949
sk
0.4299674267100977
hr
0.4067796610169492
vi
0.38811188811188807
de
0.3346007604562738
no
0.308300395256917
yo
0.308300395256917
fr
0.29149797570850206
sv
0.2857142857142857
it
0.2647058823529412
nl
0.2647058823529412
ca
0.25213675213675213
ms
0.25213675213675213
ro
0.25213675213675213
tr
0.25213675213675213
reliable
true
passes
true
11
name
"Hunter"
dialogue
"Selvi, I have to go. But I'll need to speak with you again. Can I find you here?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8110037799244015
da
0.5722433460076045
tl
0.560546875
pl
0.45054945054945056
no
0.4353826850690088
cs
0.4109947643979057
yo
0.4007989347536618
ca
0.3935309973045822
hr
0.3617021276595745
sq
0.34210526315789475
sk
0.3119266055045872
et
0.3098159509202454
nl
0.30769230769230765
lv
0.2913385826771654
lt
0.2706645056726094
tr
0.24623115577889448
az
0.23728813559322032
sv
0.23469387755102045
sl
0.2119089316987741
it
0.20353982300884957
fi
0.19642857142857142
ro
0.16666666666666666
fr
0.16356877323420074
ms
0.14772727272727273
be
0.1346153846153846
hu
0.12959381044487428
is
0.12280701754385964
uk
0.12280701754385964
vi
0.12280701754385964
reliable
true
passes
true
12
name
"Selvi"
dialogue
"हाँ, मैं यहाँ ही रहूँगी। लेकिन कृपया जल्दी आइए, मुझे इस कार्य के बारे में और बताएं।"
detectedLang
"hi"
heavyLang
"hi"
scores
hi
0.881767775603392
mr
0.8703736813874486
reliable
true
passes
true
13
name
"Hunter"
dialogue
"I will. Stay safe, Selvi."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7491638795986623
da
0.6259351620947631
no
0.6134020618556701
ca
0.589041095890411
tl
0.504950495049505
hr
0.4809688581314879
sv
0.4791666666666667
sq
0.471830985915493
pl
0.45652173913043476
it
0.43396226415094336
fi
0.4230769230769231
de
0.4140625
cs
0.4117647058823529
ro
0.375
yo
0.3670886075949367
sk
0.32432432432432434
be
0.3181818181818182
tr
0.3181818181818182
hu
0.3087557603686636
az
0.29577464788732394
et
0.29577464788732394
is
0.29577464788732394
lt
0.29577464788732394
lv
0.29577464788732394
uk
0.29577464788732394
vi
0.29577464788732394
reliable
true
passes
true