Run: 2026-09-03-01M1KRAVVE9CEQEAYJGZBGY93H

Run Details

Model:
Muse Glimmer 30B (Reasoning, Medium)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
11.9s
Cost:
$0.001894
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "मैं अपना कैमरा यहाँ छोड़ कर नहीं जा सकती।" Hunter: "Ma'am, I'm Detective Hunter. I'm investigating the disappearances. Have you seen anything unusual around town the last few days?" Selvi: "मैं अंग्रेज़ी नहीं समझती। कृपया मुझे अकेला छोड़ दीजिए। मुझे डर लग रहा है।" Hunter: "I'm sorry, what? Do you speak English at all?" Selvi: "कल रात सेब के बगीचे के पास एक आदमी... वह रो रहा था। फिर वह गायब हो गया। मैं फोटो नहीं ले पाई, मैं बहुत डर गई थी।" Hunter: "Wait, wait. Slow down. I don't understand a word you're saying." Selvi: "प्लीज़... मेरी मदद कीजिए। मैंने जो देखा वह सच है।" Hunter: "Look, I need you to tell me in English. Did you see someone? Where?" Selvi: "मैं... मैं यहाँ सुरक्षित नहीं हूँ।" Hunter: "Okay, okay. Let's just start with your name. Can you tell me your name?" Selvi: "मेरा नाम सेल्वी है। मैं फोटोग्राफी की स्टडी के लिए आई हूँ।" Hunter: "Selvi... alright. I need a translator. Stay right here, don't leave with your camera-" Hunter: *phone rings* Hunter: "Sorry. Detective Hunter. Yeah? ... What? Now? Okay, I'm on my way." Selvi: "क्या हुआ? आप जा रहे हैं?" Hunter: "Ma'am, I have to go. If you remember anything, find the police station. I'll be back." Selvi: "मैं समझ नहीं पा रही... प्लीज़..."
created_at"2026-09-03T13:46:33.205Z" 9/3/2026, 1:46:33 PM
model"meta/muse-glimmer-30b-20260810"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency425
moderation_latency(null)
generation_time11804
tokens_prompt302
tokens_completion1586
native_tokens_prompt290
native_tokens_completion1195
native_tokens_completion_images(null)
native_tokens_reasoning1035
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.001894
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788443193-sHtImhF0cxGKTXpuOFOE"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788443193-cUCFCeLbbeUeVLCMqCBz"
upstream_id"oyobqxR-fdNmn-a3553385b95ca63b"
provider_responses
0
endpoint_id"e6c588fa-aef0-4e1b-bb7f-78185dd5b6da"
id"oyobqxR-fdNmn-a3553385b95ca63b"
is_byokfalse
latency401
model_permaslug"meta/muse-glimmer-30b-20260810"
provider_name"Together"
status200
total_cost0.001894
cache_discount(null)
upstream_inference_cost0
provider_name"Together"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"मैं अपना कैमरा यहाँ छोड़ कर नहीं जा सकती।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.883692458374143
mr0.8761730969760166
reliabletrue
passestrue
1
name"Hunter"
dialogue"Ma'am, I'm Detective Hunter. I'm investigating the disappearances. Have you seen anything unusual around town the last few days?"
detectedLang"en"
heavyLang"en"
scores
en0.7954487343390437
tl0.5987963891675026
fr0.5215311004784688
pt0.49044585987261147
nl0.48152948801036943
ro0.43661971830985913
ms0.40476190476190477
it0.40298507462686567
ca0.4016454749439043
da0.3925588458618071
es0.38128383604021654
no0.36254980079681276
sq0.358974358974359
sv0.34264585045193097
de0.32088285229202035
et0.27992799279927993
cs0.25925925925925924
hr0.2530345471521942
sl0.23954372623574144
lv0.15254237288135594
is0.14712153518123666
sk0.14712153518123666
lt0.13606911447084233
az0.12854030501089325
yo0.11797133406835722
fi0.06868451688009314
tr0.06868451688009314
reliabletrue
passestrue
2
name"Selvi"
dialogue"मैं अंग्रेज़ी नहीं समझती। कृपया मुझे अकेला छोड़ दीजिए। मुझे डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8769935527655243
mr0.8702576950608446
reliabletrue
passestrue
3
name"Hunter"
dialogue"I'm sorry, what? Do you speak English at all?"
detectedLang"en"
heavyLang"en"
scores
en0.8119122257053291
tl0.6385542168674699
no0.5145631067961165
pt0.460431654676259
da0.45155393053016457
cs0.4129158512720157
hr0.3902439024390244
sq0.38650306748466257
it0.3644067796610169
de0.32432432432432434
sv0.32432432432432434
pl0.3227990970654628
sk0.3055555555555556
sl0.2857142857142857
vi0.27007299270072993
et0.22680412371134018
yo0.20634920634920634
ms0.1935483870967742
ro0.1935483870967742
reliabletrue
passestrue
4
name"Selvi"
dialogue"कल रात सेब के बगीचे के पास एक आदमी... वह रो रहा था। फिर वह गायब हो गया। मैं फोटो नहीं ले पाई, मैं बहुत डर गई थी।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8810716074111167
mr0.8695771554091158
reliabletrue
passestrue
5
name"Hunter"
dialogue"Wait, wait. Slow down. I don't understand a word you're saying."
detectedLang"en"
heavyLang"en"
scores
en0.805800103573278
da0.5772266065388951
no0.5772266065388951
sv0.5235069885641677
cs0.46120689655172414
tl0.45809248554913296
pl0.4517543859649123
ro0.4469026548672566
sk0.4369369369369369
ca0.4221879815100154
de0.4094488188976378
hr0.4009584664536741
nl0.3980738362760835
tr0.39710610932475876
it0.3902439024390244
hu0.37290969899665555
is0.36115843270868825
sq0.35456110154905335
yo0.35456110154905335
lt0.27884615384615385
pt0.27184466019417475
az0.2618110236220473
lv0.2618110236220473
vi0.2618110236220473
es0.26035502958579887
et0.251497005988024
fr0.2378048780487805
sl0.1935483870967742
be0.15730337078651685
eu0.15730337078651685
fi0.14383561643835618
ms0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
6
name"Selvi"
dialogue"प्लीज़... मेरी मदद कीजिए। मैंने जो देखा वह सच है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8879482071713147
mr0.8790647675356087
reliabletrue
passestrue
7
name"Hunter"
dialogue"Look, I need you to tell me in English. Did you see someone? Where?"
detectedLang"en"
heavyLang"en"
scores
en0.8312948123154787
et0.538638985005767
no0.5163240628778718
sl0.47575360419397117
sq0.47368421052631576
pl0.46308724832214765
it0.4609164420485175
tl0.4550408719346049
hr0.4497936726272352
sv0.4421199442119944
da0.4405594405594406
cs0.43977591036414565
yo0.43820224719101125
ro0.4318181818181818
de0.4261119081779053
nl0.375
ms0.36608557844690964
sk0.33774834437086093
lv0.3162393162393162
es0.3103448275862069
lt0.2945326278659612
pt0.29328621908127206
az0.2687385740402194
ca0.25650557620817843
fr0.18533604887983707
fi0.15789473684210525
be0.14893617021276595
tr0.14893617021276595
hu0.14346895074946467
is0.13606911447084233
uk0.13606911447084233
vi0.13606911447084233
reliabletrue
passestrue
8
name"Selvi"
dialogue"मैं... मैं यहाँ सुरक्षित नहीं हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.888618874038072
mr0.8827292110874201
reliabletrue
passestrue
9
name"Hunter"
dialogue"Okay, okay. Let's just start with your name. Can you tell me your name?"
detectedLang"en"
heavyLang"en"
scores
en0.7724089635854342
tl0.5529573590096286
nl0.4984567901234568
et0.4406196213425129
sv0.43965517241379315
no0.43082311733800355
ms0.4247787610619469
de0.41441441441441446
sl0.3380855397148676
cs0.3271221532091097
ca0.32150313152400833
fr0.3157894736842105
sq0.3128964059196617
da0.30851063829787234
it0.2995689655172413
es0.2388758782201405
pt0.21307506053268765
is0.2111650485436893
lv0.1935483870967742
pl0.1935483870967742
az0.19154228855721395
sk0.19154228855721395
tr0.19154228855721395
fi0.1875
hr0.1875
ro0.1709183673469388
lt0.15364583333333331
reliabletrue
passestrue
10
name"Selvi"
dialogue"मेरा नाम सेल्वी है। मैं फोटोग्राफी की स्टडी के लिए आई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8859749144811858
mr0.8807038473009245
reliabletrue
passestrue
11
name"Hunter"
dialogue"Selvi... alright. I need a translator. Stay right here, don't leave with your camera-"
detectedLang"en"
heavyLang"en"
scores
en0.7851882160392799
tl0.5735174654752234
ro0.51071761416589
ca0.5014245014245015
da0.4980879541108987
no0.49078564500484967
it0.4675456389452333
sq0.4631901840490798
ms0.43910256410256415
sv0.43426724137931033
et0.4230769230769231
hr0.41666666666666663
pl0.4120940649496081
de0.3979357798165138
fr0.3979357798165138
es0.3697478991596639
cs0.36053593179049936
pt0.34863523573200994
yo0.34782608695652173
nl0.3445692883895131
sk0.3354430379746835
hu0.2981283422459893
vi0.29624664879356566
lt0.28765264586160105
sl0.2857142857142857
tr0.2857142857142857
lv0.27586206896551724
az0.2677824267782427
fi0.24785100286532946
is0.2081447963800905
eu0.20694864048338368
be0.11764705882352942
uk0.10714285714285714
reliabletrue
passestrue
12
name"Hunter"
dialogue"phone rings"
detectedLang"en"
heavyLang"en"
scores
en0.7468354430379747
da0.6978851963746223
de0.6309963099630996
tl0.6197718631178707
nl0.6108949416342413
sv0.609375
no0.5951417004048583
vi0.5708154506437768
et0.47643979057591623
is0.46808510638297873
fr0.45652173913043476
ms0.45652173913043476
it0.42857142857142855
reliabletrue
passestrue
13
name"Hunter"
dialogue"Sorry. Detective Hunter. Yeah? ... What? Now? Okay, I'm on my way."
detectedLang"en"
heavyLang"en"
scores
en0.7848537005163512
tl0.6376811594202898
fr0.4993324432576769
ca0.47405329593267886
it0.47257383966244726
pt0.4703389830508474
ro0.4533527696793003
cs0.3832236842105263
es0.3218806509945751
pl0.3194192377495462
de0.31444241316270566
da0.30683918669131244
sk0.30037313432835816
no0.2964352720450282
hr0.29245283018867924
et0.29111531190926276
sq0.28842504743833014
fi0.2857142857142857
nl0.27884615384615385
sv0.267578125
sl0.251497005988024
hi0.1830065359477124
yo0.16666666666666666
ms0.1359447004608295
tr0.1359447004608295
reliabletrue
passestrue
14
name"Selvi"
dialogue"क्या हुआ? आप जा रहे हैं?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8876123876123876
mr0.8813916710595677
reliabletrue
passestrue
15
name"Hunter"
dialogue"Ma'am, I have to go. If you remember anything, find the police station. I'll be back."
detectedLang"en"
heavyLang"en"
scores
en0.8092236230922363
tl0.658956109134045
da0.6358454718176061
yo0.6001390820584145
no0.5715350223546944
sv0.5614035087719298
cs0.49294532627865967
fr0.4897959183673469
sk0.4879786286731968
pl0.4748858447488585
nl0.4666048237476809
hr0.4580584354382658
sl0.451858913250715
ms0.4497607655502392
sq0.44498069498069504
lt0.43405511811023617
hu0.43125618199802174
de0.425
it0.4004171011470281
ro0.37363834422657954
lv0.36951754385964913
et0.33449074074074076
is0.27398989898989895
ca0.267515923566879
az0.25902061855670105
tr0.25902061855670105
fi0.22402159244264505
eu0.14050822122571002
zh0.11809815950920245
es0.11538461538461538
be0.10852713178294573
pt0.10852713178294573
uk0.0987460815047022
vi0.0987460815047022
reliabletrue
passestrue
16
name"Selvi"
dialogue"मैं समझ नहीं पा रही... प्लीज़..."
detectedLang"hi"
heavyLang"hi"
scores
hi0.8859867330016584
mr0.8731549815498155
reliabletrue
passestrue