Run: 2026-07-25-01KYD62R1934578RKNB30MYG71

Run Details

Model:
Muse Spark 1.1 (Reasoning, Minimal)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
8.0s
Cost:
$0.004980
Provider:
Meta

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**VOICE SHEET - INT. ALBORN CAFE - DAY** Selvi: "..." Hunter: "Excuse me - Selvi, right? I'm Detective Hunter. Do you mind if I ask you a couple questions?" Selvi: "[staring at camera screen, not looking up]" Hunter: "I was told you were out by the old orchard yesterday taking photos. For your landscape project, I assume? Did you see anything... unusual out there? Anyone you didn't recognize?" Selvi: "क्या? नहीं, नहीं... मैं वहाँ दोबारा नहीं जाना चाहती। वो वहाँ था। पेड़ों के बीच। मैंने अपनी कैमरा में देखा... वो गायब हो गया! [kya? Nahi, nahi... main wahan dobara nahi jana chahti. Wo wahan tha. Pedon ke beech. Maine apni camera mein dekha... wo gayab ho gaya!]" Hunter: "Whoa, okay - sorry. I didn't... I don't understand. Are you saying you saw someone? Slow down." Selvi: "आप समझ नहीं रहे हैं! यह तस्वीर देखिए। इस जगह में कुछ तो गड़बड़ है। मुझे बहुत डर लग रहा है। [Aap samajh nahi rahe hain! Yah tasveer dekhiye. Is jagah mein kuch to gadbad hai. Mujhe bahut dar lag raha hai.]" Hunter: "[holds up his hands] Look, I can see you're shaken up, and I want to help. But I don't speak - I don't know what you're saying. Do you know anyone who can translate? Parlez-vous - No, that's not... Do. You. See. Someone? In. The. Orchard?" Selvi: "ऑर्चर्ड? हाँ, ऑर्चर्ड! सेब के पेड़... वहाँ एक आदमी था, फिर वो नहीं था। जैसे हवा में गायब! मेरी तस्वीर... मेरी तस्वीर सबूत है! [Orchard? Haan, orchard! Seb ke ped... wahan ek aadmi tha, phir wo nahi tha. Jaise hawa mein gayab! Meri tasveer... meri tasveer saboot hai!]" Hunter: "[frustrated, rubbing his neck] Evidence? You're saying your photo is evidence? Can I... can I see the camera?" Selvi: "नहीं! मत छुओ! आपको तो कुछ समझ ही नहीं आ रहा। कोई मेरी बात नहीं समझता यहाँ। [Nahi! Mat chhuo! Aapko to kuch samajh hi nahi aa raha. Koi meri baat nahi samajhta yahan.]" Hunter: "Okay, okay, I won't touch it. Listen, I -" Hunter: "[phone ringing] Damn. Hold that thought - [answers phone] Hunter here. What? Now? Alright, I'm on my way. Don't let anyone in there." Hunter: "I have to go - there's been another incident. Stay here, okay? Stay in town. We'll... we'll figure out the translation thing. We'll talk again." Selvi: "अरे, रुकिए! ऐसे मत जाइए! मेरी बात सुनिए! [Are, rukiye! Aise mat jaiye! Meri baat suniye!]"
created_at"2026-07-25T17:45:00.722Z" 7/25/2026, 5:45:00 PM
model"meta/muse-spark-1.1-20260709"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2994
moderation_latency(null)
generation_time7902
tokens_prompt302
tokens_completion828
native_tokens_prompt417
native_tokens_completion1049
native_tokens_completion_images0
native_tokens_reasoning332
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"completed"
service_tier"auto"
usage0.0049795
router(null)
provider_responses
0
endpoint_id"b2b9f6f9-8880-41c1-bd0c-867650fd5238"
id"resp_6a64f61dc6225c1a6088454a"
is_byokfalse
latency451
model_permaslug"meta/muse-spark-1.1-20260709"
provider_name"Meta"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.18.0; linux; x64))"
http_referer(null)
request_id"req-1785001500-ghhLxMule4nOOH3YINwY"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1785001500-Zg8c7qpLLBkIX9UkjxHr"
upstream_id"resp_6a64f61dc6225c1a6088454a"
total_cost0.0049795
cache_discount(null)
upstream_inference_cost0
provider_name"Meta"
response_cache_source_id(null)
data_region"global"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
1
name"Hunter"
dialogue"Excuse me - Selvi, right? I'm Detective Hunter. Do you mind if I ask you a couple questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7847054770926628
fr0.6490735541830431
tl0.569262577532736
pt0.5586158192090396
it0.5567375886524822
ca0.5394252026529108
no0.5023885350318471
sq0.49919871794871795
da0.47390572390572394
ro0.46351931330472107
cs0.4541484716157206
es0.43845462713387245
hr0.4120413922859831
sv0.4120413922859831
sl0.4041944709246902
pl0.3743743743743744
yo0.3641912512716175
sk0.3482794577685088
de0.3336886993603412
hu0.33226495726495725
et0.33083511777301927
nl0.3235930735930736
fi0.284077892325315
vi0.2807825086306099
ms0.24789410348977134
tr0.24789410348977134
lt0.1883116883116883
is0.18086500655307994
az0.17546174142480211
lv0.17546174142480211
be0.10071942446043164
eu0.10071942446043164
uk0.09156976744186046
reliabletrue
passestrue
2
name"Selvi"
dialogue"\"\""
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
3
name"Hunter"
dialogue"I was told you were out by the old orchard yesterday taking photos. For your landscape project, I assume? Did you see anything... unusual out there? Anyone you didn't recognize?"
detectedLang"en"
heavyLang"en"
scores
en0.8068630973769313
tl0.5820373250388803
nl0.4616925388082123
de0.38816163915765506
fr0.3839541547277937
no0.3832472748135399
da0.3717124488603156
pt0.35474189675870343
sq0.32770481550969355
et0.3068987749838814
ca0.30600387346675273
sv0.2969260954872465
ms0.2964659685863874
pl0.2818971275885103
cs0.26721199727334694
tr0.2471988795518207
sk0.24508426966292135
yo0.20722713864306785
it0.20193021529324423
es0.19776119402985076
is0.1874527588813303
lt0.168600154679041
hr0.1673121611154144
lv0.16602017067494182
ro0.14068745003996802
sl0.11595394736842106
eu0.0724762726488352
fi0.06926406926406926
hi0.06684027777777778
be0.061135371179039305
hu0.05866900175131349
az0.05536028119507908
uk0.05536028119507908
vi0.05536028119507908
reliabletrue
passestrue
4
name"Selvi"
dialogue"क्या? नहीं, नहीं... मैं वहाँ दोबारा नहीं जाना चाहती। वो वहाँ था। पेड़ों के बीच। मैंने अपनी कैमरा में देखा... वो गायब हो गया!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8858951707891637
mr0.8804750154225787
reliabletrue
passestrue
5
name"Hunter"
dialogue"Whoa, okay - sorry. I didn't... I don't understand. Are you saying you saw someone? Slow down."
detectedLang"en"
heavyLang"en"
scores
en0.7867587327376117
tl0.5014245014245015
no0.4570837642192347
da0.45595854922279794
sv0.3993135011441648
ro0.37275985663082434
cs0.3371212121212121
it0.2905405405405405
pl0.279835390946502
de0.26880222841225626
nl0.2532005689900427
pt0.2532005689900427
tr0.2446043165467626
sk0.23469387755102045
hr0.20933734939759033
ca0.2081447963800905
is0.20694864048338368
sq0.2033383915022762
ms0.16
yo0.14215686274509806
es0.12935323383084577
be0.11764705882352942
hu0.11317567567567569
az0.10714285714285714
et0.10714285714285714
lt0.10714285714285714
lv0.10714285714285714
uk0.10714285714285714
vi0.10714285714285714
reliabletrue
passestrue
6
name"Selvi"
dialogue"आप समझ नहीं रहे हैं! यह तस्वीर देखिए। इस जगह में कुछ तो गड़बड़ है। मुझे बहुत डर लग रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8769908066813414
mr0.8665730337078652
reliabletrue
passestrue
7
name"Hunter"
dialogue"Look, I can see you're shaken up, and I want to help. But I don't speak - I don't know what you're saying. Do you know anyone who can translate? Parlez-vous - No, that's not... Do. You. See. Someone? In. The. Orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.8168029993183367
tl0.5876486382815497
no0.4315177154944474
nl0.4179750947482404
pl0.3943661971830986
hr0.3864155251141552
yo0.35667265110712143
cs0.34610705596107055
fr0.3425076452599388
sk0.3425076452599388
sq0.3425076452599388
it0.3417023882424985
tr0.33229813664596275
sv0.3293824079850281
sl0.32474874371859297
pt0.32389937106918243
ca0.31962025316455694
ro0.30375647668393785
da0.29183135704874835
lv0.2913645352669743
et0.24825174825174828
az0.2471988795518207
de0.24667133847231956
es0.24614305750350632
lt0.2164723032069971
ms0.2037037037037037
vi0.19596110695587135
hu0.11083540115798181
be0.061135371179039305
eu0.05866900175131349
is0.05536028119507908
uk0.05536028119507908
reliabletrue
passestrue
8
name"Selvi"
dialogue"ऑर्चर्ड? हाँ, ऑर्चर्ड! सेब के पेड़... वहाँ एक आदमी था, फिर वो नहीं था। जैसे हवा में गायब! मेरी तस्वीर... मेरी तस्वीर सबूत है!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8767605633802817
mr0.8746777427671154
reliabletrue
passestrue
9
name"Hunter"
dialogue"Evidence? You're saying your photo is evidence? Can I... can I see the camera?"
detectedLang"en"
heavyLang"en"
scores
en0.8093315388066398
tl0.5812807881773399
fr0.555439330543933
ca0.47788697788697787
nl0.47595561035758327
yo0.47270471464019853
it0.4551282051282051
cs0.4509043927648579
ro0.42953020134228187
tr0.42489851150202973
no0.4193989071038251
sv0.4121715076071923
sq0.3963068181818182
es0.37683284457478006
et0.3541033434650456
ms0.3491577335375191
hu0.34210526315789475
da0.33800623052959505
pt0.3359375
lv0.3264659270998415
is0.2672413793103448
sk0.2530755711775044
az0.247787610619469
hr0.24645390070921988
pl0.22867513611615245
hi0.1533864541832669
sl0.15
de0.1448692152917505
be0.1414141414141414
lt0.1290983606557377
uk0.1290983606557377
vi0.1290983606557377
reliabletrue
passestrue
10
name"Selvi"
dialogue"नहीं! मत छुओ! आपको तो कुछ समझ ही नहीं आ रहा। कोई मेरी बात नहीं समझता यहाँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8759068346697213
mr0.8641304347826086
reliabletrue
passestrue
11
name"Hunter"
dialogue"Okay, okay, I won't touch it. Listen, I -"
detectedLang"en"
heavyLang"en"
scores
en0.7377622377622377
no0.5894160583941606
tl0.5833333333333334
da0.5802238805970149
sv0.5738636363636364
sq0.5570866141732284
lv0.5108695652173912
hr0.4874715261958998
pl0.4617224880382775
fi0.45520581113801456
de0.45255474452554745
fr0.4375
it0.4360902255639098
cs0.42748091603053434
yo0.4201030927835051
ro0.40476190476190477
hu0.3951612903225807
ca0.38016528925619836
tr0.3784530386740331
is0.3715083798882682
sk0.3679775280898876
eu0.34210526315789475
nl0.3401759530791789
be0.23728813559322032
az0.21875
es0.21875
et0.21875
lt0.21875
pt0.21875
uk0.21875
vi0.21875
sl0.2077464788732394
reliabletrue
passestrue
12
name"Hunter"
dialogue"Damn. Hold that thought - Hunter here. What? Now? Alright, I'm on my way. Don't let anyone in there."
detectedLang"en"
heavyLang"en"
scores
en0.8210023866348448
tl0.51651893634166
de0.4480220791168353
da0.36507936507936506
sl0.3464052287581699
cs0.3127147766323024
pl0.3023255813953488
fr0.2982456140350877
sq0.2831541218637993
yo0.2831541218637993
nl0.2673992673992674
it0.25925925925925924
ro0.250936329588015
sv0.2277992277992278
sk0.21156373193166886
ca0.20844327176781002
et0.20424403183023873
no0.20212765957446807
fi0.2
ms0.18256130790190736
hr0.12790697674418602
az0.12280701754385964
hi0.12280701754385964
pt0.09502262443438914
tr0.08952959028831564
reliabletrue
passestrue
13
name"Hunter"
dialogue"I have to go - there's been another incident. Stay here, okay? Stay in town. We'll... we'll figure out the translation thing. We'll talk again."
detectedLang"en"
heavyLang"en"
scores
en0.8149861239592969
tl0.6299722479185939
da0.559228650137741
nl0.5462280204197391
fr0.49906073888541014
de0.47678221059516024
ro0.4612794612794613
no0.4609164420485175
yo0.4546693933197001
sv0.4494150034411562
sq0.4478951000690131
pl0.42569992821249103
it0.40253920836445106
ca0.38697318007662834
sl0.3665874901029295
cs0.3447993447993448
sk0.3311036789297659
es0.3254637436762226
hr0.32030586236193714
az0.3049522154648132
lt0.26806953339432754
ms0.26605504587155965
pt0.25788497217068646
lv0.23954372623574144
et0.23882017126546146
tr0.2023928215353938
vi0.1587802313354364
hu0.13606911447084233
fi0.09297052154195011
zh0.08779931584948689
be0.08045977011494253
eu0.07727797001153403
is0.07300115874855156
uk0.07300115874855156
reliabletrue
passestrue
14
name"Selvi"
dialogue"अरे, रुकिए! ऐसे मत जाइए! मेरी बात सुनिए!"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8812517462978485
mr0.8695518723143033
reliabletrue
passestrue