Run: 2026-02-08-01KGYWXMV7AYCSSVB58XG2JMP3

Run Details

Duration:
1m 9s
Cost:
$0.007631
Provider:
Novita

Evaluation summary

Score Evaluator
Details Link
47.06% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
**Voice Sheet** **Selvi:** "Nahi, nahi... yeh galat hai." *(No, no... this is wrong.)* **Hunter:** "Ma'am? Excuse me. I'm Detective Hunter. Could I ask you a few questions?" **Selvi:** *(Clutching camera to chest, eyes wide)* "Main samajh nahi pa rahi. Aap kaun hain?" *(I don't understand. Who are you?)* **Hunter:** "I noticed you were taking pictures near the old cider mill yesterday afternoon. Did you see anyone there? Maybe around 4:30? A man in a red jacket?" **Selvi:** *(Voice trembling, pointing at camera screen)* "Wahan par... ek aadmi tha. Usne mujhe dekha. Phir... phir woh gayab ho gaya. Bas ek pal mein." *(There... there was a man. He saw me. Then... then he disappeared. Just like that.)* **Hunter:** *(Frowning, looking at the camera)* "I don't speak... uh... is that Hindi? Look, this is important. Three people are missing. If you saw something at the mill—" **Selvi:** "Gayab?" *(Missing?)* "Haan! Woh aadmi bhi gayab ho gaya! Main dar gayi. Maine socha photo acchi hogi, lekin..." *(Yes! That man also disappeared! I got scared. I thought the photo would be good, but...)* **Hunter:** *(Sighs, trying slower English)* "Do. You. Need. A. Translator? Police station? Tomorrow?" **Selvi:** *(Panicked, shaking head)* "Police? Nahi! Maine kuchh galat nahi kiya! Main sirf student hoon. Yeh dekhiye—" *(Police? No! I haven't done anything wrong! I'm just a student. Look at this—)* **Hunter:** *(Phone rings)* "Hunter... Yeah, I'm at the Beanery... What? When?" *(Pauses, jaw tightening)* "I'm ten minutes out." **Selvi:** "Kya hua? Aap theek hain?" *(What happened? Are you okay?)* **Hunter:** *(Standing up, holding up badge then pointing to her camera)* "Stay here. Don't... just don't leave town. I need to see those photos. Tomorrow. With an interpreter." **Selvi:** "Kal? Main... aap kahan ja rahe hain?" *(Tomorrow? I... where are you going?)* **Hunter:** *(Already walking backward)* "Wait here! I'll send someone who speaks... uh... your language. Just... chai. Drink your chai. Stay put." **Selvi:** *(Calling after him, distressed)* "Lekin woh photo... usmein kuchh ajeeb tha!" *(But that photo... there was something strange in it!)* **Hunter:** *(Exits, phone to ear)* "Yeah, I'm coming. No, the witness is a dead end—doesn't speak a word of English. But she's got pictures. I'll bring her in tomorrow with Patel from the university." **Selvi:** *(Alone, staring at camera screen, whispering to herself)* "Ab main kya karoon?" *(What do I do now?)*
created_at"2026-02-08T15:12:40.311181+00:00" 2/8/2026, 3:12:40 PM
model"moonshotai/kimi-k2.5-0127"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency2068
moderation_latency(null)
generation_time58859
tokens_prompt262
tokens_completion2584
native_tokens_prompt278
native_tokens_completion2622
native_tokens_completion_images(null)
native_tokens_reasoning2202
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00763116
router(null)
provider_responses
0
status429
is_byokfalse
latency10141
endpoint_id"5d3540f2-832a-4fde-87b4-b628b65e974c"
provider_name"Fireworks"
model_permaslug"moonshotai/kimi-k2.5-0127"
1
id"02d4b8559373660b23a205b8526a4ef7"
status200
is_byokfalse
latency2068
endpoint_id"96a2baea-9e77-43d3-8aed-32f3cafc2685"
provider_name"Novita"
model_permaslug"moonshotai/kimi-k2.5-0127"
api_type"completions"
id"gen-1770563490-QfQJ9k4BFLmaquoR4b4E"
upstream_id"02d4b8559373660b23a205b8526a4ef7"
total_cost0.00763116
cache_discount(null)
upstream_inference_cost0
provider_name"Novita"

Evaluation details

Result Evaluator Details Meta Data
47.06% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Nahi, nahi... yeh galat hai."
detectedLang"tl"
heavyLang"ber"
scores
tl0.571917808219178
eu0.5689655172413793
vi0.5567375886524822
ro0.5471014492753623
it0.4444444444444444
es0.37810945273631835
lv0.37810945273631835
ms0.37810945273631835
ca0.375
et0.375
sv0.375
tr0.375
reliablefalse
passesfalse
1
name"Hunter"
dialogue"Ma'am? Excuse me. I'm Detective Hunter. Could I ask you a few questions?"
detectedLang"en"
heavyLang"en"
scores
en0.7851002865329513
fr0.6399176954732511
it0.599236641221374
ca0.5550847457627118
pt0.5474137931034483
tl0.5434782608695653
ro0.5070422535211268
sq0.49078564500484967
es0.48173741362290223
no0.4691607684529828
nl0.4318181818181818
cs0.42434210526315785
da0.4179600886917961
sv0.39165701042873696
hr0.37722419928825623
sl0.3667068757539204
de0.31282722513089006
pl0.3055555555555556
hu0.2981283422459893
et0.29624664879356566
ms0.2818057455540356
tr0.2818057455540356
yo0.2818057455540356
sk0.2778541953232462
lt0.2164179104477612
fi0.2081447963800905
is0.2081447963800905
az0.20212765957446807
lv0.20212765957446807
vi0.20212765957446807
be0.11764705882352942
eu0.11764705882352942
uk0.10714285714285714
reliabletrue
passestrue
2
name"Selvi"
dialogue"Main samajh nahi pa rahi. Aap kaun hain?"
detectedLang"eu"
heavyLang"tl"
scores
eu0.5738636363636364
tl0.5182012847965739
lv0.4742990654205608
sl0.39999999999999997
hr0.32432432432432434
sq0.3202416918429003
et0.3161094224924012
fi0.3161094224924012
yo0.31402439024390244
is0.3119266055045872
no0.30769230769230765
en0.3055555555555556
fr0.281150159744409
da0.27652733118971057
lt0.2694805194805195
sv0.26229508196721313
de0.25742574257425743
ms0.2398648648648649
reliabletrue
passesfalse
3
name"Hunter"
dialogue"I noticed you were taking pictures near the old cider mill yesterday afternoon. Did you see anyone there? Maybe around 4:30? A man in a red jacket?"
detectedLang"en"
heavyLang"en"
scores
en0.8031903874041848
tl0.6532846715328468
sv0.4742667404537908
nl0.4571428571428572
da0.43952802359882004
de0.4385342789598109
no0.43486020226055916
fr0.39063502245028864
ro0.38391699092088194
it0.3338008415147265
et0.3286219081272085
ca0.3185078909612626
lv0.3180186647523331
sq0.31308749096167754
sk0.30808448652585574
pl0.3070751276440554
yo0.29681717246484085
sl0.291044776119403
es0.28625093914350114
pt0.2753623188405797
hr0.2554858934169279
cs0.24901185770750986
tr0.24121405750798725
az0.2313915857605178
lt0.20100925147182505
hu0.19011082693947143
ms0.18524871355060035
is0.18032786885245902
fi0.13083257090576395
vi0.12280701754385964
be0.06862745098039216
eu0.06862745098039216
uk0.06219151036525173
reliabletrue
passestrue
4
name"Selvi"
dialogue"Wahan par... ek aadmi tha. Usne mujhe dekha. Phir... phir woh gayab ho gaya. Bas ek pal mein."
detectedLang"ms"
heavyLang"de"
scores
ms0.45764462809917356
fr0.32778489116517284
tl0.31640625
ca0.3110236220472441
lv0.22794117647058826
de0.19230769230769232
sq0.1822429906542056
tr0.1758241758241758
no0.17452830188679244
sk0.17452830188679244
cs0.16798732171156894
it0.16798732171156894
nl0.16
da0.15048543689320387
sv0.15048543689320387
fi0.1435562805872757
reliablefalse
passesfalse
5
name"Hunter"
dialogue"I don't speak... uh... is that Hindi? Look, this is important. Three people are missing. If you saw something at the mill—"
detectedLang"en"
heavyLang"en"
scores
en0.8182457786116322
tl0.695241840346048
da0.46329639889196683
no0.4424460431654676
ro0.39829192546583847
ca0.39594699922057675
nl0.3873517786561265
sv0.38197767145135564
it0.38099041533546324
fr0.3673469387755102
is0.3432203389830509
ms0.32077125328659073
sq0.32077125328659073
pt0.30493273542600896
yo0.2883379247015611
es0.26190476190476186
et0.2226680040120361
hu0.22188755020080322
cs0.19102296450939457
tr0.16216216216216217
hr0.1520787746170678
lt0.1474147414741474
az0.14174972314507198
pl0.13984461709211987
fi0.0914419695193435
hi0.0914419695193435
de0.08500590318772137
sk0.08500590318772137
be0.08284023668639054
lv0.07517899761336516
uk0.07517899761336516
vi0.07517899761336516
reliabletrue
passestrue
6
name"Selvi"
dialogue"Haan! Woh aadmi bhi gayab ho gaya! Main dar gayi. Maine socha photo acchi hogi, lekin..."
detectedLang"fr"
heavyLang"it"
scores
fr0.4580584354382658
en0.4295634920634921
ro0.3235294117647059
tl0.3203309692671395
fi0.3088942307692307
it0.29187192118226607
de0.28125
pt0.2561448900388098
cs0.25227568270481143
et0.22086720867208673
eu0.203601108033241
lt0.1797432239657632
ca0.1726618705035971
no0.16180758017492713
sk0.16180758017492713
ms0.14814814814814814
es0.13922155688622756
is0.13273001508295626
lv0.13273001508295626
hi0.11809815950920245
reliablefalse
passesfalse
7
name"Hunter"
dialogue"Do. You. Need. A. Translator? Police station? Tomorrow?"
detectedLang"en"
heavyLang"en"
scores
en0.7858017135862913
cs0.6489468405215646
tl0.6446700507614213
hr0.6264674493062967
fr0.6199782844733985
sl0.6132596685082874
ro0.6124031007751938
sk0.6071829405162739
pl0.6049661399548533
pt0.5915985997666278
sq0.5808383233532934
da0.5742092457420924
de0.573170731707317
et0.573170731707317
it0.5662949194547707
sv0.5641344956413449
no0.5569620253164557
nl0.5530012771392081
yo0.5021337126600285
ms0.4807121661721069
lt0.47049924357034795
lv0.45226917057902977
es0.4479495268138801
ca0.4470774091627172
tr0.4363929146537842
vi0.4345718901453958
az0.43273905996758516
eu0.39759036144578314
hu0.39759036144578314
fi0.3955094991364421
zh0.18032786885245902
is0.1764705882352941
reliabletrue
passestrue
8
name"Selvi"
dialogue"Police? Nahi! Maine kuchh galat nahi kiya! Main sirf student hoon. Yeh dekhiye—"
detectedLang"ro"
heavyLang"tl"
scores
ro0.5770676691729324
fr0.5710200190657769
en0.5706106870229007
tl0.5472837022132797
de0.49324324324324326
cs0.4712103407755582
et0.46871310507674147
sk0.44649446494464945
lv0.4178525226390685
pl0.4015957446808511
sv0.39759036144578314
eu0.3653032440056418
fi0.35437589670014347
hr0.35251798561151076
it0.3440233236151603
ms0.3430656934306569
ca0.337260677466863
no0.336283185840708
nl0.3343195266272189
sl0.3293591654247392
sq0.3293591654247392
da0.32432432432432434
lt0.25864909390444807
es0.25124792013311154
az0.25
tr0.24623115577889448
hu0.22945205479452058
pt0.1346153846153846
reliablefalse
passesfalse
9
name"Hunter"
dialogue"I'm ten minutes out."
detectedLang"en"
heavyLang"en"
scores
en0.7920133111480865
cs0.5819397993311036
sk0.5819397993311036
pl0.5791245791245792
fr0.5748299319727891
tl0.5659722222222222
lt0.558303886925795
nl0.5519713261648745
ca0.5421245421245421
de0.5335820895522388
et0.5335820895522388
fi0.3654822335025381
sl0.3654822335025381
ro0.358974358974359
sv0.358974358974359
da0.34895833333333337
es0.34895833333333337
hr0.34895833333333337
it0.34895833333333337
no0.34895833333333337
pt0.33510638297872336
sq0.33510638297872336
ms0.3206521739130435
reliabletrue
passestrue
10
name"Selvi"
dialogue"Kya hua? Aap theek hain?"
detectedLang"eu"
heavyLang"fi"
scores
eu0.4791666666666667
nl0.4117647058823529
reliablefalse
passesfalse
11
name"Hunter"
dialogue"Stay here. Don't... just don't leave town. I need to see those photos. Tomorrow. With an interpreter."
detectedLang"en"
heavyLang"en"
scores
en0.8003194888178914
et0.49186991869918695
fr0.4881244881244881
sq0.46717817561807334
ca0.46167097329888035
de0.4555749128919861
no0.40702087286527516
sv0.39729990356798456
da0.3955512572533849
tl0.3872549019607844
es0.3811881188118812
ro0.36289500509684
tr0.358974358974359
sk0.3563336766220391
pl0.3543388429752066
lv0.35367114788004134
hr0.3509865005192108
lt0.34141201264488935
yo0.3372216330858961
cs0.3336886993603412
pt0.33083511777301927
ms0.32138979370249726
it0.31091510474090406
sl0.29537767756482525
nl0.27662037037037035
vi0.2732558139534884
hu0.26297169811320753
eu0.22934648581997535
az0.17218543046357618
hi0.10968660968660969
be0.10071942446043164
is0.09156976744186046
uk0.09156976744186046
reliabletrue
passestrue
12
name"Selvi"
dialogue"Kal? Main... aap kahan ja rahe hain?"
detectedLang"tl"
heavyLang"tl"
scores
tl0.5807127882599581
fi0.546485260770975
de0.453551912568306
et0.4350282485875706
eu0.40828402366863903
ms0.40828402366863903
lv0.36507936507936506
ca0.35275080906148865
en0.3311036789297659
fr0.3055555555555556
sk0.29577464788732394
da0.2857142857142857
pl0.2857142857142857
sl0.2857142857142857
sq0.2727272727272727
sv0.2727272727272727
yo0.2727272727272727
reliablefalse
passesfalse
13
name"Hunter"
dialogue"Wait here! I'll send someone who speaks... uh... your language. Just... chai. Drink your chai. Stay put."
detectedLang"en"
heavyLang"en"
scores
en0.7793468667255075
et0.38949938949938945
tl0.32523616734143057
ro0.27219796215429404
de0.24812030075187969
ms0.24812030075187969
nl0.24812030075187969
hr0.2
sv0.16943521594684383
sq0.16666666666666666
no0.15540540540540537
da0.1482112436115843
is0.14383561643835618
es0.13494809688581316
eu0.13494809688581316
pt0.13494809688581316
ca0.1334488734835355
fr0.12280701754385964
lt0.11190053285968028
yo0.11190053285968028
reliabletrue
passestrue
14
name"Selvi"
dialogue"Lekin woh photo... usmein kuchh ajeeb tha!"
detectedLang"fr"
heavyLang"et"
scores
fr0.3877551020408163
en0.3630573248407643
cs0.3548387096774194
eu0.3288590604026846
sq0.2805755395683453
sl0.25925925925925924
fi0.23857868020304565
is0.22680412371134018
hi0.20424403183023873
ms0.20424403183023873
pl0.20424403183023873
sk0.20424403183023873
tl0.20424403183023873
reliablefalse
passesfalse
15
name"Hunter"
dialogue"Yeah, I'm coming. No, the witness is a dead end—doesn't speak a word of English. But she's got pictures. I'll bring her in tomorrow with Patel from the university."
detectedLang"en"
heavyLang"en"
scores
en0.7884344146685472
tl0.587426326129666
no0.49567723342939485
da0.4905385735080059
nl0.4900437105390967
de0.45792462570986064
fr0.44678609062170704
yo0.4198895027624309
ca0.41471571906354515
ro0.4140625
sv0.4006849315068493
ms0.36286407766990286
pt0.3609251369446135
es0.3581907090464548
lv0.35304990757855825
it0.3510506798516687
cs0.27335640138408307
et0.270326615705351
tr0.2584745762711864
hr0.25479063165365506
lt0.2374727668845316
is0.23076923076923078
hu0.22794117647058826
sl0.2262343404568902
sq0.21875
az0.21052631578947367
sk0.21052631578947367
pl0.2009132420091324
eu0.0625
vi0.0625
fi0.05660377358490566
reliabletrue
passestrue
16
name"Selvi"
dialogue"Ab main kya karoon?"
detectedLang"de"
heavyLang"tl"
scores
de0.5993589743589743
tl0.5335820895522388
fi0.4444444444444444
lv0.4444444444444444
sk0.4444444444444444
en0.44196428571428575
fr0.4131455399061033
sv0.3842364532019704
tr0.3842364532019704
reliabletrue
passesfalse