Run: 2026-09-03-01M1KXK8HT7MZYPR0GDPHNEZQE

Run Details

Duration:
2m 46s
Cost:
$0.031046
Provider:
Io Net

Evaluation summary

Score Evaluator
Details Link
100.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Miss, I'm Detective Hunter. Your camera—did you take pictures near the orchard this morning? One of the missing people was last seen there." Selvi: "मैंने वहाँ कुछ देखा, लेकिन मैं अभी डरी हुई हूँ।" Hunter: "I'm sorry. I don't understand. I don't speak Hindi. Can you say it into this phone?" Selvi: "हाँ।" Hunter: "Thank you. Did you see a person?" Selvi: "हाँ, लेकिन बहुत दूर। उसका चेहरा साफ़ नहीं दिखा।" Hunter: "Man or woman?" Selvi: "पता नहीं। वह ऊँचा था और धीरे-धीरे चल रहा था।" Hunter: "Tall... walking slowly?" Selvi: "हाँ। मैंने उसकी तरफ़ कैमरा उठाया तो उसने मुझे देखा।" Hunter: "You raised your camera? The person saw you?" Selvi: "हाँ। मेरा दिल बहुत तेज़ से धड़क रहा था।" Hunter: "Okay. What did the person do?" Selvi: "वह रुका। फिर पेड़ों में गया।" Hunter: "Stopped... went into the trees?" Selvi: "हाँ। तभी मैं भागी और यहाँ आ गई।" Hunter: "Ran... came here?" Selvi: "हाँ। मैं अभी भी काँप रही हूँ।" Hunter: "Okay. I believe you. Did the person say anything?" Selvi: "नहीं। बस एक पल के लिए मुझे लगा कि वह मुझे पहचान रहा है।" Hunter: "Knew you?" Selvi: "हाँ।" Hunter: "My phone. I have to go now. Stay where you are." Selvi: "आप वापस आएँगे?" Hunter: "Yes. I will come back. If you see anything, don't move." Selvi: "मेरा नंबर यहाँ के काउंटर पर लिखा है।" Hunter: "Counter... I check. Thank you." Selvi: "कृपया सावधान रहें।" Hunter: "I... okay. Good."
created_at"2026-09-03T15:18:31.377Z" 9/3/2026, 3:18:31 PM
model"qwen/qwen3.8-27b-20260814"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency431
moderation_latency(null)
generation_time165852
tokens_prompt302
tokens_completion11790
native_tokens_prompt338
native_tokens_completion10098
native_tokens_completion_images(null)
native_tokens_reasoning11157
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.031045896
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788448711-5KqhgSwwM5yfPLBhJjVx"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788448711-sCX0O2JRpKRhh4P6sjlw"
upstream_id"chatcmpl-8c30098c-50c5-4e8d-82ad-f3e984a753cc"
provider_responses
0
endpoint_id"c65c4547-63a7-49fb-8354-a45d118663c3"
id"chatcmpl-8c30098c-50c5-4e8d-82ad-f3e984a753cc"
is_byokfalse
latency431
model_permaslug"qwen/qwen3.8-27b-20260814"
provider_name"Io Net"
status200
total_cost0.031045896
cache_discount(null)
upstream_inference_cost0
provider_name"Io Net"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
100.00% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Miss, I'm Detective Hunter. Your camera—did you take pictures near the orchard this morning? One of the missing people was last seen there."
detectedLang"en"
heavyLang"en"
scores
en0.8161367077655203
tl0.6721943694562283
nl0.5586708203530634
de0.4979326639102185
fr0.4713930348258706
no0.45125887669464165
ro0.4221617946974847
sv0.41419710544452104
da0.40848990953375086
ca0.40683879972086534
it0.35064935064935066
ms0.318364073777065
is0.2922564529558701
sq0.2659758203799654
yo0.26534140017286084
pt0.2595818815331011
es0.24578527062999111
et0.22018348623853207
sl0.1935483870967742
hr0.1533864541832669
cs0.15
pl0.09284951974386339
lv0.08896034297963559
fi0.08405172413793104
az0.07103825136612023
tr0.06490649064906491
reliabletrue
passestrue
1
name"Selvi"
dialogue"मैंने वहाँ कुछ देखा, लेकिन मैं अभी डरी हुई हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8844731977818854
mr0.878719275549806
reliabletrue
passestrue
2
name"Hunter"
dialogue"I'm sorry. I don't understand. I don't speak Hindi. Can you say it into this phone?"
detectedLang"en"
heavyLang"en"
scores
en0.7987734764277501
tl0.673913043478261
da0.4951923076923077
no0.4570837642192347
sv0.3993135011441648
it0.37648456057007124
sq0.3689903846153846
de0.3379571248423708
cs0.3371212121212121
nl0.3251928020565552
is0.30921052631578944
ca0.2905405405405405
pl0.279835390946502
vi0.27184466019417475
ro0.23802612481857763
yo0.2369186046511628
sk0.23469387755102045
et0.23020527859237538
lv0.22106824925816024
tr0.21875
az0.21052631578947367
hr0.20933734939759033
pt0.16
fr0.13793103448275862
hi0.12935323383084577
be0.11764705882352942
hu0.11317567567567569
lt0.10714285714285714
uk0.10714285714285714
reliabletrue
passestrue
3
name"Selvi"
dialogue"हाँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.900398406374502
mr0.8962655601659751
reliablefalse
passestrue
4
name"Hunter"
dialogue"Thank you. Did you see a person?"
detectedLang"en"
heavyLang"en"
scores
en0.8211091234347049
et0.5934959349593496
tl0.5901639344262295
pt0.5815899581589958
cs0.5735607675906184
sv0.5348837209302325
no0.5327102803738317
ca0.5305164319248826
ro0.5271867612293144
da0.5238095238095238
es0.5238095238095238
sq0.5238095238095238
hu0.522673031026253
vi0.5180722891566265
de0.5157384987893463
it0.5157384987893463
is0.511002444987775
fr0.5012468827930174
sk0.48586118251928023
hr0.4609164420485175
pl0.45054945054945056
lt0.4350282485875706
ms0.4301994301994302
lv0.42028985507246375
nl0.42028985507246375
tr0.4186046511627907
az0.39209726443769
yo0.3730407523510972
sl0.3103448275862069
eu0.25925925925925924
fi0.23954372623574144
reliabletrue
passestrue
5
name"Selvi"
dialogue"हाँ, लेकिन बहुत दूर। उसका चेहरा साफ़ नहीं दिखा।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8885918003565062
mr0.8845798707294552
reliabletrue
passestrue
6
name"Hunter"
dialogue"Man or woman?"
detectedLang"en"
heavyLang"en"
scores
en0.8027613412228797
tl0.7191011235955056
nl0.6309963099630996
no0.6226415094339622
da0.5633187772925764
sv0.5594713656387665
de0.5370370370370371
lv0.5192307692307693
lt0.4845360824742268
fi0.4444444444444444
ro0.4444444444444444
fr0.43820224719101125
cs0.4152046783625731
hr0.4152046783625731
sq0.4152046783625731
reliabletrue
passestrue
7
name"Selvi"
dialogue"पता नहीं। वह ऊँचा था और धीरे-धीरे चल रहा था।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8779086469405343
mr0.8681761786600496
reliabletrue
passestrue
8
name"Hunter"
dialogue"Tall... walking slowly?"
detectedLang"en"
heavyLang"en"
scores
en0.7216035634743875
pl0.4897959183673469
tl0.4703389830508474
nl0.44933920704845814
no0.4075829383886255
de0.3902439024390244
fr0.36224489795918363
is0.36224489795918363
pt0.36224489795918363
sv0.36224489795918363
reliabletrue
passestrue
9
name"Selvi"
dialogue"हाँ। मैंने उसकी तरफ़ कैमरा उठाया तो उसने मुझे देखा।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8829761024882976
mr0.8779547790339157
reliabletrue
passestrue
10
name"Hunter"
dialogue"You raised your camera? The person saw you?"
detectedLang"en"
heavyLang"en"
scores
en0.8031496062992126
tl0.6527777777777778
ms0.6246246246246246
fr0.5888157894736842
sv0.5667244367417678
no0.5029821073558649
it0.4959677419354839
ro0.49186991869918695
nl0.4845360824742268
da0.4747899159663866
sq0.4747899159663866
de0.4658119658119659
et0.4646680942184154
ca0.43438914027149317
es0.4279176201372997
pt0.3556701030927836
cs0.3540051679586563
is0.34895833333333337
yo0.299719887955182
lv0.23076923076923078
lt0.22360248447204967
tr0.21135646687697163
hu0.20127795527156547
az0.19093851132686085
hr0.19093851132686085
pl0.19093851132686085
sk0.19093851132686085
reliabletrue
passestrue
11
name"Selvi"
dialogue"हाँ। मेरा दिल बहुत तेज़ से धड़क रहा था।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8863313441318557
mr0.88558352402746
reliabletrue
passestrue
12
name"Hunter"
dialogue"Okay. What did the person do?"
detectedLang"en"
heavyLang"en"
scores
en0.808743169398907
tl0.6647509578544061
sq0.6621621621621622
pt0.6268656716417911
no0.5911214953271028
sv0.5833333333333334
da0.5635910224438903
pl0.5358090185676392
cs0.5231607629427792
sk0.5218579234972678
yo0.5138888888888888
hr0.5056497175141244
ms0.4868035190615836
fr0.4807121661721069
nl0.4760479041916168
de0.45482866043613707
is0.4336569579288026
sl0.4067796610169492
vi0.38811188811188807
ca0.33962264150943394
es0.3346007604562738
it0.3346007604562738
ro0.32432432432432434
lv0.3
lt0.29149797570850206
tr0.2768595041322314
hu0.2647058823529412
az0.25213675213675213
et0.25213675213675213
reliabletrue
passestrue
13
name"Selvi"
dialogue"वह रुका। फिर पेड़ों में गया।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8894783377541998
mr0.875249500998004
reliabletrue
passestrue
14
name"Hunter"
dialogue"Stopped... went into the trees?"
detectedLang"en"
heavyLang"en"
scores
en0.8289345063538612
no0.4852941176470589
nl0.4807121661721069
da0.4712990936555891
sv0.4712990936555891
yo0.3794326241134752
tl0.37275985663082434
ca0.36363636363636365
et0.36363636363636365
sl0.3371212121212121
fr0.308300395256917
ms0.308300395256917
pl0.308300395256917
sq0.308300395256917
cs0.2857142857142857
hr0.2857142857142857
sk0.2857142857142857
reliabletrue
passestrue
15
name"Selvi"
dialogue"हाँ। तभी मैं भागी और यहाँ आ गई।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8800295311923219
mr0.8511904761904762
reliabletrue
passestrue
16
name"Hunter"
dialogue"Ran... came here?"
detectedLang"en"
heavyLang"en"
scores
en0.8255813953488372
yo0.5989304812834225
sq0.5714285714285714
reliabletrue
passestrue
17
name"Selvi"
dialogue"हाँ। मैं अभी भी काँप रही हूँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8912518124697921
mr0.8860182370820668
reliabletrue
passestrue
18
name"Hunter"
dialogue"Okay. I believe you. Did the person say anything?"
detectedLang"en"
heavyLang"en"
scores
en0.8084855627578078
tl0.6810598626104024
sq0.6234067207415991
no0.5504840940525588
sv0.5409604519774012
ms0.5343839541547278
da0.5289855072463767
tr0.44539249146757676
nl0.4425385934819897
cs0.4268077601410935
ca0.4122965641952984
it0.38446969696969696
hr0.37858508604206503
is0.37739463601532564
yo0.3737957610789981
pl0.36274509803921573
ro0.3486973947895792
fr0.33264887063655035
de0.30997876857749473
lv0.29805615550755943
pt0.29805615550755943
lt0.2934782608695652
sk0.2872807017543859
hu0.2857142857142857
az0.27293064876957496
et0.27293064876957496
es0.21307506053268765
be0.17721518987341772
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
19
name"Selvi"
dialogue"नहीं। बस एक पल के लिए मुझे लगा कि वह मुझे पहचान रहा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8805070656691604
mr0.869762174405436
reliabletrue
passestrue
20
name"Hunter"
dialogue"Knew you?"
detectedLang"en"
heavyLang"en"
scores
en0.8281786941580757
cs0.609375
tl0.609375
reliablefalse
passestrue
21
name"Selvi"
dialogue"हाँ।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.900398406374502
mr0.8962655601659751
reliablefalse
passestrue
22
name"Hunter"
dialogue"My phone. I have to go now. Stay where you are."
detectedLang"en"
heavyLang"en"
scores
en0.8365191146881289
tl0.5906801007556676
da0.5886075949367089
pl0.5865139949109415
cs0.5517241379310345
yo0.48083067092651754
sk0.4715447154471545
hr0.43965517241379315
no0.43868739205526774
ro0.4227353463587922
sq0.39478584729981375
vi0.37619961612284064
lv0.36274509803921573
lt0.3394308943089431
de0.3200836820083682
ca0.29805615550755943
sv0.29805615550755943
sl0.2713004484304933
it0.26136363636363635
fr0.20537897310513448
nl0.1875
be0.17721518987341772
tr0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
et0.16237113402061853
is0.16237113402061853
uk0.16237113402061853
reliabletrue
passestrue
23
name"Selvi"
dialogue"आप वापस आएँगे?"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8744619799139168
mr0.860223642172524
reliabletrue
passestrue
24
name"Hunter"
dialogue"Yes. I will come back. If you see anything, don't move."
detectedLang"en"
heavyLang"en"
scores
en0.8292682926829268
tl0.5483870967741935
it0.44178628389154706
sv0.40476190476190477
sq0.4006849315068493
et0.3996569468267582
cs0.3433395872420263
no0.29292929292929293
da0.2842535787321063
hr0.2842535787321063
ca0.2827868852459016
pl0.2647058823529412
de0.2324561403508772
ro0.20454545454545453
yo0.19908466819221968
ms0.1822429906542056
sk0.17061611374407584
be0.16666666666666666
tr0.16666666666666666
hu0.1606714628297362
az0.15254237288135594
is0.15254237288135594
lt0.15254237288135594
lv0.15254237288135594
uk0.15254237288135594
vi0.15254237288135594
reliabletrue
passestrue
25
name"Selvi"
dialogue"मेरा नंबर यहाँ के काउंटर पर लिखा है।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8864604030655692
mr0.8802753666566896
reliabletrue
passestrue
26
name"Hunter"
dialogue"Counter... I check. Thank you."
detectedLang"en"
heavyLang"en"
scores
en0.8129092609915809
tl0.6710526315789473
no0.6007984031936128
da0.5249406175771971
sv0.5098039215686274
vi0.5098039215686274
ca0.49622166246851385
sq0.4910941475826972
cs0.47780678851174935
it0.4708994708994709
ro0.4269340974212034
hr0.41002949852507375
tr0.39209726443769
pl0.38650306748466257
de0.3055555555555556
yo0.30313588850174217
fr0.2647058823529412
sk0.2647058823529412
be0.25925925925925924
hu0.250936329588015
az0.23954372623574144
et0.23954372623574144
is0.23954372623574144
lt0.23954372623574144
lv0.23954372623574144
nl0.23954372623574144
pt0.23954372623574144
uk0.23954372623574144
ms0.2277992277992278
sl0.2277992277992278
reliabletrue
passestrue
27
name"Selvi"
dialogue"कृपया सावधान रहें।"
detectedLang"hi"
heavyLang"hi"
scores
hi0.8854961832061069
mr0.8815165876777251
reliabletrue
passestrue
28
name"Hunter"
dialogue"I... okay. Good."
detectedLang"tl"
heavyLang"en"
scores
tl0.7887323943661971
en0.7572815533980582
no0.6590909090909091
da0.6495327102803737
hr0.6495327102803737
ca0.647887323943662
sv0.647887323943662
sq0.6411483253588517
pl0.6268656716417911
it0.6052631578947368
cs0.5833333333333334
ro0.5454545454545454
yo0.5370370370370371
sk0.4897959183673469
be0.4827586206896552
tr0.4827586206896552
hu0.471830985915493
az0.45652173913043476
et0.45652173913043476
is0.45652173913043476
lt0.45652173913043476
lv0.45652173913043476
uk0.45652173913043476
vi0.45652173913043476
reliabletrue
passestrue