Run: 2026-03-11-01KKFFKBXPHZ6ZBSR1P7TZNV7A

Run Details

Model:
Qwen 3.5 9B
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
1m 26s
Cost:
$0.001204
Provider:
Together

Evaluation summary

Score Evaluator
Details Link
76.00% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Selvi: "Mera dost nahi." *(I don't have the friend.)* Hunter: "(In English, apologetically) I... am sorry. I do not understand Hindi. What is your name?" Selvi: "Selvi. Hindi... Inteha." *(Name is spoken in tongue gesture.)* Hunter: "Selvi. Are you safe? Where did you see him?" Selvi: "Dukaan mein. *(In the shop.)* Voh gayab. *(He disappeared.)*" Hunter: "Disappeared in the shop? Who is 'he'? Can you write it?" Selvi: *(Nods, pulls out notebook. Scribbles rapidly in Hindi.)* "Anu." *(Roughly written.)* Hunter: "Anu? Oh. Anu..." Selvi: "Anu... ghup hai." *(Anu is gone.)* Hunter: "Understood. Anu is missing. Thank you. Stay safe." Selvi: "Thank you." *(Mumbles in Hindi, unable to pronounce 'thank'.)* Hunter: "Call. Out." *(Puts phone to ear.)* Selvi: "Alborn?" *(Asking in confusion where they are going.)* Hunter: "Yes. Duty." *(Briefly.)* Selvi: "..." *(Looks at camera.)* Hunter: "I'll... come back." Selvi: "..." *(Nods.)* Hunter: "Call." *(Engages line, hangs up.)* Selvi: "Camera..." *(Looks at lenses.)* Hunter: "Must go." *(Turns to leave.)* Selvi: "Go." *(Hand gesture.)* Hunter: "Later. Stay safe." Selvi: "Okay." *(In broken English written on paper.)* Hunter: "Got it." *(Exits.)* Selvi: "..." *(Closes notebook.)*
created_at"2026-03-11T22:17:11.362Z" 3/11/2026, 10:17:11 PM
model"qwen/qwen3.5-9b-20260310"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency1528
moderation_latency(null)
generation_time85714
tokens_prompt315
tokens_completion8041
native_tokens_prompt300
native_tokens_completion7827
native_tokens_completion_images(null)
native_tokens_reasoning7714
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
usage0.00120405
router(null)
provider_responses
0
endpoint_id"00d506d9-a5e9-4382-a2b9-d54732365594"
id"oaga6g5-3pDw3Z-9daded8612ccf0ad"
is_byokfalse
latency1528
model_permaslug"qwen/qwen3.5-9b-20260310"
provider_name"Together"
status200
user_agent"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer(null)
api_type"completions"
id"gen-1773267431-Jpevi3tcPXMd4jbWW2J0"
upstream_id"oaga6g5-3pDw3Z-9daded8612ccf0ad"
total_cost0.00120405
cache_discount(null)
upstream_inference_cost0
provider_name"Together"

Evaluation details

Result Evaluator Details Meta Data
76.00% Parse dialogue n/a
dialogue
0
name"Selvi"
dialogue"Mera dost nahi."
detectedLang"eu"
heavyLang"tl"
scores
eu0.6875
cs0.5833333333333334
sv0.5833333333333334
reliabletrue
passesfalse
1
name"Hunter"
dialogue"I... am sorry. I do not understand Hindi. What is your name?"
detectedLang"en"
heavyLang"en"
scores
en0.7821034282393957
tl0.6550137994480221
no0.5410036719706242
da0.5398773006134969
nl0.5253164556962026
de0.5173745173745175
sv0.4820441988950276
pl0.4806094182825485
sq0.47405329593267886
is0.4658119658119659
cs0.46197991391678617
it0.45809248554913296
ro0.44029850746268656
sk0.438622754491018
yo0.4318181818181818
hr0.4085173501577287
pt0.40570522979397783
hu0.37080536912751677
vi0.3169398907103825
hi0.3055555555555556
et0.2951127819548872
tr0.2829827915869981
ca0.2690058479532163
sl0.24242424242424243
ms0.17218543046357618
be0.15730337078651685
az0.14383561643835618
lt0.14383561643835618
lv0.14383561643835618
uk0.14383561643835618
reliabletrue
passestrue
2
name"Selvi"
dialogue"Selvi. Hindi... Inteha."
detectedLang"tl"
heavyLang"et"
scores
tl0.7211895910780669
it0.5689655172413793
da0.5664739884393063
no0.5356037151702787
ca0.53125
sq0.5297805642633229
et0.5222929936305732
fi0.4230769230769231
is0.3951612903225807
ro0.3951612903225807
en0.39271255060728744
es0.39271255060728744
pt0.39271255060728744
fr0.375
de0.3697478991596639
lv0.3644067796610169
hr0.3562231759656652
eu0.35344827586206895
nl0.35344827586206895
pl0.35344827586206895
sl0.34782608695652173
hi0.34210526315789475
sv0.34210526315789475
cs0.33920704845814975
lt0.33920704845814975
sk0.3333333333333333
tr0.32432432432432434
hu0.3181818181818182
az0.3087557603686636
ms0.3087557603686636
vi0.29577464788732394
reliabletrue
passesfalse
3
name"Hunter"
dialogue"Selvi. Are you safe? Where did you see him?"
detectedLang"en"
heavyLang"en"
scores
en0.8150887573964498
et0.40476190476190477
ro0.3718592964824121
da0.3093922651933701
fi0.3055555555555556
no0.2711370262390671
cs0.2378048780487805
de0.2378048780487805
sq0.2378048780487805
tl0.2378048780487805
ca0.23547400611620795
reliabletrue
passestrue
4
name"Selvi"
dialogue"Dukaan mein. Voh gayab."
detectedLang"fi"
heavyLang"eo"
scores
fi0.5327102803738317
de0.4545454545454546
ms0.4545454545454546
sq0.4117647058823529
reliablefalse
passesfalse
5
name"Hunter"
dialogue"Disappeared in the shop? Who is 'he'? Can you write it?"
detectedLang"en"
heavyLang"en"
scores
en0.8176956733106466
nl0.5733788395904437
yo0.5104438642297651
tl0.4834710743801653
it0.44933920704845814
fr0.4485294117647059
ms0.4009584664536741
ro0.38016528925619836
sl0.3760399334442596
de0.375
sv0.33035714285714285
sq0.3042671614100185
az0.30037313432835816
hu0.29111531190926276
eu0.2704280155642024
no0.20212765957446807
et0.19700214132762314
is0.19700214132762314
lv0.18655097613882862
pl0.1830065359477124
sk0.17943107221006563
cs0.17218543046357618
da0.17218543046357618
ca0.17035398230088497
tr0.17035398230088497
lt0.1610738255033557
reliabletrue
passestrue
6
name"Selvi"
dialogue"Anu."
detectedLang"tl"
heavyLang"rn"
scores
tl0.8076923076923077
reliablefalse
passestrue
7
name"Hunter"
dialogue"Anu? Oh. Anu..."
detectedLang"nl"
heavyLang"rn"
scores
nl0.7142857142857143
tl0.6774193548387096
reliablefalse
passesfalse
8
name"Selvi"
dialogue"Anu... ghup hai."
detectedLang"vi"
heavyLang"tlh"
scores
vi0.6767241379310345
tl0.5833333333333334
it0.5714285714285714
reliabletrue
passesfalse
9
name"Hunter"
dialogue"Understood. Anu is missing. Thank you. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8028909329829172
nl0.5827538247566064
tl0.5412844036697247
da0.5327102803738317
sv0.5057660626029654
no0.49238578680203043
is0.4485294117647059
de0.3576017130620985
cs0.35064935064935066
hu0.33920704845814975
vi0.3258426966292135
yo0.2857142857142857
ms0.2682926829268293
sk0.22879177377892032
fi0.20634920634920634
pl0.20634920634920634
ca0.1935483870967742
fr0.1935483870967742
az0.1780821917808219
et0.1780821917808219
it0.1780821917808219
pt0.1780821917808219
reliabletrue
passestrue
10
name"Selvi"
dialogue"Thank you."
detectedLang"en"
heavyLang"en"
scores
en0.8247663551401868
vi0.6590909090909091
cs0.5098039215686274
tl0.5098039215686274
reliabletrue
passesfalse
11
name"Hunter"
dialogue"Call. Out."
detectedLang"en"
heavyLang"en"
scores
en0.84472049689441
tl0.6666666666666666
reliablefalse
passestrue
12
name"Selvi"
dialogue"Alborn?"
detectedLang""
heavyLang"en"
scores
reliablefalse
passestrue
13
name"Hunter"
dialogue"Yes. Duty."
detectedLang"en"
heavyLang"hu"
scores
en0.6774193548387096
reliablefalse
passestrue
14
name"Selvi"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
15
name"Hunter"
dialogue"I'll... come back."
detectedLang"en"
heavyLang"en"
scores
en0.7692307692307693
it0.6835443037974683
tl0.5714285714285714
reliabletrue
passestrue
16
name"Selvi"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue
17
name"Hunter"
dialogue"Call."
detectedLang"en"
heavyLang"en"
scores
en0.8333333333333334
reliablefalse
passestrue
18
name"Selvi"
dialogue"Camera..."
detectedLang"it"
heavyLang"ro"
scores
it0.7596153846153846
ro0.7596153846153846
ca0.6710526315789473
es0.6644295302013423
sv0.6212121212121212
en0.6031746031746031
fr0.6031746031746031
nl0.6031746031746031
de0.5901639344262295
ms0.5901639344262295
tl0.5901639344262295
reliablefalse
passestrue
19
name"Hunter"
dialogue"Must go."
detectedLang"en"
heavyLang"et"
scores
en0.823321554770318
pl0.6835443037974683
tl0.6062992125984252
yo0.6062992125984252
reliablefalse
passestrue
20
name"Selvi"
dialogue"Go."
detectedLang"pl"
heavyLang"ga"
scores
pl0.8120300751879699
en0.7967479674796748
tl0.7549019607843137
yo0.7549019607843137
reliablefalse
passestrue
21
name"Hunter"
dialogue"Later. Stay safe."
detectedLang"en"
heavyLang"en"
scores
en0.8062015503875969
nl0.6763754045307443
de0.609375
da0.4845360824742268
no0.47643979057591623
sv0.46236559139784944
hi0.4318181818181818
pl0.4318181818181818
fr0.4152046783625731
pt0.4152046783625731
tl0.4152046783625731
reliabletrue
passestrue
22
name"Selvi"
dialogue"Okay."
detectedLang"tl"
heavyLang"tl"
scores
tl0.8076923076923077
reliablefalse
passestrue
23
name"Hunter"
dialogue"Got it."
detectedLang"en"
heavyLang"en"
scores
en0.84472049689441
lv0.6323529411764706
sq0.6323529411764706
tl0.6031746031746031
yo0.6031746031746031
reliablefalse
passestrue
24
name"Selvi"
dialogue"..."
detectedLang""
heavyLang""
scores
reliablefalse
passestrue