Run: 2026-09-03-01M1M09P50ZXW29TVWXM52ZPVG

Run Details

Model:
Qwen 3.8 27B (Reasoning, XHigh)
Test:
Language Writing
Scenario:
Character dialogue (Hindi) in a story
Duration:
2m
Cost:
$0.014127
Provider:
Reka

Evaluation summary

Score Evaluator
Details Link
58.33% Parse dialogue (details)

Model input

System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Selvi"> Selvi is a 30-year old college student on a study abroad program. Born in India, she is fluent in Hindi and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Hindi, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Selvi is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Hindi, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Selvi and Hunter as a voice sheet: Selvi: "..." Hunter: "..."

Model response

AI
Hunter: "Excuse me, ma'am. Have you heard about the recent disappearances in Alborn?" Selvi: "Main... main abhi-ahhi... wahan kali gaari... usne mujhe dekha..." Hunter: "Ma'am, you're shaking. What did you see?" Selvi: "Mujhe samajh nahi aa raha... ek ladka... akela... uska kapda geele tha..." Hunter: "A young man? Near the old apple orchard?" Selvi: "Haan... haan... purani seeb ka baag... usne apna thela gira diya..." Hunter: "I'm sorry. I don't understand. I don't speak Hindi." Selvi: "Nahi. Main darr gayi hoon. Kripya... meri madad kijiye." Hunter: "My name is Hunter. I'm a detective. I'm going to check the orchard, but I need to take this call. Stay where you are." Selvi: "Kripya... unhe dhundo. Woh akela tha..." Hunter: "I'll do my best. I'll be right back." Hunter: "Detective Hunter. What? No, I'm at the cafe. Give me five minutes. Yes, near the old orchard. I'm moving now."
created_at"2026-09-03T16:05:43.209Z" 9/3/2026, 4:05:43 PM
model"qwen/qwen3.8-27b-20260814"
app_id182717
external_user(null)
streamedtrue
cancelledfalse
latency234
moderation_latency(null)
generation_time120266
tokens_prompt302
tokens_completion5363
native_tokens_prompt338
native_tokens_completion5508
native_tokens_completion_images(null)
native_tokens_reasoning5130
native_tokens_cached0
num_media_prompt(null)
num_input_audio_prompt(null)
num_media_completion0
num_search_results(null)
num_fetches(null)
web_search_engine(null)
origin"https://ncbench.com/"
is_byokfalse
finish_reason"stop"
native_finish_reason"stop"
service_tier(null)
usage0.01412652
router(null)
user_agent"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer(null)
request_id"req-1788451543-38mLQnQWrnZ2oDJQRRSg"
session_id(null)
preset_id(null)
api_type"completions"
id"gen-1788451543-snNcrye3EbNmKGt6UTFK"
upstream_id"chatcmpl-cf85bd50-373f-4e7d-a282-d066154efcee"
provider_responses
0
endpoint_id"15086968-df2f-4d69-86bb-c74c31644bb6"
id"chatcmpl-cf85bd50-373f-4e7d-a282-d066154efcee"
is_byokfalse
latency233
model_permaslug"qwen/qwen3.8-27b-20260814"
provider_name"Reka"
status200
total_cost0.01412652
cache_discount(null)
upstream_inference_cost0
provider_name"Reka"
response_cache_source_id(null)
data_region"global"
workspace_id"97e315e5-d303-487d-83c1-83180e8a13d4"

Evaluation details

Result Evaluator Details Meta Data
58.33% Parse dialogue n/a
dialogue
0
name"Hunter"
dialogue"Excuse me, ma'am. Have you heard about the recent disappearances in Alborn?"
detectedLang"en"
heavyLang"en"
scores
en0.7699707235466332
fr0.5335029686174724
nl0.519650655021834
tl0.4907407407407407
it0.41113490364025695
sv0.39091915836101887
pt0.38478747203579416
ms0.3785310734463277
da0.36194895591647336
sl0.35672514619883045
ca0.34523809523809523
ro0.3381468110709988
es0.3159203980099502
sq0.2912371134020619
cs0.28848641655886154
yo0.26174496644295303
no0.25271739130434784
pl0.21763869132290184
sk0.21428571428571427
de0.2109038737446198
et0.14728682170542634
az0.13249211356466878
fi0.12
lv0.1185897435897436
hr0.10277324632952692
lt0.10277324632952692
reliabletrue
passestrue
1
name"Selvi"
dialogue"Main... main abhi-ahhi... wahan kali gaari... usne mujhe dekha..."
detectedLang"ms"
heavyLang"nl"
scores
ms0.5416078984485191
tl0.4025735294117647
fi0.3380855397148676
en0.23349056603773585
et0.2243436754176611
fr0.21307506053268765
de0.1935483870967742
reliablefalse
passesfalse
2
name"Hunter"
dialogue"Ma'am, you're shaking. What did you see?"
detectedLang"en"
heavyLang"en"
scores
en0.7975708502024291
tl0.536178107606679
et0.40476190476190477
nl0.28977272727272724
no0.25595238095238093
de0.24242424242424243
cs0.2378048780487805
fr0.22118380062305293
is0.22118380062305293
pt0.22118380062305293
sv0.22118380062305293
reliabletrue
passestrue
3
name"Selvi"
dialogue"Mujhe samajh nahi aa raha... ek ladka... akela... uska kapda geele tha..."
detectedLang"et"
heavyLang"tl"
scores
et0.44581280788177335
no0.3253373313343328
eu0.2682926829268293
sq0.20634920634920634
tr0.199288256227758
fi0.18772563176895307
is0.1847826086956522
nl0.1818181818181818
lv0.1773308957952468
tl0.1773308957952468
da0.16044776119402984
sv0.15094339622641512
ms0.1362763915547025
reliablefalse
passesfalse
4
name"Hunter"
dialogue"A young man? Near the old apple orchard?"
detectedLang"en"
heavyLang"en"
scores
en0.7946228528752801
tl0.7156153050672182
fr0.6137640449438203
de0.5985401459854015
nl0.5943952802359882
sv0.5542949756888168
no0.548440065681445
es0.5080500894454383
da0.5036101083032491
yo0.4510978043912176
it0.43064182194616984
lv0.39293598233995586
lt0.3902439024390244
hu0.36194895591647336
sq0.3529411764705882
ms0.33894230769230765
pt0.3373493975903614
ro0.3357487922705314
ca0.3309002433090025
cs0.32432432432432434
sk0.32098765432098764
hr0.289405684754522
pl0.2763157894736842
sl0.24657534246575344
tr0.21875
is0.21428571428571427
az0.20289855072463767
eu0.20289855072463767
vi0.20289855072463767
et0.1863905325443787
fi0.1863905325443787
reliabletrue
passestrue
5
name"Selvi"
dialogue"Haan... haan... purani seeb ka baag... usne apna thela gira diya..."
detectedLang"sq"
heavyLang"et"
scores
sq0.5334370139968896
ms0.375
lv0.33920704845814975
et0.3227990970654628
tl0.2736077481840194
yo0.2628992628992629
sl0.25925925925925924
hr0.2537313432835821
pl0.21875
ca0.2
it0.2
reliablefalse
passesfalse
6
name"Hunter"
dialogue"I'm sorry. I don't understand. I don't speak Hindi."
detectedLang"en"
heavyLang"en"
scores
en0.7619047619047619
tl0.6687054026503568
no0.576271186440678
da0.5751633986928104
sv0.5178041543026707
it0.49376947040498437
is0.4196428571428571
sq0.40476190476190477
pl0.385633270321361
de0.3725868725868726
cs0.367704280155642
nl0.3538767395626242
ro0.33537832310838445
sk0.33127572016460904
et0.3257261410788381
hr0.2995689655172413
ca0.29805615550755943
pt0.23529411764705882
yo0.2111650485436893
hi0.1935483870967742
be0.17721518987341772
tr0.17721518987341772
hu0.1709183673469388
az0.16237113402061853
lt0.16237113402061853
lv0.16237113402061853
uk0.16237113402061853
vi0.16237113402061853
reliabletrue
passestrue
7
name"Selvi"
dialogue"Nahi. Main darr gayi hoon. Kripya... meri madad kijiye."
detectedLang"et"
heavyLang"tl"
scores
et0.41972920696324956
eu0.3548387096774194
tl0.3071593533487298
sq0.25925925925925924
sv0.25925925925925924
en0.24812030075187969
fr0.22680412371134018
de0.20634920634920634
reliablefalse
passesfalse
8
name"Hunter"
dialogue"My name is Hunter. I'm a detective. I'm going to check the orchard, but I need to take this call. Stay where you are."
detectedLang"en"
heavyLang"en"
scores
en0.8268036311514573
tl0.6308553971486762
ro0.4869072894550602
no0.47349310094408137
fr0.462166172106825
nl0.4573353293413174
cs0.45447705041384495
yo0.44015444015444016
da0.43535825545171336
sq0.4148506860371267
ca0.41437802907915994
it0.39633638634471274
de0.3933054393305439
pl0.38715131022823335
hr0.3744607420189819
sk0.36681222707423583
sv0.36459246275197194
sl0.3640350877192982
hu0.34210526315789475
pt0.3397085610200365
es0.2995169082125604
et0.2676767676767676
lv0.2602040816326531
lt0.25564681724846
is0.24083769633507857
tr0.22126745435016112
ms0.21621621621621623
az0.15501165501165504
vi0.15501165501165504
be0.0880503144654088
eu0.0880503144654088
fi0.0799492385786802
uk0.0799492385786802
reliabletrue
passestrue
9
name"Selvi"
dialogue"Kripya... unhe dhundo. Woh akela tha..."
detectedLang"sq"
heavyLang"de"
scores
sq0.592391304347826
pt0.3571428571428572
es0.3382352941176471
tl0.3055555555555556
reliabletrue
passesfalse
10
name"Hunter"
dialogue"I'll do my best. I'll be right back."
detectedLang"en"
heavyLang"en"
scores
en0.8089780324737345
tl0.698340874811463
yo0.5670995670995671
pl0.5402298850574713
cs0.522673031026253
sk0.5215311004784688
pt0.43820224719101125
no0.42857142857142855
hr0.375
sl0.375
hu0.36908517350157727
sq0.36908517350157727
lt0.358974358974359
vi0.35691318327974275
is0.3006993006993007
nl0.3006993006993007
da0.27007299270072993
de0.27007299270072993
fr0.27007299270072993
reliabletrue
passestrue
11
name"Hunter"
dialogue"Detective Hunter. What? No, I'm at the cafe. Give me five minutes. Yes, near the old orchard. I'm moving now."
detectedLang"en"
heavyLang"en"
scores
en0.8012586949320968
tl0.6417910447761195
no0.5786516853932584
fr0.5305164319248826
da0.504541701073493
pt0.5024875621890548
ca0.49874686716791977
es0.4893617021276596
nl0.47780678851174935
it0.47689625108979944
sq0.42363112391930835
de0.3939393939393939
ro0.38837920489296635
sl0.3227990970654628
sv0.3220338983050847
ms0.3181818181818182
et0.2840095465393795
hr0.281437125748503
sk0.21671018276762402
cs0.19678714859437751
fi0.19678714859437751
tr0.19678714859437751
pl0.18699186991869918
lv0.1792065663474692
yo0.15134370579915135
lt0.09502262443438914
reliabletrue
passestrue