NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-25-01KMJ8E18CSRMPPYJCCSNXMKA9
Run Details
Model:
Qwen 3 32B
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
47.3s
Cost:
$0.000386
Provider:
Nebius
Evaluation summary
Score
Evaluator
Details Link
100.00%
Parse dialogue
(details)
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
**Voice Sheet: Isabella and Hunter at the Cafe** **Setting:** A quiet corner of *Alborn’s Harvest Cup*, a rustic cafe with sun-warmed wooden tables. The scent of coffee and cinnamon rolls lingers. Isabella sits by a window, her camera resting on the table, lens polished with her thumb. Detective Hunter approaches, uniform jacket slung over his arm, and leans against her table. --- **Hunter:** (measured, scanning her camera) Ma’am, have you noticed anything odd around town lately? The mayor says the festival’s turnout’s been… off. **Isabella:** (startled, clutching her camera) *Scusi?* (She peers up, voice trembling.) *Io… non lavoro qui, sono solo…* (I don’t work here, I’m just…) **Hunter:** (interrupting, squinting at her accent) You’re not from around here. You’ve got that… (gestures vaguely at her camera) tourist energy. (Pulls a notepad.) Did you hear about the woman who vanished near the orchards last week? **Isabella:** (shaken, in rapid Italian) *L’ombra vicino al fiume! Ho visto qualcosa… qualcosa di brutto.* (The shadow by the river! I saw something… something awful.) *Ma nessuno mi crede!* (But no one believes me!) **Hunter:** (frowns, scratching his jaw) You speak…? (He glances at her camera again, then at the townspeople laughing in the distance.) You think the disappearances are tied to the festival? **Isabella:** (hands fluttering in frustration) *Non è il festival! È…* (It’s not the festival! It’s—) (She slumps, defeated.) *Lascia stare, americano. Non capisci.* (Let it go, American. You don’t understand.) **Hunter:** (squinting, leaning in) You’re scared. (Pats his radio.) I’ve got to go, but—we’ll talk again. (He nods sharply, then hesitates.) You’re not leaving town, right? **Isabella:** (softly, in Italian) *Nessuno esce vivo da Alborn in questo momento.* (No one leaves Alborn alive right now.) **Hunter:** (paling, as his phone rings) What? (He answers, gaze lingering on her.) Yes, Simpson—get over to the riverbank *now*. (To Isabella, gruff) Stay put. **Isabella:** (whispers, in Italian) *È troppo tardi per te…* (It’s too late for you…) --- **Scene Close:** Hunter strides out, radio crackling. Isabella stares at her camera, fingers shaking, as the cafe’s cheerful hum drowns out the unease curling between them.
created_at
"2026-03-25T10:25:21.681Z"
3/25/2026, 10:25:21 AM
model
"qwen/qwen3-32b-04-28"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
485
moderation_latency
(null)
generation_time
36951
tokens_prompt
344
tokens_completion
1327
native_tokens_prompt
280
native_tokens_completion
1193
native_tokens_completion_images
(null)
native_tokens_reasoning
702
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0003859
router
(null)
provider_responses
0
endpoint_id
"6f9e09e5-e836-4de0-a27d-27c74b866001"
is_byok
false
latency
10344
model_permaslug
"qwen/qwen3-32b-04-28"
provider_name
"SiliconFlow"
status
502
1
endpoint_id
"aaa39b6c-e488-491a-91e4-e5fb66f86601"
id
"cmpl-88130dd383099bd6"
is_byok
false
latency
485
model_permaslug
"qwen/qwen3-32b-04-28"
provider_name
"Nebius"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1774434321-CsnuwYhshxwuLpcVDYW3"
upstream_id
"cmpl-88130dd383099bd6"
total_cost
0.0003859
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Nebius"
Evaluation details
Result
Evaluator
Details
Meta Data
100.00%
Parse dialogue
n/a
dialogue
0
name
"Hunter"
dialogue
"Ma’am, have you noticed anything odd around town lately? The mayor says the festival’s turnout’s been… off."
detectedLang
"en"
heavyLang
"en"
scores
en
0.790356394129979
tl
0.5373430270984798
es
0.4077834179357022
da
0.36936936936936937
nl
0.36936936936936937
no
0.35720844811753905
it
0.3548387096774194
sq
0.3439550140581068
sk
0.3197278911564626
ms
0.2813141683778234
pt
0.2805755395683453
fr
0.27835051546391754
cs
0.2731048805815161
sv
0.2670157068062827
de
0.2265193370165746
hr
0.2248062015503876
pl
0.22394678492239467
fi
0.2222222222222222
lt
0.2125984251968504
sl
0.2125984251968504
lv
0.20634920634920634
ro
0.2054483541430193
ca
0.16567342073897498
et
0.1484184914841849
az
0.14425427872860636
yo
0.1325898389095415
hi
0.0979381443298969
reliable
true
passes
true
1
name
"Isabella"
dialogue
"Scusi? Io… non lavoro qui, sono solo…"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8319641523525019
fr
0.5302713987473904
es
0.36619718309859156
ca
0.3202416918429003
en
0.29245283018867924
eu
0.27884615384615385
reliable
true
passes
true
2
name
"Hunter"
dialogue
"You’re not from around here. You’ve got that… tourist energy. Did you hear about the woman who vanished near the orchards last week?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8156582086315333
tl
0.5737211634904714
nl
0.32
da
0.3122977346278317
no
0.30327868852459017
fr
0.2904841402337229
sq
0.2685025817555938
de
0.2537313432835821
et
0.2144177449168207
ro
0.20037629350893696
cs
0.19962335216572505
sv
0.19886899151743637
hr
0.19659735349716445
tr
0.1457286432160804
fi
0.14400805639476336
sl
0.1353001017293998
yo
0.11180773249738767
is
0.08405172413793104
ms
0.08405172413793104
es
0.07608695652173912
lt
0.07306434023991276
pt
0.07306434023991276
az
0.06900328587075576
hu
0.06900328587075576
it
0.06900328587075576
lv
0.06900328587075576
pl
0.06900328587075576
sk
0.06900328587075576
ca
0.06490649064906491
reliable
true
passes
true
3
name
"Isabella"
dialogue
"L’ombra vicino al fiume! Ho visto qualcosa… qualcosa di brutto. Ma nessuno mi crede!"
detectedLang
"it"
heavyLang
"it"
scores
it
0.7964601769911505
ca
0.5647236941710825
es
0.49825479930191974
pt
0.49781659388646293
ro
0.44764649375600385
fr
0.4412050534499514
sk
0.43792766373411535
sl
0.4209466263846928
no
0.3830472103004292
ms
0.3611111111111111
yo
0.3413516609392898
da
0.32432432432432434
tl
0.3162901307966707
nl
0.2542153047989624
cs
0.24639580602883354
pl
0.24342105263157895
en
0.23638778220451526
vi
0.23333333333333334
hu
0.22506738544474394
de
0.21662125340599456
lv
0.21232876712328766
tr
0.21232876712328766
lt
0.2101648351648352
hr
0.20907840440165062
et
0.14814814814814814
eu
0.14307004470938897
fi
0.13273001508295626
sv
0.11538461538461538
is
0.11128284389489954
sq
0.10156250000000001
reliable
true
passes
true
4
name
"Hunter"
dialogue
"You speak…? You think the disappearances are tied to the festival?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8019571295433364
tl
0.5944656488549619
fr
0.5728643216080402
nl
0.5272525027808677
cs
0.48233861144945184
no
0.4791666666666667
da
0.46473551637279603
pt
0.45997458703939004
ca
0.45652173913043476
ms
0.4551282051282051
hr
0.4272237196765499
sl
0.4201909959072306
it
0.4014084507042254
es
0.3902439024390244
ro
0.38494934876989867
lv
0.3786549707602339
sk
0.37037037037037035
yo
0.36472346786248133
lt
0.3511450381679389
sq
0.3285939968404423
pl
0.3178170144462279
sv
0.3156199677938808
et
0.22303473491773307
az
0.21731123388581952
de
0.1414141414141414
hu
0.1361788617886179
fi
0.1290983606557377
reliable
true
passes
true
5
name
"Isabella"
dialogue
"Non è il festival! È… Lascia stare, americano. Non capisci."
detectedLang
"it"
heavyLang
"it"
scores
it
0.7958628198149156
ro
0.6334310850439883
fr
0.6316306483300589
en
0.6161719549641761
ca
0.6077405857740585
pt
0.58006718924972
es
0.5791245791245792
tl
0.5471014492753623
sl
0.5259165613147914
sv
0.49664429530201337
hr
0.48489010989010994
cs
0.4769874476987448
no
0.4747899159663866
sq
0.4688385269121813
nl
0.46808510638297873
da
0.46351931330472107
az
0.4444444444444444
sk
0.4212962962962963
lt
0.40191387559808617
ms
0.39222042139384117
yo
0.3832236842105263
pl
0.36006825938566556
de
0.35456110154905335
lv
0.34782608695652173
et
0.32553956834532377
tr
0.2816091954022989
is
0.28023032629558536
hu
0.27466150870406186
fi
0.2454728370221328
eu
0.1883116883116883
reliable
true
passes
true
6
name
"Hunter"
dialogue
"You’re scared. I’ve got to go, but—we’ll talk again. You’re not leaving town, right?"
detectedLang
"en"
heavyLang
"en"
scores
en
0.8272613065326633
tl
0.5922905856189771
nl
0.3514150943396226
yo
0.3436754176610978
no
0.32926829268292684
pl
0.3064312736443884
da
0.2445054945054945
fr
0.22752808988764048
sk
0.1935483870967742
cs
0.19236417033773862
lv
0.18154761904761904
sl
0.18032786885245902
hr
0.17417417417417416
lt
0.15902140672782875
it
0.13793103448275862
ro
0.12420382165605094
tr
0.12420382165605094
de
0.1185897435897436
reliable
true
passes
true
7
name
"Isabella"
dialogue
"Nessuno esce vivo da Alborn in questo momento."
detectedLang
"it"
heavyLang
"en"
scores
it
0.7668997668997669
pt
0.7137404580152671
es
0.6178343949044587
sl
0.5548961424332344
tl
0.5405819295558958
en
0.5145631067961165
ro
0.49748743718592964
de
0.494949494949495
sk
0.4755244755244755
cs
0.4434137291280148
nl
0.44237918215613387
hr
0.42528735632183906
pl
0.42196531791907516
lt
0.39759036144578314
az
0.3877551020408163
fr
0.38016528925619836
yo
0.35205183585313177
eu
0.29245283018867924
sv
0.2628992628992629
tr
0.2518703241895262
ca
0.23076923076923078
da
0.23076923076923078
no
0.22879177377892032
ms
0.2
sq
0.1935483870967742
vi
0.17355371900826447
reliable
true
passes
true
8
name
"Hunter"
dialogue
"What? Yes, Simpson—get over to the riverbank now. Stay put."
detectedLang
"en"
heavyLang
"en"
scores
en
0.7980380842469705
da
0.5165745856353591
nl
0.515235457063712
tl
0.4868035190615836
no
0.4845360824742268
yo
0.476831091180867
hr
0.4664634146341463
ms
0.40476190476190477
sl
0.34701492537313433
de
0.3217054263565891
fr
0.308300395256917
sv
0.308300395256917
ca
0.2985971943887776
es
0.29577464788732394
sq
0.29006085192697767
pl
0.27835051546391754
sk
0.2738589211618257
cs
0.2723492723492723
lv
0.2584745762711864
lt
0.2290748898678414
is
0.2222222222222222
it
0.20634920634920634
tr
0.1822429906542056
pt
0.17061611374407584
ro
0.17061611374407584
reliable
true
passes
true
9
name
"Isabella"
dialogue
"È troppo tardi per te…"
detectedLang
"it"
heavyLang
"it"
scores
it
0.8020361990950227
ca
0.7058823529411765
sq
0.630801687763713
es
0.5872641509433962
nl
0.571078431372549
yo
0.5569620253164557
hr
0.5295698924731184
de
0.4696969696969697
no
0.4696969696969697
et
0.46808510638297873
lt
0.40273037542662116
ro
0.358974358974359
pl
0.35424354243542433
fr
0.34701492537313433
sl
0.34701492537313433
sv
0.34210526315789475
pt
0.3320610687022901
en
0.32950191570881227
lv
0.31906614785992216
tl
0.3
reliable
true
passes
true