NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-16-01KHM5SGTYFBG2CKSRZCJB95GR
Run Details
Model:
DeepSeek V3 (2025-03-24)
Test:
Language Writing
Scenario:
Character dialogue (Italian) in a story
Duration:
15.5s
Cost:
$0.000463
Provider:
AtlasCloud
Model input
System
You are an expert novel author in the cozy mystery genre. Take the following details about characters/locations/... into account: <character name="Isabella"> Isabella is a 30-year old college student on a study abroad program. Born in Italy, she is fluent in Italian and does not yet know any English. She enjoys landscape photography and is always seen with her camera. </character> <character name="Hunter"> Hunter is a 35-year old detective who is investigating a series of mysterious disappearances in the small town of Alborn, MN. He is a former marine and has a no-nonsense attitude. Hunter has no knowledge of Italian, not even basic phrases. </character> <location name="Alborn, MN"> Alborne is a small town in the Midwest with a population of 3,000. It is known for its annual apple festival. </location>
User/Human
Write the following scene: Isabella is sitting at a cafe, looking at her camera. Hunter approaches her and asks her about a recent event in the town. She responds troubled and shaken in Italian, and Hunter looks confused. They talk for a while, until Hunter gets a call and has to leave. Return the dialogue between Isabella and Hunter as a voice sheet: Isabella: "..." Hunter: "..."
Model response
Messages
Meta
AI
Here’s the dialogue as a voice sheet: --- **Isabella:** *(sitting at the café, frowning at her camera, muttering in Italian)* "Non può essere... questo non ha senso..." *(It can't be... this doesn't make sense...)* **Hunter:** *(approaching, standing stiffly)* "Excuse me, ma’am. Mind if I ask you a few questions?" **Isabella:** *(startled, looks up, confused)* "Mi scusi? Non parlo inglese..." *(I'm sorry? I don't speak English...)* **Hunter:** *(frustrated, rubs his temple)* "Right. Uh... do you know anything about the missing person? The woman who vanished near the orchard?" *(mimes searching with his hands, as if that helps)* **Isabella:** *(eyes widen, grips her camera tighter, speaking rapidly in Italian)* "Ho visto qualcosa... una luce strana, ieri sera. Ma non so se—" *(I saw something... a strange light, last night. But I don’t know if—)* **Hunter:** *(holds up a hand, shaking his head)* "I don’t—I don’t understand. Do you know anyone who speaks English?" **Isabella:** *(frustrated, points to her camera, then to the street, speaking emphatically)* "La fotocamera! C'è qualcosa nelle foto!" *(The camera! There’s something in the photos!)* **Hunter:** *(squints at the camera, then sighs as his phone rings)* "Hold on." *(answers phone)* "Detective Hayes." *(listens, then frowns)* "Yeah. On my way." *(hangs up, turns back to Isabella, points at her camera, then at himself)* "I’ll be back. Don’t go anywhere." **Isabella:** *(nods, though she clearly doesn’t understand, clutching her camera protectively)* "Va bene..." *(Okay...)* **Hunter:** *(mutters as he walks away)* "Great. Just great." --- Let me know if you'd like any adjustments!
created_at
"2026-02-16T21:30:52.126354+00:00"
2/16/2026, 9:30:52 PM
model
"deepseek/deepseek-chat-v3-0324"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2333
moderation_latency
(null)
generation_time
15463
tokens_prompt
321
tokens_completion
457
native_tokens_prompt
266
native_tokens_completion
461
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000463136
router
(null)
provider_responses
0
id
"05cb92d2a7084cad9aad1f4dcf2e295e"
status
200
is_byok
false
latency
2333
endpoint_id
"5bb598f5-fd97-4f8b-91e4-ceab3743a03b"
provider_name
"AtlasCloud"
model_permaslug
"deepseek/deepseek-chat-v3-0324"
api_type
"completions"
id
"gen-1771277435-fkSCRk1gtxMK5jgueqZW"
upstream_id
"05cb92d2a7084cad9aad1f4dcf2e295e"
total_cost
0.000463136
cache_discount
(null)
upstream_inference_cost
0
provider_name
"AtlasCloud"
Evaluation details
Result
Evaluator
Details
Meta Data
90.0000%
Parse dialogue
n/a
dialogue
0
name
"Isabella"
dialogue
"Non può essere... questo non ha senso..."
languages
ita
1
eng
0.7057893071812718
passes
true
1
name
"Hunter"
dialogue
"Excuse me, ma’am. Mind if I ask you a few questions?"
languages
eng
1
ita
0.7610754659333945
passes
true
2
name
"Isabella"
dialogue
"Mi scusi? Non parlo inglese..."
languages
ita
1
eng
0.7867931155602388
passes
true
3
name
"Hunter"
dialogue
"Right. Uh... do you know anything about the missing person? The woman who vanished near the orchard?"
languages
eng
1
ita
0.5989741641337386
passes
true
4
name
"Isabella"
dialogue
"Ho visto qualcosa... una luce strana, ieri sera. Ma non so se—"
languages
ita
1
eng
0.7021666158071407
passes
true
5
name
"Hunter"
dialogue
"I don’t—I don’t understand. Do you know anyone who speaks English?"
languages
eng
1
ita
0.7527930484128391
passes
true
6
name
"Isabella"
dialogue
"La fotocamera! C'è qualcosa nelle foto!"
languages
ita
1
eng
0.565843179377014
passes
true
7
name
"Hunter"
dialogue
"I’ll be back. Don’t go anywhere."
languages
eng
1
ita
0.5378031383737518
passes
true
8
name
"Isabella"
dialogue
"Va bene..."
languages
eng
1
ita
0.8213793103448276
9
name
"Hunter"
dialogue
"Great. Just great."
languages
eng
1
ita
0.8943781942078365
passes
true