NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KBYAXSTCYKJ1BYBF6Q9NWV
Run Details
Model:
DeepSeek V4 Flash 0731 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
50.3s
Cost:
$0.000213
Provider:
Relace
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight's Test" data-color="red"> I reined Thunder to a halt in the cobbled yard, the harsh clatter of hooves echoing off the stable walls. A tall knight in weathered plate armor emerged from the shadows, his hand resting on his sword pommel. Sir Roland looked me over—not my horse, not my saddle, but me. His gaze was like a cold blade. “So you are the new squire,” he said, his voice flat as a winter field. “Dismount. A squire does not ride like a lord into his own home.” I slid from the saddle, my boots crunching on loose straw. He stepped closer, close enough that I smelled oil and iron. “Remember this, boy. The castle may welcome you, but I do not—until you prove you deserve the honor of carrying a knight’s shield. Stables are this way. Your first task is to muck out every stall, and then you will learn what it truly means to serve.” He turned and walked off, leaving me standing with Thunder, my heart sinking and then hardening with resolve. </nc-section> <nc-section data-title="Version 2: The Warm Welcome" data-color="green"> The stable door creaked open before I could dismount, and out stepped a broad-shouldered knight with a smile that crinkled the corners of his sun-worn face. His armor was polished, but his tabard was loose, and he had straw in his hair. “Easy now, easy!” Sir Roland called up to me, raising a hand in greeting. “You must be Frederick. I saw you coming from the tower window and thought, ‘That boy rides like his horse means the world to him.’ Good sign, good sign.” He helped me down and clapped me on the shoulder with a hand like a friendly bear’s paw. “Welcome to the keep, lad. We’ll get you settled, feed you something hot, and then I’ll show you the stables—Thunder here deserves the best stall, and you deserve a good night’s sleep. Tomorrow the real work begins, but tonight we celebrate a new brother in arms.” He took Thunder’s reins with easy grace and led us both into the warm, hay-scented dark. </nc-section> <nc-section data-title="Version 3: The Keeper of Secrets" data-color="blue"> I was about to swing down from the saddle when a voice, low and almost drowned by the wind, spoke from beside me. “Not there. The third stall on the left. The straw is fresh.” I turned, and there stood Sir Roland, but not as I’d imagined a knight—his cloak was dark, his eyes lamp-lit, and he wore no sigil on his breast. He took my horse’s bridle without asking, his grip gentle yet firm. “Your coming was spoken of in riddles,” he murmured, glancing up at the castle’s highest tower. “The last dragon does not wake for just any squire.” I opened my mouth to question him, but he put a finger to his lips. “Stable your mount, Frederick. Then find me in the chapel under the yew tree. What I have to tell you may save your life—or doom it. Choose quickly.” He faded back into the shadows, leaving me and Thunder alone in the gathering dusk, a cold knot twisting in my chest. </nc-section>
created_at
"2026-09-03T10:09:59.757Z"
9/3/2026, 10:09:59 AM
model
"deepseek/deepseek-v4-flash-20260731"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
784
moderation_latency
(null)
generation_time
49893
tokens_prompt
303
tokens_completion
1153
native_tokens_prompt
370
native_tokens_completion
1048
native_tokens_completion_images
(null)
native_tokens_reasoning
380
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00021269
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788430199-Sj0BDUtQf1ZrSxZN0j4A"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788430199-0ZGLYD0w2jitescgiYvJ"
upstream_id
"6fbb76eb0c7741388fea57ceb307d30d"
provider_responses
0
endpoint_id
"57c1bfab-049c-4d6a-ab34-ac1007a6043b"
id
"6fbb76eb0c7741388fea57ceb307d30d"
is_byok
false
latency
752
model_permaslug
"deepseek/deepseek-v4-flash-20260731"
provider_name
"Relace"
status
200
total_cost
0.00021269
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Relace"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval