NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-03-01M1KAAZ50DYEH625W6VTE3SA1
Run Details
Model:
DeepSeek V4 Flash 0731 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
24.6s
Cost:
$0.000193
Provider:
Relace
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="The Stern Welcome" data-color="red"> Thunder’s hooves clattered on the cobblestones as Frederick reined him to a halt before the stable yard. The great oak doors of the castle loomed above, but his attention was drawn to a figure leaning against the hitching post—a knight in battered silver armor, his arms crossed and his visor raised to reveal a weathered face scored with old scars. Sir Roland did not smile. He looked Frederick up and down, from the dust on his boots to the nervous grip on his reins, and let out a low grunt. “So you’re the new squire,” he said, his voice like gravel. “They told me you’d be arriving. I expected someone taller.” He pushed off the post and strode closer, boots sinking into the mud. “Leave the horse with the groom. Then follow me. You’ll learn the stables before you learn the sword, boy, and I’ll not have a lazy hand mucking out my mounts.” He paused, eyeing Thunder with a flicker of approval. “At least you’ve got sense enough to ride a real animal. Now move—we haven’t got all night.” </nc-section> <nc-section data-title="A Warm Greeting by the Stables" data-color="green"> The evening air smelled of hay and leather as Frederick guided Thunder through the wide stable gates. A tall, broad-shouldered knight stood waiting beside a lantern, his tabard bearing the golden falcon of the realm. Sir Roland’s face was kind, creased with laugh lines, and he raised a hand in welcome as Frederick dismounted. “Easy, lad, easy,” he said, stepping forward to take Thunder’s bridle. “You’ve ridden far by the look of you. Let’s get this fine beast some water and oats.” He gestured to a young groom, then turned to Frederick with a warm clap on the shoulder. “I’m Sir Roland, master of these stables and your mentor until you earn your spurs. You’ll find no harsh words here, only honest work and good teaching. Come, let’s settle your horse, and then I’ll show you the hall where you’ll eat your first meal as a squire. You must be hungry after such a ride.” </nc-section> <nc-section data-title="The Knight in the Shadows" data-color="blue"> The stable yard was darker than Frederick expected, hemmed in by high walls that swallowed the last of the sunset. He dismounted in near silence, the only sound being Thunder’s snorting breath. Then a voice came from the shadows near the feed bins—low, measured, and strangely calm. “You ride well for someone so young. That horse trusts you. Good.” Frederick spun to see a knight emerge from the gloom, his armor black as pitch, his cloak hanging limp in the still air. Sir Roland’s face was half-hidden by a lowered visor, but his eyes caught the lantern light like twin embers. He walked past Frederick without another word, patting Thunder’s neck, then stopped at the stable door. “I am Sir Roland. I have watched many squires come through these gates. Most are afraid of me. Are you?” He tilted his head, waiting. “If you are, you’ll never be a knight. But if you’re not, you might just survive the night.” He gestured toward a flickering torch inside. “Bring your horse. I have much to tell you—and little time to tell it.” </nc-section>
created_at
"2026-09-03T09:41:56.528Z"
9/3/2026, 9:41:56 AM
model
"deepseek/deepseek-v4-flash-20260731"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
380
moderation_latency
(null)
generation_time
24509
tokens_prompt
303
tokens_completion
1031
native_tokens_prompt
370
native_tokens_completion
940
native_tokens_completion_images
(null)
native_tokens_reasoning
202
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.00019325
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.19.0; linux; x64))"
http_referer
(null)
request_id
"req-1788428516-T9ITFjTqfwpzemjIPg99"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1788428516-VQUvY9iScS6PL74O07az"
upstream_id
"addf679af1c34f6e9bfbe9ca999a0fdc"
provider_responses
0
endpoint_id
"57c1bfab-049c-4d6a-ab34-ac1007a6043b"
id
"addf679af1c34f6e9bfbe9ca999a0fdc"
is_byok
false
latency
380
model_permaslug
"deepseek/deepseek-v4-flash-20260731"
provider_name
"Relace"
status
200
total_cost
0.00019325
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Relace"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval