NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-25-01KQ2E0DV0V2VCG72ZHT8GDACA
Run Details
Model:
DeepSeek V4 Pro
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.4s
Cost:
$0.000495
Provider:
DeepSeek
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1 (Red)" data-color="red"> As I dismounted near the stables, a burly knight with graying temples strode towards me, his steel boots crunching on the gravel. Sir Roland's face was weathered and stern, a jagged scar running down his left cheek. "You're late, boy," he growled, spitting on the ground with disdain. "Thunder should have been stabled an hour ago. I don't tolerate tardiness—ten laps around the outer wall, now!" My heart sank as he ripped the reins from my trembling hands, his cold eyes promising nothing but hardship ahead. </nc-section> <nc-section data-title="Version 2 (Green)" data-color="green"> A warm, booming laugh echoed through the courtyard as I climbed down from the saddle. Sir Roland approached with open arms, his round belly jiggling beneath his polished breastplate. "Frederick, my lad! Welcome!" he bellowed cheerfully, clasping my shoulder with a surprisingly gentle hand. "I see Thunder has served you well. Come, let's get this fine beast some oats, and then we'll have supper. I've been looking forward to meeting my new squire." His eyes twinkled with genuine kindness, and I felt my nervousness melt away. </nc-section> <nc-section data-title="Version 3 (Blue)" data-color="blue"> The stables were dim and quiet when a tall, graceful figure emerged from the shadows. Sir Roland moved with an almost eerie stillness, his dark hair tied back tightly. He studied me without a word, circling slowly, his gaze piercing my very soul. "Frederick," he finally whispered, his voice soft yet commanding. "The castle has been expecting you. Not just the castle—something older, something deeper." He glanced up at the mountains beyond, his expression unreadable. "Thunder knows the way. He always has. Stow your belongings quickly; there is much to discuss before dawn." </nc-section>
created_at
"2026-04-25T13:42:01.828Z"
4/25/2026, 1:42:01 PM
model
"deepseek/deepseek-v4-pro-20260423"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
847
moderation_latency
(null)
generation_time
12338
tokens_prompt
318
tokens_completion
471
native_tokens_prompt
291
native_tokens_completion
423
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000494595
router
(null)
provider_responses
0
endpoint_id
"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
id
"e9b9e7f4-ed6e-4439-945e-1b3b834a93d3"
is_byok
false
latency
283
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"DeepSeek"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777124521-Mxo3k3rHcHvN6oXRVsSf"
session_id
(null)
api_type
"completions"
id
"gen-1777124521-nX09PMJqOEZCCSnIVxmA"
upstream_id
"e9b9e7f4-ed6e-4439-945e-1b3b834a93d3"
total_cost
0.000494595
cache_discount
(null)
upstream_inference_cost
0
provider_name
"DeepSeek"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval