NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-25-01KQ2G9A193W683S6RJPF85C5V
Run Details
Model:
DeepSeek V4 Pro (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
21.1s
Cost:
$0.000632
Provider:
DeepSeek
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="The Knight's Stern Welcome" data-color="red"> As I dismounted near the stables, the clatter of hooves on cobblestone echoed. A tall figure emerged from the shadows of the stable doorway—Sir Roland, his armor dulled by years of service, his face set in a grim line. “You’re late, squire,” he said, voice like gravel. “The castle doesn’t wait on stragglers. Stow your horse and report to the armory. We’ll see if you’re worth the bread you’ll eat.” He tossed a worn brush at my feet, turned, and strode off without another word. The weight of his gaze lingered, and I knew my trial had already begun. </nc-section> <nc-section data-title="A Warm Welcome by the Straw" data-color="green"> The scent of hay and horses filled the air as I led Thunder toward the stable. A cheerful voice rang out: “Well met, young Frederick!” Sir Roland stepped into the sunset glow, a broad smile creasing his weathered face. He clapped a hand on my shoulder with surprising gentleness. “We’ve been expecting you. How was the road? Come, let’s get your mount settled, then I’ll show you to the kitchens for a hot meal. Every future knight needs a full belly and a friend.” He took the reins himself, humming an old tune, and I felt the knots of travel loosen in my chest. </nc-section> <nc-section data-title="Whispers of Destiny at Dusk" data-color="blue"> I had barely looped Thunder’s reins over the hitching post when a voice, low and smooth as silk, slid from the stable’s dim interior. “Frederick—born under the Crescent Moon, if the records hold true.” Sir Roland emerged, his eyes glinting with an unreadable light. He wore no helm, and his silver hair caught the last rays of the sun like a crown. “The castle has awaited your arrival for longer than you know. There is a task, a burden, and a blessing woven into your bloodline. But first, you must prove yourself worthy of the secret.” He gestured for me to follow into the deepening shadows, and a chill, not of cold, but of fate, settled upon me. </nc-section>
created_at
"2026-04-25T14:21:49.997Z"
4/25/2026, 2:21:49 PM
model
"deepseek/deepseek-v4-pro-20260423"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1499
moderation_latency
(null)
generation_time
21042
tokens_prompt
318
tokens_completion
766
native_tokens_prompt
291
native_tokens_completion
698
native_tokens_completion_images
(null)
native_tokens_reasoning
204
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.000631765
router
(null)
provider_responses
0
endpoint_id
"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
id
"0148b04a-1849-4236-9877-91fb98e9835a"
is_byok
false
latency
539
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"DeepSeek"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777126909-yiOO5ZstpJZLO4tb6aQb"
session_id
(null)
api_type
"completions"
id
"gen-1777126909-RmDiPhaLPghw3EfihdyB"
upstream_id
"0148b04a-1849-4236-9877-91fb98e9835a"
total_cost
0.000631765
cache_discount
0.00010208
upstream_inference_cost
0
provider_name
"DeepSeek"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval