NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-04-25-01KQ2JM31JEGMQ4KYV0P9XDKPC
Run Details
Model:
DeepSeek V4 Pro
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
35.3s
Cost:
$0.002512
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Stern Welcome" data-color="red"> As I dismounted near the stables, a shadow fell over me. Sir Roland stood there, his scarred face unreadable, his hand resting on the pommel of his sword. "You're late," he said, his voice like grinding stone. "The other squires arrived at dawn." He looked Thunder over with a critical eye. "At least your horse seems better trained than you." I felt my cheeks burn, but before I could stammer an apology, he turned on his heel. "Stable your mount. Training begins before sunrise. Don't disappoint me again." </nc-section> <nc-section data-title="Version 2: An Old Friend's Welcome" data-color="green"> "Frederick! By the gods, is that really you?" The voice boomed across the courtyard. Sir Roland strode towards me, his arms wide, a grin splitting his weathered face. He clasped my shoulder with a hand that could have crushed stone. "I knew your father well, boy. We fought together at the Battle of Thornwood." His eyes softened. "He'd be proud to see you here." A stable boy appeared to take Thunder's reins, and Sir Roland guided me towards the keep. "Come. You must be famished. We'll talk over supper." </nc-section> <nc-section data-title="Version 3: A Mysterious Greeting" data-color="blue"> The stable yard was eerily quiet when I arrived. Sir Roland emerged from the shadows between the stalls, his cloak billowing despite the still air. He studied me for a long moment, his eyes lingering on the pendant hidden beneath my tunic—my mother's pendant, the one she'd made me swear never to show anyone. "So," he murmured, "you've come at last." He gestured, and I felt the pendant grow warm against my chest. "There is much to discuss, Frederick. But first, you must understand—nothing about your arrival here is coincidence." </nc-section>
created_at
"2026-04-25T15:02:48.082Z"
4/25/2026, 3:02:48 PM
model
"deepseek/deepseek-v4-pro-20260423"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2760
moderation_latency
(null)
generation_time
27301
tokens_prompt
318
tokens_completion
465
native_tokens_prompt
291
native_tokens_completion
432
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0025119
router
(null)
provider_responses
0
endpoint_id
"d084170b-dd99-4e53-9ae1-b63881f3cfbf"
is_byok
false
latency
298
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"DeepSeek"
status
429
1
endpoint_id
"13bda129-f8a6-4a60-b1db-98082e5f7ccd"
id
"ogZqXzF-2dTqGa-9f1e3b18a027fac6"
is_byok
false
latency
2720
model_permaslug
"deepseek/deepseek-v4-pro-20260423"
provider_name
"Together"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.1; linux; x64))"
http_referer
(null)
request_id
"req-1777129368-zgzVQxoHuPivlOq3wLMJ"
session_id
(null)
api_type
"completions"
id
"gen-1777129368-I7TbcrrqC8Jd5Bge6vxY"
upstream_id
"ogZqXzF-2dTqGa-9f1e3b18a027fac6"
total_cost
0.0025119
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval