NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-20-01M5C6MYCM7D3GDXX6JCDESHN0
Run Details
Model:
DeepSeek V4.1 Flash 1017 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
3.2s
Cost:
$0.000879
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight of Iron" data-color="red"> I reined Thunder to a halt near the stables, the scent of hay and horses filling the evening air. A tall figure emerged from the shadows of the stable door—Sir Roland, the local knight, clad in a plain tunic and worn leather gloves. His gray eyes swept over me, then over Thunder, with the practiced appraisal of a man who trusted horses more than people. “You ride well enough for a squire,” he said, his voice low and gravelly. “But a castle is not a field, boy. In there, every step you take is watched, and every mistake is remembered.” He stepped closer and rested a hand on Thunder’s neck. “Stable your horse. Then find me in the training yard. We’ll see what kind of steel you carry—inside and out.” </nc-section> <nc-section data-title="Version 2: A Warm Welcome" data-color="green"> The stable yard was alive with the clatter of buckets and the soft nickering of horses as I dismounted. A broad-shouldered man with a sunburnt face and a ready smile strode toward me, wiping his hands on a cloth. This, I knew at once, was Sir Roland—though he looked more like a farmer than a legendary knight. “Frederick, is it?” He clasped my forearm warmly. “Welcome, lad. Don’t let the castle folk frighten you with their solemn faces. Half of them have forgotten how to smile.” He nodded toward Thunder. “Fine horse. Let’s get him settled, and then I’ll show you where the kitchen keeps the good bread. A squire fights better on a full stomach.” </nc-section> <nc-section data-title="Version 3: The Knight Who Knew" data-color="blue"> Dusk had deepened by the time I reached the stables, and the castle windows glowed like embers above me. Sir Roland stood waiting beneath the stable arch, his cloak stirring in a wind that seemed to follow only him. He did not smile. “Frederick,” he said, and the way he spoke my name made it sound like an old secret. “You have your father’s eyes.” He glanced at Thunder, then back at me. “There are things in this castle that will test you before your training even begins. When they do, come to me. Not to the courtiers, not to the priests. To me.” He turned toward the stable door. “Now, see to your horse. We have much to discuss—and little time.” </nc-section>
created_at
"2026-10-20T08:25:35.386Z"
10/20/2026, 8:25:35 AM
model
"deepseek/deepseek-v4.1-flash-20261017"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
104
moderation_latency
(null)
generation_time
3136
tokens_prompt
303
tokens_completion
781
native_tokens_prompt
317
native_tokens_completion
716
native_tokens_completion_images
(null)
native_tokens_reasoning
160
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.000879036
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1792484735-WYRonErH5eg1ZcicjT94"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1792484735-GkSU6PKECICXNt0cWnDV"
upstream_id
"71524097-aws_ue1"
provider_responses
0
endpoint_id
"34cd16bf-a525-40b2-beeb-5f1809202c06"
id
"71524097-aws_ue1"
is_byok
false
latency
66
model_permaslug
"deepseek/deepseek-v4.1-flash-20261017"
provider_name
"Together"
status
200
total_cost
0.000879036
cache_discount
0.000075264
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval