NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-20-01M5C6FEW7MTG44C5JY4PW0WDN
Run Details
Model:
DeepSeek V4.1 Flash 1017 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
3.0s
Cost:
$0.000933
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight of the Red Standard" data-color="red"> Frederick reined Thunder to a halt near the stables, the stallion’s breath steaming in the cooling evening air. Before he had even swung down from the saddle, a broad-shouldered knight stepped from the shadow of the stable arch. His tabard bore a crimson standard, and his voice carried the easy authority of a man used to being obeyed. “So you are Frederick,” Sir Roland said, clasping the young squire’s forearm. “I am the knight of this keep, and I’ll be watching your training closely. A squire’s first duty is not to swing a sword, but to learn discipline. Stable your horse, then report to the armory.” Frederick nodded, heart hammering. Sir Roland’s grip was firm, his gaze firmer. </nc-section> <nc-section data-title="Version 2: The Green Lantern at the Stables" data-color="green"> Near the stables, a lantern glowed green against the gathering dusk. Frederick was loosening Thunder’s girth when a lean knight with weathered features and a moss-green cloak approached. Sir Roland moved quietly for a man in armor, and his smile was warmer than Frederick had expected. “Easy, lad,” Sir Roland said, seeing the squire startle. “The castle has frightened better men than you. I’m Sir Roland, and I greet you not as a judge but as a guide. Tend to your horse first — a knight who neglects his mount neglects his honor. When you’re done, find me by the well, and we’ll speak of what brought you here.” Frederick exhaled. The green lantern swayed, and some of his fear went with it. </nc-section> <nc-section data-title="Version 3: The Blue Twilight Greeting" data-color="blue"> The last blue light of evening lingered over the castle as Frederick led Thunder toward the stables. A knight in polished steel stood waiting by the stable door, his silhouette sharp against the twilight. He watched Frederick dismount with calm, measuring eyes. “Frederick, son of the northern vale,” Sir Roland said. It was not a question. “I am Sir Roland, knight of this castle. You arrive on the eve of strange tidings, and I would know what sort of squire rides through our gates.” Frederick straightened. “One who means to serve, my lord.” Sir Roland studied him a moment, then nodded. “Then serve well. Stable your horse, and meet me in the courtyard before the moon rises. We have much to discuss.” </nc-section>
created_at
"2026-10-20T08:22:35.661Z"
10/20/2026, 8:22:35 AM
model
"deepseek/deepseek-v4.1-flash-20261017"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
82
moderation_latency
(null)
generation_time
2845
tokens_prompt
303
tokens_completion
855
native_tokens_prompt
317
native_tokens_completion
761
native_tokens_completion_images
(null)
native_tokens_reasoning
198
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.000933036
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1792484555-nMJH5I5DExvMk7raMxdn"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1792484555-cwkP36IddlFRUVqMkfV7"
upstream_id
"4b8eb5f2-aws_ue1"
provider_responses
0
endpoint_id
"34cd16bf-a525-40b2-beeb-5f1809202c06"
id
"4b8eb5f2-aws_ue1"
is_byok
false
latency
50
model_permaslug
"deepseek/deepseek-v4.1-flash-20261017"
provider_name
"Together"
status
200
total_cost
0.000933036
cache_discount
0.000075264
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval