NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-20-01M5C6P4BQRB5A72R5A4MNPQ7W
Run Details
Model:
DeepSeek V4.1 Flash 1017 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
2.1s
Cost:
$0.000675
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Welcome of Sir Roland" data-color="red"> Frederick guided Thunder toward the stables, the scent of hay and horses filling the evening air. As he dismounted, a tall knight with a weathered face and a crimson cloak stepped from the shadows of the stable door. “You must be Frederick,” the knight said, his voice warm but steady. “I am Sir Roland, sworn to this castle and its training yard. You have ridden hard, lad, and that is a good beginning. Leave your horse to the grooms, and I will show you where a squire’s duties begin—and where they end.” </nc-section> <nc-section data-title="Version 2: The Knight at the Stables" data-color="green"> Near the stables, a broad-shouldered knight leaned against a post, watching Frederick with narrowed eyes. His armor was plain but well kept, and his hand rested easily on the pommel of his sword. “Frederick,” he said, not quite a question. “Sir Roland. I greet every squire the same way: with a warning. The castle is not kind to boys who dream only of glory. You will muck stalls, carry water, and learn obedience before you learn the sword. Prove yourself useful, and we will speak again.” </nc-section> <nc-section data-title="Version 3: The Greeting by Twilight" data-color="blue"> The stable lanterns had just been lit when Frederick led Thunder inside. A knight stood waiting between the stalls, his silver-gray hair touched by the lamplight. “Sir Roland,” he said, bowing slightly. “I have watched you ride since the tree line. There is fire in you, Frederick—I can see it. But fire must be tended, or it burns the hand that holds it. Come. The night is turning, and there is much you must learn before the last dragon’s shadow returns to these lands.” </nc-section>
created_at
"2026-10-20T08:26:14.268Z"
10/20/2026, 8:26:14 AM
model
"deepseek/deepseek-v4.1-flash-20261017"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
85
moderation_latency
(null)
generation_time
2122
tokens_prompt
303
tokens_completion
608
native_tokens_prompt
317
native_tokens_completion
546
native_tokens_completion_images
(null)
native_tokens_reasoning
128
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.000675036
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1792484774-iqc4Zej6SjgnxZVNs9ma"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1792484774-EknrtCqtumnNZM2gH9TX"
upstream_id
"81f47c08-aws_ue1"
provider_responses
0
endpoint_id
"34cd16bf-a525-40b2-beeb-5f1809202c06"
id
"81f47c08-aws_ue1"
is_byok
false
latency
49
model_permaslug
"deepseek/deepseek-v4.1-flash-20261017"
provider_name
"Together"
status
200
total_cost
0.000675036
cache_discount
0.000075264
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval