NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-10-20-01M5C6HN34A975XXE6NPTW26R4
Run Details
Model:
DeepSeek V4.1 Flash 1017 (Reasoning, High)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
4.3s
Cost:
$0.001235
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Knight's Measure" data-color="red"> I reined Thunder to a halt near the stables, the scent of hay and horses thick in the evening air. A tall figure emerged from the shadows of the stable door—Sir Roland, the local knight, his armor dulled by the day’s dust. He did not smile. His eyes, gray as storm clouds, swept over me from boots to brow, weighing me as a merchant weighs coin. “So,” he said, voice low and flat, “you are the new squire. You ride well enough. But riding is not serving.” He stepped closer, and I felt the weight of his judgment. “The castle does not need another boy who dreams of glory. It needs hands that work and a back that bends. Do you understand?” I nodded, though my throat was dry. Sir Roland turned toward the stable, then paused. “Unsaddle your horse. Rub him down. Then find me in the training yard. We will see what you are made of.” He walked away without another word, and I knew, with a sinking feeling, that my training had already begun. </nc-section> <nc-section data-title="Version 2: A Warm Welcome" data-color="green"> Thunder had barely stopped when a booming laugh rolled across the stable yard. “By the gods, a rider who knows how to sit a horse!” Sir Roland strode toward me, a bear of a man with a ruddy face and a grin that split his beard. He clapped a heavy hand on my shoulder, nearly unseating me. “Frederick, is it? The new squire? Well met, lad, well met!” His enthusiasm was infectious, and I found myself smiling despite my nerves. “I remember my first day,” he said, leaning against a post. “I fell off my horse right in front of the stable master. Twice.” He winked. “Don’t tell anyone.” He helped me unsaddle Thunder, chatting all the while about the castle’s cooks, the best places to fish in the moat, and the one stable boy who could whistle like a lark. “You’ll do fine here,” he said at last, giving my shoulder another friendly thump. “Just keep your boots clean and your sword sharp. And if you ever need a hand, my door is always open.” As he walked away, whistling a tavern tune, I felt the knot in my chest loosen for the first time since I’d left home. </nc-section> <nc-section data-title="Version 3: The Silent Knight" data-color="blue"> The stable yard was quiet, the only sound the soft nickering of horses and the distant clang of a blacksmith’s hammer. Sir Roland stood by the water trough, his back to me, a dark silhouette against the fading light. He did not turn when I approached. “You are late,” he said, though his voice held no anger—only a strange, measured calm. I began to apologize, but he raised a hand. “Time is not the issue. Silence is.” He turned then, and I saw his face for the first time—younger than I had expected, with sharp features and eyes that seemed to look through me rather than at me. “The castle has many ears, squire. Many eyes. Speak little. Listen much. And trust no one who offers you a gift without a price.” He gestured toward the stables. “Your horse is tired. So are you. But before you rest, walk the perimeter of the yard. Count the doors. Note the shadows. Then come to the north tower at midnight. We have much to discuss.” He vanished into the gathering dusk, leaving me alone with Thunder and a growing sense that the castle held more secrets than I had ever imagined. </nc-section>
created_at
"2026-10-20T08:23:47.563Z"
10/20/2026, 8:23:47 AM
model
"deepseek/deepseek-v4.1-flash-20261017"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
62
moderation_latency
(null)
generation_time
4208
tokens_prompt
303
tokens_completion
1106
native_tokens_prompt
317
native_tokens_completion
1013
native_tokens_completion_images
(null)
native_tokens_reasoning
205
native_tokens_cached
256
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
service_tier
(null)
usage
0.001235436
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1792484627-ktms9uSlRG2XGsrQTHIw"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1792484627-ZeRvKkoZDy2MMifl4Np9"
upstream_id
"e0edd326-aws_ue1"
provider_responses
0
endpoint_id
"34cd16bf-a525-40b2-beeb-5f1809202c06"
id
"e0edd326-aws_ue1"
is_byok
false
latency
61
model_permaslug
"deepseek/deepseek-v4.1-flash-20261017"
provider_name
"Together"
status
200
total_cost
0.001235436
cache_discount
0.000075264
upstream_inference_cost
0
provider_name
"Together"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval