NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-11-01KKFKFFXSBKQ1D8ZP381GNFN1
Run Details
Model:
ByteDance Seed 2.0 Lite
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
51.4s
Cost:
$0.004771
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Gruff Sentinel's Terse Welcome" data-color="red"> Frederick swings down from Thunder’s back, brushing caked road dust from his threadbare squire’s tunic, when a shadow falls across his path. Leaning against the weathered oak post of the nearest stable stall, a broad-shouldered man with a gash splitting his left eyebrow and a dented iron sword at his hip pushes off to stand at his full height—Sir Roland, the castle’s most feared battle commander. “You’re an hour late,” he barks, not offering a hand to help Frederick gather his waterlogged saddlebags, his voice sharp enough to cut through the whinny of spooked stable horses. He steps close enough that Frederick can smell old campfire smoke and bloodstain iron on his cloak, and adds, low enough no stable hand lingering in the hayloft can overhear, “Don’t trust anyone here. The dragon’s egg that went missing three moons back? It wasn’t stolen by raiders. It’s hidden in these walls, and anyone who goes looking for it ends up dead before the next full moon.” </nc-section> <nc-section data-title="Version 2: The Mentor's Heartfelt Welcome" data-color="green"> Frederick has just fumbled with Thunder’s stubborn saddle strap, his cold, stiff fingers struggling after the four-hour ride from his village, when a warm, calloused hand reaches over to loosen the knot for him. He looks up to find Sir Roland, the knight his father had written glowingly of for years, grinning down at him, a bushy auburn beard crinkling around his crinkled, kind eyes. “Easy, lad—those old straps have a mind of their own, I’ve fought them a hundred times,” he says, wiping hay dust from his linen tunic before clapping Frederick gently on the shoulder. He reaches into his pocket to pull out two crisp honeycrisp apples, tossing one to Thunder who snatches it eagerly, and leads the pair toward a clean, straw-lined stall he’d prepped just for the stallion. “I’ve got a sunny room in the barracks all set up for you, and the cook’s saved a plate of her famous cinnamon honey cakes for supper—we’re glad you’re here, Frederick. Training starts at dawn tomorrow, but tonight, we rest.” </nc-section> <nc-section data-title="Version 3: The Mystic Knight's Prophetic Greeting" data-color="blue"> Frederick reins Thunder to a halt at the stable gate, still marveling at the castle’s twilight-shrouded spires, when he realizes Sir Roland is already waiting for him, leaning against a stone hitching post, his usual knight’s surcoat stitched with faint, glowing silver runes that Frederick can’t quite parse. The knight doesn’t ask for Frederick’s name—he says it softly, as if he’s been whispering it to the wind for years, “Frederick. I’ve been waiting for you.” He steps forward, and pulls a small, iridescent indigo scale from the inner pocket of his cloak, the stone casting shards of star-like light across Frederick’s face. “You’re not here to be a common squire. The last dragon, trapped in the Frostspine Mountains for a century, sent a vision to me that you would come. You’re the only one who can reach her, who can break the curse that’s killing both our kingdom and her kind. Your training isn’t with swords—it’s with dragon magic, starting tonight.” </nc-section>
created_at
"2026-03-11T23:24:58.695Z"
3/11/2026, 11:24:58 PM
model
"bytedance-seed/seed-2.0-lite-20260309"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
580
moderation_latency
(null)
generation_time
51347
tokens_prompt
318
tokens_completion
2578
native_tokens_prompt
348
native_tokens_completion
2342
native_tokens_completion_images
(null)
native_tokens_reasoning
1578
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.004771
router
(null)
provider_responses
0
endpoint_id
"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id
"0217732714989477701a42f23cc3d37ac47a8e8735f343ab5a878"
is_byok
false
latency
580
model_permaslug
"bytedance-seed/seed-2.0-lite-20260309"
provider_name
"Seed"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773271498-3A04m80pXVSAmcaSUVRT"
upstream_id
"0217732714989477701a42f23cc3d37ac47a8e8735f343ab5a878"
total_cost
0.004771
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval