NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-11-01KKFC3W5Z0EN41VFXXASYR3X8
Run Details
Model:
ByteDance Seed 2.0 Lite
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
46.0s
Cost:
$0.004339
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Grim Welcome" data-color="red"> Frederick swung down from Thunder’s sweat-dampened back, slinging the stallion’s reins over a splintered post near the stable entrance, when a shadow detached from the archway. Sir Roland, his once-gilded armor dented and crusted with old blood, stepped forward, a longsword clinking at his hip. “You’re the new squire, Frederick,” he said, not a question, his voice rough as gravel. He crossed his arms, and Frederick spotted the ragged, claw-shaped scar slashing across his left gauntlet, the same mark he’d heard villagers whisper about in the hamlets he’d passed through. “Don’t get comfortable. The last three squires that stepped into these stables never stepped back out. Keep your wits about you, or you’ll end up as dragon fodder before the first snow.” </nc-section> <nc-section data-title="Chapter 2: The Warm Welcome" data-color="green"> Frederick had barely hopped off Thunder’s back and brushed pine needles from his travel-worn tunic when a round, cheery man in a scuffed tabard trotted out from the stable’s hayloft, his arms overflowing with fluffy, squeaking fox kits. “Frederick! Just in time, I was worried you’d gotten lost in the western woods!” Sir Roland called, wiping a strand of hay from his forehead as he descended the ladder, careful not to jostle the tiny orphaned kits he’d rescued the week prior. He slid one of the kits into Frederick’s outstretched palm, then clapped him on the back so hard Frederick stumbled. “C’mon, I got a crate of carrots stowed for Thunder, and a hot stew waiting in the kitchen. First order of business as your knight: we’ll get you settled, then tomorrow I’ll show you the glen where the dragon naps—he loves it when we bring him blackberry tarts, you’ll see he’s nothing to fear.” </nc-section> <nc-section data-title="Chapter 2: The Fated Greeting" data-color="blue"> Frederick led Thunder across the stable’s stone threshold, and the moment the stallion’s hooves touched the packed earth, faint cobalt runes carved into the rafters flared to life, casting the whole space in an eerie, glowing light. Before Frederick could fumble for the dagger at his belt, a tall, silver-haired knight stepped from the shadow of a feed trough, his own eyes glowing the same soft blue as the runes. “Frederick of Bramble Hollow. I have been waiting for you since the day you were born,” Sir Roland said, his voice echoing softly off the stone walls, no trace of surprise in his tone. He held out a hand, and a tiny shard of iridescent dragon scale floated from his palm to land in Frederick’s open palm, warm as a summer sun. “The runes only flare for the one prophesied to bond with the last dragon. You are not just here to be a squire. You are here to fulfill your destiny.” </nc-section>
created_at
"2026-03-11T21:16:17.994Z"
3/11/2026, 9:16:17 PM
model
"bytedance-seed/seed-2.0-lite-20260309"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1004
moderation_latency
(null)
generation_time
45968
tokens_prompt
318
tokens_completion
2283
native_tokens_prompt
348
native_tokens_completion
2126
native_tokens_completion_images
(null)
native_tokens_reasoning
1450
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.004339
router
(null)
provider_responses
0
endpoint_id
"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id
"0217732637785342ef693f353e4fada74e089bb6c721704c91745"
is_byok
false
latency
1004
model_permaslug
"bytedance-seed/seed-2.0-lite-20260309"
provider_name
"Seed"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773263778-2RDg1ZgiiNReNajHTCOe"
upstream_id
"0217732637785342ef693f353e4fada74e089bb6c721704c91745"
total_cost
0.004339
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval