NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-11-01KKFH22HS6Z771MNTF3GW5V8N
Run Details
Model:
ByteDance Seed 2.0 Lite
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
46.7s
Cost:
$0.003991
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Trial" data-color="red"> Frederick had just looped Thunder’s reins around a splintered oak hitching post outside the stables, brushing flecks of road dust from his tunic, when a shadow fell over him. He looked up to find Sir Roland, the kingdom’s most feared battle commander, his face crisscrossed with a scar that sliced through his left eyebrow, leaning against the stable’s stone lintel. “You’re the squire they sent from the western holds?” the knight growled, pushing off the wall to circle Frederick like a hound sizing up prey. Before Frederick could stammer a greeting, Sir Roland kicked a loose stone at his feet. “First lesson: never turn your back on an unchained stallion, and never assume a castle gate means you’re safe. Prove you’re worth the mud on my boots, or you’ll be sent home before the moon rises.” </nc-section> <nc-section data-title="Version 2: The Homecoming Welcome" data-color="green"> Frederick was just leading Thunder into the stable’s sun-warmed aisle, already reaching for a brush to work the road grit from the stallion’s coat, when a laugh rang out from the hayloft. A broad-shouldered man with silver streaks in his auburn beard swung down, wiping chaff from his leather surcoat emblazoned with Roland’s stag crest. “Easy there, Thunder, I’ve got sugar cubes in my pocket for you,” Sir Roland called, before turning to wrap Frederick in a quick, warm clap on the shoulder that nearly knocked the wind out of him. “I’m Roland—sent word ahead to have a cot and a bowl of rabbit stew waiting for you in the barracks. Your mother wrote me you’ve been riding since you were seven, eh? First order of business: feed your horse, then feed yourself. We’ve got all the time in the world to start training tomorrow.” </nc-section> <nc-section data-title="Version 3: The Clandestine Greeting" data-color="blue"> Frederick had only just secured Thunder’s stall door, fumbling with the rusted iron latch after his long ride, when a low voice spoke from the dim shadow between two hay bales. “Frederick of Westmere. You’re exactly on schedule.” He spun to find Sir Roland, his usual knight’s regalia stripped back to a plain tunic, a hood pulled low over his eyes to hide his identity from any passersby. The knight stepped forward, pressing a cold, carved iron token etched with a dragon’s wing into Frederick’s palm, folding his fingers around it before anyone could see. “The official story is you’re here for squire training. That’s a lie. The lords of this castle hunt dragons for their scales. I brought you here to find the last one before they do. Don’t speak of this to anyone. Not even the stable boys.” </nc-section>
created_at
"2026-03-11T22:42:41.862Z"
3/11/2026, 10:42:41 PM
model
"bytedance-seed/seed-2.0-lite-20260309"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
399
moderation_latency
(null)
generation_time
46580
tokens_prompt
318
tokens_completion
2148
native_tokens_prompt
348
native_tokens_completion
1952
native_tokens_completion_images
(null)
native_tokens_reasoning
1318
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.003991
router
(null)
provider_responses
0
endpoint_id
"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id
"021773268961989e14146857e7ceaf6846d2c1b56e6ac775f7ab2"
is_byok
false
latency
399
model_permaslug
"bytedance-seed/seed-2.0-lite-20260309"
provider_name
"Seed"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773268961-FNqdHtMMJdLSErwFt4NF"
upstream_id
"021773268961989e14146857e7ceaf6846d2c1b56e6ac775f7ab2"
total_cost
0.003991
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval