NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-03-01KJTYAJHDP85N82NP0B94BWPR
Run Details
Model:
ByteDance Seed 2.0 Mini
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
54.3s
Cost:
$0.000969
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Stable Greeting" data-color="red"> The clink of Thunder’s iron hooves on cobblestones faded as I led my tired stallion toward the stable’s weathered oak doors, straw sticking to the damp soles of my boots. A low, rumbling chuckle pricked my ears from the shadow of the hayloft, and I spun to find Sir Roland: tall, broad-shouldered, his plate gauntlet dangling from one wrist, a thin silvery scar slicing across his left cheek. “First time hauling your own gear to the gates, huh?” he asked, stepping forward to clap a calloused, heavy hand on my shoulder, his eyes crinkling with warm amusement as he nodded at Thunder’s flanks, still damp with sweat from the ride. I stumbled over an apology for being late, but he waved it off, jerking his chin toward a stack of polished saddle blankets by the tack room. “First task: brush this old boy down, then help the stable boys mend the split fence by the east paddock. Been meaning to get to that since last winter’s storm.” </nc-section> <nc-section data-title="Chapter 1: The Stable Assessment" data-color="green"> I fumbled with Thunder’s lead rope, my saddle bags slipping off one shoulder as I tried to tether him to an empty hitching post by the stables. A clatter of a metal water bucket skittering across the cobblestones made me spin, and I barely caught it before it slammed into my boots. Standing over the spilled grain scattered across the straw was Sir Roland: his tabard crisply pressed, his sword belt buckled tight, his gaze sharp enough to slice through the dusk. “A squire’s first duty is to control both his mount and his cargo,” he said, his voice low and sharp, no trace of easy warmth. I flushed, reaching down to right the bucket, and he sighed, softening slightly as he nodded at the hay bale beside me. “Take a breath, new boy. I don’t eat squires for breakfast—yet. But you’ll learn fast: every tool, every beast, every detail matters here. Wipe up that grain before the rats swarm it, then report to the armory before sundown.” </nc-section> <nc-section data-title="Chapter 1: The Stable Companions" data-color="blue"> I’d just guided Thunder’s wet, whinnying frame into the stable yard when a high, tiny meow made both of us turn. Sir Roland was knelt by a stack of empty feed sacks, a plump tabby cat curled in his gauntlet-free hand, purring so loud it hummed against his woolen tunic. He looked up, his face softening into a smile that erased the stern edge I’d seen from other castle knights, and tucked the cat into a pocket of his saddlebags before standing to greet me. “Welcome to the training yards, squire,” he said, nodding at Thunder, finally setting the tabby back on a pile of straw where it curled up contentedly. “This is Lila—she’s the stable’s unofficial watchcat, and she’ll hiss at you if you forget to leave a scrap of cheese for her during your shifts. I’m Sir Roland, but you can call me Roland for now; most of the stable boys do. First stop: let’s get you registered with the head stablehand, then we’ll sit for a cup of spiced cider while I walk you through your first week’s lessons.” </nc-section>
created_at
"2026-03-03T22:50:28.794Z"
3/3/2026, 10:50:28 PM
model
"bytedance-seed/seed-2.0-mini-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1115
moderation_latency
(null)
generation_time
54224
tokens_prompt
318
tokens_completion
2514
native_tokens_prompt
349
native_tokens_completion
2335
native_tokens_completion_images
(null)
native_tokens_reasoning
1574
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0009689
router
(null)
provider_responses
0
endpoint_id
"9265aa87-9657-4d40-b9d7-2a70318e57d9"
id
"0217725782292080f20bbdfc8ca54d9bbb0533a8546905c38a65c"
is_byok
false
latency
1115
model_permaslug
"bytedance-seed/seed-2.0-mini-20260224"
provider_name
"Seed"
status
200
api_type
"completions"
id
"gen-1772578228-jnKuVCvSnCw6BYRfemLl"
upstream_id
"0217725782292080f20bbdfc8ca54d9bbb0533a8546905c38a65c"
total_cost
0.0009689
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval