NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-03-01KJV0FSV5V38DQV5YBSQ4F1N7
Run Details
Model:
ByteDance Seed 2.0 Mini
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
50.1s
Cost:
$0.000899
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Gruff but Warm Training Master" data-color="red"> I’d just finished tying Thunder’s reins to the hitching post outside the stone stables, my leather gloves sticky with fresh straw dust, when a deep, rumbling voice cut through the creak of the stable doors. “You the new squire, Frederick?” I spun around, coming face-to-face with Sir Roland: his steel pauldrons were scuffed from months of training drills, a thin silver scar sliced across his left jaw, and he held a leather-bound roster of trainees tucked under one arm. He nodded at my skittish stallion, flicking a stray straw off his wool tunic, and added with a dry smirk, “Hope you know how to calm a overexcited warhorse—last squire let his mount kick over a tub full of the master smith’s oat polish. Cost me a week’s ale ration.” He gestured toward the inner stable yard, his boots clomping loud on the cobblestones, and promised I’d meet the rest of the trainee squires come first light. </nc-section> <nc-section data-title="Version 2: The Quiet Cat-Loving Knight" data-color="green"> My hands had gone clammy as I ran a shaking hand over Thunder’s mane, too busy staring up at the carved stone battlements above the stables to notice anyone approaching until a soft, warm laugh brushed my ear. I turned to find Sir Roland kneeling beside a tabby stray that had curled around his boot, his gauntlet lifted just enough to scratch the cat’s chin. He stood slowly, tucking a loose strand of chestnut hair behind his ear, and held out a gloved hand to shake. “Frederick, right? Head scullery Marquerie sent word you’d be arriving this evening.” He nodded at the cat, which padded off toward a stack of hay bales to nap, and added with a quiet, easy smile, “Don’t mind the strays—they guard the stable rats better than any hound I’ve ever used. First night’s on me at the tavern down the lane, if you’re not too worn out from the road.” </nc-section> <nc-section data-title="Version 3: The Dutiful Official Knight" data-color="blue"> I was stooping to gather the last of my stray saddle bags when the soft clink of polished chainmail made me look up. Sir Roland stood just inside the stable archway, his armor immaculately buffed, the royal lion crest of Liora emblazoned on his breastplate, a leather satchel stuffed with scrolls slung over one shoulder. He clicked his tongue once, and a young stable boy trotted over to take Thunder’s reins from my hand. “Squire Frederick, I presume,” he said, his voice crisp and measured, not unkind. He flipped open a rolled scroll and ran a finger over the inked list, explaining that my first duty would be to curry the lord’s warhorses before supper, then attend a quick gear check briefing at the armory come twilight. He paused, then added a faint, rare smile, “Don’t skip the supper line—chef hides extra turnip pies for the trainees who start early.” </nc-section>
created_at
"2026-03-03T23:28:17.265Z"
3/3/2026, 11:28:17 PM
model
"bytedance-seed/seed-2.0-mini-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
276
moderation_latency
(null)
generation_time
50028
tokens_prompt
318
tokens_completion
2339
native_tokens_prompt
349
native_tokens_completion
2160
native_tokens_completion_images
(null)
native_tokens_reasoning
1460
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.0008989
router
(null)
provider_responses
0
endpoint_id
"9265aa87-9657-4d40-b9d7-2a70318e57d9"
id
"0217725804973919aa9d0b0344e85196ac345634277259c6c5e7c"
is_byok
false
latency
276
model_permaslug
"bytedance-seed/seed-2.0-mini-20260224"
provider_name
"Seed"
status
200
api_type
"completions"
id
"gen-1772580497-maLBWTb9mlpCNZqvzMxO"
upstream_id
"0217725804973919aa9d0b0344e85196ac345634277259c6c5e7c"
total_cost
0.0008989
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval