NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-11-01KKFE82JS1MNJWPENK8HG82NY
Run Details
Model:
ByteDance Seed 2.0 Lite
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
48.5s
Cost:
$0.004331
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="The Gruff Initiation" data-color="red"> I haul Thunder’s reins over my shoulder, leading the lathered stallion toward the stone stable block, my shoulders aching from the day’s cross-country ride, when a broad shadow falls across the straw-strewn yard. I look up to find a man with a ragged scar splitting his left eyebrow, chainmail still strapped to his broad frame, wiping axle grease from a dented war axe propped against the stable wall. “You’re the new squire, Frederick,” he says, not a question, his voice rough enough to scratch stone. He steps forward, kicking a loose stone that would have caught Thunder’s hoof before the stallion could stumble, and I recognize Sir Roland, the knight I’d come to serve. “Tie that horse’s headcollar to the third post from the door, not the rickety second. Any fool that lets their mount wander off before they’ve even reported for duty spends their first week mucking the northern privies. Welcome to Castle Bramble. Don’t waste my time.” </nc-section> <nc-section data-title="The Homey Welcome" data-color="green"> I lead Thunder into the sun-dappled stable yard, clover growing between the cobblestones and the scent of hay and wild mint drifting from the open stable doors, when a warm laugh calls my name. I turn to see Sir Roland, his surcoat unbuttoned at the throat, his hands stuffed full of crisp apple slices, a tabby cat winding around his scuffed leather boots. “Frederick, right? I saw you ride in over the west hill an hour ago—your boy there looked like he could use a treat, same as you.” He crosses the yard, holding out an apple slice for Thunder to nibble, then passes me a chipped clay mug of spiced cinnamon cider, still steaming. “I remember my first day, so nervous I dropped my entire supper in the great hall. No need for that here. Your stall’s all bedded with fresh straw, and I’ve got an extra wool blanket in the loft if the mountain nights get cold. Welcome to the castle.” </nc-section> <nc-section data-title="The Hushed Warning" data-color="blue"> I lead Thunder into the shadowed stable yard, twilight bleaching the stone walls gray, the only sound the distant hoot of an owl and the shuffle of a stable boy turning down a lantern down the aisle, when a hand clamps lightly over my shoulder. I jump, spinning to find Sir Roland, his hood pulled up over his hair, his voice low enough that only I can hear it, his eyes flicking to the distant stable boy to make sure he’s out of earshot. “You’re Frederick. Don’t say a word too loud, not until you learn who you can trust in this castle.” He shakes my hand in greeting, and I feel a crumpled scrap of parchment pressed into my palm, folded small enough to hide in my fist. “The old tales they tell you of the dragon that vanished a century ago? They’re lies. It’s still here, and the lords of this castle are hunting it. Don’t trust anyone that asks you about the old cellars beneath the western tower. Welcome to your new post. Stay sharp.” </nc-section>
created_at
"2026-03-11T21:53:32.774Z"
3/11/2026, 9:53:32 PM
model
"bytedance-seed/seed-2.0-lite-20260309"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
865
moderation_latency
(null)
generation_time
48375
tokens_prompt
318
tokens_completion
2339
native_tokens_prompt
348
native_tokens_completion
2122
native_tokens_completion_images
(null)
native_tokens_reasoning
1419
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.004331
router
(null)
provider_responses
0
endpoint_id
"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id
"021773266013317682bfa727eaa8ae907bb4f408e14b63d9f2d5c"
is_byok
false
latency
865
model_permaslug
"bytedance-seed/seed-2.0-lite-20260309"
provider_name
"Seed"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773266012-awGVXfpnkL2M05DvFKzb"
upstream_id
"021773266013317682bfa727eaa8ae907bb4f408e14b63d9f2d5c"
total_cost
0.004331
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval