NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-03-11-01KKFEHKTDWZ9THR2JX72TG7HV
Run Details
Model:
ByteDance Seed 2.0 Lite
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
49.3s
Cost:
$0.004313
Provider:
Seed
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="First Meeting: The Gruff Initiation" data-color="red"> Frederick swung down from Thunder’s lathered back, his boots sinking into the mud-choked stable yard, and barely had time to loop the stallion’s reins around a splintered hitching post before a shadow fell over him. Sir Roland, the castle’s most feared battle knight, leaned against an oak stable post, a crisscrossed scar slashing across his left jaw, his chainmail clinking as he pushed off to size the young squire up. “You’re three bells late, boy,” he rumbled, kicking a loose rusted horseshoe across the mud so it skidded to a stop at Frederick’s feet. “Think you can waltz in here after the rest of the squires, and earn the right to wear this castle’s livery? First test: groom that stallion, mend his frayed girth, and have him ready for border patrol at dawn. If you slack, you’ll be sent back to your mother’s farm before the moon sets. No coddling here—not with the dragon’s fires starting to burn along the northern marches.” </nc-section> <nc-section data-title="First Meeting: The Kindred Welcome" data-color="green"> Frederick swung down from Thunder’s sweat-dusted back, his boots sinking into clover-strewn soft earth of the stable yard, and paused to brush a burr from the stallion’s mane before a warm laugh pulled his head up. Sir Roland, the local knight renowned for his care of the castle’s herd of rescue horses, stepped out from between two sunlit stable bays, a wobbly orphaned foal trotting at his heels, his face crinkling into a smile before he even crossed the yard to meet Frederick. “I’d know that line of chestnut stallions anywhere—your father rode the same bloodline when we fought side by side along the western borders,” he said, clapping Frederick gently on the shoulder before helping him loosen Thunder’s stiff saddle. “Come, I’ve saved you the driest stall in the west wing, with fresh hay and a bucket of apples for your boy. We’ve been waiting for you. Training starts slow at first, but there’s good work ahead of us here, work that’ll protect every farm and family for miles around.” </nc-section> <nc-section data-title="First Meeting: The Coded Greeting" data-color="blue"> Frederick swung down from Thunder’s shadowed back, his boots barely making a sound on the dewy stone of the stable yard, and fumbled for the official squire assignment parchment in his pocket before a low, clear voice cut through the gathering dusk. Sir Roland, his plate armor etched with faint silver runes that glowed like starlight in the fading light, stepped from the mouth of the locked, unused north stable, his hand resting on the hilt of a sword wreathed in faint wisping blue mist. “The last flame waits for the heir of the line,” he said, the ancient dragon-tongue passphrase rolling off his tongue, and he stepped closer to confirm Frederick knew the required reply—“the blood of the first binds what is broken”—before yanking him out of earshot of two passing stable hands. “You’re not here for ordinary knight’s training, boy. The last dragon is hidden beneath this castle, and your bloodline is the only one that can wake her. We’ve been waiting for you for a century.” </nc-section>
created_at
"2026-03-11T21:58:45.347Z"
3/11/2026, 9:58:45 PM
model
"bytedance-seed/seed-2.0-lite-20260309"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1202
moderation_latency
(null)
generation_time
49204
tokens_prompt
318
tokens_completion
2352
native_tokens_prompt
348
native_tokens_completion
2113
native_tokens_completion_images
(null)
native_tokens_reasoning
1367
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.004313
router
(null)
provider_responses
0
endpoint_id
"bf1a3473-7a0a-46d3-aaa5-adb8f876a697"
id
"0217732663262370c64a0471125ddcff16fb53685966178807324"
is_byok
false
latency
1202
model_permaslug
"bytedance-seed/seed-2.0-lite-20260309"
provider_name
"Seed"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.14.0; linux; x64))"
http_referer
(null)
api_type
"completions"
id
"gen-1773266325-imGzjutpKKXrkfGPkIyj"
upstream_id
"0217732663262370c64a0471125ddcff16fb53685966178807324"
total_cost
0.004313
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Seed"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval