NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-09-29-01M3P2G1QJ6894XF180DF5M2MG
Run Details
Model:
Claude Sonnet 5.5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
15.9s
Cost:
$0.016494
Provider:
Claude Platform on AWS
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Warrior's Welcome" data-color="red"> I slowed Thunder to a trot as we passed beneath the gatehouse, and the clatter of his hooves echoed off the stone. The stables sat low and long against the eastern wall, and a man stood at their entrance with his arms crossed over a chest plate dented by more battles than I could count. "You're late, boy," he called. His voice was a gravel road. "The sun's nearly down, and I was told to expect you at midday." I swung down from the saddle, my legs stiff from the long ride. "Forgive me, sir. The eastern bridge was flooded, and I had to go around by the ridge." The knight studied me for a long moment. A scar ran from his left brow to his jaw, pale against his weathered skin. Then, unexpectedly, the corner of his mouth twitched. "Sensible. A fool would have tried to ford it." He uncrossed his arms and extended a gauntleted hand. "Sir Roland. I'll be the one shouting at you for the next several years. Welcome to Castle Varethorn." I clasped his forearm as I'd seen men do in my father's hall. His grip nearly crushed my fingers. "Frederick," I managed. "Of Millbrook." "Aye, I know who you are." He glanced at Thunder, who was snorting and pawing at the cobblestones. "That's a fine animal. Shame about the rider, but we'll fix that." </nc-section> <nc-section data-title="Version 2: The Gentle Knight" data-color="green"> The stable yard smelled of hay and warm leather, and after the long ride it was the finest scent I had ever known. I dismounted and was fumbling with Thunder's reins when a voice spoke from the shadows of the doorway. "He's favoring his left foreleg. Did you notice?" I turned. An older knight sat on an overturned bucket, a half-peeled apple in one hand and a small knife in the other. His hair was silver, tied back with a scrap of green ribbon, and his eyes were kind and sharp. "I... no, sir," I admitted, crouching to look. Sure enough, Thunder held the hoof slightly raised. "Is it bad?" "A stone, likely. Nothing a good pick won't fix." He rose with a small groan, cut a slice of apple, and offered it to Thunder, who accepted it with great dignity. "I am Sir Roland. You must be young Frederick. We've been expecting you." "Thank you for the welcome, Sir Roland." "Don't thank me yet." His eyes twinkled. "I'm the one who'll be waking you before dawn. But a squire who notices his horse's troubles is a squire worth training. Tonight you learn about hooves. Tomorrow, swords." He handed me the pick, and I set to work. </nc-section> <nc-section data-title="Version 3: Shadows at Dusk" data-color="blue"> Dusk had settled over the castle by the time I reached the stables, and the torches along the wall had begun to gutter to life. Nothing moved in the yard except a pale moth circling the nearest flame. I led Thunder inside and found the stalls empty, the air strangely still. "Most of the horses were taken north," said a voice behind me. "Three days ago." I spun around, my hand flying to the hilt of the modest sword at my belt. A tall figure stood in the entrance, his cloak dark against the fading light. He raised both hands, though he did not seem alarmed. "Easy, lad. If I meant you harm, you'd not have heard me speak." He stepped forward, and the torchlight revealed a lined, weary face and a knight's sigil on his shoulder. "Sir Roland of Varethorn. You are Frederick." "How did you know?" "There are few reasons for a stranger to arrive on the eve of a storm." His gaze drifted toward the northern horizon, where the clouds hung heavy and strange. "Come. Stable your horse and keep your sword close. There is much I must tell you, and little time before the council meets." Thunder shivered beneath my hand, and I wondered what exactly I had ridden into. </nc-section>
created_at
"2026-09-29T07:54:01.335Z"
9/29/2026, 7:54:01 AM
model
"anthropic/claude-sonnet-5.5-20260928"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3804
moderation_latency
(null)
generation_time
15877
tokens_prompt
303
tokens_completion
1045
native_tokens_prompt
437
native_tokens_completion
1562
native_tokens_completion_images
(null)
native_tokens_reasoning
159
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.016494
router
(null)
user_agent
"langchainjs-openai/1.0.0 ((node/v24.21.0; linux; x64))"
http_referer
(null)
request_id
"req-1790668441-0AyJgFFo3AiDlF9lD0QG"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1790668441-MW6lmcRrABYWx6D3e5Js"
upstream_id
"msg_011CfXNQqvQ8t9wtLUpfLkT9"
provider_responses
0
endpoint_id
"99aaad94-923b-4fc1-b763-271ed5486f7a"
id
"msg_011CfXNQqvQ8t9wtLUpfLkT9"
is_byok
false
latency
699
model_permaslug
"anthropic/claude-sonnet-5.5-20260928"
provider_name
"Claude Platform on AWS"
status
200
total_cost
0.016494
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Claude Platform on AWS"
response_cache_source_id
(null)
data_region
"global"
workspace_id
"97e315e5-d303-487d-83c1-83180e8a13d4"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval