NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWEA2AVQ6CQ46VKD8DXDFPW0
Run Details
Model:
Claude Sonnet 5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.3s
Cost:
$0.009640
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: A Knight's Welcome" data-color="red"> As Thunder's hooves clattered against the cobblestones leading to the stables, a broad-shouldered figure emerged from the shadows of the hayloft. Sir Roland's armor caught the last rays of sunlight, gleaming like burnished gold. His weathered face broke into a grin beneath his graying beard. "You must be the squire from Millbrook," he said, his voice carrying the gravel of countless battle cries. "I am Sir Roland, and I'll be the one knocking the softness out of you, boy." He clasped a firm hand on Frederick's shoulder as he dismounted, nearly toppling him. "Welcome to your new home. It won't be comfortable, but it will make a man of you." </nc-section> <nc-section data-title="Chapter 1: A Knight's Welcome" data-color="green"> A tall figure stepped from the stable's entrance, his chainmail softly chiming with each measured step. Sir Roland moved with the quiet confidence of a man who had seen countless seasons of both peace and war. His eyes, sharp and assessing, studied Frederick as the young squire slid down from Thunder's saddle. "Frederick, is it?" Sir Roland asked, extending a calloused hand in greeting. "I received word of your arrival. The stable boy will see to your horse—Thunder, was it? A fine name for a fine animal." He gestured toward the castle looming behind them. "Come. There's much to discuss before nightfall, and even more to learn in the days ahead." </nc-section> <nc-section data-title="Chapter 1: A Knight's Welcome" data-color="blue"> The stables buzzed with quiet activity—grooms tending to horses, the scent of hay and leather thick in the air. Amid this bustle, a knight in polished steel emerged, his crimson cape billowing slightly in the evening breeze. Sir Roland's presence seemed to command the very air around him, though his expression remained warm. "Ah, our newest squire arrives at last," Sir Roland said, watching as Frederick struggled to calm Thunder after the long ride. "Patience with the beast—he's tired, as I imagine you are." He stepped closer, offering a respectful nod rather than the stern greeting Frederick had expected. "I've trained many squires in my years, but something tells me you'll be different. Let's get you settled, and tomorrow, we begin." </nc-section>
created_at
"2026-07-01T07:42:32.324Z"
7/1/2026, 7:42:32 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3468
moderation_latency
(null)
generation_time
13294
tokens_prompt
318
tokens_completion
641
native_tokens_prompt
435
native_tokens_completion
877
native_tokens_completion_images
(null)
native_tokens_reasoning
47
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.00964
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01Y5kJcaPGJKFVUq6QTiSnTr"
is_byok
false
latency
2228
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891752-GcCD7tD09yDncEemAta7"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891752-aPJzy2iPXj4V7sd9rVsr"
upstream_id
"msg_01Y5kJcaPGJKFVUq6QTiSnTr"
total_cost
0.00964
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval