NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9ACNTT2ZE9B2HTC5DRMCZ
Run Details
Model:
Claude Sonnet 5 (Reasoning, Low)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.2s
Cost:
$0.008630
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival - Version 1" data-color="red"> As Thunder's hooves clattered onto the cobblestones near the stables, a broad-shouldered man stepped out from the shadows of the wooden beams. His armor caught the last light of the sun, and a scar ran across his weathered cheek. "You must be the new squire," he said, his voice deep and steady. "I am Sir Roland. Welcome to Castle Blackthorn, young Frederick. I've heard much about you from your father." He extended a calloused hand, and Frederick, still catching his breath from the ride, gripped it firmly, feeling the weight of expectation settle upon his shoulders. </nc-section> <nc-section data-title="Chapter 1: The Arrival - Version 2" data-color="green"> Frederick dismounted swiftly, leading Thunder toward the stable entrance where hay and the scent of leather filled the air. A tall figure emerged, clad in polished mail that gleamed even in the dimming light. "So the boy finally arrives," the man chuckled warmly, his eyes crinkling with amusement. "I am Sir Roland, and you, I presume, are the squire everyone's been chattering about." He clapped a firm hand on Frederick's shoulder. "Don't worry, lad. The horses here are far friendlier than the training yard. Come, let's get Thunder settled before the stable boys retire for the night." </nc-section> <nc-section data-title="Chapter 1: The Arrival - Version 3" data-color="blue"> The stables loomed ahead, their wooden doors thrown open to reveal flickering lantern light within. Frederick guided Thunder toward the entrance when a commanding voice called out, "Halt there, young rider!" A knight in gleaming armor approached, his stride purposeful and his expression unreadable. "Sir Roland," he introduced himself curtly, studying Frederick with sharp eyes. "You're later than expected. The castle does not wait for stragglers, squire. Tend to your horse quickly—Lord Ashworth wishes to see you before nightfall, and I'd advise against testing his patience." </nc-section>
created_at
"2026-07-01T07:29:27.75Z"
7/1/2026, 7:29:27 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
3657
moderation_latency
(null)
generation_time
12147
tokens_prompt
318
tokens_completion
562
native_tokens_prompt
435
native_tokens_completion
776
native_tokens_completion_images
(null)
native_tokens_reasoning
47
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.00863
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_01TihsR1gYTPqRTSET12iUfv"
is_byok
false
latency
2174
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890967-99b8FVX04IRhSbfawA6m"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890967-jcXGL0K7i4QdvNXT3Z8f"
upstream_id
"msg_01TihsR1gYTPqRTSET12iUfv"
total_cost
0.00863
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval