NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE9W95JEHMMQKYWVZEA8F5M
Run Details
Model:
Claude Sonnet 5 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
13.8s
Cost:
$0.010260
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (continued)" data-color="red"> As Thunder's hooves clattered against the cobblestones of the courtyard, a broad-shouldered figure emerged from the shadows of the stables. Sir Roland stood with his arms crossed, his weathered face breaking into a stern but not unkind expression. "You must be the new squire," he said, his voice carrying the gravel of a thousand battles. "Frederick, is it? You're late. I expected you before sundown." He stepped forward and grabbed Thunder's reins with a firm hand, his eyes assessing the young man before him with the practiced scrutiny of a seasoned warrior. "No matter. Dismount. We have much to discuss before nightfall, and I don't tolerate tardiness twice." </nc-section> <nc-section data-title="Chapter 1: The Arrival (continued)" data-color="green"> "Well now, look what the wind blew in!" The voice boomed across the courtyard, warm and jovial as a summer's day. Sir Roland came striding from the stable doors, wiping his hands on a cloth, a wide grin spreading across his weathered features. Straw clung to his boots, and the smell of horses followed him like an old friend. "Frederick! I've been expecting you, lad." He clapped a heavy hand on Frederick's shoulder as the young squire dismounted, nearly knocking him off balance. "That's a fine horse you've got there. Thunder, is it? Aye, I can see why—look at that spirit in his eyes!" Sir Roland laughed heartily, gesturing toward the stable. "Come, come! Let's get him settled, and then you and I shall talk about what adventures await you here. I have a feeling you're going to fit in just fine." </nc-section> <nc-section data-title="Chapter 1: The Arrival (continued)" data-color="blue"> Frederick barely had time to catch his breath before a shadow fell across him. He looked up to find a tall knight standing near the stable entrance, his armor catching the last rays of sunlight. The man's expression was unreadable, his gaze piercing. "Sir Roland," the knight said simply, extending a gloved hand. "And you would be Frederick, the squire everyone has been talking about." There was something in his tone—not quite suspicion, not quite welcome—that made Frederick's stomach tighten. Sir Roland's eyes flickered briefly to the sword at Frederick's hip, then back to his face. "We'll see what you're made of soon enough," Roland said quietly, turning toward the castle. "Follow me. There is much you don't yet understand about this place." </nc-section>
created_at
"2026-07-01T07:39:13.979Z"
7/1/2026, 7:39:13 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
2747
moderation_latency
(null)
generation_time
13816
tokens_prompt
318
tokens_completion
683
native_tokens_prompt
435
native_tokens_completion
939
native_tokens_completion_images
(null)
native_tokens_reasoning
32
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.01026
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_011pn5QB3bzQsQtCMzxB877e"
is_byok
false
latency
1855
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782891553-WZBFhL1GvtxC6GYLPUFb"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782891553-rX9GBv0S0jh2WGtuzYWR"
upstream_id
"msg_011pn5QB3bzQsQtCMzxB877e"
total_cost
0.01026
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval