NC Bench
Overview
About
Tests
Models
Vendors
Compare
Run: 2026-02-24-01KJ8VN3Y1RKFWJYFG4S6XGRN1
Run Details
Model:
Claude Sonnet 4.6 (Reasoning)
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
12.9s
Cost:
$0.010749
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 2: The Greeting (Version 1)" data-color="red"> Sir Roland was a towering figure, his armor catching the last rays of the dying sun as he strode forth from the stables with purpose. He crossed his arms over his broad chest, his steel-grey eyes narrowing as Frederick dismounted clumsily from Thunder. "So you are the boy they sent me," Roland said, his voice low and graveled, carrying the weight of a dozen campaigns. He looked Frederick up and down with open skepticism. "You are smaller than I expected. Weaker, too, by the look of it." Frederick straightened his spine and met the knight's gaze without flinching. Something cold and determined stirred in his chest. He would prove this man wrong — if it was the last thing he ever did. </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 2)" data-color="green"> The smell of hay and warm horses filled the air as Frederick led Thunder toward the stables. A broad-shouldered knight leaned against the fence post, polishing his sword with a cloth, humming softly to himself. When he noticed Frederick approach, a wide, genuine smile broke across his weathered face. "Ah, you must be young Frederick!" Sir Roland exclaimed, pushing off the post and extending a firm, calloused hand. "I am Sir Roland. Welcome, lad. We have been expecting you." His warm tone instantly put Frederick at ease, dissolving the knots of anxiety that had built during the long journey. Perhaps this place, Frederick thought as he shook the knight's hand, would feel like home after all. </nc-section> <nc-section data-title="Chapter 2: The Greeting (Version 3)" data-color="blue"> Frederick had barely swung down from Thunder's saddle when a strange sound stopped him cold — the rhythmic clang of steel on steel echoing from just beyond the stable doors. He pushed them open cautiously, and there was Sir Roland, sparring with a wooden post, his movements fluid and impossibly fast for a man of his age. The knight froze mid-swing, sensing the boy's presence, and slowly turned around. His expression was unreadable, a mask carved from years of silence and secrets. "Frederick," he said simply, as though he had known this moment was coming for a very long time. He glanced past the boy toward the darkening horizon, and something — worry, perhaps, or recognition — flickered briefly behind his eyes. "Come. There is much to discuss before nightfall." </nc-section>
created_at
"2026-02-24T22:17:28.777Z"
2/24/2026, 10:17:28 PM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
721
moderation_latency
157
generation_time
12710
tokens_prompt
318
tokens_completion
664
native_tokens_prompt
353
native_tokens_completion
646
native_tokens_completion_images
(null)
native_tokens_reasoning
42
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.010749
router
(null)
provider_responses
0
endpoint_id
"83d802cb-44f2-45a0-a9d5-cb9bf79777c8"
id
"908b3211-1410-4f18-8432-2eedff87e599"
is_byok
false
latency
721
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
provider_name
"Amazon Bedrock"
status
200
api_type
"completions"
id
"gen-1771971448-9dBwRbK24AH8k4AjvMMp"
upstream_id
"908b3211-1410-4f18-8432-2eedff87e599"
total_cost
0.010749
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval