NC Bench
Overview
About
Tests
Models
Vendors
Run: 2026-02-18-01KHQ94CV2E83YZ85Z31R41JE1
Run Details
Model:
Claude Sonnet 4.6
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
10.5s
Cost:
$0.009693
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are 3 alternate prose sections that continue the story: <nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As I dismounted Thunder near the stables, a broad-shouldered knight strode towards me, his armor gleaming in the fading sunlight. His face was weathered and stern, marked by years of battle, yet his eyes held a glimmer of warmth. "You must be Frederick," he said, his voice deep and commanding. "I am Sir Roland, knight of the realm. I have been expecting you." He crossed his arms and looked me up and down with a critical eye. "You are smaller than I imagined. The training here will be hard. Many have failed before you." He turned sharply on his heel. "Follow me, boy. There is much to be done before nightfall." </nc-section> <nc-section data-title="Version 2: Sir Roland's Greeting" data-color="green"> The stable doors swung open with a creak, and out stepped a knight unlike any I had ever seen. Sir Roland was not the towering warrior I had expected — he was lean and agile, with sharp eyes that missed nothing. A warm smile spread across his face as he approached me. "Ah, young Frederick! Welcome to Castle Aldenmoor." He clapped a firm hand on my shoulder. "I remember my first day here as if it were yesterday. Terrifying, wasn't it?" He laughed softly, taking Thunder's reins and guiding the stallion gently into the stable. "Come now, let us get your horse settled, and then I shall show you to your quarters. Tomorrow, the real adventure begins." </nc-section> <nc-section data-title="Version 3: Sir Roland's Greeting" data-color="blue"> I had barely tied Thunder to the post when I heard the crunch of heavy boots on gravel behind me. I turned to find a knight standing in the shadow of the stable archway, his helmet tucked under one arm, his expression unreadable. "Frederick of Dunmere?" he asked quietly. I nodded. "I am Sir Roland." He stepped closer, lowering his voice as though the very stones of the castle had ears. "I will say this only once — there are those within these walls who did not wish for you to come here. Keep your wits about you, trust few, and speak carefully." His grey eyes held mine with an unsettling intensity. "Now smile, boy. Someone is always watching." </nc-section>
created_at
"2026-02-18T02:26:52.080285+00:00"
2/18/2026, 2:26:52 AM
model
"anthropic/claude-4.6-sonnet-20260217"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
638
moderation_latency
212
generation_time
10193
tokens_prompt
318
tokens_completion
581
native_tokens_prompt
336
native_tokens_completion
579
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.009693
router
(null)
provider_responses
0
id
"1cd32fc9-e263-4720-b2f9-f76fbc868ae1"
status
200
is_byok
false
latency
638
endpoint_id
"83d802cb-44f2-45a0-a9d5-cb9bf79777c8"
provider_name
"Amazon Bedrock"
model_permaslug
"anthropic/claude-4.6-sonnet-20260217"
api_type
"completions"
id
"gen-1771381601-gS8HAaNm29aclt5KoJ7R"
upstream_id
"1cd32fc9-e263-4720-b2f9-f76fbc868ae1"
total_cost
0.009693
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval