NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-07-01-01KWE8V74CGZPAMV8NJZAVRYSK
Run Details
Model:
Claude Sonnet 5
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
11.1s
Cost:
$0.008090
Provider:
Amazon Bedrock
Evaluation summary
Score
Evaluator
Details Link
Pass
Match blue prose section
(details)
Pass
Match green prose section
(details)
Pass
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (Version 1)" data-color="red"> Thunder's hooves clattered against the cobblestones as I drew him to a halt outside the stables. A broad-shouldered man in gleaming armor emerged from the shadows, his sword catching the last light of dusk. "You must be the new squire," he said, his voice carrying the weight of command. "I am Sir Roland. I've been expecting you, boy." He extended a gauntleted hand, and I noticed the scars etched across his knuckles—marks of battles I could only imagine. "Come, let's see if you're made of sturdier stuff than the last one." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 2)" data-color="green"> As I dismounted, my legs unsteady from the long journey, a hearty laugh echoed from near the stable doors. "Careful there, lad, you'll want your legs beneath you before you go falling on your face!" Sir Roland strode forward, his armor dented and worn from years of honest service, a warm grin softening his weathered face. "Frederick, is it? I remember being just as green as you, all those years ago. Don't worry—Thunder here looks like he could teach you a thing or two himself." He clapped me on the shoulder, nearly knocking me over. "Come now, let's get you settled before the cook runs out of stew." </nc-section> <nc-section data-title="Chapter 1: The Arrival (Version 3)" data-color="blue"> A shadow fell across the stable entrance just as I began to lead Thunder toward the trough. I turned to find a tall figure watching me with quiet, assessing eyes—Sir Roland, unmistakable by the emblem of the silver hawk emblazoned on his breastplate. He said nothing at first, simply studying me the way one might study a blade before a battle, searching for flaws. "Long road from home," he finally said, not quite a question. "You'll find the castle keeps its own rhythm, squire. Best you learn it quickly." Without waiting for a reply, he turned on his heel, gesturing for me to follow into the deepening dark. </nc-section>
created_at
"2026-07-01T07:21:10.552Z"
7/1/2026, 7:21:10 AM
model
"anthropic/claude-sonnet-5-20260630"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
1706
moderation_latency
(null)
generation_time
11036
tokens_prompt
318
tokens_completion
517
native_tokens_prompt
435
native_tokens_completion
722
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
num_fetches
(null)
web_search_engine
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"end_turn"
service_tier
"default"
usage
0.00809
router
(null)
provider_responses
0
endpoint_id
"37b16f45-eeae-45f3-9b85-2137f7c6d61b"
id
"msg_0133HQ9XU4NF4toiuR9oGYGr"
is_byok
false
latency
1704
model_permaslug
"anthropic/claude-sonnet-5-20260630"
provider_name
"Amazon Bedrock"
status
200
user_agent
"langchainjs-openai/1.0.0 ((node/v24.17.0; linux; x64))"
http_referer
(null)
request_id
"req-1782890470-8IOCjZiu0fj8HgfsXBUT"
session_id
(null)
preset_id
(null)
api_type
"completions"
id
"gen-1782890470-I8PjWvulEQfGjlDHtm8H"
upstream_id
"msg_0133HQ9XU4NF4toiuR9oGYGr"
total_cost
0.00809
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Amazon Bedrock"
response_cache_source_id
(null)
data_region
"global"
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval