NC Bench
Overview
About
Tests
Models
Model
Claude 3 Haiku
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAEZEQKTV1DNX5B24NGF7
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> As I approached the stables, a tall, imposing figure emerged from the shadows. It was Sir Roland, the knight who would oversee my training. He looked me up and down, his brow furrowed in a stern expression. "So, you're the new squire, are you?" he said, his voice gruff and authoritative. "I hope you're ready to work hard, boy. The path to knighthood is not an easy one." I swallowed hard, suddenly feeling small and unsure of myself. But I straightened my shoulders and looked him in the eye, determined to prove myself worthy. "I'm ready, sir," I said, my voice wavering slightly. Sir Roland nodded, a hint of approval in his gaze. "We'll see about that," he said, turning to lead me towards the stables. "Follow me." </nc-section> <nc-section data-title="Version 2" data-color="green"> As I approached the stables, a tall, weathered man emerged from the shadows. It was Sir Roland, the knight who would oversee my training. He wore a warm smile on his face, his eyes twinkling with a touch of mischief. "Welcome, young squire," he said, his voice rich and welcoming. "I've been expecting you." I felt a surge of relief wash over me. This was not the stern, unyielding figure I had imagined. "It's an honor to meet you, Sir Roland," I said, bowing respectfully. He chuckled and placed a hand on my shoulder. "No need for such formality, my boy. We're going to be spending a lot of time together, and I want us to be friends." I couldn't help but smile in return, already feeling more at ease in his presence. "Now, let's get you settled in and introduce you to the other squires," he said, turning towards the stables. </nc-section> <nc-section data-title="Version 3" data-color="blue"> As I approached the stables, a tall, imposing figure emerged from the shadows. It was Sir Roland, the knight who would oversee my training. He regarded me with a cool, appraising gaze, his arms folded across his chest. "So, you're the new squire," he said, his voice measured and controlled. "I've heard a lot about you, young Frederick." I felt a twinge of nervousness in the pit of my stomach, but I forced myself to stand tall and meet his gaze. "Yes, sir," I replied, my voice steady. Sir Roland nodded, a hint of a smile tugging at the corner of his mouth. "Good. That's what I like to see – a squire with a backbone," he said, his tone softening slightly. "Come, let me show you around. There's much to be done if you're to become a true knight." With that, he turned and led me towards the stables, and I followed, my heart racing with a mixture of excitement and trepidation. </nc-section>
id
"gen-y8e5irQKbphBWMjaXBd3VOJun4vu"
total_cost
0.00098625
upstream_id
"msg_013SyBeJXvsmH1bv9EHPbhQw"
created_at
"2024-08-09T14:57:47.248096+00:00"
Friday, August 9th, 2024 at 2:57:47 PM GMT+00:00
model
"anthropic/claude-3-haiku:beta"
app_id
182717
streamed
true
cancelled
false
provider_name
"Anthropic"
latency
690
moderation_latency
(null)
generation_time
4701
finish_reason
"end_turn"
tokens_prompt
302
tokens_completion
646
native_tokens_prompt
335
native_tokens_completion
722
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00098625
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%