NC Bench
Overview
About
Tests
Models
Model
Qwen 2.5 72B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-09-20-01J881KCMPG21JG9W9VAZNPYW7
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Stern Greeting" data-color="red"> As I dismounted Thunder, a stern-looking knight approached me. He was clad in polished steel armor, and his eyes were piercing under his helm. "You must be the new squire," he said, his voice gravelly. "I am Sir Roland, and I expect the best from you, boy. No room for mistakes here." I swallowed hard, feeling the weight of his gaze. "Yes, Sir Roland," I replied, trying to sound more confident than I felt. "I will do my best." "Good," he grunted. "First, take care of your mount. A knight is only as good as his horse." </nc-section> <nc-section data-title="Version 2: The Welcoming Knight" data-color="green"> As I led Thunder to the stables, a kind-faced knight approached. He wore a simple tabard over his chainmail, and his eyes were warm and welcoming. "Welcome, young squire," he said, extending a hand. "I am Sir Roland. I hope your journey was safe." I nodded, feeling a wave of relief. "Thank you, Sir Roland. It was a good journey." "Excellent," he replied, smiling. "Now, let's get you settled. First, you'll need to see to your horse. A knight's bond with his mount is crucial." </nc-section> <nc-section data-title="Version 3: The Practical Instructor" data-color="blue"> As I approached the stables, a knight emerged, his armor gleaming in the sunset. He had a no-nonsense air about him, and his eyes were sharp. "You must be Frederick," he said, his voice steady. "I am Sir Roland. Let's start with the basics. Take care of your horse first. A knight is nothing without his mount." I nodded, understanding the importance of his words. "Yes, Sir Roland. I'll take good care of Thunder." "Good," he said, leading me to a stall. "Show me what you can do." </nc-section>
id
"gen-tecWgoKy9ujVYI0OtN6PwBS7oyGU"
total_cost
0.0003004
upstream_id
"chat-6bf5366d212741c0996eea71c83e1fed"
created_at
"2024-09-20T15:43:03.739982+00:00"
Friday, September 20th, 2024 at 3:43:03 PM GMT+00:00
model
"qwen/qwen-2.5-72b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"Hyperbolic"
latency
420
moderation_latency
(null)
generation_time
10364
finish_reason
"stop"
tokens_prompt
302
tokens_completion
443
native_tokens_prompt
306
native_tokens_completion
445
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0003004
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%