NC Bench
Overview
About
Tests
Models
Model
Qwen 2 72B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9BGNNPAEETA8HZJ3HD95
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1" data-color="red"> Frederick's heart raced as he spotted a figure approaching. It was Sir Roland, the local knight, known for his bravery and valor in battle. Sir Roland was tall, with broad shoulders, and his armor gleamed in the fading light. He strode with a purposeful gait, his boots crunching on the gravel path leading to the stables. Frederick dismounted from Thunder, rushing to greet him with a bow. Sir Roland nodded in acknowledgment, his eyes appraising Frederick's form. "You must be Frederick," he said gruffly, his voice strong and clear. "I've been told you are here to replace my last squire. What made you want to come to the castle and serve as a squire?" </nc-section> <nc-section data-title="Version 2" data-color="green"> As Frederick neared the stables, he saw Sir Roland, a local knight, in the distance. Sir Roland was renowned for his skills in jousting, having won several tournaments in the realm. He had piercing blue eyes that seemed to pierce through Frederick's soul. Rolling up his sleeves, Sir Roland continued his work, unhurried and meticulous. Frederick walked up to him and extended his hand. Sir Roland looked at it for a moment before gripping it firmly. "Your reputation precedes you, Frederick," Sir Roland said. "I heard you were an eager learner and keen to begin your training. Let us see if it matches the stories." </nc-section> <nc-section data-title="Version 3" data-color="blue"> Frederick was surprised to see Sir Roland emerging from one of the stalls. The knight was busily grooming a horse, humming a tune under his breath. Sir Roland was an unassuming man, with a gentle demeanor. He looked up, noticing Frederick's arrival. The two men exchanged a nod of acknowledgment. "I hope you're comfortable around horses," Sir Roland said. "There's much to be done in the stables. The life of a squire is not just about combat and tournaments. It's about dedication and hard work. Are you prepared for that, Frederick?" </nc-section>
id
"gen-yqVQNLjkaKW5pQOocdWMOZNIE5FT"
total_cost
0.00062046
upstream_id
"8b0898b7506756f2-IAD"
created_at
"2024-08-09T14:57:18.033197+00:00"
Friday, August 9th, 2024 at 2:57:18 PM GMT+00:00
model
"qwen/qwen-2-72b-instruct"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
12610
moderation_latency
(null)
generation_time
0
finish_reason
"eos"
tokens_prompt
301
tokens_completion
459
native_tokens_prompt
306
native_tokens_completion
460
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00062046
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%