NC Bench
Overview
About
Tests
Models
Model
lzlv 70B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBK5S4TTRSR1BY97G8J84
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: Sir Roland's Greeting" data-color="red"> As Thunder and I approached the stables, a large, heavily armored figure stepped out to greet us. It was Sir Roland, one of the kingdom's most renowned knights. His crimson cape flowed behind him, and his broadsword hung at his side. He smiled warmly and extended a calloused hand. "Welcome to the castle, young squire. I am Sir Roland, and I will be overseeing your training." </nc-section> <nc-section data-title="Version 2: Sir Roland's Mysterious Aura" data-color="green"> Nearing the stables, I noticed a tall, imposing figure standing in the shadows. As I dismounted, the figure stepped forward, revealing himself to be Sir Roland. His emerald armor glistened in the fading sunlight, and his cloak seemed to shimmer with an otherworldly aura. His deep voice echoed as he spoke, "Welcome, Frederick. I am Sir Roland, and I will guide you on your path to knighthood." </nc-section> <nc-section data-title="Version 3: Sir Roland's Boisterous Entrance" data-color="blue"> Thunder's hooves halted abruptly as we neared the stables, and I nearly lost my balance. A booming voice called out, "Halt, young squire! State your business!" I turned to see Sir Roland, resplendent in his royal blue armor, striding towards us. His gut-busting laughter filled the air as he sheathed his sword and patted Thunder's neck. "Welcome, Frederick! I am Sir Roland, here to usher you into the world of knights and valor!" </nc-section>
id
"gen-O3ZCYKtbyNAgc6cKCUpeDZLVnpc1"
total_cost
0.00054592
upstream_id
"cmpl-33d633f45de24bb8b319fbb96ba20509"
created_at
"2024-08-09T14:58:30.574884+00:00"
Friday, August 9th, 2024 at 2:58:30 PM GMT+00:00
model
"lizpreciatior/lzlv-70b-fp16-hf"
app_id
182717
streamed
false
cancelled
false
provider_name
"Novita"
latency
11693
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
304
tokens_completion
356
native_tokens_prompt
367
native_tokens_completion
427
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00054592
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%