NC Bench
Overview
About
Tests
Models
Model
Goliath 120B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTBFBWDHW3PQNSVFF7BZX4
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Version 1 (red): As Thunder and I neared the castle stables, a tall, muscular man wearing red and gold armor approached us. His face creased into a warm smile as he sheathing his sword. "Greetings, young squire!You must be Frederick," he boomed in a deep voice. He extended a callused hand for a firm handshake. "I am Sir Roland, vassal to His Lordship, King Richard. It' Io am my honor to train you in the ways of knighthood." Version 2 (green): Thunder, recognizing his own kind, neighed in greeting as we approached the stables. A burly figure clad in emerald and silver armor emerged, signaling for me to dismount. "Welcome, Frederick," he said, a glint in his eye. "I've been awaiting your arrival. I am Sir Roland, and it's my privilege to guide you in your knightly training." His grip was firm yet reassuring as he helped me down from Thunder's back. Version 3 (blue): By the time Thunder and I reached the stables, a knight clad in shining blue armor was waiting for us. He removed his helmet, revealing a head of grizzled hair and a rugged complexion that spoke of many years under the sun. "Squire Frederick," he said, his voice gravelly but kind. "A pleasure to finally meet you. I am Sir Roland, loyal knight to King Richard. It's high time we begin your training—if you're up for it, of course." He winked, the corners of his eyes crinkling in amusement.
id
"gen-hgrysplRE0Bp71ujtNvmlktAPyma"
total_cost
0.007096875
upstream_id
"5fa85d73g74vfYdd"
created_at
"2024-08-09T14:58:41.345077+00:00"
Friday, August 9th, 2024 at 2:58:41 PM GMT+00:00
model
"alpindale/goliath-120b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
26439
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
304
tokens_completion
334
native_tokens_prompt
367
native_tokens_completion
390
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.007096875
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%