NC Bench
Overview
About
Tests
Models
Model
Gemma 2 27B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9RJZFF28ZX5QPXFQ75FQ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are three possible continuations, each with a different tone: **Version 1 (red)** <nc-section data-title="A Stern Welcome" data-color="red"> As I dismounted, a burly figure emerged from the stables, his shadow stretching long in the fading light. Sir Roland, the castle's most seasoned knight, regarded me with a skeptical frown. His eyes, as cold and sharp as a hawk's, pierced through me. "You must be Frederick," he rumbled, his voice rough like gravel. "About time you arrived. The Master of Arms has been expecting you. Don't dawdle, boy. Time is a luxury we can ill afford." </nc-section> **Version 2 (green)** <nc-section data-title="A Warm Introduction" data-color="green"> Thunder snorted softly as I led him towards the spacious stables. A kind face, tanned by the sun and creased with a welcoming smile, greeted me. "Ah, you must be young Frederick!" boomed a voice. Sir Roland, a knight whose broad shoulders filled the stable entrance, clapped me on the back. "Welcome, lad! We've been waiting for you. Come, let me show you to your quarters." </nc-section> **Version 3 (blue)** <nc-section data-title="An Impassive Observer" data-color="blue"> The stable doors clanged open, revealing a man shrouded in the gloom. Sir Roland. I had heard tales of his prowess as a warrior, but the knight before me seemed less a legend and more a statue – tall and imposing, his features hidden by the shadows cast by his helmet. His gaze, steady and unwavering, met mine. He said nothing but offered a curt nod before turning and disappearing into the stables, leaving me to follow. </nc-section>
id
"gen-5yRbVi06zgFIhsZq2AzJx5T9PP6y"
total_cost
0.00052416
upstream_id
"8b08990b21999c8a-IAD"
created_at
"2024-08-09T14:57:25.45554+00:00"
Friday, August 9th, 2024 at 2:57:25 PM GMT+00:00
model
"google/gemma-2-27b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Together"
latency
6578
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
335
tokens_completion
387
native_tokens_prompt
324
native_tokens_completion
404
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.00052416
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%