NC Bench
Overview
About
Tests
Models
Model
Gemma 2 9B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTAPSWT5YKGT1GJ5G3EGGV
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are three alternate prose sections, continuing the story, each with a different color: **Version 1 (red)** <nc-section data-title="First Impressions" data-color="red"> Thunder snorted, pawing the ground impatiently as I pulled him to a stop near the stables. A tall, imposing figure emerged from the shadows, clad in gleaming armor. Sir Roland, the local knight, strode towards me, his face weathered and stern. "So, you're Frederick," he said, his voice gruff. "Heard tales of your arrival. Don't let the grandeur of the castle fool you, squire. Life here is hard work and discipline." His eyes, sharp as flint, seemed to pierce through me. "Are you ready for the challenge?" </nc-section> **Version 2 (green)** <nc-section data-title="A Warm Welcome" data-color="green"> Thunder whinnied softly as we approached the stables, his hooves barely making a sound on the cobblestones. A smiling face appeared from behind a stack of hay bales. Sir Roland, the local knight, greeted me with a hearty laugh. "Welcome, Frederick! I've been expecting you. Come, let me introduce you to the beasts." He clapped a hand on my shoulder, his grip surprisingly strong. "Don't worry, you'll be in good hands here. We'll have you riding and fighting like a seasoned knight before you know it." </nc-section> **Version 3 (blue)** <nc-section data-title="A Moment of Doubt" data-color="blue"> Thunder stopped at the edge of the stables, his breath misting in the cool evening air. I dismounted, my heart pounding in my chest. A figure emerged from the shadows, his armor polished to a mirror shine. Sir Roland. He stood tall and silent, his expression unreadable. I swallowed nervously, suddenly unsure if I was ready for this. The weight of expectation pressed down on me. Could I live up to the legends? Could I become a knight like him? </nc-section>
id
"gen-Dtx5fLHCsZpWRVzf1Lphq358dT1a"
total_cost
0.0001562
upstream_id
"aad1ee1e-d257-478c-8138-0ead77858cfb"
created_at
"2024-08-09T14:57:54.220657+00:00"
Friday, August 9th, 2024 at 2:57:54 PM GMT+00:00
model
"google/gemma-2-9b-it"
app_id
182717
streamed
false
cancelled
false
provider_name
"Fireworks"
latency
4484
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
335
tokens_completion
446
native_tokens_prompt
324
native_tokens_completion
457
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0001562
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%