NC Bench
Overview
About
Tests
Models
Model
Mistral Medium
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9NAA59A858789PSPJBYJ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: A Gruff Greeting" data-color="red"> As I dismounted Thunder, I was greeted by a stern-looking knight. His armor was adorned with gold trim, and he wore a crimson cape. He extended a hand to help me down from the horse. "You must be Frederick," he said gruffly. "I am Sir Roland. I'll be overseeing your training." He led me towards the stables, where I could see a handful of horses being tended to by the stable hands. I swallowed hard, feeling the weight of Sir Roland's gaze upon me. </nc-section> <nc-section data-title="Version 2: A Firm Handshake" data-color="green"> I was met near the stables by Sir Roland, a tall and imposing figure. He extended a hand towards me and shook mine firmly. "Frederick," he said with a nod. "I've heard good things about you. I'm looking forward to working with you." His eyes were kind, and I could tell that despite his gruff exterior, he was a fair man. I followed him to the stables, where we were greeted by the stable master. </nc-section> <nc-section data-title="Version 3: A Warm Welcome" data-color="blue"> Sir Roland greeted me near the stables with a friendly smile. He was a handsome man, with a neatly trimmed beard and piercing blue eyes. "Frederick!" he exclaimed, clapping me on the back. "I'm so glad you're here. Let me show you around." We walked towards the stable, where I could see horses being brushed and fed. One of the stable hands greeted us warmly, and Sir Roland introduced him as Jake. The stable was filled with the sounds of horses whinnying and the soft clanging of metal as the stable hands worked. </nc-section>
id
"gen-UB0nrV5Emf8hOcdwtiijEkFqHZnS"
total_cost
0.0046683
upstream_id
"33f6964152634cec8f4766d92595a9c8"
created_at
"2024-08-09T14:57:26.40443+00:00"
Friday, August 9th, 2024 at 2:57:26 PM GMT+00:00
model
"mistralai/mistral-medium"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mistral"
latency
10912
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
302
tokens_completion
392
native_tokens_prompt
358
native_tokens_completion
457
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0046683
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%