NC Bench
Overview
About
Tests
Models
Model
Mistral Nemo 12B Celeste
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTDSV4BC5WF336XNBB51JW
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<version1 data-color="red"> As I dismounted Thunder and led him to the stables, I heard a familiar voice behind me. "Well, well, what do we have here? A new squire?" I turned around to see Sir Roland, the local knight, approaching me with a friendly smile. He was dressed in full armor, his sword by his side. "It's an honor, Sir Roland," I said. "I'm Frederick, come to begin my training at the castle." "Ah, Frederick, welcome! Your skills with the sword are well-known, my boy. I'm sure you'll do great things here. Can't wait to see what you can do on the training grounds tommorow." </version1> <version2 data-color="green"> As I dismounted Thunder and led him to the stable, a booming voice caught my attention. "Who's this riffraff?" I turned around to see Sir Roland standing there, arms crossed. The brim of his helmet obscured his face. "I...I am Frederick, Sir. The new squire," I said nervously. Sir Roland nodded, uncrossing his arms. "Ah, Frederick, right! I was hoping you would arrive early. Came first, did ya? Good," he said with a small grunt. "At least you have the early bird advantage over the rest. I'm Sir Roland, I'll be training with you until you are ready to join the true knights. Prepare yourself, it's going to be a bumpy road ahead." </version2> <version3 data-color="blue"> As I dismounted Thunder and led him to the stable, a stern voice made me turn around. "Who the hell are you?" I swallowed hard and bowed my head slightly. "I am Frederick, Your Grace, the new squire," I replied meekly. The knight that stood before me, dressed in full plate armor and holding a sword, removed his helmet. He must have been Sir Roland, the infamous knight known for his terrific manners toward lesser ranks like me. "And that's my horse." I couldn't resist raising an eyebrow slightly. I must have gotten carried away with the excitement of finally reaching the castle. "Apologies, sir knight, I had no intention of impinging upon your horse's personal space. Thou shall know it as Thunder from now on," I explained quickly.
id
"gen-QIIdqK2LnHLam8hTka3RC25QxFrC"
total_cost
0.0012015
upstream_id
"cmpl-e83f0a3aafab481cae9470ea2d627ba2"
created_at
"2024-08-09T14:59:36.56137+00:00"
Friday, August 9th, 2024 at 2:59:36 PM GMT+00:00
model
"nothingiisreal/mn-celeste-12b"
app_id
182717
streamed
false
cancelled
false
provider_name
"Infermatic"
latency
5401
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
301
tokens_completion
489
native_tokens_prompt
309
native_tokens_completion
492
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0012015
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
0.0000%