NC Bench
Overview
About
Tests
Models
Model
Fimbulvetr 11B v2
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VTCH5AKVYJBQQV6VAW9HAB
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Alternate Version 1: Red" data-color="red"> Sir Roland, an aged knight, met me at the stables. His armor had seen better days, but his eyes still sparkled with the determination of a young warrior. "Welcome, young Frederick. I'm Sir Roland. The master of the stables has been expecting you." His voice was deep, like the rumble of thunder. </nc-section> <nc-section data-title="Alternate Version 2: Green" data-color="green"> As I approached the stables, Sir Roland, a wiry knight with a wicked grin, hailed me. In between his peppered laugh, he introduced himself. "It's a pleasure, Frederick. I'm Sir Roland. Your steed's accommodations are nearby." He seemed amused, perhaps by my sheer determination and nervousness. </nc-section> <nc-section data-title="Alternate Version 3: Blue" data-color="blue"> Sir Roland, a lean old knight, greeted me by the stables. His eyes held a story I was eager to hear. "I'm Sir Roland, the master of ceremonies today. Dismount, lad, and let's get you settled." He seemed weathered but kind, an intriguing blend that made me even more eager to begin my training. </nc-section>
id
"gen-JuiCrr2ZCciLEz4vjBXfIBl0hahl"
total_cost
0.000641625
upstream_id
"5fa85d94hCMFaFpM"
created_at
"2024-08-09T14:59:09.996056+00:00"
Friday, August 9th, 2024 at 2:59:09 PM GMT+00:00
model
"sao10k/fimbulvetr-11b-v2"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
20484
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
295
tokens_completion
274
native_tokens_prompt
371
native_tokens_completion
335
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000641625
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%