NC Bench
Overview
About
Tests
Models
Model
Fimbulvetr 11B v2
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-09-01J4VT9HPJJ6FPMQTJ5HDHPSC8
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="red"> As I dismounted, the local knight, Sir Roland, strode over to greet me. His armor shone in the fading light, the sunset casting red highlights. His eyes were kind, and his voice was warm as he welcomed me to the castle. "I'm glad to finally meet you. They've spoken so highly of you in our tribe. The training shall be rigorous but exhilarating." </nc-section> <nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="green"> The local knight, Sir Roland, greeted me with a broad smile as I led Thunder towards the stables. His green eyes twinkled, giving me an assuring feeling. "Well met, young Frederick. I trust your journey was safe. Prepare for tireless days and sleepless nights, for the ways of the sword are not easily mastered." </nc-section> <nc-section data-title="Chapter 1: The Arrival (cont.)" data-color="blue"> The local knight, Sir Roland, approached on a steed his own. I could see the triumphs and battles he's endured in the shadow his blue eyes held, and in his weathered visage. "Frederick, I've heard about you. We welcome you to the brotherhood, as you embark on the path to knighthood. May thy spirit and sword match the steel of our best." With that, he patted Thunder on the neck, signifying a bond between our steeds.
id
"gen-spmQcavEuzxf8NTjJH5qDVjtUjig"
total_cost
0.000718125
upstream_id
"5fa85d39x0lQxE0s"
created_at
"2024-08-09T14:57:34.885281+00:00"
Friday, August 9th, 2024 at 2:57:34 PM GMT+00:00
model
"sao10k/fimbulvetr-11b-v2"
app_id
182717
streamed
false
cancelled
false
provider_name
"Mancer"
latency
23081
moderation_latency
(null)
generation_time
0
finish_reason
"stop"
tokens_prompt
295
tokens_completion
326
native_tokens_prompt
371
native_tokens_completion
386
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.000718125
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
66.6667%