NC Bench
Overview
About
Tests
Models
Model
AI21 Jamba 1.5 Mini
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-08-26-01J68950E2CHHBA5A0QNBY9ECJ
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Arrival at the Castle" data-color="red"> Sir Roland, a towering figure in shining armor, greeted Frederick near the stables. His presence was both intimidating and reassuring. "Welcome, young Frederick," he boomed. "I trust your journey was not too arduous?" Frederick dismounted and handed the reins to a waiting stablehand. "It was long, Sir Roland, but I am eager to begin my training." "Good," Sir Roland said with a nod. "Follow me, and I'll show you to your quarters." </nc-section> <nc-section data-title="Arrival at the Castle" data-color="green"> Frederick's heart raced as he spotted Sir Roland near the stables. The knight’s armor glinted in the dying sunlight. "Greetings, Frederick," Sir Roland said with a warm smile. "It's an honor to have you here." Frederick dismounted and approached Sir Roland, bowing respectfully. "Thank you, Sir Roland. I am ready to learn and prove myself." Sir Roland chuckled. "We shall see about that. Come, let’s get you settled." </nc-section> <nc-section data-title="Arrival at the Castle" data-color="blue"> As Frederick rode through the castle gates, he noticed Sir Roland standing by the stables, watching him approach. When Frederick dismounted, Sir Roland stepped forward with a friendly smile. "Welcome to the castle, Frederick," he said. "How was your journey?" Frederick smiled back, feeling a mixture of awe and admiration. "It was long, but worth it. Thank you, Sir Roland." </nc-section>
id
"gen-YboIicbJmKJee0FrhsWiyRl4nVQ5"
total_cost
0.0002206
upstream_id
"chat-ac130c2489fd41118158cc3ad9055f9f"
created_at
"2024-08-26T21:23:31.05347+00:00"
Monday, August 26th, 2024 at 9:23:31 PM GMT+00:00
model
"ai21/jamba-1-5-mini"
app_id
182717
streamed
true
cancelled
false
provider_name
"AI21"
latency
833
moderation_latency
(null)
generation_time
3446
finish_reason
"stop"
tokens_prompt
302
tokens_completion
350
native_tokens_prompt
331
native_tokens_completion
386
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002206
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%