NC Bench
Overview
About
Tests
Models
Model
Llama 3.1 Nemotron 70B
Test
Tool usage within Novelcrafter
Scenario
Create alternate prose sections
Run ID
2024-10-16-01JABHYQEA06C15QCHAW9W02V5
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
Here are the three alternate prose sections continuing the story: **Version 1 (red)** <nc-section data-title="A Knight's Boisterous Greeting" data-color="red"> As I dismounted Thunder near the stables, a stout figure emerged, his armor gleaming with a hint of polish. Sir Roland, the local knight, boomed out a greeting, his voice like a crack of thunder. "Ah, young Frederick! By the kingdom's gates, you've arrived! Come, let us celebrate with a tankard of ale, and may the fire in your belly match the fire in your heart for chivalry!" He clapped a meaty hand on my back, nearly sending me stumbling. </nc-section> **Version 2 (green)** <nc-section data-title="A Gentleman's Welcome" data-color="green"> Near the stables, I brought Thunder to a gentle stop, and as I slid off his back, Sir Roland approached, his footsteps quiet on the earthy ground. With a courteous bow, he greeted me, "Ah, Frederick, welcome to our humble castle. I trust your journey was uneventful? Please, allow me to assist with your steed while you freshen up. We shall discuss your training over a leisurely supper, if that suits you." His manner was as soothing as the surrounding gardens. </nc-section> **Version 3 (blue)** <nc-section data-title="A Watchful Encounter" data-color="blue"> As Thunder and I drew near the stables, a figure detached from the shadows. Sir Roland, his face a map of weathered experience, eyed me with a discerning gaze. "Frederick, the new squire," he stated, his voice even, neither warm nor cold. "I've heard a great deal about your... eagerness. Come, let us walk among the stables, and speak of what it means to serve under our banner." His eyes lingered on mine, as if searching for something, before he turned, expecting me to follow. </nc-section>
id
"gen-1729112268-cUQqJfTDewkFBCqOtmC5"
upstream_id
"cmpl-R25SLg0eBPnc6E6QESpVHlyq"
total_cost
0.0002794
cache_discount
(null)
created_at
"2024-10-16T20:58:01.610242+00:00"
Wednesday, October 16th, 2024 at 8:58:01 PM GMT+00:00
model
"nvidia/llama-3.1-nemotron-70b-instruct"
app_id
182717
streamed
true
cancelled
false
provider_name
"DeepInfra"
latency
76
moderation_latency
(null)
generation_time
12719
finish_reason
"stop"
tokens_prompt
384
tokens_completion
429
native_tokens_prompt
308
native_tokens_completion
429
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0002794
Evaluation details
Result
Evaluator
Details
Meta Data
Pass
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Pass
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Pass
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
100.0000%