NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2026-02-26-01KJCRW2XR7B0Z81DV01PJCQE3
Run Details
Model:
LFM2 24B
Test:
Tool usage within Novelcrafter
Scenario:
Create alternate prose sections
Duration:
7.8s
Cost:
$0.000058
Provider:
Together
Evaluation summary
Score
Evaluator
Details Link
Fail
Match blue prose section
(details)
Fail
Match green prose section
(details)
Fail
Match red prose section
(details)
no eval
Overall
Model input
System
You are an expert fantasy novel author. You are working on a novel called "The Chronicles of the Last Dragon". The following tools are available to you: - <nc-section> Use this tool to create a new section of prose. Arguments: - "data-title": The title of the section. - "data-color": Any color of (red, green, blue, yellow, purple, orange, pink, brown). Example usage: <nc-section data-title="Chapter 1: The Arrival" data-color="blue"> Frederick, a young squire, arrives at the castle to begin his training. </nc-section>
User/Human
The story so far: <storySoFar> Frederick, a young squire, arrives at the castle to begin his training. </storySoFar>
AI
My horse, a majestic stallion named Thunder, galloped across the open field. The wind whipped through my hair as I rode towards the castle gates. The sun was setting, casting a warm glow over the stone walls. I could see the banners of the kingdom fluttering in the breeze.
User/Human
Continue the story with the following instructions: """The local knight, Sir Roland, greets Frederick near the stables.""" Create 3 alternate prose sections that continue the story. - Version 1 (red) - Version 2 (green) - Version 3 (blue)
Model response
Messages
Meta
AI
<nc-section data-title="Version 1: The Greeting" data-color="red"> Sir Roland, a towering figure clad in polished armor, stood waiting near the stables. His face was stern, but his eyes held a glimmer of warmth. "Ah, young Frederick," he boomed, extending a gauntleted hand. "Welcome to the castle. Your journey begins now." As I shook his hand, I felt a surge of determination. The path ahead was uncertain, but with Sir Roland's guidance, I knew I would find my place among the knights. --- <nc-section data-title="Version 2: The Welcome" data-color="green"> Near the stables, Sir Roland, the local knight, approached me with a welcoming smile. "Welcome, Frederick! The castle has awaited your arrival," he said, his voice as smooth as the emerald fields beyond the courtyard. With a firm handshake, he led me into the heart of the fortress, where my adventure was about to unfold. The air buzzed with anticipation as I met the gaze of fellow squires, each one eager to prove themselves. I took a deep breath and followed Sir Roland, ready to embrace the challenges ahead. --- <nc-section data-title="Version 3: The Introduction" data-color="blue"> In the shadow of the towering castle walls, Sir Roland awaited me. His armor gleamed like the morning sky, and his presence commanded respect. "You must be Frederick," he stated, offering a hand that felt both firm and reassuring. "I am Sir Roland, your mentor in this grand endeavor." With a nod, I accepted his hand and felt a spark of excitement ignite within me. The castle's grandeur loomed around us, a testament to the legacy I was about to become part of. Together, we stepped into the unknown, ready to forge our destinies.
created_at
"2026-02-26T10:45:48.949Z"
2/26/2026, 10:45:48 AM
model
"liquid/lfm-2-24b-a2b-20260224"
app_id
182717
external_user
(null)
streamed
true
cancelled
false
latency
246
moderation_latency
(null)
generation_time
7740
tokens_prompt
318
tokens_completion
436
native_tokens_prompt
320
native_tokens_completion
403
native_tokens_completion_images
(null)
native_tokens_reasoning
0
native_tokens_cached
0
num_media_prompt
(null)
num_input_audio_prompt
(null)
num_media_completion
0
num_search_results
(null)
origin
"https://ncbench.com/"
is_byok
false
finish_reason
"stop"
native_finish_reason
"stop"
usage
0.00005796
router
(null)
provider_responses
0
endpoint_id
"b5f259c3-1e77-40d6-8fa4-161cdf0e4a7c"
id
"oYueoAK-2j9zxn-9d3edae511d4e509"
is_byok
false
latency
246
model_permaslug
"liquid/lfm-2-24b-a2b-20260224"
provider_name
"Together"
status
200
api_type
"completions"
id
"gen-1772102748-3IvGDxDu3CcOA65If4nj"
upstream_id
"oYueoAK-2j9zxn-9d3edae511d4e509"
total_cost
0.00005796
cache_discount
(null)
upstream_inference_cost
0
provider_name
"Together"
Evaluation details
Result
Evaluator
Details
Meta Data
Fail
Match blue prose section
/<nc-section data-title="[^"]*" data-color="blue">[^<]+<\/nc-section>/
n/a
Fail
Match green prose section
/<nc-section data-title="[^"]*" data-color="green">[^<]+<\/nc-section>/
n/a
Fail
Match red prose section
/<nc-section data-title="[^"]*" data-color="red">[^<]+<\/nc-section>/
n/a
no eval