NC Bench
Overview
About
Tests
Categories
Models
Vendors
Compare
Run: 2024-10-01-01J94R60RNJBD4T6ZMF88RCCKC
Run Details
Model:
Rocinante 12B
Test:
Dialogue tags
Scenario:
Write 200 words with 90% dialogue
Duration:
17.1s
Cost:
$0.000118
Provider:
Infermatic
Evaluation summary
Score
Evaluator
Details Link
0.00%
Matches word count
(details)
0.00%
Dialogue to Total Word Ratio
(details)
0.0000%
Overall
Model input
User/Human
You are a author of comedic heist books. Please write a 200 word scene that has 90% words of dialogue between two thieves named Molly and Bill who are planning to break into a children's party to steal all the presents. Only include the prose of the scene without any markdown or commentary.
Model response
Messages
Meta
AI
The rain pelted the window pane as Molly fiddled with the lockpick. "Got it," she whispered triumphantly, easing the window open with a soft creak. Bill, her partner in crime, peeked out from behind a bush. "Kids are sleeping, music's off. Timing's perfect. Remember, anything smaller than a Playstation forget you saw it." " greed is not good, Bill." Molly vaulted in, landing on silky pink carpet. Tchotchkes and toys littered every surface. Her eyes did a little jig. Bill rolled in, stifling a whoop. "Merry fucking Christmas to me." "We've got ten, fifteen minutes tops," Molly said, scooping armfuls of presents into a duffel. "Divide and conquer?" Bill, already de-stuffing stockings into his bag, grinned. "After you." Suddenly, a tiny voice piped up. "Santa?"|(23, 103)
id
"gen-1727810175-BhqjN99WjnbMDaj50zDh"
total_cost
0.0001185
upstream_id
"chatcmpl-dee18365-d64b-4400-9b94-4d2db01c24a3"
created_at
"2024-10-01T19:16:33.031311+00:00"
10/1/2024, 7:16:33 PM
model
"thedrummer/rocinante-12b"
app_id
182717
streamed
true
cancelled
false
provider_name
"Infermatic"
latency
70
moderation_latency
(null)
generation_time
16893
finish_reason
"stop"
tokens_prompt
67
tokens_completion
198
native_tokens_prompt
72
native_tokens_completion
201
native_tokens_reasoning
(null)
num_media_prompt
(null)
num_media_completion
(null)
origin
"https://ncbench.com/"
usage
0.0001185
Evaluation details
Result
Evaluator
Details
Meta Data
0.00%
Matches word count
n/a
neededClean
false
words
125
0.00%
Dialogue to Total Word Ratio
Ratio: 33.60%, Deviation: 56.40%
neededClean
false
wordsTotal
125
wordsDialogue
42
0.0000%