Run: 2024-10-01-01J94RHQX6AFX2P6VS0P8EAQTH

Run Details

Model:
Rocinante 12B
Test:
N-Length Sentences
Scenario:
Write sentences with 5 words each
Duration:
2.1s
Cost:
$0.000025
Provider:
Infermatic

Evaluation summary

Score Evaluator
Details Link
58.87% Matches word count (details)

Model input

User/Human
Please write the opening scene of a murder mystery where each sentence has exactly 5 words. Please make sure that each sentence has the same length. Only return the opening itself.

Model response

AI
Loud thud woke village. Investigating, constable discovered. Deceased was wealthy rector. Strangled with silk scarf.
id"gen-1727810560-q5qLQal78xbsnjMTBDSC"
total_cost0.00002475
upstream_id"chatcmpl-8dff62ce-4c07-4a64-9ab7-4654064a04f2"
created_at"2024-10-01T19:22:42.20811+00:00" 10/1/2024, 7:22:42 PM
model"thedrummer/rocinante-12b"
app_id182717
streamedtrue
cancelledfalse
provider_name"Infermatic"
latency250
moderation_latency(null)
generation_time1601
finish_reason"stop"
tokens_prompt41
tokens_completion28
native_tokens_prompt43
native_tokens_completion28
native_tokens_reasoning(null)
num_media_prompt(null)
num_media_completion(null)
origin"https://ncbench.com/"
usage0.00002475

Evaluation details

Result Evaluator Details Meta Data
58.87% Matches word count n/a
neededCleanfalse
sentences4
wordCounts
04
13
24
34