Run: 2024-10-01-01J94RNPREEJ5P60M9E3YNV84X

Run Details

Model:: Rocinante 12B
Test:: N-Length Sentences
Scenario:: Write sentences with 10 words each
Duration:: 9.9s
Cost:: $0.000043
Provider:: Infermatic

Evaluation summary

Score	Evaluator	Details Link
3.26%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 10 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The manor doors creaked open slowly. In the dim light, a figure lay still. strangled. by a silken rope. victims eyes were empty. missing their spark. death had taken its toll. a hush fell over the scene. authorities arrived to investigate. who dealt her this fatal blow?

Evaluation details

Result

Evaluator

Details

Meta Data

3.26%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	6
1	8
2	1
3	4
4	4
5	3
6	5
7	6
8	4
9	6

id	"gen-1727810689-JtaPTzf8FGd04DxiKsHX"
total_cost	0.000043
upstream_id	"chatcmpl-c9e8369b-4eac-48c1-a9b3-8170efacca51"
created_at	"2024-10-01T19:24:59.822841+00:00" 10/1/2024, 7:24:59 PM
model	"thedrummer/rocinante-12b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Infermatic"
latency	4640
moderation_latency	(null)
generation_time	5050
finish_reason	"stop"
tokens_prompt	41
tokens_completion	64
native_tokens_prompt	44
native_tokens_completion	64
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.000043