Run: 2024-10-01-01J94RRQ4EKQ199RRG15G1CE8X

Run Details

Model:: Rocinante 12B
Test:: N-Length Sentences
Scenario:: Write sentences with 5 words each
Duration:: 4.2s
Cost:: $0.000038
Provider:: Infermatic

Evaluation summary

Score	Evaluator	Details Link
65.90%	Matches word count	(details)

Model input

User/Human

Please write the opening scene of a murder mystery where each sentence has exactly 5 words.
Please make sure that each sentence has the same length. Only return the opening itself.

Model response

The door creaked open. Detective Atkins stepped inside. A woman lay dead. Blood soaked the carpet. He knelt beside her. Checked for a pulse. None. She was gone. A cry rang out. The killer had returned. To finish what he started.

Evaluation details

Result

Evaluator

Details

Meta Data

65.90%

Matches word count

n/a

neededClean

false

sentences

wordCounts

0	4
1	4
2	4
3	4
4	4
5	4
6	1
7	3
8	4
9	4
10	5

id	"gen-1727810788-n5dRevEtiocNbpu93zwk"
total_cost	0.00003825
upstream_id	"chatcmpl-322be6eb-fd18-4540-aa4f-09113f396f23"
created_at	"2024-10-01T19:26:32.807001+00:00" 10/1/2024, 7:26:32 PM
model	"thedrummer/rocinante-12b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Infermatic"
latency	678
moderation_latency	(null)
generation_time	3315
finish_reason	"stop"
tokens_prompt	41
tokens_completion	55
native_tokens_prompt	43
native_tokens_completion	55
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.00003825