Run 2024-10-01-01J94R369876TJZZ56FEDNWS51

Run ID

2024-10-01-01J94R369876TJZZ56FEDNWS51

Model input

User/Human

 Who does "he" refer to in the last sentence? Only return the name.

Tom and Jerry were playing in the yard. Spike, the dog, was watching them from his kennel. Suddenly, he started barking loudly. 

Model response

AI

 He refers to Spike, the dog.
 

Evaluation details

Result	Evaluator	Details	Meta Data
Fail	Matches text	Case sensitive: Spike	n/a
Pass	Matches Regex	/\bSpike\b/	n/a
50.0000%

id	"gen-1727810083-3CHsaLbqVqLKYrC7rL6S"
total_cost	0.00001775
upstream_id	"chatcmpl-470fb526-bda2-4acf-8127-6cd2d1e287a9"
created_at	"2024-10-01T19:14:53.101015+00:00" Tuesday, October 1st, 2024 at 7:14:53 PM GMT+00:00
model	"eva-unit-01/eva-qwen-2.5-14b"
app_id	182717
streamed	true
cancelled	false
provider_name	"Infermatic"
latency	67
moderation_latency	(null)
generation_time	9584
finish_reason	"stop"
tokens_prompt	53
tokens_completion	8
native_tokens_prompt	55
native_tokens_completion	8
native_tokens_reasoning	(null)
num_media_prompt	(null)
num_media_completion	(null)
origin	"https://ncbench.com/"
usage	0.00001775

Model

Test

Scenario

Run ID

Model input

Model response

Evaluation details