Run: 2024-10-16-01JAB4RYZVTRHKXACKTQ0JCA21

Run Details

Model:: Ministral 8B
Test:: Data extraction
Scenario:: Indirect birth year
Duration:: 900ms
Cost:: $0.000014

Evaluation summary

Score	Evaluator	Details Link
Fail	Matches text	(details)
Pass	Matches Regex	(details)
no eval	Overall

Model input

User/Human

What year was Sarah born? Only return the year as a four-digit number.

In 2023, Sarah celebrated her 30th birthday with a big party. Her younger sister, who is 5 years younger, couldn't attend because she was studying abroad.

Model response

To determine the year Sarah was born, we need to subtract her age from the current year.

Sarah celebrated her 30th birthday in 2023. Therefore, we subtract 30 from 2023 to find the year she was born:

2023 - 30 = 1993

Sarah was born in 1993.

Evaluation details

Result	Evaluator	Details	Meta Data
Fail	Matches text	Case sensitive: 1993	n/a
Pass	Matches Regex	/\b1993\b/	n/a
no eval