Run: 2024-10-16-01JAB4YDSXYJ9WYY373J2RGXVN

Run Details

Model:: Ministral 8B
Test:: Data extraction
Scenario:: Indirect birth year
Duration:: 661ms
Cost:: $0.000011

Evaluation summary

Score	Evaluator	Details Link
Fail	Matches text	(details)
Pass	Matches Regex	(details)
no eval	Overall

Model input

User/Human

What year was Sarah born? Only return the year as a four-digit number.

In 2023, Sarah celebrated her 30th birthday with a big party. Her younger sister, who is 5 years younger, couldn't attend because she was studying abroad.

Model response

To find out the year Sarah was born, we subtract her age from the current year:

2023 (current year) - 30 (Sarah's age) = 1993

Sarah was born in 1993.

Evaluation details

Result	Evaluator	Details	Meta Data
Fail	Matches text	Case sensitive: 1993	n/a
Pass	Matches Regex	/\b1993\b/	n/a
no eval