Run: 2026-05-01-01KQHRR9RBK20YGE5QPW2AQJYQ

Run Details

Model:: Grok 4.20 (Reasoning)
Test:: Data extraction
Scenario:: Indirect birth year
Duration:: 6.4s
Cost:: $0.001343
Provider:: xAI

Evaluation summary

Score	Evaluator	Details Link
Fail	Matches text	(details)
Pass	Matches Regex	(details)
no eval	Overall

Model input

User/Human

What year was Sarah born? Only return the year as a four-digit number.

In 2023, Sarah celebrated her 30th birthday with a big party. Her younger sister, who is 5 years younger, couldn't attend because she was studying abroad.

Model response

1993

The problem states that Sarah celebrated her 30th birthday in 2023. Subtracting her age from the year of the celebration gives her birth year directly: 2023 - 30 = 1993. The detail about her sister is extraneous and does not alter the arithmetic or the target variable (Sarah's birth year). No other constraints, offsets, or ambiguities are supplied that would require adjusting the straightforward subtraction.

Evaluation details

Result	Evaluator	Details	Meta Data
Fail	Matches text	Case sensitive: 1993	n/a
Pass	Matches Regex	/\b1993\b/	n/a
no eval