Run: 2026-03-25-01KMJ8TCS9R1NCXG62ZCVFYAV8

Run Details

Model:: Qwen3 235B A22B Instruct 2507
Test:: Data extraction
Scenario:: Indirect birth year
Duration:: 6.4s
Cost:: $0.000008
Provider:: Novita

Evaluation summary

Score	Evaluator	Details Link
Pass	Matches text	(details)
Pass	Matches Regex	(details)
no eval	Overall

Model input

User/Human

What year was Sarah born? Only return the year as a four-digit number.

In 2023, Sarah celebrated her 30th birthday with a big party. Her younger sister, who is 5 years younger, couldn't attend because she was studying abroad.

Model response

1993

Evaluation details

Result	Evaluator	Details	Meta Data
Pass	Matches text	Case sensitive: 1993	n/a
Pass	Matches Regex	/\b1993\b/	n/a
no eval