A majority of Gen X-ers didn’t prioritize retirement until age 50 or older.