More people retired during the COVID-19 pandemic than expected. But with rising inflation, a plunging stock market and a hot housing market, some are wondering if they left their jobs too soon.