Millennials are in their peak home-buying years while many baby boomers are downsizing or buying second homes. With inventory at an all-time low, young and old often compete for the same homes.