Nearly 30 million households, or 54% of primary mortgage-holders, have mortgage rates at or below 4%. They were able to buy homes or refinance their mortgages when rates fell to 3% or lower in 2020 and 2021.