The housing market remains expensive and unaffordable to most people, yet one group remains relatively active — and they’re likely to be more affluent.