The current market is so unaffordable that the only people able to buy and sell houses tend to be older, wealthy or both.