Walmart may just be a pit stop for high-income consumers.