Returning to the office — even just a few days a week — might be what fully remote workers actually need.