Federal Reserve Chairman Kevin Warsh made waves on Wednesday while hosting his first press conference as head of the U.S. central bank.