Some analysts warn the pool of potential gold buyers could begin to run dry.