Warren Buffett said his sprawling conglomerate may only slightly outperform the average American company due to its sheer size.