Getting to the Source of the Illusion of Consensus