D&D 5E - Benefit of Acolyte Background for a Wizard?

From what I've been able to glean from the PHB, it specifically states a Cleric or Paladin can make use of a Holy Symbol. The Acolyte background, though, also grants a Holy Symbol -- so is any class that takes the Acolyte background also able to use a Holy Symbol as a focus for spellcasting? How does this work? Thanks.