 Bloom's father worked as a cooper.The family eventually moved to Reading, Pennsylvania where Bloom attended Poplar Street School.Around 1871, the family moved to Williamsburg where Bloom began working as a jockey.