 Fisher spent most of his childhood living in a miners' row, which had an earthen floor and no running water.He was kicked in the head by a cow as a small child, leaving him mostly deaf in one ear.The injury may have contributed to a childhood speech impediment and his reserved nature as an adult.