 He was the son of a doctor, James Hezlep Williamson, and his wife Selina.About 1856, the family moved to Milwaukee, Wisconsin, where young James appeared in amateur theatricals beginning in 1857.That year, his father died in an accident.