 Although he was probably only partially literate, Fisher's father was prominent in the local community and involved with various community organisations.He was the leader of a temperance society, and in 1863 was one of ten miners who co-founded a cooperative society.He and his family were active members of the Free Church of Scotland.