 He would eventually marry his landlady's daughter, Margaret Irvine.Within years of arriving in the town, Fisher had become "an important figure in the Gympie labour movement, straddling both its political and industrial wings".He was a founding member of the Gympie cooperative, and in 1891 became the secretary of the Gympie Joint Labour Committee, the local labour council.