 He was also active in the Amalgamated Miners Union, becoming President of the Gympie branch by 1891.Another policy area that captured his attention during this term, was the employment of workers from the Pacific Islands in sugar plantations, a practice that Fisher and Labour both strongly opposed.He lost his seat in 1896 following a campaign in which he was charged by his opponent Jacob Stumm with being a dangerous revolutionary and an anti-Catholic, accusations that were propagated by the newspaper "Gympie Times".