 He served as Minister for Trade and Customs for a few months in 1904, in the short-lived government of Chris Watson.Fisher was elected deputy leader of the Labor Party in 1905, and replaced Watson as leader in 1907.At the time, Labor supported the Protectionist Party minority government of Alfred Deakin.