 At fourteen he accompanied his father on a visit to Ireland, and witnessed the effects of the potato famine.This experience was to provide the grounding for his political views and business ideas later in life.He started working in his father's grocery business as an apprentice the following year, and after his father's death in 1859 he took over the running, jointly managing the business with his brother John Stephenson Rowntree.