 Born in Skogen, in Songdalen near Kristiansand, Norway, Olsen emigrated to the United States to Wisconsin at the age of five.By the age of nine his parents had begun to keep the seventh-day Sabbath.He was baptized in 1858.