 His parents were residents of Port Washington, but had traveled to Illinois in 1856, returning to Long Island when Isaac was two years old.His father was a boat builder and owned the business where Isaac Smith spent his apprenticeship upon the conclusion of the American Civil War, in which his father had served as a pilot aboard the steamship "T.V.Arrowsmith".