 Storey was born July 21, 1829 to John Thompson Storey and Lucy McLester.On January 2, 1849, Storey married Adella Coloway, in Georgetown, Texas.After Adella's death in 1852, Storey and his young daughter Juliann travelled to California with a group of 42 Texans, settling in Visalia.