 Houston was born on May 4, 1814 in Concord, Delaware, attended the country schools and Newark Academy, and graduated from Yale College in 1834.While at Yale he was initiated into one of the earliest gatherings of the Skull and Bones Society.He studied law in Dover, Delaware and was admitted to the Delaware Bar in 1837.