 He married firstly (1801) Mary Lockwood and secondly (20 May 1812 St George's Hanover Square) Sarah Frances Douglass.After winning a large sum of money (according to one story, £100,000) either at cards or by running a gambling establishment, he built a luxurious gambling house designed by Benjamin and Philip Wyatt at 50-53 St James's Street in 1827.In order to ensure exclusiveness, he organised the house as a members' club under the name "The St James's Club" though popularly known as "Crockford's Club" and it quickly became the rage – every English social celebrity and every distinguished foreigner visiting London hastened to become a member.