 Scott's father was Henry Scott, a wealthy merchant and landowner who was the Mayor of Leeds.In 1779 he married Mary Kaye the sister of Sir John Lister Kaye.In 1890 when his father died he inherited the family estates and two years later founded the Commercial Bank in Leeds.