 In 1859, Breckinridge married Lucia Clay.In 1861, he married Issa Desha; they were the parents of Sophonisba Breckinridge, Desha Breckinridge, and Robert Jefferson Breckinridge.In 1893, he married Louise Scott Wing.