 The sign over the north-west corner reading "L. Libby & Son, Ship Chandlers" was never removed, and consequently the building and prison bore his name.Since the Confederates believed the building inescapable, the staff considered their job relatively easy.Libby Prison encompassed an entire city block in Richmond.