 Confederate soldiers whitewashed the outer walls to make lurking prisoners instantly recognizable.The first floor of Libby Prison housed the various offices of the Confederate guard unit; the second and third floors were partitioned as inmate holding areas.The basement of the prison was divided into three sections.