william knew of three other prisoners who were doing the same as him , but only by name and distant sight , he had never spend hours in the library with them , as he was only let in himself for an hour twice a week when no one else but the librarian warden was there .