 During this time, houses were rarely painted white, particularly in this underdeveloped area.The stage coach drivers began to call this stop and the surrounding area White House.The monument for which the town was named was torn down in 1951 to make way for new development.