 Kemp was an active member of the United Brethren Church; starting in 1810, Brethren minister Christian Newcomer would hold meetings on Kemp's farm whenever he visited the Dayton area.Kemp's house is built of brick and limestone with a stone foundation; it is covered with an asphalt roof, and peripheral elements are made of wood and stone.The original portion of the house was constructed in 1806, almost as soon as Kemp and his family reached their new farm, while the brick section was constructed in approximately 1832.