since then , rumours abounded about the place being haunted , some swore they heard noises and saw lights in the middle of the night , and neighbors to the house never seemed to last more than eighteen months before they moved on .