A couple returned from holiday to find their cottage without a wall and with no roof on the dining room after their neighbour made the "catastrophic decision" to demolish his Grade II listed home next door.