one day , there would be men working next door , smashing down the existing house and starting on a new one ; then a few days later , they would have gone elsewhere , leaving a half-built wall behind them .