Oh, of course ”that goes without saying. We had walked, as we talked, and now we passed through the little gate into the garden. 
We walked around the grounds as we spoke, eventually coming to the gate leading into the garden. 