While I haven’t had any direct experience with it yet (I have protected my team from 2 potential reshuffles in the 5 months that we’ve been together), every source I’ve read on agile has talked about the loss in velocity to a team when the composition changes.