The Bushes are "pleased to be able to witness the peaceful transfer of power - a hallmark of American democracy - and swearing-in of President Trump and Vice President Pence," Mr Bush's office said in a statement.