If that occurs, he said, President Trump might have to spend up to a quarter of his term working out of the Eisenhower Executive Office Building across the street – where President Richard Nixon labored and made some of his infamous White House recordings.