Most of the members who aren’t going made up their minds not to attend even before Trump criticized civil rights icon Rep. John Lewis (D-Ga.), who announced on Friday he wouldn’t be going and said he believed Trump wouldn’t be a legitimate president.