Washington (CNN) Former CIA Director Leon Panetta said Monday it was inappropriate for President Donald Trump to use his speech to the agency as an opportunity to complain about reports on the crowd size at his inauguration.