James Woolsey, a former CIA director who served as Trump's senior adviser on national security until last month, also believes the G20 would be a good time for the leaders to get together at an early date.