To the extent that borrowing from abroad finances domestic investment, the foreign borrowing adds to the nation's capital stock and boosts productive capacity.
For the government, it's often felt that the short-term gains outweigh the long-term implications of all this foreign borrowing.