 During the occupation of Japan, his palace in Tokyo (which had been designed by Josiah Conder in 1915), was seized by the American occupation forces, and is now the main hall for Seisen University.In the postwar era, he was involved in a number of financial scandals, notably with regards to the Shimazu Kosan Company.He was forced to sell off most of his inheritance to make ends meet, including the Shimazu clan archives, which went to Tokyo University.