when the japanese were shipped off to internment camps , and their homes and belongings sold off , the blacks , who came to the city to work in the shipyards building battleships and destroyers , moved into the vacant buildings .