 Between 1521 and 1523, Albuquerque returned to Portugal, and began work on this "Casa dos Diamantes" (House of Diamonds), incorporating Manueline (Portuguese late Gothic architecture) windows and portals, but died in 1581.Between 1620 and 1642, after a protracted period of litigation within the family, the house passed into the hands of João Afonso de Albuquerque.The building was still in the possession of his heirs, the Menezes e Albuquerque family, when the 1755 Lisbon earthquake caused significant damage to the residence.